-- Logs begin at Sun 2022-08-21 00:10:35 UTC, end at Sun 2022-08-21 03:03:37 UTC. -- Aug 21 00:56:15.708796 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 21 00:56:15.717954 n-d-master-1 devstack@n-api.service[106509]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 21 00:56:15 2022] *** Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: nodename: n-d-master-1 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: machine: x86_64 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: clock source: unix Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: pcre jit disabled Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: detected number of CPU cores: 4 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: current working directory: / Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: detected binary path: /usr/bin/uwsgi-core Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: your processes number limit is 47680 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: your memory page size is 4096 bytes Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: detected max file descriptor number: 2048 Aug 21 00:56:15.719867 n-d-master-1 devstack@n-api.service[106509]: lock engine: pthread robust mutexes Aug 21 00:56:15.720655 n-d-master-1 devstack@n-api.service[106509]: thunder lock: enabled Aug 21 00:56:15.720655 n-d-master-1 devstack@n-api.service[106509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 21 00:56:15.720655 n-d-master-1 devstack@n-api.service[106509]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 21 00:56:15.758635 n-d-master-1 devstack@n-api.service[106509]: Python main interpreter initialized at 0x55847d1099c0 Aug 21 00:56:15.758635 n-d-master-1 devstack@n-api.service[106509]: python threads support enabled Aug 21 00:56:15.758635 n-d-master-1 devstack@n-api.service[106509]: your server socket listen backlog is limited to 100 connections Aug 21 00:56:15.758635 n-d-master-1 devstack@n-api.service[106509]: your mercy for graceful operations on workers is 90 seconds Aug 21 00:56:15.759036 n-d-master-1 devstack@n-api.service[106509]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 00:56:15.759145 n-d-master-1 devstack@n-api.service[106509]: *** Operational MODE: preforking *** Aug 21 00:56:15.759455 n-d-master-1 devstack@n-api.service[106509]: *** uWSGI is running in multiple interpreter mode *** Aug 21 00:56:15.759455 n-d-master-1 devstack@n-api.service[106509]: spawned uWSGI master process (pid: 106509) Aug 21 00:56:15.759683 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 21 00:56:15.760707 n-d-master-1 devstack@n-api.service[106509]: spawned uWSGI worker 1 (pid: 106510, cores: 1) Aug 21 00:56:15.760707 n-d-master-1 devstack@n-api.service[106509]: spawned uWSGI worker 2 (pid: 106511, cores: 1) Aug 21 00:56:15.760707 n-d-master-1 devstack@n-api.service[106509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 00:56:16.406594 n-d-master-1 devstack@n-api.service[106511]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 21 00:56:16.407337 n-d-master-1 devstack@n-api.service[106510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 21 00:56:17.482906 n-d-master-1 devstack@n-api.service[106511]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:56:17.482906 n-d-master-1 devstack@n-api.service[106511]: from cryptography.utils import int_from_bytes Aug 21 00:56:17.483490 n-d-master-1 devstack@n-api.service[106511]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:56:17.483490 n-d-master-1 devstack@n-api.service[106511]: from cryptography.utils import int_from_bytes Aug 21 00:56:17.485897 n-d-master-1 devstack@n-api.service[106510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:56:17.485897 n-d-master-1 devstack@n-api.service[106510]: from cryptography.utils import int_from_bytes Aug 21 00:56:17.486354 n-d-master-1 devstack@n-api.service[106510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:56:17.486354 n-d-master-1 devstack@n-api.service[106510]: from cryptography.utils import int_from_bytes Aug 21 00:56:19.939182 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:56:19.939844 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:56:19.939949 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:56:19.939949 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:56:19.940352 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:56:19.940352 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:56:19.940516 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:56:19.940610 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:56:19.940694 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:56:19.940873 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:56:19.940976 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.941232 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.941382 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.941528 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.941627 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.941865 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942007 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942161 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942251 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942498 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942641 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.942803 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943022 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943119 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943204 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943415 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943559 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943652 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943746 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.943969 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944101 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944274 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944419 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944601 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944750 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944890 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.944989 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945223 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945365 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945506 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945612 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945852 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.945981 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.946129 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.946254 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.946453 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.946591 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.946771 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.947026 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.947272 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.948307 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.948470 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.948608 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.948742 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.948900 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949033 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949162 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949287 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949406 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949530 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949648 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949782 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.949908 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950028 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950152 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950271 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950394 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950579 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950710 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950838 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.950969 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951094 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951219 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951348 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951476 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951610 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951736 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951862 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.951986 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952126 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952259 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952385 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952495 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952618 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952743 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.952902 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953031 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953157 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953359 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953536 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953685 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953811 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.953941 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954062 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954286 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954465 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954599 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954727 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954856 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.954985 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955153 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955290 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955462 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955593 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955797 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.955976 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956107 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956247 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956374 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956500 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956627 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956747 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.956903 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957035 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957244 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957432 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957571 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957703 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957837 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.957978 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958105 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958231 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958359 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958481 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958613 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958740 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.958942 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959122 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959268 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959405 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959527 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959646 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959807 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.959936 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960135 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960335 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960470 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960592 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960725 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.960877 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961013 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961153 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961283 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961409 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961678 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961808 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.961935 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.962228 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.962443 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.962631 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.962768 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.962900 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963041 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963187 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963321 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963442 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963564 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963724 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.963867 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964069 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964208 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964383 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964509 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964683 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.964855 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965028 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965155 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965343 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965485 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965635 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965769 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.965950 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966075 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966249 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966376 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966561 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966687 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.966869 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967305 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967481 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967607 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967740 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967861 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.967984 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968103 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968287 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968427 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968609 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968736 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.968890 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969017 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969209 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969347 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969479 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969608 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969791 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.969917 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970100 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970241 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970371 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970489 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970672 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970805 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.970961 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971101 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971282 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971415 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971542 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971661 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971855 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.971994 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972123 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972248 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972439 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972572 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972703 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.972906 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973036 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973162 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973365 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973489 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973664 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973808 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.973927 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974044 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974243 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974376 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974579 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974708 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974828 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.974953 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975145 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975283 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975409 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975537 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975727 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.975858 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976015 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976146 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976382 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976560 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976684 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976820 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.976941 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977127 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977324 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977468 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977590 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977721 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.977917 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978044 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978221 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978364 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978490 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978615 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978803 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.978930 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979095 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979228 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979403 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979527 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979703 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979828 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.979986 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980113 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980292 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980418 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980575 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980701 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.980902 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981047 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981179 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981299 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981514 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981653 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981829 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.981956 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982139 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982272 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982440 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982572 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982742 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.982866 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.983054 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:56:19.983181 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.983390 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.983523 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.983716 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.983841 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984027 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984151 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984358 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984492 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984682 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.984824 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985024 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985158 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985327 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985454 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985647 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985772 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.985957 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986092 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986251 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986378 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986572 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986699 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.986878 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987010 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987191 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987318 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987501 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987632 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987784 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.987912 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988132 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988257 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988445 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988579 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988756 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.988903 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.989075 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.989201 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.989832 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.989952 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.989952 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990162 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990162 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990366 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990493 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990622 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990622 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990860 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.990987 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991115 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991243 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991367 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991561 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991703 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991865 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.991993 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.992184 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.992316 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.992492 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.992630 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.992911 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993047 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993238 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993384 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993564 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993724 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.993980 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994110 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994230 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994356 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994485 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994605 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994797 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.994925 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995112 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995251 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995436 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995565 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995713 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.995848 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996033 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996166 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996364 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996496 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996623 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996742 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.996977 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997112 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997296 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997432 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997613 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997748 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.997900 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998035 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998216 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998349 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998519 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998646 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998818 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.998952 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999105 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999238 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999420 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999545 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999715 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:19.999852 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000007 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000133 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000334 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000511 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000641 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000818 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.000942 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001062 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001263 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001403 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001563 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001690 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.001880 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002005 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002182 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002306 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002483 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002611 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002785 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.002909 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003089 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003227 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003361 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003486 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003669 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003792 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.003977 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004099 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004279 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004404 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004579 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004701 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.004910 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005050 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005216 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005348 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005522 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005644 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005825 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.005955 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006134 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006257 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006440 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006571 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006747 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.006878 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007058 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007183 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007367 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007489 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007676 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007809 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.007985 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.008106 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.008352 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.008481 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.008659 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.008877 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009000 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009117 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009288 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009412 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009602 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009721 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.009905 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010035 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010214 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010337 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010515 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010650 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010817 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.010950 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011118 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011245 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011424 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011549 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011725 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.011847 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012023 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012153 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012319 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012434 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012619 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012741 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.012940 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013075 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013247 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013370 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013552 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013676 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013855 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.013987 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014154 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014275 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014450 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014580 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014749 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.014889 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015077 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015206 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015380 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015501 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015720 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.015853 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016033 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016154 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016353 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016486 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016664 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016816 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.016997 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017121 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017305 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017426 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017612 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017735 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.017918 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018047 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018225 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018347 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018531 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018653 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018837 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.018966 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019145 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019266 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019451 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019580 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019758 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.019886 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020074 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020204 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020378 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020512 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020681 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.020831 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021010 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021141 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021325 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021449 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021665 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021786 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.021982 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022114 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022293 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022422 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022599 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022731 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.022908 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023038 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023213 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023333 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023518 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023639 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.023823 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024061 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024190 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024308 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024542 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024718 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.024948 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025104 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025234 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025376 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025499 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025696 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.025826 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026008 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026138 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026328 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026450 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026632 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026765 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.026946 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027068 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027252 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027376 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027564 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027700 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027872 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.027994 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028182 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028305 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028502 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028626 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028835 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.028962 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029144 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029266 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029453 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029577 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029753 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.029875 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030053 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030176 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030356 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030479 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030661 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030783 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.030964 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031093 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031270 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031393 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031571 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031703 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.031877 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032007 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032179 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032300 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032480 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032604 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032799 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.032943 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033106 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033236 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033409 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033532 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033720 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.033856 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034038 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034166 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034363 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034485 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034645 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034777 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.034948 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035071 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035261 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035384 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035564 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035687 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035866 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.035989 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036166 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036290 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036466 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036590 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036787 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.036913 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037088 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037223 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037423 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037552 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037730 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.037860 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038032 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038155 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038359 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038502 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038644 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038767 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.038949 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039084 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039252 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039373 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039599 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039728 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.039886 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040018 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040205 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040356 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040517 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040670 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.040848 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041008 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041133 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041318 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041442 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041628 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041758 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.041950 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042075 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042259 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042389 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042569 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042701 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.042877 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043009 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043178 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043301 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043485 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043616 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043789 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.043910 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.044107 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.044355 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.044671 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.044828 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045033 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045167 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045346 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045478 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045661 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045791 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.045972 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046098 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046292 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046412 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046627 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046758 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.046928 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047061 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047236 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047361 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047542 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047677 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047844 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.047986 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.048145 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.048269 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.048449 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.048570 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.048749 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049010 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049133 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049252 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049381 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049501 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049628 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049755 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.049932 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050057 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050234 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050356 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050530 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050653 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050828 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.050951 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051125 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051254 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051425 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051548 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051724 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.051845 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052019 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052140 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052320 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052444 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052633 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052756 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.052959 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053093 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053260 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053390 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053556 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053678 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053854 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.053984 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054181 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054303 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054482 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054612 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054817 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.054995 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.055145 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.055504 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.055641 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.055900 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056073 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056198 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056308 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056586 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056812 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.056951 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057089 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057210 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057329 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057447 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057567 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057697 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057827 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.057947 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058066 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058237 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058360 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058548 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058679 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058858 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.058981 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059164 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059288 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059467 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059598 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059766 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.059896 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060070 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060192 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060370 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060492 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060680 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.060820 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061006 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061130 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061304 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061426 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061603 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061731 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.061909 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062031 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062210 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062339 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062508 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062629 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062811 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.062934 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063107 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063230 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063420 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063541 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063717 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.063848 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064014 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064143 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064311 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064432 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064614 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064748 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.064945 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065070 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065245 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065370 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065565 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065697 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065869 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.065990 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066169 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066301 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066465 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066600 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066766 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.066889 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067065 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067194 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067362 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067485 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067665 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067787 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.067984 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068105 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068293 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068416 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068588 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068718 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.068919 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069042 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069217 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069348 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069511 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069641 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069808 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.069930 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070108 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070238 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070405 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070526 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070700 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.070896 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071031 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071197 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071353 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071509 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071665 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071795 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.071960 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072084 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072265 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072391 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072563 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072693 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.072885 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073048 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073170 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073295 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073507 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073639 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073804 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.073926 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074159 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074287 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074458 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074583 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074766 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.074895 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075078 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075233 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075384 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075507 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075689 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075809 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.075994 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076116 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076294 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076464 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076585 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076703 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.076919 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077044 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077244 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077365 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077514 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077640 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077808 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.077939 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078123 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078245 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078427 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078548 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078732 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.078877 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079046 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079176 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079361 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079483 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079680 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079812 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.079979 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080095 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080279 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080401 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080583 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080712 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.080914 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081039 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081219 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081347 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081523 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081654 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081829 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.081951 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082135 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082256 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082440 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082562 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082743 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.082877 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083045 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083161 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083348 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083471 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083651 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083780 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.083955 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084076 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084252 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084375 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084569 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084692 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.084899 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085034 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085203 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085324 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085505 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085633 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085804 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.085935 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086110 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086241 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086410 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086719 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086860 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.086992 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087179 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087376 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087510 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087630 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087756 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.087885 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088063 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088187 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088368 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088497 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088677 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.088822 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089009 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089132 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089311 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089432 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089721 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.089853 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090029 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090151 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090334 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090457 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090641 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090765 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.090938 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091060 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091233 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091354 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091535 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091662 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.091851 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.092277 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.092456 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.092576 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.092754 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.092923 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093074 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093196 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093390 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093525 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093688 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.093809 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094004 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094125 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094410 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094541 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094715 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.094836 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095013 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095137 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095421 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095553 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095724 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.095844 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096030 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096153 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096348 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096471 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096662 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.096804 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097007 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097131 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097315 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097458 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097623 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097758 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.097925 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098046 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098245 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098366 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098562 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098693 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098868 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.098997 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099175 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099296 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099474 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099596 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099789 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.099918 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100107 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100229 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100412 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100540 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100728 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.100894 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101156 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101292 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101476 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101597 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101777 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.101899 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102114 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102254 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102438 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102561 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102738 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.102860 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103041 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103174 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103350 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103486 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103654 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103785 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.103956 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104090 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104276 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104400 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104579 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104703 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.104908 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105034 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105220 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105342 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105526 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105647 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105826 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.105950 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106130 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106261 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106450 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106571 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106748 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.106877 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107067 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107188 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107376 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107497 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107695 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.107826 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108011 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108134 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108309 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108439 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108628 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108750 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.108958 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109092 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109258 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109390 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109554 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109676 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109852 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.109981 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110187 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110318 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110487 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110610 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110803 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.110924 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111127 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111259 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111451 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111573 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111754 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.111877 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112081 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112205 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112399 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112521 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112715 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.112858 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113053 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113177 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113373 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113488 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113674 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113803 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.113972 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114096 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114279 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114409 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114581 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114705 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.114882 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115007 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115183 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115309 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115488 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115618 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115785 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.115907 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116085 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116209 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116384 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116553 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116705 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.116852 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117029 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117151 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117354 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117491 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117658 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.117894 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118014 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118133 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118326 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118495 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118621 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118803 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.118951 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119146 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119279 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119452 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119577 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119779 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.119903 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120091 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120223 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120414 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120557 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120730 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.120943 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121067 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121195 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121372 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121496 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121680 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121803 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.121991 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122126 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122299 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122421 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122606 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122731 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.122910 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123033 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123217 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123340 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123527 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123650 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.123848 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.124060 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.124359 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.124484 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.124689 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.124844 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.125033 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.128888 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.128888 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129071 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129144 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129219 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129296 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129364 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129599 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129669 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129734 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129810 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129879 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.129945 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130008 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130073 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130137 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130209 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130275 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130339 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130403 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130480 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130575 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130651 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130717 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130782 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130846 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.130931 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131013 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131082 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131147 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131210 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131281 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131348 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131447 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131522 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131522 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131639 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131639 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131832 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131912 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131979 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.131979 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132102 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132168 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132245 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132311 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132375 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132445 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132517 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132591 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132657 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132888 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.132974 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.133189 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.133272 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.133559 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.133721 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.133869 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.134184 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.134296 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.134522 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.134889 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135012 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135188 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135282 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135517 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135655 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135827 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.135926 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.136116 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.136210 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.136464 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138398 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138398 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138740 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138740 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138891 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.138891 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139049 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139127 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139210 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139303 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139383 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139469 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139548 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139648 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139728 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139805 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139889 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.139967 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140043 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140139 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140217 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140293 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140381 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140459 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140535 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140618 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140696 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.140890 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141047 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141163 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141256 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141509 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141641 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141813 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.141962 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.142128 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.142343 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.142654 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.142787 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.142984 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143125 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143302 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143433 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143623 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143754 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143911 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.143997 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144217 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144349 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144532 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144661 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144828 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.144923 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145141 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145244 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145449 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145538 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145761 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.145850 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146056 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146157 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146358 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146456 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146651 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146788 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.146969 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147059 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147258 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147375 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147563 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147652 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147860 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.147948 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148161 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148266 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148470 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148558 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148810 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.148902 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149180 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149283 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149423 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149621 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149751 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149881 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.149973 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150064 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150282 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150377 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150580 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150676 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150882 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.150971 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151180 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151275 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151480 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151575 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151778 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.151866 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152074 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152163 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152370 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152465 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152655 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152739 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.152976 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153060 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153278 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153380 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153579 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153664 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153889 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.153972 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.154241 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.154333 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.154789 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.154907 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.154907 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155082 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155168 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155254 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155449 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155542 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155754 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.155838 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.156085 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.156182 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.156403 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.156720 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.156963 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157091 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157299 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157393 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157618 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157711 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.157951 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158051 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158283 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158370 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158590 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158674 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158894 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.158978 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159198 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159292 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159508 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159591 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159814 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.159905 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160109 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160193 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160408 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160494 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160713 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.160840 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161046 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161140 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161352 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161443 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161656 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161751 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.161962 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162046 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162266 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162350 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162571 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162665 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162876 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.162963 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163182 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163266 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163486 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163571 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163791 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.163883 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164105 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164191 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164430 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164516 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164806 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.164897 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165130 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165256 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165437 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165523 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165747 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.165832 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166055 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166149 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166363 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166447 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166671 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166755 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.166976 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167067 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167293 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167381 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167625 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167754 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.167938 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.168239 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.168327 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.168663 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.168748 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169002 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169101 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169320 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169404 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169635 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169719 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.169944 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170035 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170261 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170353 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170581 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170666 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170888 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.170980 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171205 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171291 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171509 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171593 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171834 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.171919 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.172170 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.172253 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.172498 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.172580 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.172846 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173023 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173155 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173332 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173459 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173632 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173764 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.173935 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174072 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174243 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174389 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174561 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174698 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174867 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.174999 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175168 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175302 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175469 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175610 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175773 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.175915 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176075 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176222 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176375 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176512 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176670 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176836 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.176995 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177144 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177307 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177445 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177619 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177747 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.177902 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178048 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178202 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178350 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178501 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178652 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178801 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.178953 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179099 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179260 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179403 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179560 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179702 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179861 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.179999 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.180161 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.180412 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.180653 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.180740 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181160 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181254 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181500 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181586 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181839 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.181923 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182151 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182235 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182473 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182557 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182778 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.182869 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183099 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183183 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183406 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183491 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183725 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.183818 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184043 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184126 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184353 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184438 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184658 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.184756 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185012 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185099 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185320 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185405 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185630 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185716 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.185936 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186019 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186243 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186329 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186553 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186639 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186858 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.186941 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187184 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187267 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187508 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187596 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187810 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.187893 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188131 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188215 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188444 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188530 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188759 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.188860 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189091 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189301 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189400 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189480 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189713 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.189799 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190018 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190110 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190323 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190407 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190628 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190719 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.190934 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191028 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191239 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191324 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191549 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191631 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191856 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.191948 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192163 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192246 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192471 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192555 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192873 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.192970 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193129 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193222 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193450 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193533 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193757 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.193843 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194079 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194171 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194403 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194498 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194742 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.194825 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195049 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195133 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195390 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195482 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195712 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.195796 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196076 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196163 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196405 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196605 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196690 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196839 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:56:20.196929 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:56:20.197087 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:56:20.351382 n-d-master-1 devstack@n-api.service[106510]: INFO dbcounter [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Registered counter for database nova_api Aug 21 00:56:20.351636 n-d-master-1 devstack@n-api.service[106511]: INFO dbcounter [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Registered counter for database nova_api Aug 21 00:56:20.373045 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_db.sqlalchemy.engines [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.376917 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_db.sqlalchemy.engines [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.380478 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writer thread running {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.384127 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writer thread running {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.437390 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.context [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=106510) load_cells /opt/stack/nova/nova/context.py:464}} Aug 21 00:56:20.439043 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.context [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=106511) load_cells /opt/stack/nova/nova/context.py:464}} Aug 21 00:56:20.441363 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 00:56:20.441772 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 00:56:20.442855 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 00:56:20.443315 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 00:56:20.443448 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 00:56:20.444052 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 00:56:20.444492 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 00:56:20.444896 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 00:56:20.445616 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 00:56:20.446244 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 00:56:20.446727 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_concurrency.lockutils [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 00:56:20.448327 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 00:56:20.448732 n-d-master-1 devstack@n-api.service[106510]: INFO dbcounter [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Registered counter for database nova_cell0 Aug 21 00:56:20.450355 n-d-master-1 devstack@n-api.service[106511]: INFO dbcounter [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Registered counter for database nova_cell0 Aug 21 00:56:20.454302 n-d-master-1 devstack@n-api.service[106510]: INFO dbcounter [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Registered counter for database nova_cell1 Aug 21 00:56:20.455812 n-d-master-1 devstack@n-api.service[106511]: INFO dbcounter [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Registered counter for database nova_cell1 Aug 21 00:56:20.462615 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_db.sqlalchemy.engines [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.465973 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_db.sqlalchemy.engines [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.466114 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_db.sqlalchemy.engines [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.470002 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_db.sqlalchemy.engines [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.472979 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writer thread running {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.473220 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writer thread running {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.475031 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writer thread running {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.607585 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writer thread running {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.617842 n-d-master-1 devstack@n-api.service[106511]: INFO dbcounter [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Registered counter for database nova_cell0 Aug 21 00:56:20.618176 n-d-master-1 devstack@n-api.service[106510]: INFO dbcounter [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Registered counter for database nova_cell0 Aug 21 00:56:20.626076 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_db.sqlalchemy.engines [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.630639 n-d-master-1 devstack@n-api.service[106510]: DEBUG oslo_db.sqlalchemy.engines [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:56:20.631706 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writer thread running {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.636320 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writer thread running {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:56:20.969832 n-d-master-1 devstack@n-api.service[106511]: WARNING keystonemiddleware.auth_token [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 00:56:20.975747 n-d-master-1 devstack@n-api.service[106510]: WARNING keystonemiddleware.auth_token [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 00:56:20.977377 n-d-master-1 devstack@n-api.service[106511]: WARNING keystonemiddleware.auth_token [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 00:56:20.983137 n-d-master-1 devstack@n-api.service[106510]: WARNING keystonemiddleware.auth_token [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 00:56:21.320905 n-d-master-1 devstack@n-api.service[106511]: WARNING keystonemiddleware.auth_token [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 00:56:21.321180 n-d-master-1 devstack@n-api.service[106510]: WARNING keystonemiddleware.auth_token [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 00:56:21.326937 n-d-master-1 devstack@n-api.service[106510]: WARNING keystonemiddleware.auth_token [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 00:56:21.327071 n-d-master-1 devstack@n-api.service[106511]: WARNING keystonemiddleware.auth_token [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 00:56:21.332202 n-d-master-1 devstack@n-api.service[106510]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55847d1099c0 pid: 106510 (default app) Aug 21 00:56:21.332337 n-d-master-1 devstack@n-api.service[106511]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55847d1099c0 pid: 106511 (default app) Aug 21 00:56:21.334300 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:56:21.335502 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-f959cbb4-40c4-4c66-a2dc-6e8b7a086a23 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Aug 21 00:56:21.335880 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Sun Aug 21 00:56:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:40.176722 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:40.178746 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002831 Aug 21 00:57:40.179328 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:40.191524 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_api:SELECT=3 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:40.193587 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_cell0:SELECT=3 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:40.194698 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_cell1:SELECT=3 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:40.196396 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:41.078214 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-2ae128e8-2b7d-4d8a-af11-a3f70c0ecabb admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:41.114152 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-2ae128e8-2b7d-4d8a-af11-a3f70c0ecabb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928273 Aug 21 00:57:41.121009 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 00:57:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:57:43.449539 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:43.450515 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-97ddf54b-15ca-443a-886a-fc56d63b623b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 21 00:57:43.456359 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:43.935674 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-fba620a7-1f30-4423-b32f-36b0ac794ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:43.956129 n-d-master-1 devstack@n-api.service[106510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 00:57:43.956129 n-d-master-1 devstack@n-api.service[106510]: warnings.warn(msg) Aug 21 00:57:43.991395 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-fba620a7-1f30-4423-b32f-36b0ac794ef5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533473 Aug 21 00:57:43.992493 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:57:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:44.006466 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_api:SELECT=3 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.007666 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_cell0:SELECT=3 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.008645 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_cell1:SELECT=3 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.009398 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:44.214316 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-4acdb263-f2a0-483a-a335-111e31768caa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:44.218672 n-d-master-1 devstack@n-api.service[106511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 00:57:44.218672 n-d-master-1 devstack@n-api.service[106511]: warnings.warn(msg) Aug 21 00:57:44.279267 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-4acdb263-f2a0-483a-a335-111e31768caa admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278122 Aug 21 00:57:44.284909 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1336 bytes} [Sun Aug 21 00:57:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:57:46.654263 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-fba620a7-1f30-4423-b32f-36b0ac794ef5 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:46.655242 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-fba620a7-1f30-4423-b32f-36b0ac794ef5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 21 00:57:46.656392 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:47.429147 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-a6697191-0c0a-49e5-8553-1d725891b497 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:47.465337 n-d-master-1 devstack@n-api.service[106511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 00:57:47.465337 n-d-master-1 devstack@n-api.service[106511]: warnings.warn(msg) Aug 21 00:57:47.493219 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-a6697191-0c0a-49e5-8553-1d725891b497 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.830052 Aug 21 00:57:47.494072 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:57:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:47.506400 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-c46de453-ce1e-4466-bb45-ca152e82f124 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:47.509246 n-d-master-1 devstack@n-api.service[106510]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 00:57:47.509246 n-d-master-1 devstack@n-api.service[106510]: warnings.warn(msg) Aug 21 00:57:47.542678 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-c46de453-ce1e-4466-bb45-ca152e82f124 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040275 Aug 21 00:57:47.543605 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1336 bytes} [Sun Aug 21 00:57:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:57:50.030326 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-a6697191-0c0a-49e5-8553-1d725891b497 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:50.032570 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-a6697191-0c0a-49e5-8553-1d725891b497 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002725 Aug 21 00:57:50.033564 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:50.555302 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-542c56f8-bfb5-47d2-b9b2-e425a73a35d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:50.581167 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-542c56f8-bfb5-47d2-b9b2-e425a73a35d8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.539142 Aug 21 00:57:50.589704 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:57:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:50.596348 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-596cdf31-5c25-4e0b-94ce-33f11f78720c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:50.624320 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-596cdf31-5c25-4e0b-94ce-33f11f78720c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031565 Aug 21 00:57:50.633638 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1336 bytes} [Sun Aug 21 00:57:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 00:57:53.212053 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-542c56f8-bfb5-47d2-b9b2-e425a73a35d8 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:53.213093 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-542c56f8-bfb5-47d2-b9b2-e425a73a35d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 21 00:57:53.213729 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:53.615238 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-47700cdc-c6e8-456e-9d14-a1e2c5b3842a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:53.643292 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-47700cdc-c6e8-456e-9d14-a1e2c5b3842a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423556 Aug 21 00:57:53.652911 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:57:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 00:57:53.659254 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-caac6b7f-e4fe-4a04-a37c-2703fb87f961 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:53.695490 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-caac6b7f-e4fe-4a04-a37c-2703fb87f961 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041040 Aug 21 00:57:53.696697 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1336 bytes} [Sun Aug 21 00:57:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:57:56.121612 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-47700cdc-c6e8-456e-9d14-a1e2c5b3842a admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:56.123386 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-47700cdc-c6e8-456e-9d14-a1e2c5b3842a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002342 Aug 21 00:57:56.124201 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:56.652650 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:56.674471 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534065 Aug 21 00:57:56.675312 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:57:56.687909 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-b9527212-693d-4178-8658-3221a20c1e9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:57:56.724097 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-b9527212-693d-4178-8658-3221a20c1e9f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039992 Aug 21 00:57:56.725576 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1336 bytes} [Sun Aug 21 00:57:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:57:59.244031 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:59.245409 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 21 00:57:59.247009 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:57:59.679942 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-0cba989d-f12b-4891-8209-f336b3e77421 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:57:59.705535 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-0cba989d-f12b-4891-8209-f336b3e77421 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452271 Aug 21 00:57:59.706732 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 00:57:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:58:02.112574 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:02.113628 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-09cc7295-724e-46e7-b13c-4c2abb4133ce admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 21 00:58:02.114027 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:02.608947 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-055aaad9-7f54-431f-9378-0af1b34ad2ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:02.629956 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-055aaad9-7f54-431f-9378-0af1b34ad2ae admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.507705 Aug 21 00:58:02.630665 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:58:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:02.647436 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-6453df88-f462-4b7a-bb13-13cb6805d834 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:02.673360 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-6453df88-f462-4b7a-bb13-13cb6805d834 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030540 Aug 21 00:58:02.673955 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1333 bytes} [Sun Aug 21 00:58:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:58:05.114606 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-055aaad9-7f54-431f-9378-0af1b34ad2ae admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:05.115792 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-055aaad9-7f54-431f-9378-0af1b34ad2ae admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 21 00:58:05.116202 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:05.565441 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-44d3a7a7-1c92-43ef-a697-1be8574d2f63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "swap": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:05.586760 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-44d3a7a7-1c92-43ef-a697-1be8574d2f63 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462554 Aug 21 00:58:05.588800 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:58:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:05.603310 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-ddc02bfe-376c-4c42-a888-3a1547d821fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:05.635036 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-ddc02bfe-376c-4c42-a888-3a1547d821fa admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037036 Aug 21 00:58:05.635789 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1333 bytes} [Sun Aug 21 00:58:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:58:08.026589 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-44d3a7a7-1c92-43ef-a697-1be8574d2f63 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:08.027605 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-44d3a7a7-1c92-43ef-a697-1be8574d2f63 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 21 00:58:08.027976 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:08.453967 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-b1ccf615-c49d-4b87-8c5d-43a56cf08acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "disk": 40, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:08.475135 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-b1ccf615-c49d-4b87-8c5d-43a56cf08acd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.440492 Aug 21 00:58:08.475668 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:58:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:08.488159 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-139492f4-c1a5-44d5-badb-6e00cf23700c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:08.514388 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-139492f4-c1a5-44d5-badb-6e00cf23700c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030162 Aug 21 00:58:08.514968 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1333 bytes} [Sun Aug 21 00:58:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 00:58:10.884060 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-b1ccf615-c49d-4b87-8c5d-43a56cf08acd admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:10.885104 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-b1ccf615-c49d-4b87-8c5d-43a56cf08acd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 21 00:58:10.885513 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:11.293636 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-21346daa-a1e0-466b-8783-e1c1ddfeadc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "disk": 80, "vcpus": 4, "swap": 0}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:11.299340 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.314954 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-21346daa-a1e0-466b-8783-e1c1ddfeadc4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423309 Aug 21 00:58:11.315506 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:58:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:11.327906 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-b47eaeb3-769a-4b2c-92c9-6c8faefa6738 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:11.359552 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-b47eaeb3-769a-4b2c-92c9-6c8faefa6738 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035233 Aug 21 00:58:11.360127 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1333 bytes} [Sun Aug 21 00:58:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 00:58:13.878000 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-21346daa-a1e0-466b-8783-e1c1ddfeadc4 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:13.879013 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-21346daa-a1e0-466b-8783-e1c1ddfeadc4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 21 00:58:13.879710 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:14.329643 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:14.352625 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466785 Aug 21 00:58:14.353323 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1283 bytes} [Sun Aug 21 00:58:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:14.366231 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-83eb0f57-f8c6-4ca1-8074-dd9b8ade4ddf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:14.394003 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-83eb0f57-f8c6-4ca1-8074-dd9b8ade4ddf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032149 Aug 21 00:58:14.394802 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1333 bytes} [Sun Aug 21 00:58:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:58:37.119334 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:37.120380 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 21 00:58:37.120968 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:37.132116 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:37.547510 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-2f8d1df1-3c8f-4e3f-9672-0a4158dbaf79 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:37.566051 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-2f8d1df1-3c8f-4e3f-9672-0a4158dbaf79 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.438876 Aug 21 00:58:37.566587 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 00:58:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 00:58:38.637505 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:38.638507 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-48eb9cde-cb20-4668-983c-a038dc8fea38 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 21 00:58:38.638896 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:39.244428 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-909d810d-ea23-4231-b1c8-60417ff09658 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:39.250181 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.wsgi [None req-909d810d-ea23-4231-b1c8-60417ff09658 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-909d810d-ea23-4231-b1c8-60417ff09658 admin admin] Request method failure captured: Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Accept: application/json Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Accept-Encoding: gzip, deflate Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Connection: keep-alive Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Content-Length: 0 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Host: 10.222.0.46 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: Openstack-System-Scope: None Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: User-Agent: python-novaclient Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Auth-Token: gAAAAABjAYM-2Xlr6YkxBcYC1wd8AFYtGHuMIWcLDiuPZtiraHoOtDQ_Cg3LIyY5fbp6nN8wPwjIC7vhjcWAFag3j1EhTdAjjBLIWVDKACsnxp5OxUPsroEWXM2fYTA6wZUoEmOSEcL-ZLyzTvinxx7EHspHgqqrAsyJy6t794IpIb7Ycyzq728 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Id: None Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Name: None Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Identity-Status: Confirmed Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Is-Admin-Project: True Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Id: default Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Name: Default Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Project-Name: admin Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Role: member,reader,admin Aug 21 00:58:39.253398 n-d-master-1 devstack@n-api.service[106510]: X-Roles: member,reader,admin Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-Tenant: admin Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Name: admin Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-User: admin Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Id: default Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Name: Default Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: X-User-Name: admin Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: method: > Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: exception: Flavor 42 could not be found. Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: action_args: {'id': '42'} Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:39.254959 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:39.255905 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.257024 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-909d810d-ea23-4231-b1c8-60417ff09658 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:39.258352 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-909d810d-ea23-4231-b1c8-60417ff09658 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.454981 Aug 21 00:58:39.258352 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Sun Aug 21 00:58:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:39.268433 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-8e029d47-0e75-4956-a4e4-68aba5232f17 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:39.274046 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:39.294198 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-8e029d47-0e75-4956-a4e4-68aba5232f17 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031308 Aug 21 00:58:39.294685 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:58:39.305262 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-79af7159-2bf1-4aa9-8b82-fbd45410dbfc admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:39.331346 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-79af7159-2bf1-4aa9-8b82-fbd45410dbfc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030089 Aug 21 00:58:39.331934 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:58:39.344712 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-bd645177-f01b-4353-a4bd-bef98b4e5275 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:39.352756 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.wsgi [None req-bd645177-f01b-4353-a4bd-bef98b4e5275 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-bd645177-f01b-4353-a4bd-bef98b4e5275 admin admin] Request method failure captured: Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Accept: application/json Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Accept-Encoding: gzip, deflate Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Connection: keep-alive Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Content-Length: 0 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Host: 10.222.0.46 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: Openstack-System-Scope: None Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: User-Agent: python-novaclient Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Auth-Token: gAAAAABjAYM-2Xlr6YkxBcYC1wd8AFYtGHuMIWcLDiuPZtiraHoOtDQ_Cg3LIyY5fbp6nN8wPwjIC7vhjcWAFag3j1EhTdAjjBLIWVDKACsnxp5OxUPsroEWXM2fYTA6wZUoEmOSEcL-ZLyzTvinxx7EHspHgqqrAsyJy6t794IpIb7Ycyzq728 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Id: None Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Name: None Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Identity-Status: Confirmed Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Is-Admin-Project: True Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Id: default Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Name: Default Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Project-Name: admin Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Role: member,reader,admin Aug 21 00:58:39.356138 n-d-master-1 devstack@n-api.service[106511]: X-Roles: member,reader,admin Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-Tenant: admin Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Name: admin Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-User: admin Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Id: default Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Name: Default Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: X-User-Name: admin Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: method: > Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: exception: Flavor 42 could not be found. Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: action_args: {'id': '42'} Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:39.357748 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:39.359362 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:39.361252 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-bd645177-f01b-4353-a4bd-bef98b4e5275 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:39.363272 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-bd645177-f01b-4353-a4bd-bef98b4e5275 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018941 Aug 21 00:58:39.363272 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Sun Aug 21 00:58:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:40.351476 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-79af7159-2bf1-4aa9-8b82-fbd45410dbfc admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:40.352489 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-79af7159-2bf1-4aa9-8b82-fbd45410dbfc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 21 00:58:40.352902 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:40.963203 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-202fa236-3bc4-459e-88f6-d9e2b6469f3c admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:40.971230 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.wsgi [None req-202fa236-3bc4-459e-88f6-d9e2b6469f3c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-202fa236-3bc4-459e-88f6-d9e2b6469f3c admin admin] Request method failure captured: Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Accept: application/json Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Accept-Encoding: gzip, deflate Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Connection: keep-alive Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Content-Length: 0 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Host: 10.222.0.46 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: Openstack-System-Scope: None Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: User-Agent: python-novaclient Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Auth-Token: gAAAAABjAYNA6m-iEA5cxqc24NfAfLjmXhaBRu4GKSkmWUrc4KmOwcXViYrN4WCI6cnXD71sTXD_UQNTS1Kstt8cWfQjxNDU5-NTw3y1Ra2RbN64Tr-NVfGnEel-rbvkVFMk-LajPe6zzWwN2mOmuSBT4UPuVAY9DLRvzdXxOanspiOEOpmufWU Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Id: None Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Name: None Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Identity-Status: Confirmed Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Is-Admin-Project: True Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Id: default Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Name: Default Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Project-Name: admin Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Role: member,reader,admin Aug 21 00:58:40.973785 n-d-master-1 devstack@n-api.service[106511]: X-Roles: member,reader,admin Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-Tenant: admin Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Name: admin Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-User: admin Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Id: default Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Name: Default Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: X-User-Name: admin Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: method: > Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: exception: Flavor 84 could not be found. Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: action_args: {'id': '84'} Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:40.975394 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:40.976320 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:40.977423 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-202fa236-3bc4-459e-88f6-d9e2b6469f3c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:40.978464 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-202fa236-3bc4-459e-88f6-d9e2b6469f3c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.487673 Aug 21 00:58:40.978464 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Sun Aug 21 00:58:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:40.985358 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-53837b38-312e-4c71-a40b-76ba14900b45 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:41.000390 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-53837b38-312e-4c71-a40b-76ba14900b45 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018724 Aug 21 00:58:41.000950 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 00:58:41.010584 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-c3a786eb-84a1-41c8-8c0b-bc7346332e59 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:41.025973 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-c3a786eb-84a1-41c8-8c0b-bc7346332e59 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018941 Aug 21 00:58:41.026498 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:58:41.035941 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-4cc9cf4c-03f0-41e6-8ad3-97fd6180bda3 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:41.042381 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.wsgi [None req-4cc9cf4c-03f0-41e6-8ad3-97fd6180bda3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-4cc9cf4c-03f0-41e6-8ad3-97fd6180bda3 admin admin] Request method failure captured: Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Accept: application/json Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Accept-Encoding: gzip, deflate Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Connection: keep-alive Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Content-Length: 0 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Host: 10.222.0.46 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: Openstack-System-Scope: None Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: User-Agent: python-novaclient Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Auth-Token: gAAAAABjAYNA6m-iEA5cxqc24NfAfLjmXhaBRu4GKSkmWUrc4KmOwcXViYrN4WCI6cnXD71sTXD_UQNTS1Kstt8cWfQjxNDU5-NTw3y1Ra2RbN64Tr-NVfGnEel-rbvkVFMk-LajPe6zzWwN2mOmuSBT4UPuVAY9DLRvzdXxOanspiOEOpmufWU Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Id: None Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Name: None Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Identity-Status: Confirmed Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Is-Admin-Project: True Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Id: default Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Name: Default Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Project-Name: admin Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Role: member,reader,admin Aug 21 00:58:41.043893 n-d-master-1 devstack@n-api.service[106510]: X-Roles: member,reader,admin Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-Tenant: admin Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Name: admin Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-User: admin Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Id: default Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Name: Default Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: X-User-Name: admin Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: method: > Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: exception: Flavor 84 could not be found. Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: action_args: {'id': '84'} Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:41.045410 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:41.046640 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:41.048696 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-4cc9cf4c-03f0-41e6-8ad3-97fd6180bda3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:41.050659 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-4cc9cf4c-03f0-41e6-8ad3-97fd6180bda3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012942 Aug 21 00:58:41.050659 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Sun Aug 21 00:58:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:42.032266 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-c3a786eb-84a1-41c8-8c0b-bc7346332e59 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:42.033304 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-c3a786eb-84a1-41c8-8c0b-bc7346332e59 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 21 00:58:42.033701 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:42.595273 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-3264a572-8f9a-4c02-9c70-69c8863a16b4 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:42.603252 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.wsgi [None req-3264a572-8f9a-4c02-9c70-69c8863a16b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-3264a572-8f9a-4c02-9c70-69c8863a16b4 admin admin] Request method failure captured: Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Accept: application/json Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Accept-Encoding: gzip, deflate Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Connection: keep-alive Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Content-Length: 0 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Host: 10.222.0.46 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: Openstack-System-Scope: None Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: User-Agent: python-novaclient Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Auth-Token: gAAAAABjAYNBbRc_xw2aMflsh6L8kLnQAffPvkqPKViLQ_WH-GFsKKZCL-QFZdbOBt-uiyvFBjn-oTFhISsv6YB_jVwGYfeK83lEMLy1ZzN5eLxCYGzJrBNP7yFySlfYJH6uLUJqKVpVI3Wn8juzh3XEu0GW0aSaULYh2ZXHgqD4a6VU6iGPB84 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Id: None Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Domain-Name: None Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Identity-Status: Confirmed Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Is-Admin-Project: True Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Id: default Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Project-Domain-Name: Default Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Project-Name: admin Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Role: member,reader,admin Aug 21 00:58:42.604748 n-d-master-1 devstack@n-api.service[106510]: X-Roles: member,reader,admin Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-Tenant: admin Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-Tenant-Name: admin Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-User: admin Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Id: default Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-User-Domain-Name: Default Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: X-User-Name: admin Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: method: > Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: exception: Flavor 451 could not be found. Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: action_args: {'id': '451'} Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:42.606282 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:42.607198 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.608529 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-3264a572-8f9a-4c02-9c70-69c8863a16b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:42.609786 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-3264a572-8f9a-4c02-9c70-69c8863a16b4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.435522 Aug 21 00:58:42.609786 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 00:58:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:42.616194 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-867a1632-c19b-449d-8df2-64d85366b0ee admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:42.630903 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-867a1632-c19b-449d-8df2-64d85366b0ee admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018363 Aug 21 00:58:42.631454 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 00:58:42.641372 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:42.656489 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018687 Aug 21 00:58:42.657056 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Sun Aug 21 00:58:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:58:42.668830 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-25543b5d-6940-4ac1-b388-99c94da82265 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:42.677251 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.wsgi [None req-25543b5d-6940-4ac1-b388-99c94da82265 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-25543b5d-6940-4ac1-b388-99c94da82265 admin admin] Request method failure captured: Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Accept: application/json Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Accept-Encoding: gzip, deflate Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Connection: keep-alive Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Content-Length: 0 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Host: 10.222.0.46 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Openstack-Api-Version: compute 2.90 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: Openstack-System-Scope: None Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: User-Agent: python-novaclient Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Auth-Token: gAAAAABjAYNBbRc_xw2aMflsh6L8kLnQAffPvkqPKViLQ_WH-GFsKKZCL-QFZdbOBt-uiyvFBjn-oTFhISsv6YB_jVwGYfeK83lEMLy1ZzN5eLxCYGzJrBNP7yFySlfYJH6uLUJqKVpVI3Wn8juzh3XEu0GW0aSaULYh2ZXHgqD4a6VU6iGPB84 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Id: None Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Domain-Name: None Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Identity-Status: Confirmed Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Is-Admin-Project: True Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Openstack-Nova-Api-Version: 2.90 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Id: default Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Project-Domain-Name: Default Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Project-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Project-Name: admin Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Role: member,reader,admin Aug 21 00:58:42.679754 n-d-master-1 devstack@n-api.service[106511]: X-Roles: member,reader,admin Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e256165a7ff4427f88213eb7acbe8301", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e256165a7ff4427f88213eb7acbe8301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e256165a7ff4427f88213eb7acbe8301"}]}] Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-Tenant: admin Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Id: e256165a7ff4427f88213eb7acbe8301 Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-Tenant-Name: admin Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-User: admin Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Id: default Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-User-Domain-Name: Default Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-User-Id: d3c40350199043a89e4162ff1c7c88f4 Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: X-User-Name: admin Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: method: > Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: exception: Flavor 451 could not be found. Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: action_args: {'id': '451'} Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 00:58:42.682101 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:42.683032 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: ERROR nova.api.openstack.wsgi Aug 21 00:58:42.684289 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-25543b5d-6940-4ac1-b388-99c94da82265 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 00:58:42.685529 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-25543b5d-6940-4ac1-b388-99c94da82265 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018485 Aug 21 00:58:42.685529 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 00:58:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:43.677660 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:43.678978 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 21 00:58:43.679501 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:44.254445 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-de049c6f-a592-4433-b8fa-5f3bdf5e1a1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:44.277294 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-de049c6f-a592-4433-b8fa-5f3bdf5e1a1b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.459215 Aug 21 00:58:44.277837 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Sun Aug 21 00:58:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 00:58:45.265354 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:45.266351 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 21 00:58:45.266722 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:45.844435 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-5c0d6ee3-dae4-4a4c-b7d5-d5c3becea025 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:45.865919 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-5c0d6ee3-dae4-4a4c-b7d5-d5c3becea025 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.447505 Aug 21 00:58:45.867811 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Sun Aug 21 00:58:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:46.863091 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:46.864092 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 21 00:58:46.864488 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:47.452964 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-3bbcf2ba-9451-4bfb-82e4-8315a2b05f74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:47.476550 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-3bbcf2ba-9451-4bfb-82e4-8315a2b05f74 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.470587 Aug 21 00:58:47.478142 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Sun Aug 21 00:58:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:48.500243 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:48.501391 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 21 00:58:48.501778 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:49.060495 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-cae56684-088b-4274-a022-8b9ad8d26978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 00:58:49.081024 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-cae56684-088b-4274-a022-8b9ad8d26978 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.439543 Aug 21 00:58:49.081585 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Sun Aug 21 00:58:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 00:58:50.086503 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:50.087513 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 21 00:58:50.087906 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 00:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:58:50.665984 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-8ca53319-9858-464a-b2e6-066828e2d92a admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:58:50.686176 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-8ca53319-9858-464a-b2e6-066828e2d92a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.454534 Aug 21 00:58:50.686708 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Sun Aug 21 00:58:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:59:44.857934 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:44.858937 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-56206e62-f08f-49d6-84c3-f2d96e45a73e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 21 00:59:44.859336 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 931 bytes} [Sun Aug 21 00:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 00:59:44.872477 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.300959 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-fbb04fb6-beb7-4dc4-819b-d7700c366882 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:45.322938 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-fbb04fb6-beb7-4dc4-819b-d7700c366882 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.457051 Aug 21 00:59:45.323493 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 00:59:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 00:59:45.349006 n-d-master-1 devstack@n-api.service[106510]: DEBUG dbcounter [-] [106510] Writing DB stats nova_api:SELECT=14 {{(pid=106510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:45.353000 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-dea22bbc-8302-4279-a28b-13b9d4fed009 admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:45.361262 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-dea22bbc-8302-4279-a28b-13b9d4fed009 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013706 Aug 21 00:59:45.361816 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1283 bytes} [Sun Aug 21 00:59:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:59:45.373972 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-f07feb3a-d2db-43a4-9911-a3d5504c8117 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:45.382023 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-f07feb3a-d2db-43a4-9911-a3d5504c8117 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011677 Aug 21 00:59:45.382659 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1286 bytes} [Sun Aug 21 00:59:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:59:45.394410 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:45.402201 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011421 Aug 21 00:59:45.402731 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1286 bytes} [Sun Aug 21 00:59:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 00:59:45.414577 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-cccfd3ca-020a-4f41-9afb-6dcb6876ed2e admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 00:59:45.422831 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-cccfd3ca-020a-4f41-9afb-6dcb6876ed2e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011954 Aug 21 00:59:45.423363 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1283 bytes} [Sun Aug 21 00:59:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:05:02.636267 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:05:02.637418 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 21 01:05:02.637818 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 01:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:05:02.783382 n-d-master-1 devstack@n-api.service[106511]: DEBUG dbcounter [-] [106511] Writing DB stats nova_api:SELECT=6 {{(pid=106511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:02.932285 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:05:02.934740 n-d-master-1 devstack@n-api.service[106511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:02.934740 n-d-master-1 devstack@n-api.service[106511]: warnings.warn(msg) Aug 21 01:05:02.935876 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:02.936435 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:02.936996 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:02.937713 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:02.938155 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:02.938651 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:02.984538 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-d57f3667-32e8-4d42-abca-3ef1ab02a5fa admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1215 microversion: 2.90 time: 0.202510 Aug 21 01:05:02.985201 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 01:05:02 2022] GET /compute/v2.1/os-services => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:05:03.829537 n-d-master-1 devstack@n-api.service[106510]: DEBUG nova.api.openstack.wsgi [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] Calling method '>' {{(pid=106510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:05:03.830542 n-d-master-1 devstack@n-api.service[106510]: INFO nova.api.openstack.requestlog [None req-363da66b-cfbf-4d1e-b19e-8a224f0910fe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 21 01:05:03.830940 n-d-master-1 devstack@n-api.service[106510]: [pid: 106510|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1074 bytes} [Sun Aug 21 01:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:05:04.028642 n-d-master-1 devstack@n-api.service[106511]: DEBUG nova.api.openstack.wsgi [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Calling method '>' {{(pid=106511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:05:04.031123 n-d-master-1 devstack@n-api.service[106511]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:05:04.031123 n-d-master-1 devstack@n-api.service[106511]: warnings.warn(msg) Aug 21 01:05:04.032165 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:04.032632 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:04.033076 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:04.033775 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:04.034210 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:04.034617 n-d-master-1 devstack@n-api.service[106511]: DEBUG oslo_concurrency.lockutils [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:04.057417 n-d-master-1 devstack@n-api.service[106511]: INFO nova.api.openstack.requestlog [None req-89fd3e08-3b38-444a-9121-94bf9025afa4 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1215 microversion: 2.90 time: 0.088991 Aug 21 01:05:04.057967 n-d-master-1 devstack@n-api.service[106511]: [pid: 106511|app: 0|req: 36/72] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 01:05:03 2022] GET /compute/v2.1/os-services => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:05:53.355435 n-d-master-1 devstack@n-api.service[106509]: Sun Aug 21 01:05:53 2022 - graceful shutdown triggered... Aug 21 01:05:53.356163 n-d-master-1 devstack@n-api.service[106510]: Gracefully killing worker 1 (pid: 106510)... Aug 21 01:05:53.356600 n-d-master-1 devstack@n-api.service[106511]: Gracefully killing worker 2 (pid: 106511)... Aug 21 01:05:53.356249 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 21 01:05:54.357277 n-d-master-1 devstack@n-api.service[106509]: worker 1 buried after 1 seconds Aug 21 01:05:54.357277 n-d-master-1 devstack@n-api.service[106509]: worker 2 buried after 1 seconds Aug 21 01:05:54.357277 n-d-master-1 devstack@n-api.service[106509]: goodbye to uWSGI. Aug 21 01:05:54.359621 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 21 01:05:54.360565 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 21 01:05:54.364400 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 21 01:05:54.383298 n-d-master-1 devstack@n-api.service[122475]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 21 01:05:54 2022] *** Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: nodename: n-d-master-1 Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: machine: x86_64 Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: clock source: unix Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: pcre jit disabled Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: detected number of CPU cores: 4 Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: current working directory: / Aug 21 01:05:54.386026 n-d-master-1 devstack@n-api.service[122475]: detected binary path: /usr/bin/uwsgi-core Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: your processes number limit is 47680 Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: your memory page size is 4096 bytes Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: detected max file descriptor number: 2048 Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: lock engine: pthread robust mutexes Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: thunder lock: enabled Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 21 01:05:54.386768 n-d-master-1 devstack@n-api.service[122475]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 21 01:05:54.428595 n-d-master-1 devstack@n-api.service[122475]: Python main interpreter initialized at 0x557e603df9c0 Aug 21 01:05:54.428595 n-d-master-1 devstack@n-api.service[122475]: python threads support enabled Aug 21 01:05:54.428595 n-d-master-1 devstack@n-api.service[122475]: your server socket listen backlog is limited to 100 connections Aug 21 01:05:54.428595 n-d-master-1 devstack@n-api.service[122475]: your mercy for graceful operations on workers is 90 seconds Aug 21 01:05:54.429085 n-d-master-1 devstack@n-api.service[122475]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 01:05:54.429085 n-d-master-1 devstack@n-api.service[122475]: *** Operational MODE: preforking *** Aug 21 01:05:54.429312 n-d-master-1 devstack@n-api.service[122475]: *** uWSGI is running in multiple interpreter mode *** Aug 21 01:05:54.429312 n-d-master-1 devstack@n-api.service[122475]: spawned uWSGI master process (pid: 122475) Aug 21 01:05:54.429533 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 21 01:05:54.430133 n-d-master-1 devstack@n-api.service[122475]: spawned uWSGI worker 1 (pid: 122482, cores: 1) Aug 21 01:05:54.430488 n-d-master-1 devstack@n-api.service[122475]: spawned uWSGI worker 2 (pid: 122483, cores: 1) Aug 21 01:05:54.430643 n-d-master-1 devstack@n-api.service[122475]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 01:05:55.083650 n-d-master-1 devstack@n-api.service[122483]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 21 01:05:55.105474 n-d-master-1 devstack@n-api.service[122482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 21 01:05:56.223310 n-d-master-1 devstack@n-api.service[122483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 01:05:56.223310 n-d-master-1 devstack@n-api.service[122483]: from cryptography.utils import int_from_bytes Aug 21 01:05:56.224009 n-d-master-1 devstack@n-api.service[122483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 01:05:56.224009 n-d-master-1 devstack@n-api.service[122483]: from cryptography.utils import int_from_bytes Aug 21 01:05:56.273445 n-d-master-1 devstack@n-api.service[122482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 01:05:56.273445 n-d-master-1 devstack@n-api.service[122482]: from cryptography.utils import int_from_bytes Aug 21 01:05:56.274060 n-d-master-1 devstack@n-api.service[122482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 01:05:56.274060 n-d-master-1 devstack@n-api.service[122482]: from cryptography.utils import int_from_bytes Aug 21 01:05:58.601504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 01:05:58.602194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 01:05:58.602301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 01:05:58.602653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 01:05:58.602915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 01:05:58.603296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.603621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.603914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.604265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.604743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.605077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.605405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.605724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.606052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.606319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.606634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.606959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.607287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.607596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.607894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.608213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.608537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.608879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.609198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.609696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.610130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.610440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.610759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.611117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.611422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.611728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.612031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.612356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.612669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.613107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.613642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.613959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.614272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.614731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.615024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.615341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.615725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.616045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.616416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.616681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.617108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.617413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.617727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.618061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.618380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.618738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.619071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.619374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.619684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.620032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.620283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.620591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.620940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.621260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.621587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.621839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.622090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.622407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.622727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.623035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.623343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.623648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.623955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.624262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.624568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.624894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.625211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.625521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.625834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.626158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.626462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.626780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.627191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.627441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.627746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.628095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.628404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.628870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.629110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.629433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.629933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.630242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.630549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.630868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.631202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.631507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.631757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.632055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.632359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.632673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.633006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.633313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.633619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.633917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.634220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.634526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.634832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.635134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.635439 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.635745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.636046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.636348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.636648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.636992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.637311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.637622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.637927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.638231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.638571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.638890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.639193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.639484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.639789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.640093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.640394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.640710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.641047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.641352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.641667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.641966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.642270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.642584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.642888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.643189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.643488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.643789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.644090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.644486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.644816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.645141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.645440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.645761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.646086 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.646395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.646700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.646984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.647299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.647632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.647959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.648300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.648631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.648987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.649314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.649630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.649938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.650254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.650575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.650890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.651196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.651504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.651811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.652127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.652456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.652811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.653104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.653422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.653729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.654044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.654370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.654692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.655001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.655343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.655683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.656017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.656332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.656654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.656990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.657297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.657612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.657935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.658265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.658574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.658891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.659208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.659519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.659883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.660186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.660509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.660882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.661170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.661483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.661796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.662112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.662423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.662734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.663042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.663343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.663645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.663945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.664255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.664556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.664896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.665224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.665532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.665861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.666167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.666473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.666781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.667090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.667421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.667726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.668033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.668336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.668657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.668986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.669294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.669613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.669916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.670215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.670523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.670831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.671141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.671445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.671752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.672070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.672382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.672686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.673041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.673367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.673665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.673970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.674290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.674604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.674844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 01:05:58.675284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.675380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 01:05:58.675524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.675668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.675827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 01:05:58.675989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.676150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 01:05:58.676367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.676499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 01:05:58.676625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.676797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.676946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.677075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.677200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.677324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.677475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.677679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.677841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.677992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.678140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.678287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.678458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.678621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.678786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.678949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.679107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.679253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.679425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.679425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.679705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.679869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.680048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.680150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.680237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.680319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.680451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.680631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.680813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.680937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.681102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.681265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.681419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.681585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.681728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.681837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.681933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.682129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.682362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.682538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.682662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.682882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.683042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.683145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.683247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.683466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.683651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.683823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.683983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.684142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.684297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.684459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.684646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.684827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.684944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.685038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.685123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.685312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.685463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.685565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.685653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.694673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.694806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.694898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.694987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.695133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.697688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.697825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.697937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.698896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.698980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.699903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.699972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.700041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.700110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.700178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.700255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.700335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.700415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.700494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.700648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.700799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.700938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.701075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.701213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.701354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.701488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.701587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.701737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.701835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.701968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.702055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.702181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.702284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.702415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.702555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.702681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.702771 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.702862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.703007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.703105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.703227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.703329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.703495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.703601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.703695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.703786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.703878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.703962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.704054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.704197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.704294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.704379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.704469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.704560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.704652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.704935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.705037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.705130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.705224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.705308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.705390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.705486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.705578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.705716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.705822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.705908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.706005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.706149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.706245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.706331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.706427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.706514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.706654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.706772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.706856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.706993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.707089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.707174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.707274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.707359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.707449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.707542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.707634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.707718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.708119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.708216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.708307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.708400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.708484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.708567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.708662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.708754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.708855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.708951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.709140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.709323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.709499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.709679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.709853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.709944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.710119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.710308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.710480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.710663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.710937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.711035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.711120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.711255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.711391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.711532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.711621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.711712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.711804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.711895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.711989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.712087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.712171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.712254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.712254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.712421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.712514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.712599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.712681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.712859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.712958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.713143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.713317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.713499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.713711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.713892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.713990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.714082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.714179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.714271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.714392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.714490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.714583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.714674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.714758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.714850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.714943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.715035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.715170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.715265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.715359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.715461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.715555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.715639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.715639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.715798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.715927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.716112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.716320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.716495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.716671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.716854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.716938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.717033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.717168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.717267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.717352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.717480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.717567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.717678 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.717763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.717854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.717938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 01:05:58.718112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.718960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.719849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.720995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.721999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.722217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.722362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.722557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.722724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.722965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.723987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.724215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.724377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.724582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.724753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.724945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.725933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.726968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.727878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.728930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.729929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.735858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.736998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.737968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.738946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.739995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.740985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.741947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.742931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743086 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.743888 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.744103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.744257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.744379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.744507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.744707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.745939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.746951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.747801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.748945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.749877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.750936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.751899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.752999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.753109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.753312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.753410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.754934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.755796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.756950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.757971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.758975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.759918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.760986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.761982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.762829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.763946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.764867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.765976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.766992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.767910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768439 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.768892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.769079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.769267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.769494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.769967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.770790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.771929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.772978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.773890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.774808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.775955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.776893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.777880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.778948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.779966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.780916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.781860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.782923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.783927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.784961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.785990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.786905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.787915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.788902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.789964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.790877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.791978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.792918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.793851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.794970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.795971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.796941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.797872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.798972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.799899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.800122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.800215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.800470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.800897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.800897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.801940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.802949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.803840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.804965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.805967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.806932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.807857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.808968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.809884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.810951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.811855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.812957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.813868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.814953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.815866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.816863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.817984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.818924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.819930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.820869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.821770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.822951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.823952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.824939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.825976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.826980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.827923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.828949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.829973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.830972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.831214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.831322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.831520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.831707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.831935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.832040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.832250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.832347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.832559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.832701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.833913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.834863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.835863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.836782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.837903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.838917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.839997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.840932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.841932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.842876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.843955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.844907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.845923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.846851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.847995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.848156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.848290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.848409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.848575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.848676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.869463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.870117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.870439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.870721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.870948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.871221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.871515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.871792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.872061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.872305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.872305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.872651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.872842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.873040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.873223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.873709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.873937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.874963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.875961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.876130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.876324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.876753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.877197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.877369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.877538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.877705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.877876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.878062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.878249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.878447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.878686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.878862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.879777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.880997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.881587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.882660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.883801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.884619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.885124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.885124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.885430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.885756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.886083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.886406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.886713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.887040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.887345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.887654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.887968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.888277 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.888580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.888905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.889215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.889522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.889823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.890129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.890434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.890762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.891063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.891365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.891665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.891975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.892275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.892576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.893177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.893491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.894676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.895027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.895341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.895649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.895966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.896272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.896582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.897202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.897359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.897520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.897875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.898283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.898498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.898857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.899168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.899856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.899856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.900550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.900752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.901107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.901426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.901758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.902086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.902392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.902696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.903000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.903317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.903622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.903929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.904233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.904537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.904886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.905195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.905503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.905809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.906115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.906417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.906720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.907022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.907327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.907626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.907933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.908268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.908583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.908919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.909235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.909549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.909939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.910363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.910683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.910987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.911303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.911631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.911942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.912243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.912666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.913002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.913321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.913644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.913956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.914273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.914593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.914900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.915217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.915523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.915849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.916185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.916508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.916875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.917158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.917457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.917756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.918061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.918375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.918682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.918980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.919275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.919637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.919934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.920298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.920598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.920966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.921223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.923329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.924353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.924353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.924353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.924353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.925142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.925142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.925531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.925729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.926072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.926384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.926700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.927003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.927318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.927655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.927936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.928239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.928568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.928899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.929208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.929514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.929818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.930121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.930441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.931724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.931724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.931724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.931724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.932068 n-d-master-1 devstack@n-api.service[122483]: INFO dbcounter [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Registered counter for database nova_api Aug 21 01:05:58.932157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.932308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.932619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.932949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.933331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.933639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.933946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.934414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.934561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.934867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.935175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.935479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.935781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.936090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.936400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.936720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.937069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.937372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.937694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.938009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.938347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.938653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.938992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.939312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.939619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.939924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.940226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 01:05:58.940462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 01:05:58.952316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_db.sqlalchemy.engines [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:58.959555 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writer thread running {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.002777 n-d-master-1 devstack@n-api.service[122482]: INFO dbcounter [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Registered counter for database nova_api Aug 21 01:05:59.016628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.context [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122483) load_cells /opt/stack/nova/nova/context.py:464}} Aug 21 01:05:59.020815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:59.021282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:59.022912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:59.023692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:59.024221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:59.024614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_db.sqlalchemy.engines [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.026280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:59.028395 n-d-master-1 devstack@n-api.service[122483]: INFO dbcounter [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Registered counter for database nova_cell0 Aug 21 01:05:59.031790 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writer thread running {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.032453 n-d-master-1 devstack@n-api.service[122483]: INFO dbcounter [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Registered counter for database nova_cell1 Aug 21 01:05:59.040042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_db.sqlalchemy.engines [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.042721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_db.sqlalchemy.engines [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.049700 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writer thread running {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.051998 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writer thread running {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.089134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.context [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122482) load_cells /opt/stack/nova/nova/context.py:464}} Aug 21 01:05:59.093222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:59.093698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:59.095246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:59.095984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:05:59.096422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:05:59.098555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:05:59.100655 n-d-master-1 devstack@n-api.service[122482]: INFO dbcounter [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Registered counter for database nova_cell0 Aug 21 01:05:59.104647 n-d-master-1 devstack@n-api.service[122482]: INFO dbcounter [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Registered counter for database nova_cell1 Aug 21 01:05:59.114687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_db.sqlalchemy.engines [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.115505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_db.sqlalchemy.engines [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.122287 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writer thread running {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.125112 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writer thread running {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.201469 n-d-master-1 devstack@n-api.service[122483]: INFO dbcounter [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Registered counter for database nova_cell0 Aug 21 01:05:59.209359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_db.sqlalchemy.engines [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.214261 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writer thread running {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.274210 n-d-master-1 devstack@n-api.service[122482]: INFO dbcounter [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Registered counter for database nova_cell0 Aug 21 01:05:59.282974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_db.sqlalchemy.engines [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 01:05:59.288364 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writer thread running {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 01:05:59.537566 n-d-master-1 devstack@n-api.service[122483]: WARNING keystonemiddleware.auth_token [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 01:05:59.547122 n-d-master-1 devstack@n-api.service[122483]: WARNING keystonemiddleware.auth_token [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 01:05:59.618786 n-d-master-1 devstack@n-api.service[122482]: WARNING keystonemiddleware.auth_token [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 01:05:59.626135 n-d-master-1 devstack@n-api.service[122482]: WARNING keystonemiddleware.auth_token [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 01:05:59.887501 n-d-master-1 devstack@n-api.service[122483]: WARNING keystonemiddleware.auth_token [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 01:05:59.893561 n-d-master-1 devstack@n-api.service[122483]: WARNING keystonemiddleware.auth_token [None req-89ee8548-a64e-42fe-81b4-9e7ca2a00057 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 01:05:59.899104 n-d-master-1 devstack@n-api.service[122483]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e603df9c0 pid: 122483 (default app) Aug 21 01:05:59.984009 n-d-master-1 devstack@n-api.service[122482]: WARNING keystonemiddleware.auth_token [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 21 01:05:59.990693 n-d-master-1 devstack@n-api.service[122482]: WARNING keystonemiddleware.auth_token [None req-552b5b79-c0c4-41cd-8aa1-e195b57309af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 21 01:05:59.996080 n-d-master-1 devstack@n-api.service[122482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e603df9c0 pid: 122482 (default app) Aug 21 01:06:39.667722 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.669020 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.669765 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.670932 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.921108 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.921917 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.923003 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:39.924902 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:40.859885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:40.861628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:40.862396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:40.862850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:40.863580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:40.864024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:40.864434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:40.905161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-737254df-d4e7-47f6-abf0-ae3f076c59dc tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.246930 Aug 21 01:06:40.905743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1/1] 10.222.0.46 () {58 vars in 1164 bytes} [Sun Aug 21 01:06:39 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:41.273979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b1ffa3d-79c7-44bd-803e-ef91fbd434c7 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-962589292", "id": 352467031, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:41.282277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '.version_select at 0x7fc400a46a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.283827 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.283827 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.289734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122483) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 21 01:06:41.290412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.290874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.291277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.303382 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.303382 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:41.316742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.317244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.317650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.331073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.331832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.332248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.336074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b1ffa3d-79c7-44bd-803e-ef91fbd434c7 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.420140 Aug 21 01:06:41.336691 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:39 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:41.338334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbec1a3a-7c08-4210-9e2e-c65003c70757 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.431413 Aug 21 01:06:41.345246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:06:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:41.352428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.353217 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.353217 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.354244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.354713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.355133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.355846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.356283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.356698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.379292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ea0e6d3-d160-41a6-8025-75a9744cb9b4 tempest-AZAdminV2TestJSON-1497553380 tempest-AZAdminV2TestJSON-1497553380-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.030357 Aug 21 01:06:41.379953 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.430447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.434095 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.434095 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.435265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.435732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.436364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.437292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.437790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.438208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.462035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30c4a8a4-b38a-4f0f-8d02-115b9fd4d064 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081170 Aug 21 01:06:41.462603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 4/5] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.465555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d834373a-2dd0-40d2-99f9-0f28062bf7c6 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-70168602", "id": 1786866850, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:41.485445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d834373a-2dd0-40d2-99f9-0f28062bf7c6 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.147613 Aug 21 01:06:41.493243 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2/6] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:06:41 2022] POST /compute/v2.1/flavors => generated 447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:06:41.525955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc4008bdca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.528322 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.528322 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.529399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.529970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.530389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.531089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.532150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.532560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.558756 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b666a6f-4add-4ab5-8d69-3e5dd9d4f00e tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.094996 Aug 21 01:06:41.559329 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 5/7] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.634625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c2460c9-3db6-4bab-9325-7f32a3a7743e tempest-AZAdminNegativeTestJSON-27457206 tempest-AZAdminNegativeTestJSON-27457206-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.635721 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.635721 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:41.636752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c2460c9-3db6-4bab-9325-7f32a3a7743e tempest-AZAdminNegativeTestJSON-27457206 tempest-AZAdminNegativeTestJSON-27457206-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a4ea03fb1c6240fca90d8d3eaa20138f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364660defd60430b9098d4eb84d399d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c2460c9-3db6-4bab-9325-7f32a3a7743e tempest-AZAdminNegativeTestJSON-27457206 tempest-AZAdminNegativeTestJSON-27457206-project] Request method failure captured: Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUeMTQZbWSTIf7fuL-g0AGNMzbAdYUpwZStEpmrPPlZDNZ3GAeotMYpByvn5mHGlELenf73uVSC9ljzdqQUeTaQBE1WQeGY8hLkdmMXM49QEQ-SVm0ERnQJ8nbxBk9inEdVcLRejhmznFDAVkbI_vaaQQoFwFYVps0vU58EdpTuz7I Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 364660defd60430b9098d4eb84d399d7 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AZAdminNegativeTestJSON-27457206 Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:41.639928 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/364660defd60430b9098d4eb84d399d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_364660defd60430b9098d4eb84d399d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/364660defd60430b9098d4eb84d399d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/364660defd60430b9098d4eb84d399d7"}]}] Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AZAdminNegativeTestJSON-27457206 Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 364660defd60430b9098d4eb84d399d7 Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-27457206 Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AZAdminNegativeTestJSON-27457206-project Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a4ea03fb1c6240fca90d8d3eaa20138f Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AZAdminNegativeTestJSON-27457206-project Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 21 01:06:41.641022 n-d-master-1 devstack@n-api.service[122482]: action_args: {} Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:41.641709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 21 01:06:41.642729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:41.645087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c2460c9-3db6-4bab-9325-7f32a3a7743e tempest-AZAdminNegativeTestJSON-27457206 tempest-AZAdminNegativeTestJSON-27457206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:41.646039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c2460c9-3db6-4bab-9325-7f32a3a7743e tempest-AZAdminNegativeTestJSON-27457206 tempest-AZAdminNegativeTestJSON-27457206-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.159059 Aug 21 01:06:41.646718 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3/8] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:41.651809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56036946-c8e0-4b54-ad08-bae756922498 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.652761 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.652761 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:41.682027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56036946-c8e0-4b54-ad08-bae756922498 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/352467031" status: 202 len: 0 microversion: 2.1 time: 0.033782 Aug 21 01:06:41.683483 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4/9] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:41 2022] DELETE /compute/v2.1/flavors/352467031 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:41.689140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b924c182-dbe7-41be-aa7d-22c23003f91f tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1068318047", "name": "tempest-test_aggregate-1098736603"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:41.710494 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.710494 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:41.711640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-b924c182-dbe7-41be-aa7d-22c23003f91f tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 4c432492-f34b-4a9f-ac47-37922f284347 for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:06:41.787628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b924c182-dbe7-41be-aa7d-22c23003f91f tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.102453 Aug 21 01:06:41.787923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 5/10] 10.222.0.46 () {60 vars in 1165 bytes} [Sun Aug 21 01:06:41 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.832227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Calling method '.version_select at 0x7fc4008915e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.835294 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.835294 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.836715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.837646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.838304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.856378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.856890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.857372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.868110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.868661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.869062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.875241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f55becb7-9fe1-4ef8-a68d-dff2e5eeeeda tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.314823 Aug 21 01:06:41.875816 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 6/11] 10.222.0.46 () {60 vars in 1208 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:06:41.887939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc4008bd430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.891181 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.891181 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.892657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.893628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.894065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.894798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.895298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.895721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.920850 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-262aa16a-e1e9-4f8b-90b8-d2c81c331efa tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.043698 Aug 21 01:06:41.921432 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1139 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.926699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-714f8951-abed-4247-b184-5653c3a6c23b tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.967603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-714f8951-abed-4247-b184-5653c3a6c23b tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.044976 Aug 21 01:06:41.968525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 8/13] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:41.973074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1297bc30-44e4-470f-9db2-40398058315a tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.974045 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.974045 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.989298 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1297bc30-44e4-470f-9db2-40398058315a tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.020070 Aug 21 01:06:41.989867 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 9/14] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:41.994064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc40085b0d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:41.996880 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:41.996880 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:41.997878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.998350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:41.998783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:41.999495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:41.999938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:42.000346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:42.025333 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bce3e4e-bf2c-45c7-956f-238f9f26534a tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034321 Aug 21 01:06:42.025847 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 10/15] 10.222.0.46 () {58 vars in 1145 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:42.030230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ba87064-2290-4557-8281-52ebfc1748da tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1297509612", "id": 1316995312, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.050876 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.050876 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:42.083201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ab0ac03-b1c7-495f-8465-f9e6988359cf tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.088002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ba87064-2290-4557-8281-52ebfc1748da tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.061137 Aug 21 01:06:42.088803 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 11/16] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/flavors => generated 417 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.093254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ab547bb-8fa9-480b-aaf7-8cb8eeb9c094 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.098085 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.098085 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:42.121051 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ab0ac03-b1c7-495f-8465-f9e6988359cf tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] 10.222.0.46 "GET /compute/v2.1/flavors/1786866850" status: 200 len: 447 microversion: 2.55 time: 0.331198 Aug 21 01:06:42.122662 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 6/17] 10.222.0.46 () {60 vars in 1199 bytes} [Sun Aug 21 01:06:41 2022] GET /compute/v2.1/flavors/1786866850 => generated 447 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:06:42.128749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4486b26c-07d0-4eab-8057-7e797cc6984c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.150930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ab547bb-8fa9-480b-aaf7-8cb8eeb9c094 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:42.151853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ab547bb-8fa9-480b-aaf7-8cb8eeb9c094 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:42.152695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ab547bb-8fa9-480b-aaf7-8cb8eeb9c094 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:42.162976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4486b26c-07d0-4eab-8057-7e797cc6984c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.037689 Aug 21 01:06:42.164308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 7/18] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:42.169984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-29ef11a1-e6c2-4cd2-8416-6d80f0a9bf9a tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] Action: 'update', calling method: .version_select at 0x7fc400e06ca0>, body: {"flavor": {"description": "new"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.182422 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.182422 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:42.218903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-29ef11a1-e6c2-4cd2-8416-6d80f0a9bf9a tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1786866850" status: 200 len: 448 microversion: 2.55 time: 0.053046 Aug 21 01:06:42.220190 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 8/19] 10.222.0.46 () {62 vars in 1219 bytes} [Sun Aug 21 01:06:42 2022] PUT /compute/v2.1/flavors/1786866850 => generated 448 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:06:42.228407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffe047f3-d079-4df9-9fd8-3f91f5f876ec tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.229683 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.229683 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:42.249061 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffe047f3-d079-4df9-9fd8-3f91f5f876ec tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1316995312" status: 202 len: 0 microversion: 2.1 time: 0.026944 Aug 21 01:06:42.250694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 9/20] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:42 2022] DELETE /compute/v2.1/flavors/1316995312 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:42.256309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4100f5ae-447e-40a5-a32b-f2829cf3bdf2 tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.304745 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4100f5ae-447e-40a5-a32b-f2829cf3bdf2 tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5723 microversion: 2.55 time: 0.052798 Aug 21 01:06:42.307165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 10/21] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5723 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:06:42.312997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a96aa8b3-e290-42af-ab95-ad7f2782df2d tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.336755 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a96aa8b3-e290-42af-ab95-ad7f2782df2d tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.028359 Aug 21 01:06:42.337898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 11/22] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:42.343959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48a5955f-9c6c-46ad-b5d8-0bd65c01d487 tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.374638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48a5955f-9c6c-46ad-b5d8-0bd65c01d487 tempest-FlavorsV255TestJSON-1441715958 tempest-FlavorsV255TestJSON-1441715958-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.55 time: 0.035445 Aug 21 01:06:42.375231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 12/23] 10.222.0.46 () {60 vars in 1166 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:06:42.380687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3675495e-ce49-4a5a-9e9b-f6a537fc4d19 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-993830358", "id": 1970347856, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.385045 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:42.385045 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:42.415893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3675495e-ce49-4a5a-9e9b-f6a537fc4d19 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.038959 Aug 21 01:06:42.416458 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 13/24] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/flavors => generated 428 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.421412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-587adc99-46a2-4eae-978d-ab51e308d6a0 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.445082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-587adc99-46a2-4eae-978d-ab51e308d6a0 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1786866850" status: 202 len: 0 microversion: 2.55 time: 0.027231 Aug 21 01:06:42.446305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 14/25] 10.222.0.46 () {60 vars in 1202 bytes} [Sun Aug 21 01:06:42 2022] DELETE /compute/v2.1/flavors/1786866850 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:06:42.451835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4facbc63-f793-4aeb-8f54-d23062941fe2 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.478443 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4facbc63-f793-4aeb-8f54-d23062941fe2 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1970347856" status: 202 len: 0 microversion: 2.1 time: 0.030798 Aug 21 01:06:42.480148 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 15/26] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:42 2022] DELETE /compute/v2.1/flavors/1970347856 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:42.489085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-88b9f234-dac2-4e0b-8d39-11aa0c464fd9 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.521533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-88b9f234-dac2-4e0b-8d39-11aa0c464fd9 tempest-FlavorsV255TestJSON-115356306 tempest-FlavorsV255TestJSON-115356306-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.039792 Aug 21 01:06:42.522406 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 16/27] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:06:42.530568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cccbcd4-5282-46f4-8bf8-6d3a323c4524 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.559235 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0cccbcd4-5282-46f4-8bf8-6d3a323c4524 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035671 Aug 21 01:06:42.559923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 17/28] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:42.582420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d8952e8-cf49-428b-b120-a2b55865f914 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-642716115", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.617284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d8952e8-cf49-428b-b120-a2b55865f914 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.042880 Aug 21 01:06:42.618466 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 18/29] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/flavors => generated 506 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.633755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5907f7e0-4602-438c-bba5-2e23ffa1fab2 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.667346 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5907f7e0-4602-438c-bba5-2e23ffa1fab2 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/cdbce47d-f911-43b6-88b1-cb48b532a99d" status: 202 len: 0 microversion: 2.1 time: 0.040025 Aug 21 01:06:42.669610 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 19/30] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:06:42 2022] DELETE /compute/v2.1/flavors/cdbce47d-f911-43b6-88b1-cb48b532a99d => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:42.678943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9832fe5b-5dfb-496d-bedb-4fccb75705a7 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.715268 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9832fe5b-5dfb-496d-bedb-4fccb75705a7 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041617 Aug 21 01:06:42.716276 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 20/31] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:42.738885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fe1eba57-615d-4ad4-84da-10183cf93226 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1261754311", "id": "4ed689ba-20f7-4627-be45-a7c62e8d12f6", "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.772277 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fe1eba57-615d-4ad4-84da-10183cf93226 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.038522 Aug 21 01:06:42.779460 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 21/32] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/flavors => generated 507 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.779550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ab547bb-8fa9-480b-aaf7-8cb8eeb9c094 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.687230 Aug 21 01:06:42.779550 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 12/33] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.795256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6881560c-c8eb-4d23-9ce2-6a6a05cca0ff tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.813768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6881560c-c8eb-4d23-9ce2-6a6a05cca0ff tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/4ed689ba-20f7-4627-be45-a7c62e8d12f6" status: 202 len: 0 microversion: 2.1 time: 0.022093 Aug 21 01:06:42.814908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 22/34] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:06:42 2022] DELETE /compute/v2.1/flavors/4ed689ba-20f7-4627-be45-a7c62e8d12f6 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:42.823879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f60d59a8-19db-4c59-b603-8add79231c0c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.845969 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f60d59a8-19db-4c59-b603-8add79231c0c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025984 Aug 21 01:06:42.846978 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 13/35] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:42.865612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52e01277-41d8-4462-a176-eba0e72defbb tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1535338740", "id": 223107368, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:42.885361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52e01277-41d8-4462-a176-eba0e72defbb tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.023925 Aug 21 01:06:42.886282 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 23/36] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/flavors => generated 411 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:42.897458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe247ebb-8891-4e5d-9fa8-5024f79a7f92 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:42.912242 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe247ebb-8891-4e5d-9fa8-5024f79a7f92 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/223107368" status: 200 len: 411 microversion: 2.1 time: 0.018558 Aug 21 01:06:42.913054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 14/37] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/223107368 => generated 411 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:43.275022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0a62faa-89f9-495c-8acb-6ff82923d5db tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.330258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0a62faa-89f9-495c-8acb-6ff82923d5db tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.408544 Aug 21 01:06:43.343323 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 24/38] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:42 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:43.348715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e896b393-c846-4b6e-8a59-1b3633dd77c9 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.356828 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8,nova_api:DELETE=18,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:43.373152 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e896b393-c846-4b6e-8a59-1b3633dd77c9 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/223107368" status: 202 len: 0 microversion: 2.1 time: 0.028051 Aug 21 01:06:43.374010 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 25/39] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:43 2022] DELETE /compute/v2.1/flavors/223107368 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:06:43.390624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13bc9abc-0edd-4ada-8db4-8c9003fb1ec1 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.402522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-131306000", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "availability_zone": "tempest-test_az-1068318047"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:43.428544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13bc9abc-0edd-4ada-8db4-8c9003fb1ec1 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047695 Aug 21 01:06:43.429159 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 26/40] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:43.445180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:43.446499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:43.447095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:43.448120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:43.448858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7f5e81a-9701-4307-81d6-c2c0cd7210a9 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1172524722", "id": 264883116, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:43.449470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:43.450166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:43.472797 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7f5e81a-9701-4307-81d6-c2c0cd7210a9 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.027951 Aug 21 01:06:43.473670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 27/41] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:43 2022] POST /compute/v2.1/flavors => generated 427 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:43.505996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de7afe97-c9c9-4a06-980a-2a7aea8413a8 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "264883116"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:43.548194 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-de7afe97-c9c9-4a06-980a-2a7aea8413a8 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] HTTP exception thrown: Flavor 264883116 could not be found. Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de7afe97-c9c9-4a06-980a-2a7aea8413a8 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Request method failure captured: Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 106 Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUdrXej2fRlZSHViT6C5totcxo5EBcQ5HRbVBB9ZuZ8D9hqDC6wpBSbfTJKbWx7KxdvJ2oUlhxt56yD1SvTpk5I9J8GkILpUBwnVqJfuF4En-2IOrG_5QFby3r9kCtv1pS3xCXH3cPXUeKYTbtu9sHaXpTO8KxnRNlzesG3X-k_zZc Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 5c1ed37794e64d02b4a9aace33ab7d2d Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsAdminTestJSON-871909105 Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:43.566422 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5c1ed37794e64d02b4a9aace33ab7d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5c1ed37794e64d02b4a9aace33ab7d2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5c1ed37794e64d02b4a9aace33ab7d2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5c1ed37794e64d02b4a9aace33ab7d2d"}]}] Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsAdminTestJSON-871909105 Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 5c1ed37794e64d02b4a9aace33ab7d2d Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-871909105 Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsAdminTestJSON-871909105-project Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: ed42ee9fffaa49bfb15f6ee2d691004f Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsAdminTestJSON-871909105-project Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "test", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "264883116"}} Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:06:43.567689 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor 264883116 could not be found. Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '264883116'}}} Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 264883116 could not be found. Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:43.568514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 264883116 could not be found. Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:43.569895 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 264883116 could not be found. Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de7afe97-c9c9-4a06-980a-2a7aea8413a8 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Returning 400 to user: Flavor 264883116 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:43.571208 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de7afe97-c9c9-4a06-980a-2a7aea8413a8 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.070139 Aug 21 01:06:43.578156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 28/42] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:43 2022] POST /compute/v2.1/servers => generated 80 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:43.589715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-add59f0c-d14a-4349-96f4-1cd6b9a7b09f tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.625351 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-add59f0c-d14a-4349-96f4-1cd6b9a7b09f tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/264883116" status: 202 len: 0 microversion: 2.1 time: 0.045779 Aug 21 01:06:43.626777 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 29/43] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:43 2022] DELETE /compute/v2.1/flavors/264883116 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:43.638413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd04ef7b-0438-47a7-8055-b9fe0175230c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.667376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd04ef7b-0438-47a7-8055-b9fe0175230c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034473 Aug 21 01:06:43.668220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 30/44] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:06:43.689343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d56c07f5-2983-4ee0-af5e-7ffb4c78355a tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1319903810", "id": 1812319988, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:43.720907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d56c07f5-2983-4ee0-af5e-7ffb4c78355a tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.035604 Aug 21 01:06:43.722820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 31/45] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:43 2022] POST /compute/v2.1/flavors => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:43.738706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18654dc9-c882-46f9-a293-f894b605b444 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-980729192", "id": 869343368, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:43.766843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-18654dc9-c882-46f9-a293-f894b605b444 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.035271 Aug 21 01:06:43.773984 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 32/46] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:43 2022] POST /compute/v2.1/flavors => generated 410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:43.779514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96ca39b7-d683-4f76-b0ca-0b2ecc2c683d tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.808723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96ca39b7-d683-4f76-b0ca-0b2ecc2c683d tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.033386 Aug 21 01:06:43.810171 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 33/47] 10.222.0.46 () {58 vars in 1169 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:43.823431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62915704-68a3-43fc-8149-14ce14d59759 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.835894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62915704-68a3-43fc-8149-14ce14d59759 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.017291 Aug 21 01:06:43.836666 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 34/48] 10.222.0.46 () {58 vars in 1177 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:43.852746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a047de26-13cb-4ae4-b095-b9d7a66caea0 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.865412 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a047de26-13cb-4ae4-b095-b9d7a66caea0 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.019569 Aug 21 01:06:43.866586 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 35/49] 10.222.0.46 () {58 vars in 1171 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:43.883476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3f83241-59be-4baa-899b-09161b30f043 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.895839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3f83241-59be-4baa-899b-09161b30f043 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.021014 Aug 21 01:06:43.896970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 36/50] 10.222.0.46 () {58 vars in 1169 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:43.910457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd5ed8ce-d756-4715-b907-b7f0915a6690 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.953291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd5ed8ce-d756-4715-b907-b7f0915a6690 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.047117 Aug 21 01:06:43.953881 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 37/51] 10.222.0.46 () {58 vars in 1169 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:43.973079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99debca6-11e4-495b-9f63-e7bc7730aebf tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:43.996304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99debca6-11e4-495b-9f63-e7bc7730aebf tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.028211 Aug 21 01:06:43.997149 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 38/52] 10.222.0.46 () {58 vars in 1175 bytes} [Sun Aug 21 01:06:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:06:44.021291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c4265fd-f1e5-424b-b5e7-25f7e1f6d782 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.051536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:06:44.054824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c4265fd-f1e5-424b-b5e7-25f7e1f6d782 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.040706 Aug 21 01:06:44.055593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 39/53] 10.222.0.46 () {58 vars in 1173 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.075921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-000e1d69-c8e8-4047-9d60-7623e05d6f67 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.108794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-000e1d69-c8e8-4047-9d60-7623e05d6f67 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.024016 Aug 21 01:06:44.108794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 40/54] 10.222.0.46 () {58 vars in 1169 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.116846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd0f484b-6914-4e4d-8970-d19c7b6bdc36 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.149320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd0f484b-6914-4e4d-8970-d19c7b6bdc36 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/869343368" status: 202 len: 0 microversion: 2.1 time: 0.035658 Aug 21 01:06:44.150526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 41/55] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:44 2022] DELETE /compute/v2.1/flavors/869343368 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:44.158737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76ba06e0-585b-4c08-82f8-06d5ec715c3b tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.180472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76ba06e0-585b-4c08-82f8-06d5ec715c3b tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025765 Aug 21 01:06:44.191311 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 42/56] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:06:44.200826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d63bc83-abb6-4a4d-836f-e056996491f8 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.223127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d63bc83-abb6-4a4d-836f-e056996491f8 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1812319988" status: 202 len: 0 microversion: 2.1 time: 0.027060 Aug 21 01:06:44.223845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 43/57] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:44 2022] DELETE /compute/v2.1/flavors/1812319988 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:44.233541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cffb92a9-0e79-4553-889f-f6dd858319de tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.256819 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cffb92a9-0e79-4553-889f-f6dd858319de tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027231 Aug 21 01:06:44.270077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 44/58] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.278636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e86ca2ed-828b-43bb-873f-ebd7c0df9f94 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-199347925", "id": 322834660, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:44.305270 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e86ca2ed-828b-43bb-873f-ebd7c0df9f94 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.032924 Aug 21 01:06:44.308039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 45/59] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:44 2022] POST /compute/v2.1/flavors => generated 411 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:44.320151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e5ae61a-67a4-4b6d-90b4-a31e1669d1ad tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.343534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e5ae61a-67a4-4b6d-90b4-a31e1669d1ad tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027667 Aug 21 01:06:44.344907 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 46/60] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:06:44.362947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02e938e5-225d-4659-927f-8705eab6e164 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.388226 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02e938e5-225d-4659-927f-8705eab6e164 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029785 Aug 21 01:06:44.401062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 47/61] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.405553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73bc36c4-8c1f-4c93-87f2-659ca571e166 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.434941 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73bc36c4-8c1f-4c93-87f2-659ca571e166 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/322834660" status: 202 len: 0 microversion: 2.1 time: 0.032917 Aug 21 01:06:44.439632 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 48/62] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:44 2022] DELETE /compute/v2.1/flavors/322834660 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:44.448227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-361891d1-1049-4c52-9b85-9f4264e341a0 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.475176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-361891d1-1049-4c52-9b85-9f4264e341a0 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034315 Aug 21 01:06:44.476300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 49/63] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.499651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0177ef56-67c4-4105-aafc-974052261cde tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-755529312", "id": 1262689951, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:44.531833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0177ef56-67c4-4105-aafc-974052261cde tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.035554 Aug 21 01:06:44.532668 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 50/64] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:44 2022] POST /compute/v2.1/flavors => generated 413 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:44.553429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-691c6732-66ed-4a3b-a661-1ebb437ce993 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.593673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:06:44.594038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:06:44.594786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:06:44.595345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:06:44.595817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:06:44.608256 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-691c6732-66ed-4a3b-a661-1ebb437ce993 tempest-FlavorsAdminTestJSON-871909105 tempest-FlavorsAdminTestJSON-871909105-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.066087 Aug 21 01:06:44.609172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 51/65] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:06:44.625583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:44.626404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8309c2e-e148-4076-9b02-5cc197c37141 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.627302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:44.632191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:44.635218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:44.637067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:44.637663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:44.648318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8309c2e-e148-4076-9b02-5cc197c37141 tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1262689951" status: 202 len: 0 microversion: 2.1 time: 0.024942 Aug 21 01:06:44.653994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 52/66] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:44 2022] DELETE /compute/v2.1/flavors/1262689951 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:06:44.660810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-904f6f1f-49b1-4f13-956d-e1fb2a7bc42c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.691672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Getting quotas for project 7969fbfe11204268ba47c497448be0dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:06:44.696800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-904f6f1f-49b1-4f13-956d-e1fb2a7bc42c tempest-FlavorsAdminTestJSON-1180265055 tempest-FlavorsAdminTestJSON-1180265055-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039971 Aug 21 01:06:44.701114 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 53/67] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:44.701330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Getting quotas for user f83dfdbfecd9420dbc75d1d1dfcb59f8 and project 7969fbfe11204268ba47c497448be0dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:06:44.720115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:06:44.723347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:06:44.789361 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4adf8179-5582-4a71-91e3-388face72357 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838596 Aug 21 01:06:44.790501 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 15/68] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:06:44.801610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0a60afd-75f6-46b7-9584-903bb12582d4 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:44.802366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c0a60afd-75f6-46b7-9584-903bb12582d4 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:44.838492 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=18,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:45.549764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0a60afd-75f6-46b7-9584-903bb12582d4 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:45.579074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0a60afd-75f6-46b7-9584-903bb12582d4 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1242 microversion: 2.1 time: 0.781654 Aug 21 01:06:45.582800 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 54/69] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:44 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1242 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:46.603979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:46.605757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:46.637158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:46.637897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:46.638595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:46.639798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:46.640391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:46.641161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:46.912940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:46.945055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39a477fa-c035-45c5-a4c7-7e8d7b2385d6 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1234 microversion: 2.1 time: 0.345433 Aug 21 01:06:46.945648 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 16/70] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:46 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1234 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:47.973435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:47.974876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:47.985550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:47.986895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:48.000387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:48.007352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:48.008092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:48.010111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:48.278641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:48.308624 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a03c17f-b36d-48f7-9019-d555be359a91 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1296 microversion: 2.1 time: 0.339034 Aug 21 01:06:48.309937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 55/71] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:47 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1296 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:48.538257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Calling method '.version_select at 0x7fc3fee1b1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:48.540951 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:48.540951 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:48.542049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:48.542532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:48.542961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:48.552856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:48.556815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:48.557371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:48.610899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90184a5a-71d1-4d0f-9fb0-9c4a4964219a tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.641593 Aug 21 01:06:48.611884 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 17/72] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:06:47 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:48.851270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea856e6e-8f0f-4305-890a-4774a6c448e3 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-72333008", "id": 14171414, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:48.855134 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:48.855134 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:48.900969 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea856e6e-8f0f-4305-890a-4774a6c448e3 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.397985 Aug 21 01:06:48.904087 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 56/73] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:48 2022] POST /compute/v2.1/flavors => generated 431 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:48.914340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3cd1c2a7-1f5d-45a3-be31-0403b7ecfe65 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:48.922472 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:48.922472 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:49.162854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9d00b08-7ea5-4245-ad0f-b435aa9ff9fd tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Calling method '.version_select at 0x7fc3fee2caf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:49.177119 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:49.177119 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:49.182144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c9d00b08-7ea5-4245-ad0f-b435aa9ff9fd tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9d00b08-7ea5-4245-ad0f-b435aa9ff9fd tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:06:49.194393 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:06:49.195720 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:49.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 21 01:06:49.198057 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.201883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9d00b08-7ea5-4245-ad0f-b435aa9ff9fd tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:49.204515 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9d00b08-7ea5-4245-ad0f-b435aa9ff9fd tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.579279 Aug 21 01:06:49.214528 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 18/74] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:06:48 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 591 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:49.228346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed00392e-14d1-4204-aeed-a260f9b82a62 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Calling method '.version_select at 0x7fc3fed465e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:49.229145 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:49.229145 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:49.235861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed00392e-14d1-4204-aeed-a260f9b82a62 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed00392e-14d1-4204-aeed-a260f9b82a62 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:06:49.240707 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'n-d-master-1'} Aug 21 01:06:49.242184 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:49.242986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 21 01:06:49.244134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.257920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed00392e-14d1-4204-aeed-a260f9b82a62 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:49.260640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed00392e-14d1-4204-aeed-a260f9b82a62 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.040605 Aug 21 01:06:49.277089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 19/75] 10.222.0.46 () {58 vars in 1188 bytes} [Sun Aug 21 01:06:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:49.286201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3f722d5-2f06-477f-bcbf-609aaf58c066 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Calling method '.version_select at 0x7fc4012758b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:49.286847 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3cd1c2a7-1f5d-45a3-be31-0403b7ecfe65 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/14171414/action" status: 200 len: 95 microversion: 2.1 time: 0.372601 Aug 21 01:06:49.288822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 57/76] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:48 2022] POST /compute/v2.1/flavors/14171414/action => generated 95 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:49.307253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-548e519f-1a15-40af-881a-da4e5f12ad79 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:49.362180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e3f722d5-2f06-477f-bcbf-609aaf58c066 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3f722d5-2f06-477f-bcbf-609aaf58c066 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:06:49.383210 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'nonexistent_hostname'} Aug 21 01:06:49.384383 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:49.385160 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 21 01:06:49.386163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3f722d5-2f06-477f-bcbf-609aaf58c066 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3f722d5-2f06-477f-bcbf-609aaf58c066 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.101236 Aug 21 01:06:49.389015 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 20/77] 10.222.0.46 () {58 vars in 1212 bytes} [Sun Aug 21 01:06:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:06:49.418831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:49.419443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:49.458144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:49.458640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:49.459081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:49.459780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:49.482411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:49.482862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:49.596728 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-548e519f-1a15-40af-881a-da4e5f12ad79 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-548e519f-1a15-40af-881a-da4e5f12ad79 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Request method failure captured: Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/flavors/14171414/action HTTP/1.1 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 67 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnRv6frjK89Tlkkt4mlI0sLUembpr01SgFs01NHhCtC4oBqyavJiwhG6KmngQ_tbTL5VW1wFagKH0WIS2m64Xfd6oVGyViLLfsRbaasd8EUXctk1Vh0BytnRsPRAJDbena6gU9rFtLxIg_Vli4D3duT3Ic34E9B7KYaxi9Fob1zx0 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:49.645966 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_877e38f15766473b9c3047efe6a901e1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}] Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 33427f6bd4bb4ba29cdc179966e9a09d Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} Aug 21 01:06:49.647354 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '14171414', 'body': {'addTenantAccess': {'tenant': '16579e1e520e472a9ff663e210931c5d'}}} Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:06:49.648142 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-16579e1e520e472a9ff663e210931c5d' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi session.flush() Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:06:49.649343 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 01:06:49.650394 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:06:49.651353 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-16579e1e520e472a9ff663e210931c5d' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 21, 1, 6, 49, 585870), 'updated_at': None, 'flavor_id': 27, 'project_id': '16579e1e520e472a9ff663e210931c5d'}] Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.652286 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.654127 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:49.657773 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:49.661274 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. Aug 21 01:06:49.661274 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.661274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-548e519f-1a15-40af-881a-da4e5f12ad79 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project 16579e1e520e472a9ff663e210931c5d combination. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:49.661274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-548e519f-1a15-40af-881a-da4e5f12ad79 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/14171414/action" status: 409 len: 152 microversion: 2.1 time: 0.350641 Aug 21 01:06:49.661274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 58/78] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:49 2022] POST /compute/v2.1/flavors/14171414/action => generated 152 bytes in 363 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:06:49.680675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14632594-8a33-43a2-a932-c4d28dc61745 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Calling method '.version_select at 0x7fc3fac1e940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:49.683439 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:49.683439 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:49.686956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14632594-8a33-43a2-a932-c4d28dc61745 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14632594-8a33-43a2-a932-c4d28dc61745 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:49.693504 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1'} Aug 21 01:06:49.694854 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:49.695729 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 21 01:06:49.696784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:49.699165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14632594-8a33-43a2-a932-c4d28dc61745 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:49.699964 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14632594-8a33-43a2-a932-c4d28dc61745 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.039964 Aug 21 01:06:49.707526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 59/79] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:06:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:49.717424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d15c797d-1fba-41e1-809b-1dfcc55dd15e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:49.726697 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:49.726697 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:50.090383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:50.099794 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a5b19af-0d85-4a25-b389-8aa9360f02dd tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.690340 Aug 21 01:06:50.104002 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 21/80] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:49 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:50.115457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d8f966f-6ccd-4e0c-8b50-2c2f697a2c30 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Calling method '.version_select at 0x7fc3fee2c940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.123715 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.123715 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:50.166580 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4d8f966f-6ccd-4e0c-8b50-2c2f697a2c30 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d8f966f-6ccd-4e0c-8b50-2c2f697a2c30 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:06:50.171335 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'nonexistent_hostname'} Aug 21 01:06:50.173020 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.173998 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.175297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.177276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d8f966f-6ccd-4e0c-8b50-2c2f697a2c30 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.183466 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d8f966f-6ccd-4e0c-8b50-2c2f697a2c30 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.075304 Aug 21 01:06:50.184321 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 22/81] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:06:50.198055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c76b62a-6657-424f-aae2-5b0614624279 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Calling method '.version_select at 0x7fc3fecb0af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.201723 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.201723 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:50.204192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c76b62a-6657-424f-aae2-5b0614624279 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c76b62a-6657-424f-aae2-5b0614624279 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:06:50.214156 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'n-d-master-1'} Aug 21 01:06:50.215894 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.216579 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 21 01:06:50.217562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.218402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c76b62a-6657-424f-aae2-5b0614624279 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.218402 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c76b62a-6657-424f-aae2-5b0614624279 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.026312 Aug 21 01:06:50.234381 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 23/82] 10.222.0.46 () {58 vars in 1194 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:06:50.239698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-778a7cbf-b3cc-45c0-afd0-c41198b57a50 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Calling method '.version_select at 0x7fc3fee1b8b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.276121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-778a7cbf-b3cc-45c0-afd0-c41198b57a50 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-778a7cbf-b3cc-45c0-afd0-c41198b57a50 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:06:50.279502 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'nonexistent_hostname'} Aug 21 01:06:50.280586 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:50.282738 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 21 01:06:50.283774 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.284693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-778a7cbf-b3cc-45c0-afd0-c41198b57a50 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.294743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-778a7cbf-b3cc-45c0-afd0-c41198b57a50 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.059231 Aug 21 01:06:50.319014 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d15c797d-1fba-41e1-809b-1dfcc55dd15e tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/14171414/action" status: 200 len: 21 microversion: 2.1 time: 0.613317 Aug 21 01:06:50.319621 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 60/83] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:49 2022] POST /compute/v2.1/flavors/14171414/action => generated 21 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:50.324227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06f1bf9b-e18c-41c4-9f45-4de52e790c39 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Calling method '.version_select at 0x7fc3fac2bdc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.325023 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.325023 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:50.325210 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 24/84] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:06:50.326100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06f1bf9b-e18c-41c4-9f45-4de52e790c39 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06f1bf9b-e18c-41c4-9f45-4de52e790c39 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:50.328087 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1'} Aug 21 01:06:50.329172 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.330220 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 21 01:06:50.331479 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.332324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06f1bf9b-e18c-41c4-9f45-4de52e790c39 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.333522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53c38dde-0c49-4ca0-bda5-1968e9fca893 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.336577 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.336577 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:50.337828 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06f1bf9b-e18c-41c4-9f45-4de52e790c39 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008425 Aug 21 01:06:50.345100 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 61/85] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:50.351788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cdd588cb-afc5-4ebc-bdb1-40582810a053 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Calling method '.version_select at 0x7fc3fac1ee50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.417465 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-cdd588cb-afc5-4ebc-bdb1-40582810a053 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cdd588cb-afc5-4ebc-bdb1-40582810a053 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:50.421904 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'nonexistent_hostname'} Aug 21 01:06:50.422989 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:50.423689 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 21 01:06:50.424586 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.425763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.446407 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53c38dde-0c49-4ca0-bda5-1968e9fca893 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/14171414" status: 202 len: 0 microversion: 2.1 time: 0.119791 Aug 21 01:06:50.447471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cdd588cb-afc5-4ebc-bdb1-40582810a053 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.448550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cdd588cb-afc5-4ebc-bdb1-40582810a053 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.101774 Aug 21 01:06:50.449534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 25/86] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:06:50 2022] DELETE /compute/v2.1/flavors/14171414 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:50.450595 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 62/87] 10.222.0.46 () {58 vars in 1215 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:06:50.458550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b206f4cf-5caf-4922-aeac-8edf2569af51 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.483335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4311bcb5-b265-4c8b-b6f2-882ca8bcf9ef tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fab5fdc0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.484477 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4311bcb5-b265-4c8b-b6f2-882ca8bcf9ef tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 51 Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:50.521884 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: {"status": "enable", "maintenance_mode": "invalid"} Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.523148 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'disable', Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Enable', Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Disable', Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance: Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'invalid' Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.523804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.525113 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.526102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4311bcb5-b265-4c8b-b6f2-882ca8bcf9ef tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.527507 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4311bcb5-b265-4c8b-b6f2-882ca8bcf9ef tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.067461 Aug 21 01:06:50.533015 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b206f4cf-5caf-4922-aeac-8edf2569af51 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078693 Aug 21 01:06:50.536577 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 63/88] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:06:50.537665 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 26/89] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:50.562022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c428da2-c601-4414-a832-b62f5ff0a9e0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-813649565", "id": 1482330128, "os-flavor-access:is_public": "True"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.564963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ecebeba-ded3-4b2e-be8d-0e2a33765660 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fab049d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.567788 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.567788 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ecebeba-ded3-4b2e-be8d-0e2a33765660 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 51 Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:50.580386 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: {"status": "invalid", "maintenance_mode": "enable"} Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.583708 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'disable', Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Enable', Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Disable', Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance: Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'invalid' Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.584402 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.585739 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.586666 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.586666 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:06:50.586666 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:06:50.586666 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 21 01:06:50.586666 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.592144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ecebeba-ded3-4b2e-be8d-0e2a33765660 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.596052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ecebeba-ded3-4b2e-be8d-0e2a33765660 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.052267 Aug 21 01:06:50.611365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 64/90] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:06:50.623797 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c428da2-c601-4414-a832-b62f5ff0a9e0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.065506 Aug 21 01:06:50.624697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25e442a4-2944-4c37-bf17-6513be76d591 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Action: 'update', calling method: .version_select at 0x7fc3fab27d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.628404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 27/91] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:50.640334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0703e286-8aac-4860-b085-8ac05abbbeb9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.644162 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.644162 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:50.646315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25e442a4-2944-4c37-bf17-6513be76d591 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a0ebb6aa35a7482d888d8e59cb29b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb2b61108224266b050a58ffbf0c445', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25e442a4-2944-4c37-bf17-6513be76d591 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Request method failure captured: Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 50 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUmKKvpycRBhcW0aE0Xb7Jcwps1e08D7qj7axdTkECfpSskzPEfTx95ISe4u_8dew7ylwIHauG7HUDd8grr4vCQ3-6QhrdmKy8_g8q1hwXheL30z27VZHkKcoO4K1YDFL_7bqZNesLxMwyJzM5ZTZgapcHHdUtr4527V7T3Ek2FJ3Q Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:50.648021 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7eb2b61108224266b050a58ffbf0c445", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7eb2b61108224266b050a58ffbf0c445"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7eb2b61108224266b050a58ffbf0c445"}]}] Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7eb2b61108224266b050a58ffbf0c445 Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-329581142 Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a0ebb6aa35a7482d888d8e59cb29b891 Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-329581142-project Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: {"status": "enable", "maintenance_mode": "enable"} Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 21 01:06:50.649237 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.649999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 21 01:06:50.651079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.653595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25e442a4-2944-4c37-bf17-6513be76d591 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.653670 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:50.653670 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:50.656144 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25e442a4-2944-4c37-bf17-6513be76d591 tempest-HostsAdminNegativeTestJSON-329581142 tempest-HostsAdminNegativeTestJSON-329581142-project] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.036905 Aug 21 01:06:50.657753 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 65/92] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:06:50.663027 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0703e286-8aac-4860-b085-8ac05abbbeb9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0703e286-8aac-4860-b085-8ac05abbbeb9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Request method failure captured: Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/flavors/1482330128/os-flavor-access HTTP/1.1 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUnRv6frjK89Tlkkt4mlI0sLUembpr01SgFs01NHhCtC4oBqyavJiwhG6KmngQ_tbTL5VW1wFagKH0WIS2m64Xfd6oVGyViLLfsRbaasd8EUXctk1Vh0BytnRsPRAJDbena6gU9rFtLxIg_Vli4D3duT3Ic34E9B7KYaxi9Fob1zx0 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:06:50.664551 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_877e38f15766473b9c3047efe6a901e1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}] Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 33427f6bd4bb4ba29cdc179966e9a09d Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: exception: Access list not available for public flavors. Aug 21 01:06:50.665787 n-d-master-1 devstack@n-api.service[122483]: action_args: {'flavor_id': '1482330128'} Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 21 01:06:50.666470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.667587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0703e286-8aac-4860-b085-8ac05abbbeb9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.667587 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0703e286-8aac-4860-b085-8ac05abbbeb9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1482330128/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029498 Aug 21 01:06:50.669338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-694fcc90-b9b3-4287-8fff-ae91a4ba70c2 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fab27160>, body: {"status": null, "maintenance_mode": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-694fcc90-b9b3-4287-8fff-ae91a4ba70c2 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 42 Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:50.680339 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: {"status": null, "maintenance_mode": null} Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 21 01:06:50.681583 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'disable', Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Enable', Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'Disable', Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance: Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi None Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.682366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.684916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-694fcc90-b9b3-4287-8fff-ae91a4ba70c2 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.685841 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-694fcc90-b9b3-4287-8fff-ae91a4ba70c2 tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.017518 Aug 21 01:06:50.686370 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 28/93] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/flavors/1482330128/os-flavor-access => generated 91 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:06:50.689267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 66/94] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:06:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:06:50.695206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fab36b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.698460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21888c3e-9566-4a2f-925e-2ea10471df00 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.722413 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.hosts [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Enabling host nonexistent_hostname. Aug 21 01:06:50.741815 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Request method failure captured: Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 50 Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUnYxwACERE8UKCAYgVimF8wpRYPnmAOKS77S50UyyPUbg3ugQ098H_cf-jRHusmsEt9PuU6SDNjmRiztRjHA0Oi_z2kH1buDiF3gQiIvZZHoLrRtP_jWxS-a1yB9HiSlzH66Ff5Yb9JzfKM9boIwCeTqnKGTQh2PJhBpRxaBzWLLE Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:06:50.745667 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_12be6f89b04341538cb2d73cce43060c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/12be6f89b04341538cb2d73cce43060c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/12be6f89b04341538cb2d73cce43060c"}]}] Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 12be6f89b04341538cb2d73cce43060c Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1116032640 Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd15610fd0c34c4aa070e4e8f638856a Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1116032640-project-admin Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: {"status": "enable", "maintenance_mode": "enable"} Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.747386 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:06:50.748872 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:50.750435 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 21 01:06:50.753029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:50.758188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:50.762218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0312ae06-83f2-435b-a41e-914d0461a3af tempest-HostsAdminNegativeTestJSON-1116032640 tempest-HostsAdminNegativeTestJSON-1116032640-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.071731 Aug 21 01:06:50.772380 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 67/95] 10.222.0.46 () {60 vars in 1211 bytes} [Sun Aug 21 01:06:50 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:06:50.785354 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21888c3e-9566-4a2f-925e-2ea10471df00 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1482330128" status: 202 len: 0 microversion: 2.1 time: 0.096897 Aug 21 01:06:50.786338 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 29/96] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:50 2022] DELETE /compute/v2.1/flavors/1482330128 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:50.796343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1faf036-9b53-4877-aff9-e0cb62ccf97a tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:50.850144 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1faf036-9b53-4877-aff9-e0cb62ccf97a tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054814 Aug 21 01:06:50.862281 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 68/97] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:50.873755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2f7c6b4-d6ed-4dd2-ab24-9b8688a5c5ef tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2130045637", "id": 1446775986, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:50.921902 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2f7c6b4-d6ed-4dd2-ab24-9b8688a5c5ef tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.051814 Aug 21 01:06:50.924078 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 69/98] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:50 2022] POST /compute/v2.1/flavors => generated 439 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:51.210934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3db17270-4b15-43bd-a672-0b52bda9486a tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1360680092", "id": 955962859, "os-flavor-access:is_public": "False"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:51.267677 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3db17270-4b15-43bd-a672-0b52bda9486a tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.396368 Aug 21 01:06:51.269188 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 30/99] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:06:51.274593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:51.278208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:51.310193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:51.315292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:51.318367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:51.324426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:51.325192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:51.327087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:51.590000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ad0180e-6db9-4500-8911-d4a97044a401 tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:51.600824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ad0180e-6db9-4500-8911-d4a97044a401 tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bcc3be52ed8a47a39d124500df3681de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16579e1e520e472a9ff663e210931c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ad0180e-6db9-4500-8911-d4a97044a401 tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Request method failure captured: Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/flavors/1446775986/action HTTP/1.1 Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 67 Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUl20d8o3g6MiZixXfAV-DhN4TBPpMsVxj-TlA7-SHsnKfwot-uLaBRJzAN76An7GulNLnLr5fJPGFSBxCGh021-0f8FlLhweDm4l0NZKB0BfkVFdk4u1Bk8zCOoDtUtXLskL4LntqoL56aypYmy_8CzM7AI2a_xGs3ToXylTZoV9s Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 16579e1e520e472a9ff663e210931c5d Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:51.617132 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16579e1e520e472a9ff663e210931c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_16579e1e520e472a9ff663e210931c5d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/16579e1e520e472a9ff663e210931c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16579e1e520e472a9ff663e210931c5d"}]}] Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 16579e1e520e472a9ff663e210931c5d Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsAccessNegativeTestJSON-1123297319-project Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: bcc3be52ed8a47a39d124500df3681de Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319-project Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} Aug 21 01:06:51.619412 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '1446775986', 'body': {'addTenantAccess': {'tenant': '16579e1e520e472a9ff663e210931c5d'}}} Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:51.620512 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 21 01:06:51.622317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:51.627269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ad0180e-6db9-4500-8911-d4a97044a401 tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:51.629002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ad0180e-6db9-4500-8911-d4a97044a401 tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] 10.222.0.46 "POST /compute/v2.1/flavors/1446775986/action" status: 403 len: 130 microversion: 2.1 time: 0.697658 Aug 21 01:06:51.630156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 70/100] 10.222.0.46 () {60 vars in 1200 bytes} [Sun Aug 21 01:06:50 2022] POST /compute/v2.1/flavors/1446775986/action => generated 130 bytes in 700 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:06:51.641411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0b71055-9433-45a2-93cd-066bd106f565 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01a478281683432a80ad47494488ff22"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:52.324981 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0b71055-9433-45a2-93cd-066bd106f565 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/955962859/action" status: 200 len: 96 microversion: 2.1 time: 0.687355 Aug 21 01:06:52.336534 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 71/101] 10.222.0.46 () {60 vars in 1197 bytes} [Sun Aug 21 01:06:51 2022] POST /compute/v2.1/flavors/955962859/action => generated 96 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:52.342526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-22e4f264-ca01-4c59-b928-6c111030bbf2 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:52.347762 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:52.347762 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:06:52.390639 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-22e4f264-ca01-4c59-b928-6c111030bbf2 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1446775986" status: 202 len: 0 microversion: 2.1 time: 0.058630 Aug 21 01:06:52.392602 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 72/102] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:06:52 2022] DELETE /compute/v2.1/flavors/1446775986 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:52.644427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58e97127-d046-43ae-8641-e10c9e3da376 tempest-FlavorsAccessTestJSON-1428981761 tempest-FlavorsAccessTestJSON-1428981761-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:52.677933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58e97127-d046-43ae-8641-e10c9e3da376 tempest-FlavorsAccessTestJSON-1428981761 tempest-FlavorsAccessTestJSON-1428981761-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.283710 Aug 21 01:06:52.689267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 73/103] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:52 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:52.700593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26fd2eb3-43d2-4c5c-a0ec-5f141cd64aa9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:52.745033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26fd2eb3-43d2-4c5c-a0ec-5f141cd64aa9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063519 Aug 21 01:06:52.746803 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 74/104] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:52.755313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8eaa5c39-320f-4872-8144-715f89774644 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01a478281683432a80ad47494488ff22"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:52.953937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8eaa5c39-320f-4872-8144-715f89774644 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/955962859/action" status: 200 len: 21 microversion: 2.1 time: 0.205266 Aug 21 01:06:52.962182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:52.963035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 75/105] 10.222.0.46 () {60 vars in 1197 bytes} [Sun Aug 21 01:06:52 2022] POST /compute/v2.1/flavors/955962859/action => generated 21 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:52.979110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1a96262-6d14-4a8a-9212-1e77a8de8e99 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 1.706533 Aug 21 01:06:52.979626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8d1a432-49ec-4c99-8e7d-e8c63672cac0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1113161899", "id": 17119002, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:52.981849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 31/106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:51 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:52.991290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb72ebd7-746a-4952-99a6-872b3c96c7b4 tempest-FlavorsAccessTestJSON-1428981761 tempest-FlavorsAccessTestJSON-1428981761-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.024216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8d1a432-49ec-4c99-8e7d-e8c63672cac0 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.059816 Aug 21 01:06:53.025233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 76/107] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:52 2022] POST /compute/v2.1/flavors => generated 433 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:53.061919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7367fc8e-4e77-44ee-8b57-5d5298de8b54 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:53.072326 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bb72ebd7-746a-4952-99a6-872b3c96c7b4 tempest-FlavorsAccessTestJSON-1428981761 tempest-FlavorsAccessTestJSON-1428981761-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089135 Aug 21 01:06:53.073697 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 32/108] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:53.123170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1d15b37-03a3-4edb-ae94-d25ba2bc6298 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.125990 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:53.125990 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:53.212684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1d15b37-03a3-4edb-ae94-d25ba2bc6298 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/955962859" status: 202 len: 0 microversion: 2.1 time: 0.115348 Aug 21 01:06:53.216278 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 33/109] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:53 2022] DELETE /compute/v2.1/flavors/955962859 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:06:53.242694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9cc1cac3-b61d-479c-b0d3-37257e26547a tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.337453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9cc1cac3-b61d-479c-b0d3-37257e26547a tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113699 Aug 21 01:06:53.343436 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 34/110] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:53.374259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-55f38b57-f45b-4d17-89da-45594a0a72ee tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-255668492", "id": 899806697, "os-flavor-access:is_public": "False"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:53.378705 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:53.378705 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:53.432509 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-55f38b57-f45b-4d17-89da-45594a0a72ee tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.065821 Aug 21 01:06:53.434431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 35/111] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:53 2022] POST /compute/v2.1/flavors => generated 427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:53.461362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea8cc8e2-f713-4068-b506-213023c6e099 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.464830 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:53.464830 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:53.594165 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea8cc8e2-f713-4068-b506-213023c6e099 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/899806697/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.120208 Aug 21 01:06:53.600326 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 36/112] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:06:53 2022] GET /compute/v2.1/flavors/899806697/os-flavor-access => generated 21 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:53.606713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8933ae9e-537c-4e0d-b680-1181b09458d1 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.652810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8933ae9e-537c-4e0d-b680-1181b09458d1 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/899806697" status: 202 len: 0 microversion: 2.1 time: 0.050714 Aug 21 01:06:53.654346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 37/113] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:53 2022] DELETE /compute/v2.1/flavors/899806697 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:53.664022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a30ecf9f-67ff-4855-824a-9339a12ae471 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:53.713565 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a30ecf9f-67ff-4855-824a-9339a12ae471 tempest-FlavorsAccessTestJSON-68872086 tempest-FlavorsAccessTestJSON-68872086-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051031 Aug 21 01:06:53.715378 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 38/114] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:54.002198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:54.003870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:54.024497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:54.026093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:54.028308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:54.034755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:54.036038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:54.037049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:54.052732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7367fc8e-4e77-44ee-8b57-5d5298de8b54 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/17119002/action" status: 200 len: 95 microversion: 2.1 time: 1.015168 Aug 21 01:06:54.072075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 77/115] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:53 2022] POST /compute/v2.1/flavors/17119002/action => generated 95 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:54.102691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4160648b-bf1a-459d-a4fa-72dabd30bf4a tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:54.187399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4160648b-bf1a-459d-a4fa-72dabd30bf4a tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bcc3be52ed8a47a39d124500df3681de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16579e1e520e472a9ff663e210931c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4160648b-bf1a-459d-a4fa-72dabd30bf4a tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Request method failure captured: Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/flavors/17119002/action HTTP/1.1 Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 70 Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUl20d8o3g6MiZixXfAV-DhN4TBPpMsVxj-TlA7-SHsnKfwot-uLaBRJzAN76An7GulNLnLr5fJPGFSBxCGh021-0f8FlLhweDm4l0NZKB0BfkVFdk4u1Bk8zCOoDtUtXLskL4LntqoL56aypYmy_8CzM7AI2a_xGs3ToXylTZoV9s Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 16579e1e520e472a9ff663e210931c5d Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:06:54.192259 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16579e1e520e472a9ff663e210931c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_16579e1e520e472a9ff663e210931c5d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/16579e1e520e472a9ff663e210931c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16579e1e520e472a9ff663e210931c5d"}]}] Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 16579e1e520e472a9ff663e210931c5d Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319 Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsAccessNegativeTestJSON-1123297319-project Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: bcc3be52ed8a47a39d124500df3681de Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1123297319-project Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: {"removeTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} Aug 21 01:06:54.193758 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '17119002', 'body': {'removeTenantAccess': {'tenant': '16579e1e520e472a9ff663e210931c5d'}}} Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can( Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:06:54.194551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 21 01:06:54.195794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:06:54.202765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4160648b-bf1a-459d-a4fa-72dabd30bf4a tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:54.204687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4160648b-bf1a-459d-a4fa-72dabd30bf4a tempest-FlavorsAccessNegativeTestJSON-1123297319 tempest-FlavorsAccessNegativeTestJSON-1123297319-project] 10.222.0.46 "POST /compute/v2.1/flavors/17119002/action" status: 403 len: 133 microversion: 2.1 time: 0.128085 Aug 21 01:06:54.207782 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 78/116] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:54 2022] POST /compute/v2.1/flavors/17119002/action => generated 133 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:54.220356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81566614-b234-443b-bb1c-6141f373e680 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "16579e1e520e472a9ff663e210931c5d"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:54.710245 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:55.049877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81566614-b234-443b-bb1c-6141f373e680 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/17119002/action" status: 200 len: 21 microversion: 2.1 time: 0.837061 Aug 21 01:06:55.055521 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 79/117] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:06:54 2022] POST /compute/v2.1/flavors/17119002/action => generated 21 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:06:55.060440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e941392-a4d6-4d65-ab30-0ab82482ab41 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:55.113533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e941392-a4d6-4d65-ab30-0ab82482ab41 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/17119002" status: 202 len: 0 microversion: 2.1 time: 0.056568 Aug 21 01:06:55.114328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 80/118] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:06:55 2022] DELETE /compute/v2.1/flavors/17119002 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:06:55.136687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f535b80e-8e7d-43bd-9506-827e7044fb1a tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:55.195355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f535b80e-8e7d-43bd-9506-827e7044fb1a tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073117 Aug 21 01:06:55.197206 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 81/119] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:55.209294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:55.248299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d79e5a54-1dd2-42a7-bd50-b5b29d6c4c90 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1727962119", "id": 631207566, "os-flavor-access:is_public": "False"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:55.251230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d170068-035d-429b-9bfa-45eed04f385d tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 1.253565 Aug 21 01:06:55.252481 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 39/120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:53 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:55.312392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d79e5a54-1dd2-42a7-bd50-b5b29d6c4c90 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.095017 Aug 21 01:06:55.314897 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 82/121] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:55 2022] POST /compute/v2.1/flavors => generated 436 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:55.325957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-198f4dba-7067-49d1-8aae-b9ef49f614a9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c5c5a179f61040508ffbe0334c910749"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:55.328456 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:55.328456 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:06:55.923898 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-198f4dba-7067-49d1-8aae-b9ef49f614a9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] HTTP exception thrown: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-198f4dba-7067-49d1-8aae-b9ef49f614a9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Request method failure captured: Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/flavors/631207566/action HTTP/1.1 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 70 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUnRv6frjK89Tlkkt4mlI0sLUembpr01SgFs01NHhCtC4oBqyavJiwhG6KmngQ_tbTL5VW1wFagKH0WIS2m64Xfd6oVGyViLLfsRbaasd8EUXctk1Vh0BytnRsPRAJDbena6gU9rFtLxIg_Vli4D3duT3Ic34E9B7KYaxi9Fob1zx0 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:06:55.930297 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_877e38f15766473b9c3047efe6a901e1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/877e38f15766473b9c3047efe6a901e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/877e38f15766473b9c3047efe6a901e1"}]}] Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 877e38f15766473b9c3047efe6a901e1 Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706 Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 33427f6bd4bb4ba29cdc179966e9a09d Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: {"removeTenantAccess": {"tenant": "c5c5a179f61040508ffbe0334c910749"}} Aug 21 01:06:55.931581 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: exception: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '631207566', 'body': {'removeTenantAccess': {'tenant': 'c5c5a179f61040508ffbe0334c910749'}}} Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 21 01:06:55.932208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:55.933199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-198f4dba-7067-49d1-8aae-b9ef49f614a9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Returning 404 to user: Flavor access not found for 33 / c5c5a179f61040508ffbe0334c910749 combination. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:06:55.934263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-198f4dba-7067-49d1-8aae-b9ef49f614a9 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/631207566/action" status: 404 len: 124 microversion: 2.1 time: 0.610346 Aug 21 01:06:55.936238 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 40/122] 10.222.0.46 () {60 vars in 1197 bytes} [Sun Aug 21 01:06:55 2022] POST /compute/v2.1/flavors/631207566/action => generated 124 bytes in 615 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:55.944216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4a8725c-fce5-4ee8-bd8b-69cfb5e57756 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:55.949266 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:55.983790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4a8725c-fce5-4ee8-bd8b-69cfb5e57756 tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/631207566" status: 202 len: 0 microversion: 2.1 time: 0.046021 Aug 21 01:06:55.988896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 83/123] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:06:55 2022] DELETE /compute/v2.1/flavors/631207566 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:06:55.998438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-214644fb-bce4-447e-8f9c-2e01a3cbc5eb tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:56.077203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-214644fb-bce4-447e-8f9c-2e01a3cbc5eb tempest-FlavorsAccessNegativeTestJSON-1848854706 tempest-FlavorsAccessNegativeTestJSON-1848854706-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084674 Aug 21 01:06:56.082269 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 41/124] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:06:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:56.287283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:56.290394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:56.334214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:56.335802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:56.337330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:56.342664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:56.343800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:56.346126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:56.947689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "450afbb0-432d-4f96-809c-d4c8469433e7", "tag": "469b0955-91d5-4c75-9ccd-c35f18e4eee8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:06:56.982214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:56.982693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:56.983113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:57.047908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Creating event network-changed:469b0955-91d5-4c75-9ccd-c35f18e4eee8 for instance 450afbb0-432d-4f96-809c-d4c8469433e7 on n-h1-master-1 Aug 21 01:06:57.048390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:06:57.048890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fad420b6-0d71-4c65-a193-741d6fe4064a req-7dc50c98-6b60-4f06-935c-c17f8b8ab424 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:06:57.050170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:57.050625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:57.051078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:57.051754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:57.069692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:57.070410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:57.106540 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.rpcapi [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 21 01:06:57.108746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] Releasing lock "compute-rpcapi-router" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:06:57.175909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8df3c745-2953-4158-96f8-599e19c2333d None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.926656 Aug 21 01:06:57.179575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 84/125] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:06:57.235122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:57.244719 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05cdbbc2-842d-4a03-b48f-f05bb2199c3c tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.966474 Aug 21 01:06:57.249267 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 42/126] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:56 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:58.278309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:58.279649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:58.297004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:58.301327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:58.304893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:58.308842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:58.312471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:58.317518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:58.791877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:06:58.806666 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d46fbc55-d489-49ef-ba98-fafb793c2753 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.533838 Aug 21 01:06:58.810885 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 85/127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:58 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:06:59.820556 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=18 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:59.836444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:06:59.837362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:06:59.851958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:59.852541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:59.855293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:06:59.857145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:06:59.859035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:06:59.859748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:00.181666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:00.195526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23def41c-c74e-4a76-b9cf-0dd21ffa318e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.365431 Aug 21 01:07:00.213199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 86/128] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:06:59 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:00.364413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1942333304", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:00.493881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:00.852491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:00.853198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:00.853602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:00.854005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:00.855159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:00.870606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:00.871382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:00.872663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:00.873763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:00.874575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:00.875418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:00.921659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Getting quotas for project aa388d025cac48ada2e632d0df0b4cad. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:00.926897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Getting quotas for user 22500a157cbb43eab8e92270d59a2f2a and project aa388d025cac48ada2e632d0df0b4cad. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:00.969005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:00.974712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:01.103775 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76da5829-ffb1-4c36-afe1-852636d7f811 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285998 Aug 21 01:07:01.107754 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 43/129] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:07:01.118784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e95f987-4519-470e-8e00-2a71afae0695 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:01.119495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e95f987-4519-470e-8e00-2a71afae0695 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:01.123511 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:01.219499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:01.220845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:01.240686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:01.252004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:01.252470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:01.253251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:01.253707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:01.254123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:01.380460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e95f987-4519-470e-8e00-2a71afae0695 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:01.408406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e95f987-4519-470e-8e00-2a71afae0695 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1219 microversion: 2.1 time: 0.292004 Aug 21 01:07:01.414738 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 87/130] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:01 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1219 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:01.803865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:01.814394 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1c2459b-a723-44ca-8bce-a59b56bdeacf tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.597127 Aug 21 01:07:01.825367 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 44/131] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:01 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:02.212518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Calling method '.version_select at 0x7fc3fab39940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:02.214170 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:02.214170 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:02.223383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122482) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 21 01:07:02.226760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.227827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.229367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.283758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.289099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.292393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.335598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.336091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.336520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.352538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e7cf02f-6287-4ff1-9733-d9688099a84f tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.366703 Aug 21 01:07:02.363326 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 88/132] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:07:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:02.370176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Calling method '.version_select at 0x7fc3fecc4d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:02.371597 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:02.371597 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:02.373611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.374253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.375247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.428543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.430608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.432054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.437049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f97fb7d0-7c64-404e-8a27-3e9ad635dae2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:02.437927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f97fb7d0-7c64-404e-8a27-3e9ad635dae2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:02.452329 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-388a2349-d210-42e7-a1da-79fdfffd31c0 tempest-HypervisorAdminV228Test-340858454 tempest-HypervisorAdminV228Test-340858454-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.091548 Aug 21 01:07:02.463366 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 45/133] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 01:07:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:07:02.619916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f97fb7d0-7c64-404e-8a27-3e9ad635dae2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:02.636117 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f97fb7d0-7c64-404e-8a27-3e9ad635dae2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1219 microversion: 2.1 time: 0.203665 Aug 21 01:07:02.643401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 89/134] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:02 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:02.836530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:02.837377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:02.850925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.851403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.851794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:02.852712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:02.853369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:02.853964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:03.323229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:03.335432 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd0404cb-9b51-4691-9036-e5dbc9fcf73b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.502165 Aug 21 01:07:03.339721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 46/135] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:02 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:03.658338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:03.658965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:03.674712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:03.676890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:03.678932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:03.682706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:03.683536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:03.684350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:03.840576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:03.851840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e178faf-399c-42bb-9c7d-78db65148d61 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1271 microversion: 2.1 time: 0.197446 Aug 21 01:07:03.865278 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 90/136] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:03 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:04.357264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:04.359527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:04.369964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:04.372352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:04.374956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:04.376026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:04.378036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:04.378466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:04.713140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:04.722544 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38c831af-770e-49f6-8a41-527adadec758 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.369417 Aug 21 01:07:04.723761 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 47/137] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:04 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:04.876063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:04.877202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:04.885682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:04.886164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:04.899289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:04.900050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:04.900684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:04.903750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:05.043329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:05.057121 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40c67009-bf75-4604-9dd2-bba8d4e22e51 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.185216 Aug 21 01:07:05.057709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 91/138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:04 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:05.581758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac7a52bd-5f4a-43fa-9728-84b3a27d9a09 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-969172196", "ram": 512, "vcpus": 1, "disk": 10, "id": 682921575, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:05.585035 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:05.585035 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:05.619677 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ac7a52bd-5f4a-43fa-9728-84b3a27d9a09 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.358225 Aug 21 01:07:05.620290 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 48/139] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:05 2022] POST /compute/v2.1/flavors => generated 412 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:05.749346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:05.749889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:05.762783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:05.763295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:05.763724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:05.764439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:05.767627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:05.768329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:05.888683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af7ff36d-dd96-4577-8f8f-7d35ca245a70 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:05.906884 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-af7ff36d-dd96-4577-8f8f-7d35ca245a70 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] HTTP exception thrown: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af7ff36d-dd96-4577-8f8f-7d35ca245a70 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Request method failure captured: Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYU3m6w1cKPVWSgS7kPGbRaMDHg2VamEwWcRsN1PIA0qmr37eBf26FpuwJuh4XgyCJOci7aVBU6D66mdCUnhfmeO8TbpArqCLknoP9VgyqXRMDeJmf6Upk6K_L0bDRv-cQJmZ-uCyvfWfUh9QDGgHsVIoSQ8Wl2kF92uAP2QO2rxlHQ Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:05.911347 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15476e1aff4949d392ef4f1cd6f43bbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}] Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c4bc3ac4ef7c4c5fa2004e8cfdd83115 Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:05.912754 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: action_args: {'flavor_id': '682921575', 'id': 'hw:cpu_thread_policy'} Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:05.913419 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.914696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af7ff36d-dd96-4577-8f8f-7d35ca245a70 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Returning 404 to user: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:05.915881 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af7ff36d-dd96-4577-8f8f-7d35ca245a70 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] 10.222.0.46 "GET /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.283447 Aug 21 01:07:05.921290 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 92/140] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:07:05 2022] GET /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:05.928559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c446bb9-5463-47fb-a086-1155c09f5166 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:05.934226 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:05.934226 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:05.936635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c446bb9-5463-47fb-a086-1155c09f5166 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15476e1aff4949d392ef4f1cd6f43bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c446bb9-5463-47fb-a086-1155c09f5166 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Request method failure captured: Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/flavors/682921575/os-extra_specs HTTP/1.1 Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 66 Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYU3m6w1cKPVWSgS7kPGbRaMDHg2VamEwWcRsN1PIA0qmr37eBf26FpuwJuh4XgyCJOci7aVBU6D66mdCUnhfmeO8TbpArqCLknoP9VgyqXRMDeJmf6Upk6K_L0bDRv-cQJmZ-uCyvfWfUh9QDGgHsVIoSQ8Wl2kF92uAP2QO2rxlHQ Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:05.944219 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15476e1aff4949d392ef4f1cd6f43bbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}] Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c4bc3ac4ef7c4c5fa2004e8cfdd83115 Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 21 01:07:05.945610 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: action_args: {'flavor_id': '682921575', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:05.946236 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 21 01:07:05.947324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:05.948359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c446bb9-5463-47fb-a086-1155c09f5166 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:05.948860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c446bb9-5463-47fb-a086-1155c09f5166 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] 10.222.0.46 "POST /compute/v2.1/flavors/682921575/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025258 Aug 21 01:07:05.955189 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 93/141] 10.222.0.46 () {60 vars in 1221 bytes} [Sun Aug 21 01:07:05 2022] POST /compute/v2.1/flavors/682921575/os-extra_specs => generated 124 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:05.962170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb6342b2-5e5b-44af-abba-2d781a1c6040 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:06.038349 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb6342b2-5e5b-44af-abba-2d781a1c6040 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/682921575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079283 Aug 21 01:07:06.046500 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 94/142] 10.222.0.46 () {60 vars in 1221 bytes} [Sun Aug 21 01:07:05 2022] POST /compute/v2.1/flavors/682921575/os-extra_specs => generated 66 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:06.057136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff186019-69e2-42eb-91e2-1d5ff83898bc tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:06.058385 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.058385 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:06.059632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff186019-69e2-42eb-91e2-1d5ff83898bc tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15476e1aff4949d392ef4f1cd6f43bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff186019-69e2-42eb-91e2-1d5ff83898bc tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Request method failure captured: Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYU3m6w1cKPVWSgS7kPGbRaMDHg2VamEwWcRsN1PIA0qmr37eBf26FpuwJuh4XgyCJOci7aVBU6D66mdCUnhfmeO8TbpArqCLknoP9VgyqXRMDeJmf6Upk6K_L0bDRv-cQJmZ-uCyvfWfUh9QDGgHsVIoSQ8Wl2kF92uAP2QO2rxlHQ Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:06.069965 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15476e1aff4949d392ef4f1cd6f43bbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}] Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c4bc3ac4ef7c4c5fa2004e8cfdd83115 Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:06.071462 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: action_args: {'flavor_id': '682921575', 'id': 'hw:numa_nodes'} Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:06.072333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 21 01:07:06.073703 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.082194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff186019-69e2-42eb-91e2-1d5ff83898bc tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:06.083393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff186019-69e2-42eb-91e2-1d5ff83898bc tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] 10.222.0.46 "DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035530 Aug 21 01:07:06.091187 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 95/143] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:07:06 2022] DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:06.103709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:06.105660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:06.114160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:06.124865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:06.131608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:06.132266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:06.133313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:06.133918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:06.134588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:06.138831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1bb17a1-6f16-4be5-a978-6b0b638aed1e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.391124 Aug 21 01:07:06.140461 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 49/144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:05 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:06.158635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76342056-eda4-4ad1-82a0-bd0790d8cd4a tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:06.162944 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.162944 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:06.228979 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76342056-eda4-4ad1-82a0-bd0790d8cd4a tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/682921575/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.085027 Aug 21 01:07:06.234638 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 50/145] 10.222.0.46 () {60 vars in 1221 bytes} [Sun Aug 21 01:07:06 2022] POST /compute/v2.1/flavors/682921575/os-extra_specs => generated 66 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:06.247465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a78f9264-398f-4ab4-aade-17eadb9896cf tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:06.254886 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.254886 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:06.256641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a78f9264-398f-4ab4-aade-17eadb9896cf tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c4bc3ac4ef7c4c5fa2004e8cfdd83115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15476e1aff4949d392ef4f1cd6f43bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a78f9264-398f-4ab4-aade-17eadb9896cf tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Request method failure captured: Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 22 Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU3m6w1cKPVWSgS7kPGbRaMDHg2VamEwWcRsN1PIA0qmr37eBf26FpuwJuh4XgyCJOci7aVBU6D66mdCUnhfmeO8TbpArqCLknoP9VgyqXRMDeJmf6Upk6K_L0bDRv-cQJmZ-uCyvfWfUh9QDGgHsVIoSQ8Wl2kF92uAP2QO2rxlHQ Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:06.258738 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_15476e1aff4949d392ef4f1cd6f43bbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/15476e1aff4949d392ef4f1cd6f43bbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/15476e1aff4949d392ef4f1cd6f43bbc"}]}] Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 15476e1aff4949d392ef4f1cd6f43bbc Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c4bc3ac4ef7c4c5fa2004e8cfdd83115 Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: {"hw:numa_nodes": "1"} Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:06.260152 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: action_args: {'flavor_id': '682921575', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:06.260987 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 21 01:07:06.262241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.264412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a78f9264-398f-4ab4-aade-17eadb9896cf tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:06.266301 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a78f9264-398f-4ab4-aade-17eadb9896cf tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386 tempest-FlavorsExtraSpecsNegativeTestJSON-1596090386-project] 10.222.0.46 "PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024516 Aug 21 01:07:06.268081 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 51/146] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:07:06 2022] PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:06.283274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09695e14-129f-40c4-9d52-25e04a82cd02 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:06.283433 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.283433 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:06.293496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:06.301908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ac905b1-aeff-4bb8-a4eb-9b81feede990 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.208964 Aug 21 01:07:06.302485 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 96/147] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:06 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:06.311551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-09695e14-129f-40c4-9d52-25e04a82cd02 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] HTTP exception thrown: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09695e14-129f-40c4-9d52-25e04a82cd02 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Request method failure captured: Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU5eAyQPIijD2LNuWs4c1TGIzAcXKiJ5glq9bThlD3rscPg9kHHiBZ-cQaLsf-lhp_lSDfe-9Y8uFKt6K0z5jbGatBQmyhWbnFcMPq6EnMg9sU_Cp3_Rf9ntex2PkFYlgL_-Z4ZE5V-Whg8aUiXmPbdHYjN8_44ATUVkk46ofs1deo Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:06.313216 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_48cebb60caa745d5ad461530cc84ae5c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}] Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 72038a4480324c5795e55f10fb928b69 Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:06.314633 n-d-master-1 devstack@n-api.service[122483]: exception: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: action_args: {'flavor_id': '682921575', 'id': 'hw:cpu_thread_policy'} Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.315378 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. Aug 21 01:07:06.316501 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.318849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09695e14-129f-40c4-9d52-25e04a82cd02 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Returning 404 to user: Flavor 682921575 has no extra specs with key hw:cpu_thread_policy. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:06.319720 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09695e14-129f-40c4-9d52-25e04a82cd02 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.043952 Aug 21 01:07:06.320518 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 52/148] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:07:06 2022] DELETE /compute/v2.1/flavors/682921575/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:06.331546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-646a0538-8b5e-4967-b1ff-5e9c5d668680 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:06.334131 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.334131 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:06.334935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-646a0538-8b5e-4967-b1ff-5e9c5d668680 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-646a0538-8b5e-4967-b1ff-5e9c5d668680 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Request method failure captured: Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 27 Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYU5eAyQPIijD2LNuWs4c1TGIzAcXKiJ5glq9bThlD3rscPg9kHHiBZ-cQaLsf-lhp_lSDfe-9Y8uFKt6K0z5jbGatBQmyhWbnFcMPq6EnMg9sU_Cp3_Rf9ntex2PkFYlgL_-Z4ZE5V-Whg8aUiXmPbdHYjN8_44ATUVkk46ofs1deo Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:06.336260 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_48cebb60caa745d5ad461530cc84ae5c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}] Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 72038a4480324c5795e55f10fb928b69 Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: {"hw:cpu_policy": "shared"} Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:06.337826 n-d-master-1 devstack@n-api.service[122482]: exception: Request body and URI mismatch Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: action_args: {'flavor_id': '682921575', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.338527 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-646a0538-8b5e-4967-b1ff-5e9c5d668680 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:06.342393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-646a0538-8b5e-4967-b1ff-5e9c5d668680 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011810 Aug 21 01:07:06.349101 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fa504ee-11f5-40a9-bf48-bae01a2bd90c tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:06.350995 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 97/149] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:07:06 2022] PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fa504ee-11f5-40a9-bf48-bae01a2bd90c tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Request method failure captured: Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 49 Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU5eAyQPIijD2LNuWs4c1TGIzAcXKiJ5glq9bThlD3rscPg9kHHiBZ-cQaLsf-lhp_lSDfe-9Y8uFKt6K0z5jbGatBQmyhWbnFcMPq6EnMg9sU_Cp3_Rf9ntex2PkFYlgL_-Z4ZE5V-Whg8aUiXmPbdHYjN8_44ATUVkk46ofs1deo Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:06.358587 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_48cebb60caa745d5ad461530cc84ae5c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/48cebb60caa745d5ad461530cc84ae5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/48cebb60caa745d5ad461530cc84ae5c"}]}] Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 48cebb60caa745d5ad461530cc84ae5c Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 72038a4480324c5795e55f10fb928b69 Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 21 01:07:06.359766 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: action_args: {'flavor_id': '682921575', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance: Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 21 01:07:06.360511 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.362244 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fa504ee-11f5-40a9-bf48-bae01a2bd90c tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:06.363239 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fa504ee-11f5-40a9-bf48-bae01a2bd90c tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017352 Aug 21 01:07:06.364482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 53/150] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:07:06 2022] PUT /compute/v2.1/flavors/682921575/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:07:06.394918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e18c9646-ecd5-4168-86f4-4a69ec7b4d8b tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:06.396568 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:06.396568 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:06.419538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e18c9646-ecd5-4168-86f4-4a69ec7b4d8b tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/682921575" status: 202 len: 0 microversion: 2.1 time: 0.048930 Aug 21 01:07:06.422665 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 98/151] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:07:06 2022] DELETE /compute/v2.1/flavors/682921575 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:07:06.431099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e01e77fa-881c-4b7d-b22e-98c59b8af8af tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:06.444482 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:DELETE=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:06.478409 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e01e77fa-881c-4b7d-b22e-98c59b8af8af tempest-FlavorsExtraSpecsNegativeTestJSON-253022284 tempest-FlavorsExtraSpecsNegativeTestJSON-253022284-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050605 Aug 21 01:07:06.481138 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 54/152] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:07.162175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:07.162728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:07.174260 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:07.181760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:07.182333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:07.185812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:07.186668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:07.187478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:07.187906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:07.324143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:07.324884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:07.340899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:07.341598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:07.342146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:07.342922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:07.343569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:07.344284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:07.498278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:07.503132 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:07.514750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-532693cb-8db3-4fb1-bf33-0a778a45986d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.194409 Aug 21 01:07:07.516132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 55/153] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:07 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:07.605411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:07.644906 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61a6a045-4126-40e8-887d-6689f196c2b9 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.487205 Aug 21 01:07:07.668197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 99/154] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:07 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:08.557049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Calling method '.version_select at 0x7fc3fec39ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:08.557700 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:08.557700 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:08.558737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.559204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.559628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.578677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.579064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.580094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.597759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.598526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.599092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.605891 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93bee0f8-020e-4763-992d-0b29a66dd9c3 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.453649 Aug 21 01:07:08.613347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450afbb0-432d-4f96-809c-d4c8469433e7", "name": "network-vif-plugged", "status": "completed", "tag": "469b0955-91d5-4c75-9ccd-c35f18e4eee8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:08.619476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 56/155] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:08.631245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:08.632021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:08.635181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.635826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.636473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.645759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.646479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.647181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.648370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.649171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.650800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.654846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] Creating event network-vif-plugged:469b0955-91d5-4c75-9ccd-c35f18e4eee8 for instance 450afbb0-432d-4f96-809c-d4c8469433e7 on n-h1-master-1 Aug 21 01:07:08.667662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5d453053-ff72-481c-a03a-f8b7e8757914 req-2e236085-944c-409c-88d3-18cf2766fb2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140032 Aug 21 01:07:08.671105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 100/156] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:08.816941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:08.826812 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5abaf329-1a7e-474a-8cae-e912029a772d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.206074 Aug 21 01:07:08.835639 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 57/157] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:08 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:08.842997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:08.844277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:08.854108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.854891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.855454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:08.856742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:08.857582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:08.858723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.057377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09585782-cfb2-4aab-aab7-82f277992d03 tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Calling method '.version_select at 0x7fc3fab368b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.058242 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:09.058242 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:09.060755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-09585782-cfb2-4aab-aab7-82f277992d03 tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3e42e5d5c3384acda7fb872e35a918e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1d812cc34240d8995ecd6dd936e3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09585782-cfb2-4aab-aab7-82f277992d03 tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Request method failure captured: Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYU64QFmKMR2CVNszn1ssSwKlJF5CsLLZN0L8GG3uHsUNkKGFQmv6JDzQIUy8dMz3ubuh7eTTY3NaDT_CH296ihl1_AVnKNjmxc-b89E8tFMzs_0cmFpILPcCXgEdw-6RTqFbZG3SmIHGdW2Wy7uRSvSIuN_FlyvRFNOMiqtng1oYcQ Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 3e1d812cc34240d8995ecd6dd936e3cb Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:09.062911 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e1d812cc34240d8995ecd6dd936e3cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e1d812cc34240d8995ecd6dd936e3cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e1d812cc34240d8995ecd6dd936e3cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e1d812cc34240d8995ecd6dd936e3cb"}]}] Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 3e1d812cc34240d8995ecd6dd936e3cb Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-720234467-project Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 3e42e5d5c3384acda7fb872e35a918e2 Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467-project Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 21 01:07:09.064447 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'n-h1-master-1'} Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:09.065118 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 21 01:07:09.066485 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.068175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09585782-cfb2-4aab-aab7-82f277992d03 tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:09.068175 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09585782-cfb2-4aab-aab7-82f277992d03 tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.391875 Aug 21 01:07:09.069832 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 101/158] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:07:08 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:09.170258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:09.181652 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dfeba5cb-be27-466e-94cd-3acb5c32b506 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.352583 Aug 21 01:07:09.182734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 58/159] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:08 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:09.199901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Calling method '.version_select at 0x7fc3fec6f940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.200752 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:09.200752 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:09.202127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.202872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.203204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.218949 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Request method failure captured: Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU8WrhGKFk-t2YyO1NJzWiFwk2m1h5AArOE4dhqsTcp6Mtt0Y2I5Bt6-LDCk3UGM-fyMq9x5vqYA6mwXI0SMKbMb-XCIidRhNe4ILgI11lqUyN4kmcuBTi3Xe0mR5uZrGmqtcXzknSGoKXpY1V0kkwnqmAxspKBuYGuEMSD2LNSN-0 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f20051e18286402b8f75acb97060dd77 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:09.221216 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f20051e18286402b8f75acb97060dd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f20051e18286402b8f75acb97060dd77", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f20051e18286402b8f75acb97060dd77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f20051e18286402b8f75acb97060dd77"}]}] Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f20051e18286402b8f75acb97060dd77 Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7e6dcdc432d94f469d1d6d78495f8ca3 Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 21 01:07:09.222577 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.223344 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b19430d-8407-4752-bde5-803446e8c9c6 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.035928 Aug 21 01:07:09.224568 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 59/160] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:09.233540 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Calling method '.version_select at 0x7fc3fec6f700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.234332 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:09.234332 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:09.235484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.239278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.239731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.262085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.262611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.263056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.266096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0363af4c-255e-4bfc-bfde-7e44b200e65a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.275016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.275494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.275924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.280700 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0363af4c-255e-4bfc-bfde-7e44b200e65a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.209420 Aug 21 01:07:09.282521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3bc98f7-d318-43bb-8352-c71e20126fb9 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052410 Aug 21 01:07:09.283768 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 60/161] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:09.293823 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 102/162] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:09.294000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dd66bd9-3f5c-4315-8e57-ce22267f225e tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Calling method '.version_select at 0x7fc3fec6f3a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.294768 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:09.294768 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:09.295832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4dd66bd9-3f5c-4315-8e57-ce22267f225e tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3e42e5d5c3384acda7fb872e35a918e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1d812cc34240d8995ecd6dd936e3cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dd66bd9-3f5c-4315-8e57-ce22267f225e tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Request method failure captured: Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU64QFmKMR2CVNszn1ssSwKlJF5CsLLZN0L8GG3uHsUNkKGFQmv6JDzQIUy8dMz3ubuh7eTTY3NaDT_CH296ihl1_AVnKNjmxc-b89E8tFMzs_0cmFpILPcCXgEdw-6RTqFbZG3SmIHGdW2Wy7uRSvSIuN_FlyvRFNOMiqtng1oYcQ Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 3e1d812cc34240d8995ecd6dd936e3cb Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:09.299942 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e1d812cc34240d8995ecd6dd936e3cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e1d812cc34240d8995ecd6dd936e3cb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e1d812cc34240d8995ecd6dd936e3cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e1d812cc34240d8995ecd6dd936e3cb"}]}] Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 3e1d812cc34240d8995ecd6dd936e3cb Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467 Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-720234467-project Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3e42e5d5c3384acda7fb872e35a918e2 Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-720234467-project Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 21 01:07:09.301488 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '1'} Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:09.302168 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 21 01:07:09.303169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.304499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dd66bd9-3f5c-4315-8e57-ce22267f225e tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:09.304499 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4dd66bd9-3f5c-4315-8e57-ce22267f225e tempest-HypervisorAdminNegativeUnderV252Test-720234467 tempest-HypervisorAdminNegativeUnderV252Test-720234467-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012636 Aug 21 01:07:09.304499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 61/163] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:07:09.313893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Calling method '.version_select at 0x7fc3feb96280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.315726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.316204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.316686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.325772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] HTTP exception thrown: No hypervisor matching 'a45680bb-9ca4-4135-9505-35ca3da668a2' could be found. Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Request method failure captured: Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/a45680bb-9ca4-4135-9505-35ca3da668a2/servers HTTP/1.1 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYU8WrhGKFk-t2YyO1NJzWiFwk2m1h5AArOE4dhqsTcp6Mtt0Y2I5Bt6-LDCk3UGM-fyMq9x5vqYA6mwXI0SMKbMb-XCIidRhNe4ILgI11lqUyN4kmcuBTi3Xe0mR5uZrGmqtcXzknSGoKXpY1V0kkwnqmAxspKBuYGuEMSD2LNSN-0 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f20051e18286402b8f75acb97060dd77 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:09.327760 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f20051e18286402b8f75acb97060dd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f20051e18286402b8f75acb97060dd77", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f20051e18286402b8f75acb97060dd77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f20051e18286402b8f75acb97060dd77"}]}] Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f20051e18286402b8f75acb97060dd77 Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719 Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7e6dcdc432d94f469d1d6d78495f8ca3 Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: exception: No hypervisor matching 'a45680bb-9ca4-4135-9505-35ca3da668a2' could be found. Aug 21 01:07:09.329557 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a45680bb-9ca4-4135-9505-35ca3da668a2'} Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a45680bb-9ca4-4135-9505-35ca3da668a2' could be found. Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.331230 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a45680bb-9ca4-4135-9505-35ca3da668a2' could be found. Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] Returning 404 to user: No hypervisor matching 'a45680bb-9ca4-4135-9505-35ca3da668a2' could be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80b8edf6-b991-4ab4-bce9-8f4264f1ff37 tempest-HypervisorAdminNegativeUnderV252Test-1150797719 tempest-HypervisorAdminNegativeUnderV252Test-1150797719-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/a45680bb-9ca4-4135-9505-35ca3da668a2/servers" status: 404 len: 123 microversion: 2.1 time: 0.019380 Aug 21 01:07:09.332214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 62/164] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/os-hypervisors/a45680bb-9ca4-4135-9505-35ca3da668a2/servers => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:07:09.456509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-486a019c-2820-4741-b45e-d125b02c236c tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-631823761", "id": 1816049612, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:09.463328 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:09.463328 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:09.492519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-486a019c-2820-4741-b45e-d125b02c236c tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.183527 Aug 21 01:07:09.499748 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 103/165] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:09 2022] POST /compute/v2.1/flavors => generated 424 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:09.505747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dbc7c385-ce12-4ea2-82b0-ae76cb422a15 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.516053 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dbc7c385-ce12-4ea2-82b0-ae76cb422a15 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014239 Aug 21 01:07:09.522589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 63/166] 10.222.0.46 () {58 vars in 1182 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:09.528819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71757acb-a05a-44d8-901c-54c89fc70df1 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-500736014", "id": 778805818, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:09.555401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71757acb-a05a-44d8-901c-54c89fc70df1 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.031865 Aug 21 01:07:09.555718 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 104/167] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:09 2022] POST /compute/v2.1/flavors => generated 421 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:09.570527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62bcacf6-d708-4713-a6a7-9b916d83393f tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.583195 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62bcacf6-d708-4713-a6a7-9b916d83393f tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019474 Aug 21 01:07:09.584122 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 64/168] 10.222.0.46 () {58 vars in 1182 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:09.599246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e2f34ce-d895-4da6-a2c9-0c6a6e3ca005 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Action: 'create', calling method: .version_select at 0x7fc3fab34280>, body: {"keypair": {"name": "tempest-keypair-1473760196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJFYnLjtu/Onq3/q2ey9JSRsFwwrFoB9JActLXjtzk3gxHquS0m4mZsgw06RZBlyFG3S7ed3DWn1iFyyPQaCoGqCCHETdJ9krelhCYjVo4Ygw0v6FKQY5HqY8UeLN8G8Q=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:09.637577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5e2f34ce-d895-4da6-a2c9-0c6a6e3ca005 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for project c81f6af23f174318870b6ef8633f5cf3. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:09.646494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5e2f34ce-d895-4da6-a2c9-0c6a6e3ca005 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for user 52db969e85344bb6a40150cedc205df8 and project c81f6af23f174318870b6ef8633f5cf3. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:09.679739 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5e2f34ce-d895-4da6-a2c9-0c6a6e3ca005 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084765 Aug 21 01:07:09.680656 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 105/169] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:07:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:09.849812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:09.850474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:09.861450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.863119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.863518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:09.864169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:09.864699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:09.865224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:10.002069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:10.026626 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5c402fc5-2dbb-4f60-ae8c-c43f045a7ebe tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.181391 Aug 21 01:07:10.029139 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 65/170] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:09 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:10.212475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:10.214783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:10.229181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:10.230262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:10.231223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:10.232667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:10.233711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:10.234694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:10.280306 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=55 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:10.552650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:10.562061 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d973ae99-12ac-4bd6-9e3f-777f6f5af347 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1338 microversion: 2.1 time: 0.358212 Aug 21 01:07:10.565951 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 106/171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:10 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:11.047617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:11.049003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:11.051186 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:11.052137 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:11.067598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.068399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.070309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:11.071318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.077363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.078162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:11.212740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:11.234932 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9deb2b32-37c5-4165-9c0e-460ed2273026 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.182798 Aug 21 01:07:11.235770 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 66/172] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:11 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:11.588898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:11.590215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:11.597364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.598012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.598630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:11.599332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.599773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.600594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:11.809892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:11.820390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06ea1e3a-3d92-45d4-9b75-9214447a44e8 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1487 microversion: 2.1 time: 0.234983 Aug 21 01:07:11.821499 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 107/173] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:11 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1487 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:11.848932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:11.850323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:11.862173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.862989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.863648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:11.864373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:11.864842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:11.865267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.125289 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fec6f040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.126151 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:12.126151 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:12.127233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.127924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.128494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.146245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.146958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.147529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.159765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.160249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.160702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.170825 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e28952e-a43b-488f-936a-db40bca2c62b tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.425691 Aug 21 01:07:12.171920 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 67/174] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:12.178289 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1224984138", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "778805818", "adminPass": "***", "networks": [{"uuid": "38022af8-b00a-4407-8953-c3cf46d57e62"}], "security_groups": [{"name": "tempest-securitygroup--880624571"}], "key_name": "tempest-keypair-1473760196", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:12.320389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b36e0bc-4691-48c9-8a21-fb7e9b42d61d tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1638 microversion: 2.1 time: 0.476270 Aug 21 01:07:12.333562 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 108/175] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:11 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1638 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:12.339138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] validate_networks() for [('38022af8-b00a-4407-8953-c3cf46d57e62', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:12.344215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3faa6dd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.345215 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:12.345215 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:12.346616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.347288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.347806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.367872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.369299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.370070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.384623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.385455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.386145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.394054 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbafc09a-f79e-44ba-9080-58bfa928409d tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.058919 Aug 21 01:07:12.395283 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 109/176] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:07:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:12.400408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.401417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:12.410938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.411626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.412196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.413098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.413702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.414254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.498904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:12.507972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c266bb70-0457-4955-8387-fa7d9dec02e1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.111477 Aug 21 01:07:12.508685 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 110/177] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:12 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:12.514273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.514961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:12.521341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.521975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.522562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.523397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.523939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.524518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.553004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:07:12.704623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-132975c2-7be9-4988-a6fe-94a8c2b3988b tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "DELETE /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 204 len: 0 microversion: 2.1 time: 0.194359 Aug 21 01:07:12.706411 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 111/178] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:07:12 2022] DELETE /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:07:12.714878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fae20ca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.716271 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:12.716271 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:12.719115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.720022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.735693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.771683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.772358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.772996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.797194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.797778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.798209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.815366 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3f50d2b-992e-4037-a4f2-28372e351be0 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.107456 Aug 21 01:07:12.817444 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 112/179] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:12.835417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:12.836538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:12.843046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.843987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.844684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:12.845693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:12.846354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:12.846919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.125074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:13.148576 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43a5a55e-d927-44d1-b664-5ca6c133b0ea tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1493 microversion: 2.1 time: 0.328978 Aug 21 01:07:13.149205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 113/180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:12 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1493 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:13.168451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fa9e9670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.169898 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.169898 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:13.171221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.171773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.172384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.203123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.205010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.206914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.216337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f03b101f-6e19-4ab1-9826-dcbbe7924338 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.051604 Aug 21 01:07:13.217413 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 114/181] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.233774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89cf4abd-87cd-41a9-a995-4d14615877fa tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fa9e9e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.234456 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.234456 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:13.236834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89cf4abd-87cd-41a9-a995-4d14615877fa tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.237474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89cf4abd-87cd-41a9-a995-4d14615877fa tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.238983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89cf4abd-87cd-41a9-a995-4d14615877fa tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.268939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89cf4abd-87cd-41a9-a995-4d14615877fa tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.039110 Aug 21 01:07:13.270077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 115/182] 10.222.0.46 () {58 vars in 1179 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.295194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fa9e93a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.296061 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.296061 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:13.299600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.300088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.300679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.334683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.335165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.335902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.372579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.373205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.373639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.388681 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae892c3e-08f2-43f8-8c79-357ddb99fb89 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109141 Aug 21 01:07:13.392539 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 116/183] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.403660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fa9e9820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.405743 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.405743 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:13.407299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.407935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.408813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.427065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.427800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.429553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.438470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7fb3516-2d1d-4fb2-93a4-6575cc621585 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039099 Aug 21 01:07:13.439622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 117/184] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.455011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fa9e9940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.456282 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.456282 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:13.457689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.458338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.459253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.464164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:13.464798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:13.465092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:13.465486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:13.466010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:13.480652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.481859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.482285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.483000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.483438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.487971 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:13.489493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.495721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.496196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.496622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.519738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c32c875-8993-4bba-b55f-2548961dde86 tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.069066 Aug 21 01:07:13.530405 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 118/185] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.532499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for project c81f6af23f174318870b6ef8633f5cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:13.536733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.537671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:13.538879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for user 52db969e85344bb6a40150cedc205df8 and project c81f6af23f174318870b6ef8633f5cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:13.558047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:13.559957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.560494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.560968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.561877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:13.563432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.564368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.564801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.647118 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05cfde01-b0e9-4df9-9ed0-c7c9378aecb5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.473922 Aug 21 01:07:13.648698 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 68/186] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:07:13.655611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Calling method '.version_select at 0x7fc3fec6f0d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.656524 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:13.656524 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:13.657795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.658281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.658714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.682581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.683357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.683788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.685523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:13.693830 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af16a8b6-42ce-4765-97d0-9bf5bc064a34 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1277 microversion: 2.1 time: 0.162244 Aug 21 01:07:13.697659 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 119/187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:13.702205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25e4fe97-d6cc-4eb2-b998-82f250580dc2 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:13.702799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25e4fe97-d6cc-4eb2-b998-82f250580dc2 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:13.711732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.712389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.714953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.722416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:07:13.722880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46e9752a-3a4e-4631-aef3-8f539f86941e tempest-HypervisorAdminTestJSON-1872729335 tempest-HypervisorAdminTestJSON-1872729335-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:07:13.724092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.725998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.726577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.729219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:13.729878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:13.731317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:13.750228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.rpcapi [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 21 01:07:13.754372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] Releasing lock "compute-rpcapi-router" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:07:13.802591 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4075ad0b-c16d-4cd7-8201-a84a317e0f52 None None] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.152321 Aug 21 01:07:13.803213 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 69/188] 10.222.0.46 () {58 vars in 1173 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:13.830816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25e4fe97-d6cc-4eb2-b998-82f250580dc2 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:13.840799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25e4fe97-d6cc-4eb2-b998-82f250580dc2 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1263 microversion: 2.1 time: 0.142040 Aug 21 01:07:13.841372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 120/189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:13 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:14.104032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be0c405f-4359-4586-b6f2-6f4f4d2088d8 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] Action: 'create', calling method: .version_select at 0x7fc3feb5f8b0>, body: {"security_group": {"name": "tempest-securitygroup-634742886", "description": "tempest-description-1129877894"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:14.172100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:14.173555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:14.187571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:14.188390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:14.189530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:14.191150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:14.193866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:14.196167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:14.536653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:14.544738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c901da7-a9df-49d3-9d37-5b853b040277 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1493 microversion: 2.1 time: 0.378002 Aug 21 01:07:14.545929 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 121/190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:14 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1493 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:14.715372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:14.715978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:14.723254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:14.724094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:14.724579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:14.725525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:14.726054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:14.727407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:14.950946 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be0c405f-4359-4586-b6f2-6f4f4d2088d8 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.118191 Aug 21 01:07:14.958468 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 70/191] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:07:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:14.969125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:14.971663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:14.994003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:14.996914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:14.997608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:14.998864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:15.001233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:15.002688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:15.123161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:15.152497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:15.161251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93af0fac-93f4-4f8e-94e2-2220cd457491 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1315 microversion: 2.1 time: 0.201313 Aug 21 01:07:15.167183 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 71/192] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:14 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:15.167594 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4eeecb7e-ba75-4797-88c3-76dc79689842 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.455639 Aug 21 01:07:15.173377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa1d79d0-0afb-4a83-a557-844a48d9e065 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] Action: 'create', calling method: .version_select at 0x7fc3fecc4040>, body: {"security_group": {"name": "tempest-securitygroup-669850777", "description": "tempest-description-1023399340"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:15.182934 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 122/193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:14 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:15.253723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450afbb0-432d-4f96-809c-d4c8469433e7", "name": "network-vif-deleted", "tag": "469b0955-91d5-4c75-9ccd-c35f18e4eee8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:15.306544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:15.307063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:15.311418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:15.341859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] Creating event network-vif-deleted:469b0955-91d5-4c75-9ccd-c35f18e4eee8 for instance 450afbb0-432d-4f96-809c-d4c8469433e7 on n-h1-master-1 Aug 21 01:07:15.356128 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-909a1f89-812a-4dd9-9f10-df982237b1ef req-c2b89d58-c59b-4b45-8308-8bbd4fdf3a07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111608 Aug 21 01:07:15.358572 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 123/194] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:15.568092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:15.568816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:15.578782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:15.579326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:15.579899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:15.580898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:15.581374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:15.581792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:15.600830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa1d79d0-0afb-4a83-a557-844a48d9e065 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.432085 Aug 21 01:07:15.601765 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 72/195] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:07:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:15.680749 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:15.715106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:15.716014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:15.716720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:15.717668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lazy-loading 'fault' on Instance uuid 450afbb0-432d-4f96-809c-d4c8469433e7 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:07:15.802636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f83dfdbfecd9420dbc75d1d1dfcb59f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7969fbfe11204268ba47c497448be0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:15.817996 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb885a44-073a-44ca-bca4-4fa3a517821e tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 200 len: 1328 microversion: 2.1 time: 0.254738 Aug 21 01:07:15.823605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 124/196] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:15 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 1328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:16.072577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02334a70-94e9-4cb1-b3c8-4adc69c15d55 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] Action: 'create', calling method: .version_select at 0x7fc3feb96790>, body: {"security_group": {"name": "tempest-securitygroup-1195602838", "description": "tempest-description-805009601"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:16.188891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:16.190154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:16.199620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.200588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.201966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.204052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.205640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.206329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.321165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:16.331001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-29b3aef8-e714-4b27-a65a-52ac767914cc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1321 microversion: 2.1 time: 0.146089 Aug 21 01:07:16.331697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 125/197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:16 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:16.337114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:16.337716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:16.352315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.353744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.355525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.357397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.359261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.360999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.638712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02334a70-94e9-4cb1-b3c8-4adc69c15d55 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.028649 Aug 21 01:07:16.639300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 73/198] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:07:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:16.715834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:16.716151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6335189-ef66-469d-9ec9-aae1ebee7701", "tag": "e35a7458-a0bf-44c7-a333-a8265cabbc00"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:16.724605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd4bdba6-5b60-4277-9c1b-fbda0179c4e2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.391667 Aug 21 01:07:16.726031 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 126/199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:16 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:16.731245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ba39ab1-4e73-400c-aec7-db05c424ba19 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] Action: 'create', calling method: .version_select at 0x7fc3fa903550>, body: {"security_group": {"name": "tempest-securitygroup-1309755350", "description": "tempest-description-972788520"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:16.743298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.744021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.744508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.764385 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] Creating event network-changed:e35a7458-a0bf-44c7-a333-a8265cabbc00 for instance c6335189-ef66-469d-9ec9-aae1ebee7701 on n-h2-master-1 Aug 21 01:07:16.770214 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7aa8e077-9f38-4d21-be4d-8d8305c106d8 req-9e794cb8-871e-471f-a765-e2a9743e0a18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129374 Aug 21 01:07:16.770925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 74/200] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:16.846719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:16.847893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:16.854714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.855583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.856239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.857182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.857767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.858575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.874574 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] HTTP exception thrown: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Request method failure captured: Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 HTTP/1.1 Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUdTB5E0cxo-0DWHNqqKJL1qGsXZTEUgvo4o_ub3ERwNwAI8GSvHzQdBf8ZAYjLxChMISw96MN5EscagjH3BEtTvcddX9PmygiTVVh0wXS8rTanl_VvAW80dqjhHpLowe8AU5FoWol58WdLsRFqtjeZjkTuAwX0IAYUb2mqaBhVNoo Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:16.882167 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7969fbfe11204268ba47c497448be0dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}] Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f83dfdbfecd9420dbc75d1d1dfcb59f8 Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:16.883355 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '450afbb0-432d-4f96-809c-d4c8469433e7'} Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:16.884047 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:16.885110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:16.888448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Returning 404 to user: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:16.889712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c2ec981-76eb-40bb-9bbf-212185d8cc72 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 404 len: 111 microversion: 2.1 time: 0.048189 Aug 21 01:07:16.890511 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 75/201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:16 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:16.905851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3ce4c71-e598-4915-af4a-6bfd63668474 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:16.909597 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:16.909597 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:16.922058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c71-e598-4915-af4a-6bfd63668474 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:16.923019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c71-e598-4915-af4a-6bfd63668474 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:16.923681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3ce4c71-e598-4915-af4a-6bfd63668474 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:16.946845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ba39ab1-4e73-400c-aec7-db05c424ba19 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.218972 Aug 21 01:07:16.948106 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 127/202] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:07:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:16.961894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d166899-a9a6-40d5-b631-b33e346244f9 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] Calling method '.version_select at 0x7fc3faa65700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:17.092297 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3ce4c71-e598-4915-af4a-6bfd63668474 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.191186 Aug 21 01:07:17.093749 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 76/203] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:17.109589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e18d3ad2-de85-4c50-9438-34ebc5f40edd tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:17.111193 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:17.111193 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:17.146928 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e18d3ad2-de85-4c50-9438-34ebc5f40edd tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.044793 Aug 21 01:07:17.147551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 77/204] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:17 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:17.165232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3b4a6b8-c7c5-48bc-8209-050a893ef280 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1750564411"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:17.172124 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:17.172124 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:17.173359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-b3b4a6b8-c7c5-48bc-8209-050a893ef280 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid afc1d822-a373-40f7-afb6-72fb2d75d40e for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:17.211251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3b4a6b8-c7c5-48bc-8209-050a893ef280 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052474 Aug 21 01:07:17.212562 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 78/205] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:17.223558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dab38c51-885d-4541-8524-5115f884cdf4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:17.226223 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:17.226223 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:17.236277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab38c51-885d-4541-8524-5115f884cdf4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.236466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab38c51-885d-4541-8524-5115f884cdf4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.237008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab38c51-885d-4541-8524-5115f884cdf4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.377903 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dab38c51-885d-4541-8524-5115f884cdf4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.158432 Aug 21 01:07:17.378642 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 79/206] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:17 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:17.383613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:17.384449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:17.390928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.392504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.393199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.394034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.394549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.395039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.562289 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:17.576731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-74d067b7-eea8-4906-a1a2-414d82e84061 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.192451 Aug 21 01:07:17.577724 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 80/207] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:17 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:17.583557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3ee72-efe7-436d-8834-88e9a01ef0ad", "tag": "fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:17.594596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.595057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.595459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.609188 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] Creating event network-changed:fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea for instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad on n-h2-master-1 Aug 21 01:07:17.615925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6c603223-153a-4735-8acb-379072ec1fe0 req-0aa5b6eb-8cf2-442a-8b2a-e8dcb33f1575 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036661 Aug 21 01:07:17.616931 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 81/208] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:17.623208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ef2da90-5de1-4b36-a95e-efa1af0da436 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:17.624122 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:17.624122 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:17.637618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ef2da90-5de1-4b36-a95e-efa1af0da436 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.019326 Aug 21 01:07:17.638263 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 82/209] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:07:17 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:17.651150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a54b052-56de-487a-83a8-2c129d9e758e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:17.654102 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:17.654102 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:17.663515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a54b052-56de-487a-83a8-2c129d9e758e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.664000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a54b052-56de-487a-83a8-2c129d9e758e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.664436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a54b052-56de-487a-83a8-2c129d9e758e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.823083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a54b052-56de-487a-83a8-2c129d9e758e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.177155 Aug 21 01:07:17.824165 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 83/210] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:17 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:17.830211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:17.833831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:17.840560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.841485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.842062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:17.844715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:17.846491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:17.847085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.016452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:18.025179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63fe1aac-d1e8-4479-b484-36ea8e71a8e6 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.199729 Aug 21 01:07:18.031809 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 84/211] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:17 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:18.037661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a6e08cc-d769-4776-ba2c-43a59ae27b5c tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.038903 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.038903 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.054947 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:18.067203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a6e08cc-d769-4776-ba2c-43a59ae27b5c tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032775 Aug 21 01:07:18.068063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 85/212] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:18 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:18.079656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-902f9372-46e3-40c4-90d8-70fd7eec0f3c tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-314638358"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:18.083484 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.083484 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.084452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-902f9372-46e3-40c4-90d8-70fd7eec0f3c tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 7c7dc4d0-351a-4afd-bfb3-3f473c6a5d9a for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:18.114231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-902f9372-46e3-40c4-90d8-70fd7eec0f3c tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039159 Aug 21 01:07:18.114996 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 86/213] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:18.129985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7735e1d6-3058-4bcc-8ff3-1b7101d57fc1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:18.134766 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.134766 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.146826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7735e1d6-3058-4bcc-8ff3-1b7101d57fc1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:18.147536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7735e1d6-3058-4bcc-8ff3-1b7101d57fc1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:18.147972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7735e1d6-3058-4bcc-8ff3-1b7101d57fc1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.309008 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7735e1d6-3058-4bcc-8ff3-1b7101d57fc1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.186482 Aug 21 01:07:18.310078 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 87/214] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:18.324288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23b71a1c-bb19-4885-8c2f-84538f6cab35 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.325218 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.325218 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.334390 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23b71a1c-bb19-4885-8c2f-84538f6cab35 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.014907 Aug 21 01:07:18.343315 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 88/215] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:07:18 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:18.348519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54912c87-155e-40f4-92ca-deef3259e547 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:18.351898 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.351898 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.360308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54912c87-155e-40f4-92ca-deef3259e547 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:18.360924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54912c87-155e-40f4-92ca-deef3259e547 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:18.361280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54912c87-155e-40f4-92ca-deef3259e547 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.380383 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:18.447767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d166899-a9a6-40d5-b631-b33e346244f9 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8309 microversion: 2.1 time: 1.490276 Aug 21 01:07:18.448956 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 128/216] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:07:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8309 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:18.477666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fce1445a-5d9e-4dda-8fe4-718ac7696b63 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] Calling method '.version_select at 0x7fc3fa903430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.496663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54912c87-155e-40f4-92ca-deef3259e547 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.152592 Aug 21 01:07:18.498203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 89/217] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:18.510555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95c032b1-db6a-402c-8f7b-93bb93f5d095 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.511677 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.511677 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.537068 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95c032b1-db6a-402c-8f7b-93bb93f5d095 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.031284 Aug 21 01:07:18.537998 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 90/218] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:18 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 21 01:07:18.550953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35c69787-bc1a-4635-b641-969a10b9ca44 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-156523883"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:18.553806 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.553806 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.554776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-35c69787-bc1a-4635-b641-969a10b9ca44 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 7db92403-4683-4826-b05c-e385bf233c22 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:18.576407 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35c69787-bc1a-4635-b641-969a10b9ca44 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.029999 Aug 21 01:07:18.580810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 91/219] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:18.596477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0661fa46-fb34-4934-a851-6491e4c941f5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:18.599292 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:18.599292 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:18.609562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0661fa46-fb34-4934-a851-6491e4c941f5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:18.610213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0661fa46-fb34-4934-a851-6491e4c941f5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:18.610671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0661fa46-fb34-4934-a851-6491e4c941f5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.697172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fce1445a-5d9e-4dda-8fe4-718ac7696b63 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.223220 Aug 21 01:07:18.697767 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 129/220] 10.222.0.46 () {58 vars in 1191 bytes} [Sun Aug 21 01:07:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:18.705284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.705389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:18.714186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:18.714677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:18.715290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.716007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:18.716470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:18.716928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:18.743460 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0661fa46-fb34-4934-a851-6491e4c941f5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.153407 Aug 21 01:07:18.744264 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 92/221] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:18 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:18.749168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-994a6689-771e-4dfb-84b8-4551bb51bf70 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] Calling method '.version_select at 0x7fc3feb241f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:18.922945 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-994a6689-771e-4dfb-84b8-4551bb51bf70 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5464b11e-8994-4a69-a0dc-8f0a4ba7ce1c" status: 202 len: 0 microversion: 2.1 time: 0.177213 Aug 21 01:07:18.923881 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 93/222] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:07:18 2022] DELETE /compute/v2.1/os-security-groups/5464b11e-8994-4a69-a0dc-8f0a4ba7ce1c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:07:19.011929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:19.020437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8825898e-2304-4f95-9225-66438bc78421 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.321705 Aug 21 01:07:19.021221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 130/223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:18 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:19.026382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-91e0415b-3cde-4205-8d35-8a185255f9a6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:19.029665 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.029665 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.038334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91e0415b-3cde-4205-8d35-8a185255f9a6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.038913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91e0415b-3cde-4205-8d35-8a185255f9a6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.039412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91e0415b-3cde-4205-8d35-8a185255f9a6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.061526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Calling method '.version_select at 0x7fc3feb96790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.062380 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.062380 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:19.063492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.063962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.064389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.078021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.078488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.079261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.090144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.090692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.091112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.098091 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11e50d6e-e090-4f54-a705-77f246bed431 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.172981 Aug 21 01:07:19.098846 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 94/224] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.102896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bd4d2a0-c651-4175-b0d6-3bab60acd4f2 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] Calling method '.version_select at 0x7fc3feb96e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.274646 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bd4d2a0-c651-4175-b0d6-3bab60acd4f2 tempest-SecurityGroupsTestAdminJSON-750586578 tempest-SecurityGroupsTestAdminJSON-750586578-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/1bb874f3-48ca-45dd-8ea5-701fc77af2d5" status: 202 len: 0 microversion: 2.1 time: 0.174673 Aug 21 01:07:19.277646 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 95/225] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-security-groups/1bb874f3-48ca-45dd-8ea5-701fc77af2d5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:07:19.286597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.287941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:19.298405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.298970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.299415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.300129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.300580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.301026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.387379 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-91e0415b-3cde-4205-8d35-8a185255f9a6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.365111 Aug 21 01:07:19.387950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 131/226] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.393114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Calling method '.version_select at 0x7fc3faa6d670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.393969 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.393969 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.394970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.395440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.395859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.418305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.418791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.419221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.442060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:19.451060 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf4b82dc-fb18-4ecf-a9ee-f82b897a225d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.171720 Aug 21 01:07:19.451876 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 96/227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:19.458155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6bc859f-a431-4e5f-8b3d-4c83bf1d2d39 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] Calling method '.version_select at 0x7fc3feb570d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.603985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.604564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.604658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.612714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93426195-e4fc-41fa-a0b7-59b016b9c41f tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.222835 Aug 21 01:07:19.613084 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 132/228] 10.222.0.46 () {58 vars in 1212 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 104 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.619040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b0815fb-47b8-4717-80ad-b843dcca7798 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.619833 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.619833 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.644967 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b0815fb-47b8-4717-80ad-b843dcca7798 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.030679 Aug 21 01:07:19.645904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 133/229] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:19.653493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Calling method '.version_select at 0x7fc3fa903ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.655737 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.655737 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.657031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.658158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.658736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.673754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.674238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.674667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.685622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.686100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.686526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.694419 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95046b86-ea44-49d0-84e1-92f7597dc123 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047321 Aug 21 01:07:19.694948 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 134/230] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.705438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b0b596a-d67f-46b5-ab3e-535ecddd8de5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1135688726"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:19.709125 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.709125 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.710724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-8b0b596a-d67f-46b5-ab3e-535ecddd8de5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 859ebb76-bac3-4fbf-bbe8-c9d6ddf7b16d for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:19.745288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b0b596a-d67f-46b5-ab3e-535ecddd8de5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048531 Aug 21 01:07:19.745896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 135/231] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.750528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc3fa8c8700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.753491 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.753491 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.754875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.755507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.755934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.756889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.757337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.757919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.794920 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd99cc2f-7b5d-4a95-8e41-242e8b9faa8f tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.047755 Aug 21 01:07:19.795675 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 136/232] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.801293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Calling method '.version_select at 0x7fc3fa8ebb80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.802271 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.802271 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.803540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.804795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.805276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.817864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.818341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.818771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.825321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e192665-b7db-4567-bf30-e5cb08230c16 tempest-HypervisorAdminUnderV252Test-1841708205 tempest-HypervisorAdminUnderV252Test-1841708205-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.028512 Aug 21 01:07:19.826421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 137/233] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.833974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b984f1a6-89f1-48d8-a61f-22dfad1d34b7 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.834787 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.834787 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.860385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b984f1a6-89f1-48d8-a61f-22dfad1d34b7 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032599 Aug 21 01:07:19.861681 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 138/234] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:19.869657 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc3fab360d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.872230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6bc859f-a431-4e5f-8b3d-4c83bf1d2d39 tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/548c4b1a-57dc-4dfb-9498-8dc69bc436da" status: 202 len: 0 microversion: 2.1 time: 0.419451 Aug 21 01:07:19.872779 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.872779 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.874348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.875163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.875805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.877489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.878097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.878668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.880361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 97/235] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-security-groups/548c4b1a-57dc-4dfb-9498-8dc69bc436da => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:07:19.885827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5544593f-dda3-4425-a22a-fded1f260495 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.886749 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.886749 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:19.903325 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-5544593f-dda3-4425-a22a-fded1f260495 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5544593f-dda3-4425-a22a-fded1f260495 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Request method failure captured: Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUgktnthPqMD1SHMxFnSDTcTe3ACUc0o7e6v_S_q4v_BfgHOzOKnlpJlBbgByIaLZUcVayDOS7cCRdg-Xi13K2pIKYgOAGLB6Ti6MM9n8a_P794BL1e8x_Nt4z19rA7QtR1lsym1W8hNyuZSFAdxEHI4eFXIVrsMxqZ54joJxf-slA Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:19.911760 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ba8597f8fa994c60b4eb65f99799c313", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}] Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 5f0e210ad13e4a8988a425d272f3f6b8 Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: exception: Aggregate 5 could not be found. Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5'} Aug 21 01:07:19.913264 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.914145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.915394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5544593f-dda3-4425-a22a-fded1f260495 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:19.916703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5544593f-dda3-4425-a22a-fded1f260495 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032434 Aug 21 01:07:19.920582 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 98/236] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:19.923103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f87fbda-ed1b-4ee8-95a6-7ed1eefd834d tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.060009 Aug 21 01:07:19.923885 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 139/237] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:19.928810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9210efa5-5708-4993-84fa-2e3bf3dc45ec tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.929873 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.929873 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.937377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3cb039c-6a76-44c9-acee-54f972010a9b tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] Calling method '.version_select at 0x7fc3feb63310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.941494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9210efa5-5708-4993-84fa-2e3bf3dc45ec tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9210efa5-5708-4993-84fa-2e3bf3dc45ec tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Request method failure captured: Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUgktnthPqMD1SHMxFnSDTcTe3ACUc0o7e6v_S_q4v_BfgHOzOKnlpJlBbgByIaLZUcVayDOS7cCRdg-Xi13K2pIKYgOAGLB6Ti6MM9n8a_P794BL1e8x_Nt4z19rA7QtR1lsym1W8hNyuZSFAdxEHI4eFXIVrsMxqZ54joJxf-slA Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:19.945929 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ba8597f8fa994c60b4eb65f99799c313", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}] Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 5f0e210ad13e4a8988a425d272f3f6b8 Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: exception: Aggregate 5 could not be found. Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5'} Aug 21 01:07:19.947366 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:19.948224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:19.949720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:19.951030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:19.951030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:19.951030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:19.951030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 21 01:07:19.951030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:19.952698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9210efa5-5708-4993-84fa-2e3bf3dc45ec tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:19.953756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9210efa5-5708-4993-84fa-2e3bf3dc45ec tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.028781 Aug 21 01:07:19.954602 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 140/238] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:19.962392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc3fa903790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:19.966190 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:19.966190 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:19.968235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.969192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.969656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:19.970394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:19.971675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:19.972103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.012588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c5d42c6-5e4c-48e1-ac44-0f581752a03b tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.055555 Aug 21 01:07:20.013478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 141/239] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:07:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.023757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87e0ac72-e55d-4cbe-b9ab-7150e3f19b5e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-586647155", "name": "tempest-test_aggregate-574927618"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.027905 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.027905 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.028978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-87e0ac72-e55d-4cbe-b9ab-7150e3f19b5e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid e2d4de3e-d4f6-4040-9f06-40c9f6cf546a for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:20.070909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87e0ac72-e55d-4cbe-b9ab-7150e3f19b5e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.055366 Aug 21 01:07:20.077042 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 142/240] 10.222.0.46 () {60 vars in 1165 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.088755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86214937-5713-4036-a0c2-dd21916a0132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-268455475"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.091684 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.091684 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.093044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-86214937-5713-4036-a0c2-dd21916a0132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 22d75cc0-f712-4f31-8492-16da3ea35362 for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:20.119636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86214937-5713-4036-a0c2-dd21916a0132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040482 Aug 21 01:07:20.126645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 143/241] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.132879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc3fa8c8c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.139178 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.139178 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.146711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.147200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.147632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.165175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.165666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.166106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.175082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f6fb620-8564-4885-af07-1da250080840 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 332 microversion: 2.1 time: 0.052892 Aug 21 01:07:20.180140 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 144/242] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 332 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.185588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.186364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:20.196133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.197299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.198028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.199014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.199696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.200342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.458003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:20.467069 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-82802545-9cbe-4e07-ad3b-5309ff2f2040 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.289833 Aug 21 01:07:20.468702 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 145/243] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:20.474429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-970a2e38-5c8e-4473-9cd7-cb82a680c168 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.475041 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.475041 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.503774 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-970a2e38-5c8e-4473-9cd7-cb82a680c168 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.033512 Aug 21 01:07:20.504689 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 146/244] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:20 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:20.511130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8844a06-9955-436c-995b-745a5f9fe2bd tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.513971 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.513971 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.527747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8844a06-9955-436c-995b-745a5f9fe2bd tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.528591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8844a06-9955-436c-995b-745a5f9fe2bd tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.528827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8844a06-9955-436c-995b-745a5f9fe2bd tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.541709 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3cb039c-6a76-44c9-acee-54f972010a9b tempest-SecurityGroupsTestAdminJSON-680754338 tempest-SecurityGroupsTestAdminJSON-680754338-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6bf563ef-2cc4-46ff-8add-e7422aa0a91e" status: 202 len: 0 microversion: 2.1 time: 0.609828 Aug 21 01:07:20.542805 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 99/245] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:07:19 2022] DELETE /compute/v2.1/os-security-groups/6bf563ef-2cc4-46ff-8add-e7422aa0a91e => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:07:20.548054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Calling method '.version_select at 0x7fc3feb96820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.549425 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.549425 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:20.556282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.557111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.557736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.558180 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:20.574925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.577043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.577602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.636513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f42824a-5fc9-4326-89a5-5f424f8a0c24 tempest-HostsAdminTestJSON-751946846 tempest-HostsAdminTestJSON-751946846-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.092344 Aug 21 01:07:20.637240 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 100/246] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 598 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.648052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.648657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:20.664381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.664618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.665068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.669189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.669805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.670229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.743725 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8844a06-9955-436c-995b-745a5f9fe2bd tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.237907 Aug 21 01:07:20.745400 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 147/247] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.756298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a77a699-51b5-426c-a5c3-48c521ac1a16 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.759482 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.759482 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.772604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6a77a699-51b5-426c-a5c3-48c521ac1a16 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a77a699-51b5-426c-a5c3-48c521ac1a16 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Request method failure captured: Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUgktnthPqMD1SHMxFnSDTcTe3ACUc0o7e6v_S_q4v_BfgHOzOKnlpJlBbgByIaLZUcVayDOS7cCRdg-Xi13K2pIKYgOAGLB6Ti6MM9n8a_P794BL1e8x_Nt4z19rA7QtR1lsym1W8hNyuZSFAdxEHI4eFXIVrsMxqZ54joJxf-slA Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:20.775421 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ba8597f8fa994c60b4eb65f99799c313", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}] Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 5f0e210ad13e4a8988a425d272f3f6b8 Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: exception: Aggregate 6 could not be found. Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6'} Aug 21 01:07:20.776568 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.777357 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.778339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a77a699-51b5-426c-a5c3-48c521ac1a16 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:20.780211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a77a699-51b5-426c-a5c3-48c521ac1a16 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030870 Aug 21 01:07:20.780211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 148/248] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:20.789407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.793076 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.793076 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.809259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.810199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.810199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.843292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-master-1. Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 39 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:20.846532 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: {"add_host": {"host": "n-h1-master-1"}} Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:20.847710 n-d-master-1 devstack@n-api.service[122482]: exception: Aggregate 7 already has host n-h1-master-1. Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:07:20.848525 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi session.flush() Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:07:20.849566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 01:07:20.850551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:07:20.851486 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 21, 1, 7, 20, 833770), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 7}] Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.852445 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-master-1. Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.853330 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-master-1. Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:20.854360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:20.855418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-master-1. Aug 21 01:07:20.855418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.855418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-master-1. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:20.855418 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b84cb49e-7a7d-4ea2-a462-74f9a1f80299 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.071206 Aug 21 01:07:20.857792 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 149/249] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 21 01:07:20.868268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18c2c758-d149-4328-9a18-c6a09e60636e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.869615 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.869615 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.889119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-18c2c758-d149-4328-9a18-c6a09e60636e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18c2c758-d149-4328-9a18-c6a09e60636e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Request method failure captured: Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUgktnthPqMD1SHMxFnSDTcTe3ACUc0o7e6v_S_q4v_BfgHOzOKnlpJlBbgByIaLZUcVayDOS7cCRdg-Xi13K2pIKYgOAGLB6Ti6MM9n8a_P794BL1e8x_Nt4z19rA7QtR1lsym1W8hNyuZSFAdxEHI4eFXIVrsMxqZ54joJxf-slA Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:20.891020 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ba8597f8fa994c60b4eb65f99799c313", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ba8597f8fa994c60b4eb65f99799c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba8597f8fa994c60b4eb65f99799c313"}]}] Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ba8597f8fa994c60b4eb65f99799c313 Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-173667063 Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 5f0e210ad13e4a8988a425d272f3f6b8 Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminTestJSON-173667063-project-admin Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: exception: Aggregate 6 could not be found. Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6'} Aug 21 01:07:20.892219 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:20.892954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:20.894038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18c2c758-d149-4328-9a18-c6a09e60636e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:20.895605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-18c2c758-d149-4328-9a18-c6a09e60636e tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.034002 Aug 21 01:07:20.898379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 150/250] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:20 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:20.908879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85cee4cb-e6cf-4167-a65e-f1553ef866af tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.910496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:20.913854 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.913854 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:20.921093 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39ec337c-ac3d-49b3-a510-622345a581b2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.282523 Aug 21 01:07:20.921691 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 101/251] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:20.926875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65ceffac-8a4c-454e-8a7c-82611e807e12 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-334437903"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:20.930500 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.930500 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:20.931379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-65ceffac-8a4c-454e-8a7c-82611e807e12 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 439a10de-7178-4554-ae46-8d7320f30120 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:20.938380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85cee4cb-e6cf-4167-a65e-f1553ef866af tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:20.939282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85cee4cb-e6cf-4167-a65e-f1553ef866af tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:20.940596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85cee4cb-e6cf-4167-a65e-f1553ef866af tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:20.965429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65ceffac-8a4c-454e-8a7c-82611e807e12 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042573 Aug 21 01:07:20.967677 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 102/252] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:20.978059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7aaf0d5c-2e65-4dc6-b932-83f6669d86a1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:20.978618 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:20.978618 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:20.990628 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7aaf0d5c-2e65-4dc6-b932-83f6669d86a1 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.017281 Aug 21 01:07:21.007013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 103/253] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:07:20 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:21.038310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-294228b7-c72c-4f54-aa8b-8a099f049606 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.040445 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.040445 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.075118 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-294228b7-c72c-4f54-aa8b-8a099f049606 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.053513 Aug 21 01:07:21.075726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 104/254] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.088264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6abfd9d9-e79b-4b65-9244-335d1e77cb40 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.089063 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.089063 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.102114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6abfd9d9-e79b-4b65-9244-335d1e77cb40 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.018135 Aug 21 01:07:21.102789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 105/255] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:07:21 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.116081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ea0baaa-c760-4831-a8b0-59d5b9327ac6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.116932 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.116932 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.146429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ea0baaa-c760-4831-a8b0-59d5b9327ac6 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.035806 Aug 21 01:07:21.147022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 106/256] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:21 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 21 01:07:21.156471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21cf121a-3667-4f03-890f-9f7e2929d5b4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785445007", "availability_zone": "tempest-test_az-1900855226"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.161214 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85cee4cb-e6cf-4167-a65e-f1553ef866af tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.261335 Aug 21 01:07:21.162013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 151/257] 10.222.0.46 () {60 vars in 1191 bytes} [Sun Aug 21 01:07:20 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.174553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2846dee-96d0-48cd-a360-535e5f6249ef tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.175318 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.175318 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.180745 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.180745 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.182441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-21cf121a-3667-4f03-890f-9f7e2929d5b4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 468a898e-262c-4a61-945e-f1be4a3383c1 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:21.213556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2846dee-96d0-48cd-a360-535e5f6249ef tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.043259 Aug 21 01:07:21.216814 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 152/258] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:21.227297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e30f8a77-87e5-4238-bb3e-338f5139d612 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-492002484"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.231414 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21cf121a-3667-4f03-890f-9f7e2929d5b4 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.079102 Aug 21 01:07:21.232682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 107/259] 10.222.0.46 () {60 vars in 1165 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.244662 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.244662 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.246143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f88b2623-9a2d-443b-bf26-9100fae0c2e7 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-305288656"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.246316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-e30f8a77-87e5-4238-bb3e-338f5139d612 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 22acbf55-8f9e-4a5d-a114-a4e7b9bc6acc for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:21.248784 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.248784 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.250899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-f88b2623-9a2d-443b-bf26-9100fae0c2e7 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Generated uuid 9131c760-3a7d-4b08-8fe5-fdb33ed1aad7 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:21.289146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e30f8a77-87e5-4238-bb3e-338f5139d612 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065618 Aug 21 01:07:21.290030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 153/260] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.291690 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f88b2623-9a2d-443b-bf26-9100fae0c2e7 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.057694 Aug 21 01:07:21.292472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 108/261] 10.222.0.46 () {62 vars in 1205 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:21.311151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da2d97cf-e453-464a-b155-340156f5fdb5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785445007_new", "availability_zone": "tempest-test_az-1900855226_new"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.395369 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.395369 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.444042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2d97cf-e453-464a-b155-340156f5fdb5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:21.446389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2d97cf-e453-464a-b155-340156f5fdb5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:21.446980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2d97cf-e453-464a-b155-340156f5fdb5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:21.484497 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da2d97cf-e453-464a-b155-340156f5fdb5 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.181873 Aug 21 01:07:21.485753 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 154/262] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:07:21 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.491431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-390ce90b-ea91-470b-8944-6d44239ff7a6 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1530763977"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.494259 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.494259 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.530371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-390ce90b-ea91-470b-8944-6d44239ff7a6 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.043412 Aug 21 01:07:21.531291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 155/263] 10.222.0.46 () {62 vars in 1213 bytes} [Sun Aug 21 01:07:21 2022] PUT /compute/v2.1/os-aggregates/11 => generated 300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:21.543290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.543905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:21.552435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:21.553266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:21.553769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:21.554529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:21.555046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:21.555518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:21.750189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00d44931-86cc-4a17-9de7-aa1fde51c399 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.754269 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.754269 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.756044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00d44931-86cc-4a17-9de7-aa1fde51c399 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00d44931-86cc-4a17-9de7-aa1fde51c399 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 39 Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:21.758693 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: {"add_host": {"host": "n-h1-master-1"}} Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:21.759919 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:21.760705 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 21 01:07:21.761720 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:21.764695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00d44931-86cc-4a17-9de7-aa1fde51c399 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:21.765750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00d44931-86cc-4a17-9de7-aa1fde51c399 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.461444 Aug 21 01:07:21.766909 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 109/264] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 463 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:21.773362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3eaabe3f-9149-4076-a408-b949a47dfb45 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.775328 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.775328 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.782002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:21.796431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea37e25a-a432-4bf6-8027-012086a8c55a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.258062 Aug 21 01:07:21.797605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 156/265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:21 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:21.802929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3eaabe3f-9149-4076-a408-b949a47dfb45 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 792 microversion: 2.1 time: 0.025998 Aug 21 01:07:21.803584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 110/266] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:07:21 2022] GET /compute/v2.1/os-aggregates => generated 792 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.804507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e7211dd-984c-4708-9c55-36d6951df534 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.806341 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.806341 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.819091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f8c17fe1-696c-4082-8641-1ad821c2c970 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.819091 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.819091 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.825272 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e7211dd-984c-4708-9c55-36d6951df534 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 300 microversion: 2.41 time: 0.026353 Aug 21 01:07:21.825855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 157/267] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 01:07:21 2022] GET /compute/v2.1/os-aggregates/11 => generated 300 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:21.842115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc903a60-dd2f-427c-b0df-1334e0685878 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:21.843456 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.843456 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.858304 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f8c17fe1-696c-4082-8641-1ad821c2c970 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.052660 Aug 21 01:07:21.858905 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 111/268] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:21 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:21.878691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c33bd12d-d3d1-4478-bde6-f708f9c83f57 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.883699 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc903a60-dd2f-427c-b0df-1334e0685878 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.052916 Aug 21 01:07:21.885223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 158/269] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:21 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:21.886925 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.886925 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:21.894029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8048f5f1-6b4a-47e0-87d1-8440464c9bd3 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1848402384"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.897869 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.897869 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.899252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-8048f5f1-6b4a-47e0-87d1-8440464c9bd3 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 6699afcb-92f4-4ba0-b301-bf1f3280588a for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:21.900011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33bd12d-d3d1-4478-bde6-f708f9c83f57 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:21.900570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33bd12d-d3d1-4478-bde6-f708f9c83f57 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:21.901103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33bd12d-d3d1-4478-bde6-f708f9c83f57 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:21.932658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8048f5f1-6b4a-47e0-87d1-8440464c9bd3 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045054 Aug 21 01:07:21.933574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 159/270] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:21.963422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6ee0110-cbb1-428b-bee6-8c95a5d22865 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1225366121"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:21.972417 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:21.972417 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:21.974070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-d6ee0110-cbb1-428b-bee6-8c95a5d22865 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Generated uuid 64c79aad-afcf-422b-bf0b-4a55e6b21baf for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:22.000703 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6ee0110-cbb1-428b-bee6-8c95a5d22865 tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056157 Aug 21 01:07:22.007130 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 160/271] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:22.008337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.009128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:22.020096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.020600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.021057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.021755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.028607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.029129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.108325 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c33bd12d-d3d1-4478-bde6-f708f9c83f57 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 315 microversion: 2.41 time: 0.241332 Aug 21 01:07:22.116070 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 112/272] 10.222.0.46 () {62 vars in 1235 bytes} [Sun Aug 21 01:07:21 2022] POST /compute/v2.1/os-aggregates/11/action => generated 315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:22.117925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1108445932"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.125555 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.125555 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.137133 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=82,nova_api:INSERT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:22.154217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.154706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.155205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.168148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.168741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.169220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.183467 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1108445932 could not be found. Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 58 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:22.185829 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: {"add_host": {"host": "tempest-nonexist_host-1108445932"}} Aug 21 01:07:22.187325 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: exception: Compute host tempest-nonexist_host-1108445932 could not be found. Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-1108445932'}}} Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1108445932' is not mapped to any cell Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.188519 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 21 01:07:22.189921 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1108445932 could not be found. Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1108445932 could not be found. Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.191191 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1108445932 could not be found. Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1108445932 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b511496-e942-430d-b403-4b56727185fc tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.073206 Aug 21 01:07:22.192539 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 113/273] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:22.193229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54f134dd-9dd8-4f15-995a-eb21632e922b tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.193937 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.193937 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.205355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54f134dd-9dd8-4f15-995a-eb21632e922b tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 700 microversion: 2.1 time: 0.014698 Aug 21 01:07:22.212257 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 114/274] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/os-aggregates => generated 700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:22.212257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39dabc1a-6379-433b-bc45-e111d4c36b36 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.214111 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.214111 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.227996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39dabc1a-6379-433b-bc45-e111d4c36b36 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.228451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39dabc1a-6379-433b-bc45-e111d4c36b36 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.230001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39dabc1a-6379-433b-bc45-e111d4c36b36 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.248949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:22.264668 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-602bc088-8ae6-4419-be2b-d35ebac1119b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.262184 Aug 21 01:07:22.267421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 161/275] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:22.273025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84b522be-08aa-4ad1-9a67-768f700e2f19 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.274049 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.274049 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.301798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84b522be-08aa-4ad1-9a67-768f700e2f19 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.033138 Aug 21 01:07:22.302875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 162/276] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:22.309176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8c4a7f3-bd94-46ae-ae1d-e3f7c14167ab tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.310305 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.310305 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.350432 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8c4a7f3-bd94-46ae-ae1d-e3f7c14167ab tempest-AggregatesAdminTestJSON-173667063 tempest-AggregatesAdminTestJSON-173667063-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.046258 Aug 21 01:07:22.351024 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 163/277] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:22.355915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f744c79-d661-431d-b8fa-ec43117659d9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f744c79-d661-431d-b8fa-ec43117659d9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 283 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:22.360829 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.362117 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:07:22.362636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.363161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.364508 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.366115 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:07:22.366115 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:07:22.366115 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:07:22.366115 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.366115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f744c79-d661-431d-b8fa-ec43117659d9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.366682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f744c79-d661-431d-b8fa-ec43117659d9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010174 Aug 21 01:07:22.369196 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 164/278] 10.222.0.46 () {60 vars in 1165 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:07:22.375078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.375629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:22.384464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.385132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.385944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.386795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.387241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.387656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.403441 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] HTTP exception thrown: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Request method failure captured: Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 HTTP/1.1 Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUdTB5E0cxo-0DWHNqqKJL1qGsXZTEUgvo4o_ub3ERwNwAI8GSvHzQdBf8ZAYjLxChMISw96MN5EscagjH3BEtTvcddX9PmygiTVVh0wXS8rTanl_VvAW80dqjhHpLowe8AU5FoWol58WdLsRFqtjeZjkTuAwX0IAYUb2mqaBhVNoo Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:22.405298 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7969fbfe11204268ba47c497448be0dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}] Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f83dfdbfecd9420dbc75d1d1dfcb59f8 Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.407544 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '450afbb0-432d-4f96-809c-d4c8469433e7'} Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.408845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.410728 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.412388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Returning 404 to user: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.412388 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-539b72ba-daba-42ae-a313-75cda337a511 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "DELETE /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 404 len: 111 microversion: 2.1 time: 0.036609 Aug 21 01:07:22.412388 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 165/279] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:22.415763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc69a037-e07b-4893-a977-aa0f03a57b31 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc69a037-e07b-4893-a977-aa0f03a57b31 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 27 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:22.419497 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: {"aggregate": {"name": ""}} Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:22.420987 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi '' Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.421843 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:07:22.426131 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.427642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc69a037-e07b-4893-a977-aa0f03a57b31 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.427642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc69a037-e07b-4893-a977-aa0f03a57b31 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009042 Aug 21 01:07:22.427642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 166/280] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:07:22.431910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.432696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] [instance: 450afbb0-432d-4f96-809c-d4c8469433e7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:22.436574 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39dabc1a-6379-433b-bc45-e111d4c36b36 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 300 microversion: 2.41 time: 0.228557 Aug 21 01:07:22.439672 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 115/281] 10.222.0.46 () {62 vars in 1235 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates/11/action => generated 300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:22.440162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.440643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.441121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.441813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.442252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.442799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.455353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a52400a9-3b86-42f0-91d8-0d314418575f tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787392244"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.458875 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.458875 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.459810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a52400a9-3b86-42f0-91d8-0d314418575f tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a52400a9-3b86-42f0-91d8-0d314418575f tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 60 Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:22.461648 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: {"aggregate": {"name": "tempest-test_aggregate-1787392244"}} Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.462810 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1787392244'}}} Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:22.463474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:22.464417 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 21 01:07:22.467756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.468396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] HTTP exception thrown: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.468715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a52400a9-3b86-42f0-91d8-0d314418575f tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Request method failure captured: Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 HTTP/1.1 Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUdTB5E0cxo-0DWHNqqKJL1qGsXZTEUgvo4o_ub3ERwNwAI8GSvHzQdBf8ZAYjLxChMISw96MN5EscagjH3BEtTvcddX9PmygiTVVh0wXS8rTanl_VvAW80dqjhHpLowe8AU5FoWol58WdLsRFqtjeZjkTuAwX0IAYUb2mqaBhVNoo Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:22.468915 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7969fbfe11204268ba47c497448be0dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7969fbfe11204268ba47c497448be0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7969fbfe11204268ba47c497448be0dc"}]}] Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7969fbfe11204268ba47c497448be0dc Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-397529806 Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f83dfdbfecd9420dbc75d1d1dfcb59f8 Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminTestJSON-397529806-project Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.472597 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '450afbb0-432d-4f96-809c-d4c8469433e7'} Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.476760 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. Aug 21 01:07:22.480090 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.483142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] Returning 404 to user: Instance 450afbb0-432d-4f96-809c-d4c8469433e7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.483142 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f3d9c1e-654d-4b87-a7d9-499f492fef08 tempest-AggregatesAdminTestJSON-397529806 tempest-AggregatesAdminTestJSON-397529806-project] 10.222.0.46 "GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7" status: 404 len: 111 microversion: 2.1 time: 0.037607 Aug 21 01:07:22.483142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 167/282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/servers/450afbb0-432d-4f96-809c-d4c8469433e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:22.483546 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a52400a9-3b86-42f0-91d8-0d314418575f tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.022469 Aug 21 01:07:22.483546 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 116/283] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:22.483827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5aa2ca69-1bf3-43c6-b9a1-a5c12ff84d68 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.483827 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.483827 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.484212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bdf57b5-e48d-4514-9576-48e68b0f249e tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-253549700"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.493101 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-1bdf57b5-e48d-4514-9576-48e68b0f249e tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 9304295c-89ed-48e4-928b-f6023c4deba6 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:22.523492 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5aa2ca69-1bf3-43c6-b9a1-a5c12ff84d68 tempest-AggregatesAdminTestV241-1771669208 tempest-AggregatesAdminTestV241-1771669208-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.050386 Aug 21 01:07:22.527325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 168/284] 10.222.0.46 () {60 vars in 1196 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:22.548670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bdf57b5-e48d-4514-9576-48e68b0f249e tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070384 Aug 21 01:07:22.549710 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 117/285] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:22.560515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-253549700"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.563080 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.563080 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.564117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 8999bc1d-a3bc-4c9a-b55e-de8dab62d7a7 for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:22.580468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-253549700 already exists. Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 59 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:22.583561 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: {"aggregate": {"name": "tempest-test_aggregate-253549700"}} Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:22.584723 n-d-master-1 devstack@n-api.service[122482]: exception: Aggregate tempest-test_aggregate-253549700 already exists. Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-253549700'}}} Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 21 01:07:22.585490 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-253549700 already exists. Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:22.591300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-253549700 already exists. Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-253549700 already exists. Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-253549700 already exists. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.592493 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca457c95-5add-4324-948e-3ca36774fef4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.028241 Aug 21 01:07:22.593916 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 169/286] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 32 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:07:22.594737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-386c8f41-1c31-4648-b79f-078b5273912f tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.595495 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.595495 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.632426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-386c8f41-1c31-4648-b79f-078b5273912f tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.041259 Aug 21 01:07:22.633029 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 118/287] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:22.642576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-212be74f-beef-443b-afa4-4e446fcf62c6 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1396949813"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.645148 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.645148 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.646042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-212be74f-beef-443b-afa4-4e446fcf62c6 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid da097918-b415-4436-97ba-bf072faef7dc for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:22.685832 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-212be74f-beef-443b-afa4-4e446fcf62c6 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047402 Aug 21 01:07:22.687241 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 170/288] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:22.699017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d018cef-8de7-4753-9127-b039ae0ee64d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.700231 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.700231 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.701401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d018cef-8de7-4753-9127-b039ae0ee64d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d018cef-8de7-4753-9127-b039ae0ee64d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:22.703502 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 21 01:07:22.705165 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '15'} Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.706202 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 21 01:07:22.707185 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.709388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d018cef-8de7-4753-9127-b039ae0ee64d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.711544 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d018cef-8de7-4753-9127-b039ae0ee64d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015816 Aug 21 01:07:22.712818 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 119/289] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:22.727558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2948d7d-149c-4af6-84cd-5498ce4b3f54 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.729826 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.729826 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:22.782455 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2948d7d-149c-4af6-84cd-5498ce4b3f54 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.064023 Aug 21 01:07:22.784182 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 171/290] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:22.793053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45755b67-9365-4334-9841-3c845f073132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.813669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-45755b67-9365-4334-9841-3c845f073132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45755b67-9365-4334-9841-3c845f073132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:22.815587 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: exception: Aggregate -1 could not be found. Aug 21 01:07:22.816802 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '-1'} Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:22.817457 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.823514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45755b67-9365-4334-9841-3c845f073132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45755b67-9365-4334-9841-3c845f073132 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027999 Aug 21 01:07:22.824860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 120/291] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:22.827014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.827646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:22.832647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1616668-8781-4e53-98b5-033c31567f65 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1368654133"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:22.835812 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.835812 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.836804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-d1616668-8781-4e53-98b5-033c31567f65 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 152a97a0-a9ee-4842-9379-f96eeb67a0ce for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:22.853022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.855098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.855859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.858718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:22.860240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:22.861895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:22.877914 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1616668-8781-4e53-98b5-033c31567f65 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050194 Aug 21 01:07:22.878743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 121/292] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:22.896524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0377c783-c659-49ca-bc3b-d7da1379212d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.897540 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.897540 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.898414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0377c783-c659-49ca-bc3b-d7da1379212d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0377c783-c659-49ca-bc3b-d7da1379212d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:22.899946 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 21 01:07:22.901377 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '16'} Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:22.902240 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.903474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0377c783-c659-49ca-bc3b-d7da1379212d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.905695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0377c783-c659-49ca-bc3b-d7da1379212d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.016865 Aug 21 01:07:22.905695 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 122/293] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:07:22.913063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2847d102-edaf-448b-90d0-d191f0826be9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.913799 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.913799 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.955440 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2847d102-edaf-448b-90d0-d191f0826be9 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.045688 Aug 21 01:07:22.957026 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 123/294] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:22 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 21 01:07:22.972301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b009e28-89b4-4dae-85d9-ed50c54753e0 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:22.973369 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:22.973369 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:22.980291 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1b009e28-89b4-4dae-85d9-ed50c54753e0 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b009e28-89b4-4dae-85d9-ed50c54753e0 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:22.983132 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: exception: Aggregate -1 could not be found. Aug 21 01:07:22.984277 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '-1'} Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.985042 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 21 01:07:22.986060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:22.989989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b009e28-89b4-4dae-85d9-ed50c54753e0 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:22.991389 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b009e28-89b4-4dae-85d9-ed50c54753e0 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025286 Aug 21 01:07:22.992811 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 124/295] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:07:23.001558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-233e45e0-df60-4d19-8182-fd5e698f4b54 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:23.003860 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.003860 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.006345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-233e45e0-df60-4d19-8182-fd5e698f4b54 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-233e45e0-df60-4d19-8182-fd5e698f4b54 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:23.014962 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 21 01:07:23.016516 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:23.017372 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 21 01:07:23.018549 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.020573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-233e45e0-df60-4d19-8182-fd5e698f4b54 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:23.021469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-233e45e0-df60-4d19-8182-fd5e698f4b54 tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.024386 Aug 21 01:07:23.022032 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 125/296] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:07:23.036710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-194d016f-7d88-4678-94f0-cb02eff60a28 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-771375936"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.041573 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.041573 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.043223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-194d016f-7d88-4678-94f0-cb02eff60a28 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 6d67a581-2dd9-435f-9985-f97b66af24d4 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:23.067831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-194d016f-7d88-4678-94f0-cb02eff60a28 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038453 Aug 21 01:07:23.069688 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 126/297] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:23.084073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d30923d7-2237-4594-b7ea-aac6bbe71545 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.088016 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.088016 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.098997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30923d7-2237-4594-b7ea-aac6bbe71545 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.099860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30923d7-2237-4594-b7ea-aac6bbe71545 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.101009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30923d7-2237-4594-b7ea-aac6bbe71545 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.106521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:23.114289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2b865a4-c351-486c-85b1-1b284b0cfd07 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.299098 Aug 21 01:07:23.114857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 172/298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:22 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:23.287581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:23.288632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:23.290725 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=13,nova_api:UPDATE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.301367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.301852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.302326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.303379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.303496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.303809 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d30923d7-2237-4594-b7ea-aac6bbe71545 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.226969 Aug 21 01:07:23.303907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.304829 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 127/299] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:23.315983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b844f6a-62b1-4475-8be5-f4f3eb625c9d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.321643 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.321643 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.322545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b844f6a-62b1-4475-8be5-f4f3eb625c9d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '907073f9a3fa44869bced2e46ed909fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bacf2fc234419fa36f2f38a3208acf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b844f6a-62b1-4475-8be5-f4f3eb625c9d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Request method failure captured: Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 42 Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUejbCGrvfL1Un2syNJ-iuh-ZdjHbpOQintPVhpzPffGsGoiOb2uGXpepab9xYbzYFe_b4JCgvxOrmzOtQegqqdKbgK3rEu0uz_fyeufb7SaZ9eN7UhQAdWr3G_kFue2aZIxtkqWKncUKeVfWNl9X0rDLqxHfUvDCPOdMHZXhegCFQ Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:23.325906 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_34bacf2fc234419fa36f2f38a3208acf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/34bacf2fc234419fa36f2f38a3208acf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/34bacf2fc234419fa36f2f38a3208acf"}]}] Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 34bacf2fc234419fa36f2f38a3208acf Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-410669429 Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 907073f9a3fa44869bced2e46ed909fb Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-410669429-project Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: {"remove_host": {"host": "n-h1-master-1"}} Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:23.327158 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:23.328096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 21 01:07:23.330629 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.334603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b844f6a-62b1-4475-8be5-f4f3eb625c9d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:23.336492 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b844f6a-62b1-4475-8be5-f4f3eb625c9d tempest-AggregatesAdminNegativeTestJSON-410669429 tempest-AggregatesAdminNegativeTestJSON-410669429-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024374 Aug 21 01:07:23.337147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 128/300] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:23.352130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4133171-8dff-4410-9539-cb2a0a40f742 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.367166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4133171-8dff-4410-9539-cb2a0a40f742 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.367896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4133171-8dff-4410-9539-cb2a0a40f742 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.368421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4133171-8dff-4410-9539-cb2a0a40f742 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.501192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:23.511215 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4133171-8dff-4410-9539-cb2a0a40f742 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.169279 Aug 21 01:07:23.512890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 129/301] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:23.520838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f2720e6-1fd4-43c0-bbe6-fa4738f843d2 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.236984 Aug 21 01:07:23.536301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-112c4f92-b5a5-4860-907b-814182e4eab4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:23.536301 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.536301 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.538798 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 173/302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:23 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:23.551355 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:23.554606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-112c4f92-b5a5-4860-907b-814182e4eab4 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.034246 Aug 21 01:07:23.555445 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 130/303] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:23 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:23.566385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87fc597e-1be9-40fe-9501-c74ada193c5b tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785975670"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.569392 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.569392 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:23.570662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.aggregate [None req-87fc597e-1be9-40fe-9501-c74ada193c5b tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Generated uuid 43fa7716-1bde-47cc-9842-3998d09f20d9 for aggregate {{(pid=122482) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:07:23.602774 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87fc597e-1be9-40fe-9501-c74ada193c5b tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040874 Aug 21 01:07:23.603960 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 174/304] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:23.615457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:23.617971 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.617971 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:23.627435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.628394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.629136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.635580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:23.636053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:23.636488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:23.644283 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.compute.aggregates [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 21 01:07:23.644828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Request method failure captured: Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 42 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUg5fg17nsjdJXByed1MC0ZetyLHEg9XNDqjY1Pt9bf1n6M3PNd2fQPAajTMVDLm-42wpbnhVO3FG1Q0f76i3PKJBlm18-gp99bfUIPjbAy9KIQC0wzy1T3zj70A2kjHoveGXrJa47ex5QPFJSwlIajE8Yott-Nd2Lk2V9LOo7IFL8 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:07:23.646755 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7826447993f745a192767a8f573df304", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7826447993f745a192767a8f573df304"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7826447993f745a192767a8f573df304"}]}] Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7826447993f745a192767a8f573df304 Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048 Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9b87749d407d4ddc92ad45d7bd34ed1d Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: {"remove_host": {"host": "nonexist_host"}} Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:23.647955 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 21 01:07:23.648975 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 21 01:07:23.650363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.651406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d695be96-c7f5-4fd4-a273-25a4759d9804 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.036726 Aug 21 01:07:23.654789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 131/305] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:07:23 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:07:23.656448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1744488-7623-46e8-b903-4c47497bd796 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:23.657318 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:23.657318 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:23.685389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1744488-7623-46e8-b903-4c47497bd796 tempest-AggregatesAdminNegativeTestJSON-1372061048 tempest-AggregatesAdminNegativeTestJSON-1372061048-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.032350 Aug 21 01:07:23.690206 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 175/306] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:07:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:24.143553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:24.144181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:24.150347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:24.150815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:24.151412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:24.152396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:24.152877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:24.153297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:24.321009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:24.332202 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d634211e-92d5-4cc0-a4d7-952c29f2dfea tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.199742 Aug 21 01:07:24.333925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 132/307] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:24 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:24.351476 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.356727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6335189-ef66-469d-9ec9-aae1ebee7701", "name": "network-vif-plugged", "status": "completed", "tag": "e35a7458-a0bf-44c7-a333-a8265cabbc00"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:24.370941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:24.371410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:24.371823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:24.375949 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.387093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] Creating event network-vif-plugged:e35a7458-a0bf-44c7-a333-a8265cabbc00 for instance c6335189-ef66-469d-9ec9-aae1ebee7701 on n-h2-master-1 Aug 21 01:07:24.392228 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4d09bed3-77bc-4c80-a7fb-f1cfd2ace742 req-6ae567ed-02b7-444e-ad20-11713a086484 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 Aug 21 01:07:24.392837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 176/308] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:24.543856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:24.544654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:24.552121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:24.555768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:24.555768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:24.555768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:24.555768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:24.556018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:24.742809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:24.753348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-736436f6-b48f-47ff-94db-39b54d4e75ad tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.213648 Aug 21 01:07:24.753923 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 133/309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:24 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:25.356966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:25.358311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:25.365504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:25.366357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:25.366886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:25.367750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:25.368190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:25.368601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:25.506436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:25.515561 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46890bf4-9303-43a1-8e26-484a3498df3a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.163898 Aug 21 01:07:25.516521 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 177/310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:25 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:25.778721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:25.779406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:25.788067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:25.788351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:25.788786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:25.789482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:25.789920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:25.790404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:25.984212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:25.994181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b37ecaf-b897-4e15-9c8b-9fd9b03342a1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1319 microversion: 2.1 time: 0.222194 Aug 21 01:07:26.008678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 134/311] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:25 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:26.541450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:26.542333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:26.559144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:26.560205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:26.560874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:26.564085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:26.567089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:26.569005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:27.016788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:27.019100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:27.046953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:27.050065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:27.051887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:27.053869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:27.057486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:27.060636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:27.199321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:27.213413 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-034c5ded-4c0b-4d84-8262-63676271e534 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.678896 Aug 21 01:07:27.231444 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 178/312] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:26 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:27.300919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:27.310482 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ff2a57c-1ab0-4095-a761-c62d4c21e010 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1469 microversion: 2.1 time: 0.297302 Aug 21 01:07:27.317831 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 135/313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:27 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:27.760622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1504939357", "block_migration": true, "disk_over_commit": false}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:27.764241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:27.782930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:27.783753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:27.784188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:27.785333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:27.786118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:27.786593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:28.241973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:28.242584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:28.250164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:28.252646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:28.253131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:28.253855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:28.254415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:28.255039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:28.488719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:28.499836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd343499-526b-47d9-ae78-5060e2b9d6ac tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.264642 Aug 21 01:07:28.501392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 136/314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:28 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:28.727142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lazy-loading 'flavor' on Instance uuid c6335189-ef66-469d-9ec9-aae1ebee7701 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:07:28.835077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Going to try to live migrate instance to tempest-host-1504939357 {{(pid=122482) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:07:28.854698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] HTTP exception thrown: Compute host tempest-host-1504939357 could not be found. Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Request method failure captured: Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701/action HTTP/1.1 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 107 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUzm5bmQQYXgwUtviC7ZjAruMttmtQPK4tFV6xKb8hhCxLBnjCRr4BqsBJGiTV1ZnbGAEDHBXrVzfas1FepyOvxSH48QiEOPSm5DN-FCz0mZXI70By9JVBmYbScDo5puec_ik7kPWe1rlqbTe-9cI5ey8xrqUukJxfRARPYW9bIkFE Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: aa7ed056a25f4e0eac5fb20571f85a61 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:28.864665 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa7ed056a25f4e0eac5fb20571f85a61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa7ed056a25f4e0eac5fb20571f85a61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa7ed056a25f4e0eac5fb20571f85a61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa7ed056a25f4e0eac5fb20571f85a61"}]}] Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: aa7ed056a25f4e0eac5fb20571f85a61 Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveMigrationNegativeTest-1429790141-project-admin Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9163e0cbd5ae479cb49905b804c3dbba Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveMigrationNegativeTest-1429790141-project-admin Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: {"os-migrateLive": {"host": "tempest-host-1504939357", "block_migration": true, "disk_over_commit": false}} Aug 21 01:07:28.867263 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: exception: Compute host tempest-host-1504939357 could not be found. Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c6335189-ef66-469d-9ec9-aae1ebee7701', 'body': {'os-migrateLive': {'host': 'tempest-host-1504939357', 'block_migration': True, 'disk_over_commit': False}}} Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:07:28.868643 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1504939357 could not be found. Aug 21 01:07:28.872215 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1504939357 could not be found. Aug 21 01:07:28.874734 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1504939357 could not be found. Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Returning 400 to user: Compute host tempest-host-1504939357 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49697a4f-1dbd-49d4-ba59-026588b1d847 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701/action" status: 400 len: 100 microversion: 2.1 time: 1.536678 Aug 21 01:07:28.879804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 179/315] 10.222.0.46 () {60 vars in 1279 bytes} [Sun Aug 21 01:07:27 2022] POST /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701/action => generated 100 bytes in 1538 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:07:28.886336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:28.887261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:28.897617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:28.898165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:28.899107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:28.900524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:28.901408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:28.901956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:29.239749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:29.249731 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b3364d6-78b1-45ba-9070-6e526a095ecf tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1469 microversion: 2.1 time: 0.375238 Aug 21 01:07:29.250428 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 180/316] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:28 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:29.259014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f3ee72-efe7-436d-8834-88e9a01ef0ad", "name": "network-vif-plugged", "status": "completed", "tag": "fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:29.303097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:29.303565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:29.303992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:29.334302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] Creating event network-vif-plugged:fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea for instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad on n-h2-master-1 Aug 21 01:07:29.348138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-eaececeb-202f-4137-87a1-7ba786003918 req-6d59a7c8-8bc3-4937-8c7a-2c081716151e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092901 Aug 21 01:07:29.348750 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 181/317] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:29.703537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2022137168", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:29.815233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:29.909562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9cfaeaa-59b5-4c80-895a-e41cd84f15d8 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:29.911399 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:29.911399 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:29.915722 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f9cfaeaa-59b5-4c80-895a-e41cd84f15d8 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9cfaeaa-59b5-4c80-895a-e41cd84f15d8 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin] Request method failure captured: Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVQCvxZZQC-8ikWQXtP19ofIUsoaey1VcVC7Kf2dEJd0CjIUlXjvUanvVxva2etL_ydT6pO7ZKS-Sw_NKlslQDtg8gUBGLheaBRk4Q5SVgcC40K6M6dLxb2mEQri-ZeTCnvtLwr_5BJgvSBHNOpJIOlptqAIzFZdY29hoUWPsSPOp8 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 31f6466c5f544de08b54adf5dc999fda Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:07:29.930456 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f6466c5f544de08b54adf5dc999fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_31f6466c5f544de08b54adf5dc999fda", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/31f6466c5f544de08b54adf5dc999fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/31f6466c5f544de08b54adf5dc999fda"}]}] Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 31f6466c5f544de08b54adf5dc999fda Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: aee9627e48c74ff28d7de1eef3d0684f Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:29.931700 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid timestamp for date invalid_time Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'invalid_time'} Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:29.932314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 21 01:07:29.933406 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:29.937503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9cfaeaa-59b5-4c80-895a-e41cd84f15d8 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:29.939270 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9cfaeaa-59b5-4c80-895a-e41cd84f15d8 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433 tempest-InstanceUsageAuditLogNegativeTestJSON-163876433-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.584925 Aug 21 01:07:29.940748 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 182/318] 10.222.0.46 () {58 vars in 1224 bytes} [Sun Aug 21 01:07:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 588 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:29.954294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:29.958560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:29.975510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:29.978858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:29.979729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:29.980717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:29.982388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:29.985753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:29.987741 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:30.288015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:30.288842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:30.289537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:30.290183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:30.290820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:30.305330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:30.306129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:30.306859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:30.308091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:30.308811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:30.309449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:30.414147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:30.429279 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9af6562-7d50-4925-97dc-ff4e9d4821dc tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1388 microversion: 2.1 time: 0.486701 Aug 21 01:07:30.430134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 183/319] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:29 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1388 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:30.438754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-416098209", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:30.563965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:30.645974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Getting quotas for project ee9e0038aadf42e8be2911efd9bfb896. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:30.652520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Getting quotas for user dd9f99d20b344589961aa679179adbb1 and project ee9e0038aadf42e8be2911efd9bfb896. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:30.685276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:30.688741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:30.803998 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aad57303-aa1a-40b6-a490-5e2ad79addd2 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053530 Aug 21 01:07:30.804662 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 137/320] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:07:31.438350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76f6a046-fa98-42ef-83c5-6f34f615b8b7 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:31.439085 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:31.439085 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:31.440133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76f6a046-fa98-42ef-83c5-6f34f615b8b7 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'cc05807e58484524907c3641929b0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546bf89d982a47ab86c0cb0088e86d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76f6a046-fa98-42ef-83c5-6f34f615b8b7 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Request method failure captured: Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVN6cKuUMnFCvJ0lZZWY7O97ytZlq9W0ZFyx9oAJ6GbYDsyj_LyQNn0Xva2VdB26N4JXetO0XYkkaa9K7q7OJUWSDZxbPxXEeeEhB45YGloSBWz8BrmGdhHfdHne41Y5kqfiggYvVutqL_E6Nh2OBev6ViIo7CsOkNiadPdYFd493c Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 546bf89d982a47ab86c0cb0088e86d61 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:31.442136 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/546bf89d982a47ab86c0cb0088e86d61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_546bf89d982a47ab86c0cb0088e86d61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/546bf89d982a47ab86c0cb0088e86d61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/546bf89d982a47ab86c0cb0088e86d61"}]}] Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 546bf89d982a47ab86c0cb0088e86d61 Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: cc05807e58484524907c3641929b0e12 Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project Aug 21 01:07:31.443307 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:31.443940 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 21 01:07:31.445097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.448635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76f6a046-fa98-42ef-83c5-6f34f615b8b7 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:31.456513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76f6a046-fa98-42ef-83c5-6f34f615b8b7 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.642288 Aug 21 01:07:31.463776 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 138/321] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:07:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 650 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:31.497523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebb338e8-04ec-4f78-bb30-a21e1a52c0cb tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:31.499840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebb338e8-04ec-4f78-bb30-a21e1a52c0cb tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:31.534743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:31.535857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:31.536497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:31.537083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:31.537655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:31.553102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:31.553637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:31.561109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:31.564264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:31.565105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:31.565679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:31.669219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Getting quotas for project aa388d025cac48ada2e632d0df0b4cad. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:31.681508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Getting quotas for user 22500a157cbb43eab8e92270d59a2f2a and project aa388d025cac48ada2e632d0df0b4cad. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:31.689595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebb338e8-04ec-4f78-bb30-a21e1a52c0cb tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:31.717277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebb338e8-04ec-4f78-bb30-a21e1a52c0cb tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1223 microversion: 2.1 time: 0.247138 Aug 21 01:07:31.724247 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 139/322] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:31 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1223 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:31.726473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:31.731854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:31.736147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:31.740938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:31.753173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:31.753750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:31.755989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:31.756810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:31.760198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:31.760914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:31.827968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec80413e-eb22-472b-82f2-f96f3af6c500 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394865 Aug 21 01:07:31.829808 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 184/323] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:07:31.850849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d660050c-23b2-40a7-bb0e-5b71ced55c77 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:31.855018 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:31.855018 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:31.858439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d660050c-23b2-40a7-bb0e-5b71ced55c77 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'cc05807e58484524907c3641929b0e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546bf89d982a47ab86c0cb0088e86d61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d660050c-23b2-40a7-bb0e-5b71ced55c77 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Request method failure captured: Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-21%2001:07:31 HTTP/1.1 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVN6cKuUMnFCvJ0lZZWY7O97ytZlq9W0ZFyx9oAJ6GbYDsyj_LyQNn0Xva2VdB26N4JXetO0XYkkaa9K7q7OJUWSDZxbPxXEeeEhB45YGloSBWz8BrmGdhHfdHne41Y5kqfiggYvVutqL_E6Nh2OBev6ViIo7CsOkNiadPdYFd493c Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 546bf89d982a47ab86c0cb0088e86d61 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:07:31.876411 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/546bf89d982a47ab86c0cb0088e86d61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_546bf89d982a47ab86c0cb0088e86d61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/546bf89d982a47ab86c0cb0088e86d61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/546bf89d982a47ab86c0cb0088e86d61"}]}] Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 546bf89d982a47ab86c0cb0088e86d61 Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: cc05807e58484524907c3641929b0e12 Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project Aug 21 01:07:31.877747 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2022-08-21 01:07:31'} Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:31.878897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 21 01:07:31.881157 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:07:31.888501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d660050c-23b2-40a7-bb0e-5b71ced55c77 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:31.892055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d660050c-23b2-40a7-bb0e-5b71ced55c77 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218 tempest-InstanceUsageAuditLogNegativeTestJSON-496532218-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-21 01:07:31" status: 403 len: 128 microversion: 2.1 time: 0.056907 Aug 21 01:07:31.892950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 185/324] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:07:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-21%2001%3A07%3A31 => generated 128 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:31.905874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f61e800-7110-4036-b7e6-185287ac879e tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:31.908473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f61e800-7110-4036-b7e6-185287ac879e tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:32.162503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f61e800-7110-4036-b7e6-185287ac879e tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:32.175680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f61e800-7110-4036-b7e6-185287ac879e tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1218 microversion: 2.1 time: 0.276698 Aug 21 01:07:32.177663 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 186/325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:31 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:32.269212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:32.291660 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c717dbb-f49f-4467-8b35-6fd2d6a59812 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1587 microversion: 2.1 time: 0.565380 Aug 21 01:07:32.293331 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 140/326] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:31 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1587 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:32.313947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:32.314855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:32.341136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:32.341986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:32.343106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:32.344139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:32.344642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:32.354238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:32.629537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7607a42e-f982-4bd8-92d1-89cb879427c6 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319568 Aug 21 01:07:32.630797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 141/327] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:07:32 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:32.747897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:32.749479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:32.763360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:32.769846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:32.770327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:32.777040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:32.777587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:32.778018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:32.849026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-506719674", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:32.960162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:33.150107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:33.171843 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1283 microversion: 2.1 time: 0.428227 Aug 21 01:07:33.175227 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 142/328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:32 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1283 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:33.176825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:33.180555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3597f5bb-79cf-4d09-ae88-46058e6bd1f5 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002713 Aug 21 01:07:33.181217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 143/329] 10.222.0.46 () {56 vars in 886 bytes} [Sun Aug 21 01:07:33 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 21 01:07:33.200170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:33.200986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:33.215699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:33.216718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:33.217539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:33.218441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:33.219081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:33.219686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:33.277254 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:33.507454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:33.519740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38145c8d-02ff-4e08-b828-fde26ec15d6b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1270 microversion: 2.1 time: 0.326137 Aug 21 01:07:33.535212 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 144/330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:33 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1270 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:34.053483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:34.054069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:34.054834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:34.055411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:34.056043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:34.074614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.076683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.079181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.080744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.082446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.083702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.138077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Getting quotas for project 58c64f1c2dba41298be11cd0772e8792. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:34.155406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Getting quotas for user 49f609273d3d4d18a9ef755ed5359da9 and project 58c64f1c2dba41298be11cd0772e8792. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:34.198450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:34.200012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:34.212740 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:34.225526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.233266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:34.234845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.238807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:34.240460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.243350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.243931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.247362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.354905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-acb6a700-438a-4a28-9779-9f240e9ccb21 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.174087 Aug 21 01:07:34.360569 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 187/331] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:07:34.375736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a410e5a-22d7-4ec7-9ff2-9ef75e3096ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:34.376473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a410e5a-22d7-4ec7-9ff2-9ef75e3096ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:34.492325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a410e5a-22d7-4ec7-9ff2-9ef75e3096ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:34.504716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a410e5a-22d7-4ec7-9ff2-9ef75e3096ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1219 microversion: 2.1 time: 0.135452 Aug 21 01:07:34.506359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 188/332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:34 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:34.547783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:34.548637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:34.556954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.567865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.568414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.569343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:34.569891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:34.570493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:34.638244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:34.648833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d9ac0ea-4637-4909-8dc9-13e53f5dac55 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1276 microversion: 2.1 time: 0.104800 Aug 21 01:07:34.649921 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 189/333] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:34 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:34.840316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:34.853610 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f8f880b-a00d-4dd5-9a55-fa1ed3e33caf tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1281 microversion: 2.1 time: 0.662270 Aug 21 01:07:34.866959 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 145/334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:34 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1281 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:35.527405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:35.528184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:35.535365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.535845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.547587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:35.552373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.553520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.553970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:35.670356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:35.671253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:35.690964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.693025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.693773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:35.695690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.697410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.698877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:35.777601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:35.789859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16f6b245-0a17-4c63-a216-b64a3de93efe tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1215 microversion: 2.1 time: 0.262552 Aug 21 01:07:35.796418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 190/335] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:35 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:35.895332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:35.909626 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-145b615c-b785-4979-a1a7-e234aaded4b3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1276 microversion: 2.1 time: 0.241897 Aug 21 01:07:35.913367 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 146/336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:35 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:35.922059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:35.925312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:35.932921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.933402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.933835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:35.934583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:35.935031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:35.935443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:36.035920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:36.049165 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7479388f-52ee-4166-9d0f-668e2795d44c tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1281 microversion: 2.1 time: 0.134371 Aug 21 01:07:36.072738 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 147/337] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:35 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:36.534887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2404e5e-0562-49e6-869a-cfe608993cee tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-599963022", "ram": 512, "vcpus": 1, "disk": 10, "id": 1246341089, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:36.538113 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:36.538113 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:36.577654 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2404e5e-0562-49e6-869a-cfe608993cee tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.777758 Aug 21 01:07:36.589162 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 191/338] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:36.601390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fdf9af34-9efd-4655-a62e-2640d3e56ec7 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:36.604306 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:36.604306 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:36.669798 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fdf9af34-9efd-4655-a62e-2640d3e56ec7 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074212 Aug 21 01:07:36.672014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 148/339] 10.222.0.46 () {60 vars in 1224 bytes} [Sun Aug 21 01:07:36 2022] POST /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:36.803562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:36.804158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:36.819678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:36.824201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:36.825412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:36.826822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:36.828358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:36.835842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:37.224600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb53aabc-cfda-46bf-a249-df894fd615d8 tempest-FlavorsExtraSpecsTestJSON-934331551 tempest-FlavorsExtraSpecsTestJSON-934331551-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:37.247012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb53aabc-cfda-46bf-a249-df894fd615d8 tempest-FlavorsExtraSpecsTestJSON-934331551 tempest-FlavorsExtraSpecsTestJSON-934331551-project] 10.222.0.46 "GET /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.570356 Aug 21 01:07:37.252972 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 192/340] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:07:36 2022] GET /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:37.261594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:37.263978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:37.282077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:37.283038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:37.283767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:37.284885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:37.287126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:37.288068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:37.571221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:37.585309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7595d9a-a468-44e6-af1a-a9c704cf2368 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1277 microversion: 2.1 time: 0.331672 Aug 21 01:07:37.601926 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 193/341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:37 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1277 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:37.616757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f3ee72-efe7-436d-8834-88e9a01ef0ad", "tag": "fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:37.650222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:37.655584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:37.656071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:37.683873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] Creating event network-changed:fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea for instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad on n-h2-master-1 Aug 21 01:07:37.699031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5eb29076-cb30-4799-b1ed-2bc0d9e323c6 req-9a507a70-3fdc-4c78-bd00-d83bcb722fef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095520 Aug 21 01:07:37.700726 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 194/342] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:37.714463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:37.716866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:37.736915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:37.741234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:37.742547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:37.744035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:37.749799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:37.750568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:38.131979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:38.141105 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8845a853-2932-4332-a2dd-c44f366eb753 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 200 len: 1587 microversion: 2.1 time: 1.340932 Aug 21 01:07:38.145660 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 149/343] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:36 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 1587 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:38.157669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.158642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:38.171898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:38.175071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:38.175787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:38.181309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:38.182000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:38.182638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:38.262049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:38.272475 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-121c9acb-5f30-4376-8142-d5494943d765 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.570251 Aug 21 01:07:38.278066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 195/344] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:37 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:38.291404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b3a99d2-799a-452e-aecb-71cd50792b3c tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:38.299844 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:38.299844 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:38.348968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b3a99d2-799a-452e-aecb-71cd50792b3c tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066615 Aug 21 01:07:38.351081 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 196/345] 10.222.0.46 () {60 vars in 1224 bytes} [Sun Aug 21 01:07:38 2022] POST /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:38.361948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5861a57-fc62-4e51-9d0c-9af67a7f67a8 tempest-FlavorsExtraSpecsTestJSON-934331551 tempest-FlavorsExtraSpecsTestJSON-934331551-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.385183 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5861a57-fc62-4e51-9d0c-9af67a7f67a8 tempest-FlavorsExtraSpecsTestJSON-934331551 tempest-FlavorsExtraSpecsTestJSON-934331551-project] 10.222.0.46 "GET /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.028185 Aug 21 01:07:38.388143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 197/346] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:07:38.400468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fe22998-daa7-4f65-b6d6-755e6dbea097 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:38.418884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:38.427191 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6dff3e5-673e-4a5a-ac33-ea5ffe31fa89 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1281 microversion: 2.1 time: 0.276641 Aug 21 01:07:38.441629 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:38.444356 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 150/347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:38.467661 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fe22998-daa7-4f65-b6d6-755e6dbea097 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.073624 Aug 21 01:07:38.468877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 198/348] 10.222.0.46 () {60 vars in 1224 bytes} [Sun Aug 21 01:07:38 2022] POST /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:38.479322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5fec741-b497-4293-953f-bb98c7491205 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.490112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5fec741-b497-4293-953f-bb98c7491205 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014985 Aug 21 01:07:38.508915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0eb88d87-649d-4677-beba-134fa710897c tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:38.511489 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:38.511489 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:38.513131 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 151/349] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:38.576381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0eb88d87-649d-4677-beba-134fa710897c tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.071995 Aug 21 01:07:38.583009 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 199/350] 10.222.0.46 () {60 vars in 1265 bytes} [Sun Aug 21 01:07:38 2022] PUT /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes => generated 22 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:07:38.592687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65327a08-651b-4d9b-80ab-e688dbd96224 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.605075 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65327a08-651b-4d9b-80ab-e688dbd96224 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020283 Aug 21 01:07:38.606179 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 152/351] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/flavors/1246341089/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:38.617878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.621350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:38.635626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d5d2cef9-78ce-4670-ac32-26156c81246a tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.639061 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:38.639061 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:38.639802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:38.640314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:38.642245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:38.643024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:38.643478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:38.643894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:38.723485 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d5d2cef9-78ce-4670-ac32-26156c81246a tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.102823 Aug 21 01:07:38.726215 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 153/352] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:07:38 2022] DELETE /compute/v2.1/flavors/1246341089/os-extra_specs/hw:numa_nodes => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:38.741072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-629e7b9e-929e-400d-8a48-f77d3fb9e1b9 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.789488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-629e7b9e-929e-400d-8a48-f77d3fb9e1b9 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1246341089/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.058380 Aug 21 01:07:38.791986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 154/353] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:07:38 2022] DELETE /compute/v2.1/flavors/1246341089/os-extra_specs/hw:cpu_policy => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:07:38.805300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20bbceb5-9ae9-41ad-951c-cf3802b98e41 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.826838 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20bbceb5-9ae9-41ad-951c-cf3802b98e41 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1246341089/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026876 Aug 21 01:07:38.827152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:38.828516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 155/354] 10.222.0.46 () {58 vars in 1203 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/flavors/1246341089/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:07:38.843225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9fe6ba65-ab34-4f47-940c-84a0dfbb5c91 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.847255 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:38.847255 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:38.854378 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fdf8184-71a4-42db-9152-7cca2d4c30a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1277 microversion: 2.1 time: 0.249901 Aug 21 01:07:38.857782 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 200/355] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:38.888856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9fe6ba65-ab34-4f47-940c-84a0dfbb5c91 tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1246341089" status: 202 len: 0 microversion: 2.1 time: 0.053157 Aug 21 01:07:38.890110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 156/356] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:07:38 2022] DELETE /compute/v2.1/flavors/1246341089 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:07:38.901256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e8a24f2-a651-4865-ae50-e071e5e87a6f tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:38.938834 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e8a24f2-a651-4865-ae50-e071e5e87a6f tempest-FlavorsExtraSpecsTestJSON-1955906933 tempest-FlavorsExtraSpecsTestJSON-1955906933-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.043963 Aug 21 01:07:38.961585 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 201/357] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:07:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:39.301161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:39.302393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:39.326926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:39.327951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:39.329554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:39.333757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:39.335354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:39.336848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:39.451981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:39.457911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:39.474551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:39.475302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:39.483438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:39.484573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:39.485485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:39.486872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:40.416831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:40.427562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2167758-6ab9-4ed0-a206-f5afd6c8548b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 1.131320 Aug 21 01:07:40.444483 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 157/358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:39 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:40.457272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:40.458819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:40.483167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:40.486053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:40.486708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:40.488814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:40.489276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:40.489698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:40.618932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:40.620310 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:40.635745 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-583d1b25-48ac-4deb-b12e-c8ccb3d5d766 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 1.187680 Aug 21 01:07:40.637085 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 202/359] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:39 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:41.034602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6da2993d-5b9d-4d05-85dc-1a3bc881b92f tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Action: 'create', calling method: .version_select at 0x7fc3fa8ebe50>, body: {"keypair": {"name": "tempest-keypair-399131272", "type": "ssh", "user_id": "bbd3e55d2c7241df93b25250f3f077ab", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAN3DCyUsF8VgKgnA/+Kpzrm9redg5iBEwtpUel/JKN68t+r+iDZWGIrIkK+frwR/gjCuakI1ghHygecfmEGF1HC9ncDGbf+0LbEwdxTPnr4sZ76ZigMkaHP4iEc36lcQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:41.071036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6da2993d-5b9d-4d05-85dc-1a3bc881b92f tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:41.077091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6da2993d-5b9d-4d05-85dc-1a3bc881b92f tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for user d72e959103ed4c6fbe0c6053abf40171 and project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:41.110781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:41.119343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69d6e3c9-8a6b-4a83-9dd3-6367865396a6 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.673629 Aug 21 01:07:41.125027 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 158/360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:40 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:41.138417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6da2993d-5b9d-4d05-85dc-1a3bc881b92f tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.495068 Aug 21 01:07:41.140316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 203/361] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:07:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 503 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:07:41.154083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25efb241-2eae-4f23-a84f-19954ce8b76d tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Action: 'create', calling method: .version_select at 0x7fc3fead7160>, body: {"keypair": {"name": "tempest-keypair-764263298", "type": "ssh", "user_id": "bbd3e55d2c7241df93b25250f3f077ab", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPsFuyDXz4zV++gAFVAocZbC4JmgHGZLaEuWjH8OddjJsnvIclNIjF0FfrI64pGQgErzfhNGCeWJCifkAfr/fUEfXAgixrXMqBiOyXV1golMJtQmNa8G0BN8aO6DDRohA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:41.203266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-25efb241-2eae-4f23-a84f-19954ce8b76d tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:41.224969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-25efb241-2eae-4f23-a84f-19954ce8b76d tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for user d72e959103ed4c6fbe0c6053abf40171 and project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:41.296522 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-25efb241-2eae-4f23-a84f-19954ce8b76d tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.146355 Aug 21 01:07:41.304245 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 159/362] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:07:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:07:41.308221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc1cf1eb-b0d1-451d-a703-e9c42bfb9cd1 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Calling method '.version_select at 0x7fc3fa68d310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.323603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc1cf1eb-b0d1-451d-a703-e9c42bfb9cd1 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-399131272?user_id=bbd3e55d2c7241df93b25250f3f077ab" status: 200 len: 511 microversion: 2.10 time: 0.019022 Aug 21 01:07:41.342400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b48b5758-bbf4-4a59-a226-898034750a0c tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Action: 'create', calling method: .version_select at 0x7fc3fea40310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-868283828", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGQf3gfjvEXLfsC69bK0u7FDx8oR9fgbJZbYZEaWTmVJQsiBp7rTFHzOEhSb19RHSKIUvGS3BwGYrDbtRuLiJVkqJr6EWFsJWKluZ+ar6/wT7H6ZYZGq/gnGJMF5w2F5A=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:41.355956 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 204/363] 10.222.0.46 () {60 vars in 1337 bytes} [Sun Aug 21 01:07:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-399131272?user_id=bbd3e55d2c7241df93b25250f3f077ab => generated 511 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:41.380279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b48b5758-bbf4-4a59-a226-898034750a0c tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:41.389504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b48b5758-bbf4-4a59-a226-898034750a0c tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Getting quotas for user d72e959103ed4c6fbe0c6053abf40171 and project c91c594d418c401f9f86a81de3205bf4. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:41.436317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b48b5758-bbf4-4a59-a226-898034750a0c tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.097057 Aug 21 01:07:41.438967 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 160/364] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:07:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:07:41.451559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa04b5ca-e647-4536-97f4-b42c2f900b4e tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Calling method '.version_select at 0x7fc3fa68d8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.456363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.456544 n-d-master-1 devstack@n-api.service[122482]: WARNING oslo_db.sqlalchemy.utils [None req-fa04b5ca-e647-4536-97f4-b42c2f900b4e tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:07:41.457505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:41.471644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:41.472193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:41.472527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:41.473250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:41.473775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:41.474101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:41.476516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa04b5ca-e647-4536-97f4-b42c2f900b4e tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs?user_id=bbd3e55d2c7241df93b25250f3f077ab" status: 200 len: 724 microversion: 2.10 time: 0.029600 Aug 21 01:07:41.488070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 205/365] 10.222.0.46 () {60 vars in 1259 bytes} [Sun Aug 21 01:07:41 2022] GET /compute/v2.1/os-keypairs?user_id=bbd3e55d2c7241df93b25250f3f077ab => generated 724 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:41.512829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6daad698-d1fe-4875-8214-8f34258cf860 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Calling method '.version_select at 0x7fc3fa8ebe50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.575792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6daad698-d1fe-4875-8214-8f34258cf860 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-868283828" status: 204 len: 0 microversion: 2.10 time: 0.085035 Aug 21 01:07:41.582060 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 206/366] 10.222.0.46 () {60 vars in 1322 bytes} [Sun Aug 21 01:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-868283828 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:07:41.588916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e1cca3e-7eab-4532-9be8-ea90b69d9e75 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Calling method '.version_select at 0x7fc3fa67f280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.630025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e1cca3e-7eab-4532-9be8-ea90b69d9e75 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764263298?user_id=bbd3e55d2c7241df93b25250f3f077ab" status: 204 len: 0 microversion: 2.10 time: 0.044122 Aug 21 01:07:41.636506 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 207/367] 10.222.0.46 () {60 vars in 1340 bytes} [Sun Aug 21 01:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764263298?user_id=bbd3e55d2c7241df93b25250f3f077ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:07:41.645664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9ae5015-7e90-4242-a47f-c955eabc0655 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] Calling method '.version_select at 0x7fc3fa67fca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.675696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9ae5015-7e90-4242-a47f-c955eabc0655 tempest-KeyPairsV210TestJSON-2021208987 tempest-KeyPairsV210TestJSON-2021208987-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-399131272?user_id=bbd3e55d2c7241df93b25250f3f077ab" status: 204 len: 0 microversion: 2.10 time: 0.035709 Aug 21 01:07:41.676717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 208/368] 10.222.0.46 () {60 vars in 1340 bytes} [Sun Aug 21 01:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-399131272?user_id=bbd3e55d2c7241df93b25250f3f077ab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:07:41.682244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:41.683514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:41.694430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:41.695718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:41.696560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:41.697732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:41.699381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:41.700819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:41.903421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:41.923228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-382786f2-88c0-4fb4-a5d7-cb4484bdb396 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.476310 Aug 21 01:07:41.926077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 161/369] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:41 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:42.067640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b191227-e668-49a2-bc32-e515bed64e53", "tag": "5599bdf2-250c-4f09-b2b3-46f3a5764d26"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:42.086042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.086514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.086969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.110618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] Creating event network-changed:5599bdf2-250c-4f09-b2b3-46f3a5764d26 for instance 7b191227-e668-49a2-bc32-e515bed64e53 on n-h1-master-1 Aug 21 01:07:42.124078 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e86192f3-aa0b-42e6-b18d-856a68ca81f3 req-3d283da7-6784-4b89-9ddf-9c52bae5c04c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061125 Aug 21 01:07:42.125076 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 162/370] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:42.148508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:42.149238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:42.158184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.158672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.159108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.159823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.160272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.160703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.330219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:42.340574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-853cb846-4ea8-43d6-a3ca-f4dba84a6977 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.662619 Aug 21 01:07:42.343815 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 209/371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:41 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:42.723555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Calling method '.version_select at 0x7fc3fa68da60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:42.727615 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:42.727615 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:42.730207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.731214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.731880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.756375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.757674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.758577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.790205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.791090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.792057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.805405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.806303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.807133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.837954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.839105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.839820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.863553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e9d4a4a-e8ef-48cf-8ada-36d934b3720a tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.516660 Aug 21 01:07:42.865490 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 210/372] 10.222.0.46 () {60 vars in 1243 bytes} [Sun Aug 21 01:07:42 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:42.883275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Calling method '.version_select at 0x7fc3fa66a8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:42.886162 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:42.886162 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:42.887525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.888096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.888616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.915778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.916640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.917402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.922126 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:42.970437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.971207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.971576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:42.993228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:42.994021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:42.994763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.026909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.027549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.028064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.035792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04fc7a69-d084-436f-a0a5-800dbc3c85dc tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.157582 Aug 21 01:07:43.036886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 211/373] 10.222.0.46 () {60 vars in 1222 bytes} [Sun Aug 21 01:07:42 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:43.042114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:43.042908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:43.052824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.053501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.054062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.056069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.056429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.057059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.086703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:43.099563 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3de368c2-3a2c-4d44-8196-43694e9365ce tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.955184 Aug 21 01:07:43.115184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 163/374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:42 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:43.122663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Calling method '.version_select at 0x7fc3feb57ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:43.126643 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:43.126643 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:43.128344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.129371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.131299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.156833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.158610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.159557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.198866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e71ca238-d387-4e73-9127-f4fbebda0fb3 tempest-HypervisorAdminV253TestBase-842801292 tempest-HypervisorAdminV253TestBase-842801292-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/0099b71b-bb18-467e-a610-e1c890fdebe3" status: 200 len: 792 microversion: 2.53 time: 0.080004 Aug 21 01:07:43.202286 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 164/375] 10.222.0.46 () {60 vars in 1298 bytes} [Sun Aug 21 01:07:43 2022] GET /compute/v2.1/os-hypervisors/0099b71b-bb18-467e-a610-e1c890fdebe3 => generated 792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:43.333971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86bf180-918f-4cd9-a821-c185a370dab9", "tag": "5bf5e45f-20b1-4528-97e7-c89c98c430f7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:43.349534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.354999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.356485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.395309 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] Creating event network-changed:5bf5e45f-20b1-4528-97e7-c89c98c430f7 for instance c86bf180-918f-4cd9-a821-c185a370dab9 on n-h2-master-1 Aug 21 01:07:43.401862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-99f7ee70-362f-4979-8984-6d1be2ab8162 req-98d5efd6-f9f9-4b85-b6c6-9a4547f4d610 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071504 Aug 21 01:07:43.404830 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 165/376] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:43.412892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:43.418852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:43.432185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.435362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.436102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.443886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:43.445439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:43.446139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:43.682293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:43.693359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9167ee63-527f-4889-b0f8-3ba7c8fd5543 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.655112 Aug 21 01:07:43.693938 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 212/377] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:43 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:43.918314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:43.928921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92200e6a-c4ce-4164-842d-14ca60562695 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.522522 Aug 21 01:07:43.929866 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 166/378] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:43 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:44.122665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:44.124645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:44.149463 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:44.155927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.160706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.161418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.170784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.175824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.176571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.192118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b476691a-9615-4e96-ab87-6f3d90b3e7ee", "tag": "9ccc7040-9a7a-4f9c-bf53-e6a75e549910"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:44.208854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.211732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.212419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.239362 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] Creating event network-changed:9ccc7040-9a7a-4f9c-bf53-e6a75e549910 for instance b476691a-9615-4e96-ab87-6f3d90b3e7ee on n-h1-master-1 Aug 21 01:07:44.250885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3164d2ca-aa61-4f71-bcb8-633023e7487c req-8797190b-89b7-4a12-b49b-b1d4107a9685 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060534 Aug 21 01:07:44.253555 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 167/379] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:44.617506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:44.632553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5381e60e-1cad-433c-944c-e8aad1595afb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.513699 Aug 21 01:07:44.633774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 213/380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:44 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:44.716102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:44.716830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:44.726109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.728645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.729337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.730262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.733493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.735817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.950151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:44.950765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:44.962603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.963529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.965597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:44.966505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:44.972745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:44.973515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:45.071046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:45.083377 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf325fa4-8cfb-4874-a625-a3b1c93a6bbc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.372244 Aug 21 01:07:45.100616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 168/381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:44 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:45.346573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:45.360829 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5feb58c1-373b-427a-a318-c162b31dec90 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.414436 Aug 21 01:07:45.361553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 214/382] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:44 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:45.656042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:45.656973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:45.691236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:45.692140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:45.692816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:45.694436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:45.695369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:45.696033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:46.107737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:46.108617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:46.116294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:46.125342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:46.125800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:46.126684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:46.127322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:46.127876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:46.255328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:46.267979 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-894c93d0-c861-460b-82b0-31728bd26386 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.615000 Aug 21 01:07:46.270425 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 169/383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:45 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:46.382083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:46.382704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:46.394319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:46.398610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:46.401112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:46.402100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:46.402749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:46.404684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:46.580131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:46.590670 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1219a99-ace4-47d9-8872-d9da9e2bfe44 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.486922 Aug 21 01:07:46.595869 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 215/384] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:46 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:46.785586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:46.794356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d716404-8367-494c-a808-547a6321c461 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.416409 Aug 21 01:07:46.808412 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 170/385] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:46 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:47.289962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:47.290815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:47.297946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.300197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.300914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:47.304076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.304973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.305623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:47.807039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:47.824892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b23dd805-b5f0-4708-a58b-84741ed74018 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.538472 Aug 21 01:07:47.839056 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 216/386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:47 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:47.849918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:47.850045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-787f4f76-ac97-41c0-af82-f0588f92f7a1 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-166241527", "id": 1844657217, "os-flavor-access:is_public": "True"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:47.850563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:47.853294 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:47.853294 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:47.869170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.870121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.870803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:47.871636 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3,nova_api:DELETE=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:47.873263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.875935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.877981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:47.887938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-787f4f76-ac97-41c0-af82-f0588f92f7a1 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.473079 Aug 21 01:07:47.889538 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 171/387] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:07:47 2022] POST /compute/v2.1/flavors => generated 467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:47.895899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:47.897702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:47.923081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.923586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.924013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:47.924936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:47.925479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:47.925948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:48.144611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:48.154192 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e41605a7-3c5b-4feb-a942-e50b7a1eaccc tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.262714 Aug 21 01:07:48.157022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 172/388] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:47 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:48.393544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:48.408631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66b3bbc4-5304-4b85-8aab-2c2f847c3a22 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.567353 Aug 21 01:07:48.420975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 217/389] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:47 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:48.479864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81f8d665-6db9-49c0-8ee7-8a00ad2dc96e tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.500000 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81f8d665-6db9-49c0-8ee7-8a00ad2dc96e tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] 10.222.0.46 "GET /compute/v2.1/flavors/1844657217" status: 200 len: 467 microversion: 2.61 time: 0.343510 Aug 21 01:07:48.501163 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 173/390] 10.222.0.46 () {60 vars in 1199 bytes} [Sun Aug 21 01:07:48 2022] GET /compute/v2.1/flavors/1844657217 => generated 467 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:48.516283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a59692a-4f5e-4367-a295-286da196e709 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:48.519073 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:48.519073 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:48.559715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a59692a-4f5e-4367-a295-286da196e709 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1844657217" status: 200 len: 468 microversion: 2.61 time: 0.047726 Aug 21 01:07:48.574774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 218/391] 10.222.0.46 () {62 vars in 1219 bytes} [Sun Aug 21 01:07:48 2022] PUT /compute/v2.1/flavors/1844657217 => generated 468 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:48.578459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6226eabb-95be-435d-ae63-f4c81780de39 tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.643106 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6226eabb-95be-435d-ae63-f4c81780de39 tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 7154 microversion: 2.61 time: 0.073299 Aug 21 01:07:48.656864 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 174/392] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:07:48 2022] GET /compute/v2.1/flavors/detail => generated 7154 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:48.666797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5177b877-d1e9-40ac-80ca-98b3fd7846cf tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.696178 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5177b877-d1e9-40ac-80ca-98b3fd7846cf tempest-FlavorsV261TestJSON-1047653365 tempest-FlavorsV261TestJSON-1047653365-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.61 time: 0.033091 Aug 21 01:07:48.708846 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 219/393] 10.222.0.46 () {60 vars in 1166 bytes} [Sun Aug 21 01:07:48 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:48.714300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93cc2f9d-653f-4429-8203-c561a149e7eb tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.715296 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:48.715296 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:48.740599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93cc2f9d-653f-4429-8203-c561a149e7eb tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1844657217" status: 202 len: 0 microversion: 2.61 time: 0.029839 Aug 21 01:07:48.741915 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 175/394] 10.222.0.46 () {60 vars in 1202 bytes} [Sun Aug 21 01:07:48 2022] DELETE /compute/v2.1/flavors/1844657217 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:07:48.758109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87e6165a-6c31-447a-b038-c80c55180a83 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.786595 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87e6165a-6c31-447a-b038-c80c55180a83 tempest-FlavorsV261TestJSON-2144100318 tempest-FlavorsV261TestJSON-2144100318-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.038543 Aug 21 01:07:48.793322 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 220/395] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:07:48 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:07:48.848556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:48.849825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:48.874696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:48.877146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:48.880381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:48.881667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:48.882513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:48.883426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:48.926703 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:49.150321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:49.161570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b7063a83-2fec-42d0-8ead-8b3e55185235 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.318346 Aug 21 01:07:49.164061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 176/396] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:48 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:49.177658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:49.178283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:49.188140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:49.189714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:49.191198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:49.192365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:49.192992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:49.194029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:49.430785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:49.431397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:49.445058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:49.446053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:49.446689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:49.447545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:49.450520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:49.451382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:49.685492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:49.696937 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8ccff38-4205-4fb9-a274-68168ca41b90 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.269952 Aug 21 01:07:49.698035 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 177/397] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:49 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:49.714414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:49.724901 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68f941e4-20e6-459e-9ebb-e4f1d7497f98 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.551904 Aug 21 01:07:49.725931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 221/398] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:49 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:49.886010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1320017511", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:49.903041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9942576e-cba1-47c1-aeae-33b5fb237381 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] Calling method '.version_select at 0x7fc3fa66ae50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:49.904416 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:49.904416 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:49.996724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9942576e-cba1-47c1-aeae-33b5fb237381 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.269451 Aug 21 01:07:49.998244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:49.999632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:50.000585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:50.000876 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 222/399] 10.222.0.46 () {60 vars in 1226 bytes} [Sun Aug 21 01:07:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:50.001180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:50.001828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:50.010926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a7cc106-2fdc-4fa8-99a3-4f338169a9c5 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa8eb9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:50.018318 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:50.018318 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:50.027199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.028513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.030237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.031455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.034298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.034903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.087148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Getting quotas for project 10a30211c0624285b0d861b43a2036c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:50.088876 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:RELEASE=3,nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:UPDATE=4,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:50.103370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Getting quotas for user 1c396660456743b19abe19dccdb9ba2e and project 10a30211c0624285b0d861b43a2036c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:50.140452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:50.146758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:50.225267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-74b49960-7537-4014-9a7e-ebc3d7f44175 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.525534 Aug 21 01:07:50.225904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 178/400] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:07:50.235398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:50.236323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:50.260462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.261318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.261911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.262826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.263426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.263994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.370154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a7cc106-2fdc-4fa8-99a3-4f338169a9c5 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.363631 Aug 21 01:07:50.371473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 223/401] 10.222.0.46 () {62 vars in 1247 bytes} [Sun Aug 21 01:07:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:50.377019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:50.383659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:50.491944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.500617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b8d94c4-62fb-45ef-a632-d64a08918fcb tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.273672 Aug 21 01:07:50.514918 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 179/402] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:50 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:50.515131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.519854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.525247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.529067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0f5c0d82-a0f9-4b6e-9d7c-4f116e0a4cbb tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] Calling method '.version_select at 0x7fc3fecb0c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:50.536486 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:50.536486 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:07:50.544318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17708984-7cc7-4897-8a3b-aa86acc4a7d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "PUT /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1359 microversion: 2.75 time: 0.169958 Aug 21 01:07:50.557389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 224/403] 10.222.0.46 () {62 vars in 1297 bytes} [Sun Aug 21 01:07:50 2022] PUT /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:50.574868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b476691a-9615-4e96-ab87-6f3d90b3e7ee", "name": "network-vif-plugged", "status": "completed", "tag": "9ccc7040-9a7a-4f9c-bf53-e6a75e549910"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:50.576663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0f5c0d82-a0f9-4b6e-9d7c-4f116e0a4cbb tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.068465 Aug 21 01:07:50.583972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 180/404] 10.222.0.46 () {60 vars in 1226 bytes} [Sun Aug 21 01:07:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:50.583972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:50.584155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:50.614489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.614957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.615376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.640813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] Creating event network-vif-plugged:9ccc7040-9a7a-4f9c-bf53-e6a75e549910 for instance b476691a-9615-4e96-ab87-6f3d90b3e7ee on n-h1-master-1 Aug 21 01:07:50.654076 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9126cc00-76f3-4501-a743-1eff919acc86 req-79ca7ca1-35ab-4b89-afc0-c5278129f4d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095000 Aug 21 01:07:50.654999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 225/405] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:50.658376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.666364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbf051fb-bccc-49b3-aedd-ced67e85e696 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa66af70>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:50.669477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.671604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:50.675014 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:07:50.675014 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:07:50.682281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5522ad6a-1dcd-49d9-bd06-0bdbb160e9de tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1359 microversion: 2.75 time: 0.101745 Aug 21 01:07:50.693414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 181/406] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:50 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1359 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:50.723501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:50.723501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:50.731681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.732522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.733153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.734275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.735018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.735587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.809407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbf051fb-bccc-49b3-aedd-ced67e85e696 tempest-QuotaClassesAdmin257Test-1445407369 tempest-QuotaClassesAdmin257Test-1445407369-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.152642 Aug 21 01:07:50.810873 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 226/407] 10.222.0.46 () {62 vars in 1247 bytes} [Sun Aug 21 01:07:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:07:50.826442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:50.827191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:50.842372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.842881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.843377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:50.844098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:50.844844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:50.845062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:51.182275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:51.197344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:51.199730 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1443d9d-f4a6-430f-96cd-d44e8d9ec51b tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.480508 Aug 21 01:07:51.205151 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 182/408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:50 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:51.209010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f63d338e-f332-4614-95f3-fc5dbd627ca3 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.397013 Aug 21 01:07:51.210533 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 227/409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:50 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:51.522758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:51.524107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:51.539202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:51.540281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:51.540742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:51.543151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:51.543640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:51.545789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:51.718444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:51.719224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:51.729570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:51.731839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:51.732622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:51.734166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:51.735367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:51.736186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:51.995542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.006144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.007661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.019101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4e7deb7-6035-46af-a63e-4648fabb8722 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1355 microversion: 2.75 time: 0.304550 Aug 21 01:07:52.023712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 228/410] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:51 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:52.108950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.124792 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15a9a215-06d9-491a-87eb-4661251544c2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.605423 Aug 21 01:07:52.139062 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 183/411] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:51 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:52.227737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:52.228523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:52.230521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:52.231632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:52.237872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:52.240021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:52.241693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:52.242628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:52.244845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:52.245481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:52.245850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:52.246329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:52.246754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:52.247443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:52.247882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:52.248290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:52.700180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.732262 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f80d2ff-d764-418c-9b7f-3c5e39437f47 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.505068 Aug 21 01:07:52.733621 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 229/412] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:52 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:52.766530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:52.778096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ddb229cf-9f5b-4f80-b7f8-5dfeb4eb1897 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1323 microversion: 2.1 time: 0.551341 Aug 21 01:07:52.780414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 184/413] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:52 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:52.804893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b191227-e668-49a2-bc32-e515bed64e53", "name": "network-vif-plugged", "status": "completed", "tag": "5599bdf2-250c-4f09-b2b3-46f3a5764d26"}, {"server_uuid": "c86bf180-918f-4cd9-a821-c185a370dab9", "name": "network-vif-plugged", "status": "completed", "tag": "5bf5e45f-20b1-4528-97e7-c89c98c430f7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:52.821350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:52.833460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:52.833926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:52.871602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Creating event network-vif-plugged:5599bdf2-250c-4f09-b2b3-46f3a5764d26 for instance 7b191227-e668-49a2-bc32-e515bed64e53 on n-h1-master-1 Aug 21 01:07:52.874442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] Creating event network-vif-plugged:5bf5e45f-20b1-4528-97e7-c89c98c430f7 for instance c86bf180-918f-4cd9-a821-c185a370dab9 on n-h2-master-1 Aug 21 01:07:52.890779 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2eff0025-1633-4cbc-8c6c-41b7781319b7 req-bba0396d-b97e-4eed-ba96-1ec6a99a8b45 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090535 Aug 21 01:07:52.902109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 230/414] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:07:53.056153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:53.056811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:53.082693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.083291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.086316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.087112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.090325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.092060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.148106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:53.159087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:53.195897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.196679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.197355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.198439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.202329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.213579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.336160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:53.349429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:53.352165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:53.364254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5687510-86bf-4f87-aae7-8046063b234e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1417 microversion: 2.75 time: 0.318397 Aug 21 01:07:53.364879 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 185/415] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:53 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1417 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:53.765260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:53.766212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:53.773758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.774416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.775383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.779002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.781141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.783621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.878376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:53.891151 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15267a11-cab3-42e7-9705-8a8cf7d94c45 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1319 microversion: 2.1 time: 0.747629 Aug 21 01:07:53.904543 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 231/416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:53 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:53.915516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:53.916142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:53.932486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.933105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.933549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:53.936258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:53.936937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:53.937735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.265091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.291399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-515d607f-af6b-4c66-9550-9833ec68dafc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.531257 Aug 21 01:07:54.293376 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 186/417] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:53 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:54.334294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.344339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57eb2321-e138-4011-945c-4cbdc44f9ec1 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1472 microversion: 2.1 time: 0.441997 Aug 21 01:07:54.345771 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 232/418] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:53 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:54.366884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:54.367987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:54.377970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.378455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.378892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.379578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.380020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.388296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.395388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:54.397145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:54.415792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.416483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.417173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.418700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.422827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.423423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.448120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Request method failure captured: Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee/diagnostics HTTP/1.1 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVNXpYPoeOtNOcjDN8g3g36-1fpM1MuNEXGv6OgaOTuPGPNi7E4SECD1I01jZvO2lSAAhI83MmcWlMj3CmW2XSX0_zYbGn9JcIefHIqNs1RucYiKaPGR5No4qyMEOkKxnl664raClzlBpkcj98kl6AOw4wV5o9PfQz2xu5xgI1-BZ0 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: ee9e0038aadf42e8be2911efd9bfb896 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:07:54.466919 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee9e0038aadf42e8be2911efd9bfb896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee9e0038aadf42e8be2911efd9bfb896", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee9e0038aadf42e8be2911efd9bfb896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee9e0038aadf42e8be2911efd9bfb896"}]}] Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: ee9e0038aadf42e8be2911efd9bfb896 Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerDiagnosticsNegativeTest-716852830-project Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: dd9f99d20b344589961aa679179adbb1 Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-716852830-project Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:07:54.468357 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'b476691a-9615-4e96-ab87-6f3d90b3e7ee'} Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:07:54.469011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 21 01:07:54.470135 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:07:54.472532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:07:54.476450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-685076b5-22e5-490a-ae9d-e7fd93daac82 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.113134 Aug 21 01:07:54.483937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 187/419] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:07:54 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee/diagnostics => generated 117 bytes in 117 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:54.498183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:54.499036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:54.507747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.509887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.510585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.511734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.513036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.513978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.571650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:07:54.674376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.688060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.692200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:54.710872 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c15fdfd-04fe-4d90-a9a7-bc879bf37a3e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1417 microversion: 2.75 time: 0.322957 Aug 21 01:07:54.726325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 233/420] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:54 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1417 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:54.752129 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef13fc32-9e68-428c-92ef-2b167c49531d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 204 len: 0 microversion: 2.1 time: 0.258768 Aug 21 01:07:54.753362 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 188/421] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:07:54 2022] DELETE /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:07:54.783322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:54.784184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:54.804419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.804948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.807610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.811465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.812500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.814703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.914285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:54.915267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:54.942644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.943629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.945144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:54.947524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:54.948998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:54.950335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:55.252806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:55.266529 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b456009-da63-477d-a67d-626510faa327 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1467 microversion: 2.1 time: 0.354786 Aug 21 01:07:55.269371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 189/422] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:54 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:55.607768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:55.628906 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5804453-46a3-480d-b5f8-c22dafc4c20d tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1478 microversion: 2.1 time: 0.856724 Aug 21 01:07:55.645265 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 234/423] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:54 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1478 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:55.652967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:55.665772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:55.684604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:55.685520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:55.686491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:55.688634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:55.690027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:55.690788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:55.704570 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:55.730769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:55.736871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:55.757216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:55.758264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:55.759917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:55.765503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:55.766395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:55.769070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:55.903511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:07:56.183254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:56.195023 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96213f71-ccf4-4932-952f-fd7ccf5fa525 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1318 microversion: 2.1 time: 0.548551 Aug 21 01:07:56.197801 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c06c237-4dbc-4baf-9a51-086c59b77c0e tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 204 len: 0 microversion: 2.1 time: 0.908903 Aug 21 01:07:56.198651 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 190/424] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:07:55 2022] DELETE /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:07:56.202141 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 235/425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:55 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:56.208881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:56.209855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:56.217784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:56.219308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:56.228659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.229188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.229621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.230346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.230791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.235039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.238670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.239233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.239667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.240552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.241020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.244607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.486213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:56.497979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:56.500673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:56.507531 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c20a849-6c24-48d0-a200-1c1a5005dff8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1438 microversion: 2.75 time: 0.306398 Aug 21 01:07:56.510038 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 191/426] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:56 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1438 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:56.539847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:56.543532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:56.551516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.552149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.577802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.580731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.581392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.581960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.743886 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:56.768378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:56.769096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:56.769572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:56.769972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:56.770376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:56.949804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:56.962551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:56.975111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.976761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5e0c491-409a-421a-9ef3-ef9933ddf166 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1473 microversion: 2.1 time: 0.769028 Aug 21 01:07:56.977748 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 236/427] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:56 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1473 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:56.984557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.985036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.985781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:56.986235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:56.989684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:56.994710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:56.995549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:57.003457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.004210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.004873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.005803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.006445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.007059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.314844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.346963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.349579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.361111 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4ef688d-d707-44b6-bcd4-5ca9220605ff tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "POST /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78/action" status: 202 len: 1495 microversion: 2.75 time: 0.828182 Aug 21 01:07:57.378355 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 192/428] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:07:56 2022] POST /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78/action => generated 1495 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 21 01:07:57.385766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.394065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:57.397462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac8880ad-f18b-45a8-967b-e10fb204b770 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1478 microversion: 2.1 time: 0.417443 Aug 21 01:07:57.398046 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 237/429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:56 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1478 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:57.404829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:57.405482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:57.413977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:57.429332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.429814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.430235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.430934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.431378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.431784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.434127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.434734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.435266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.436088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.438251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.438979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.676650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.694500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.700154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.713746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58685039-46a1-42a6-ba91-4fe7a5bad946 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.314652 Aug 21 01:07:57.718684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 238/430] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:57 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:57.885756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:57.896684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-777a6344-28ab-4c0b-9480-ec7092ec75c3 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1467 microversion: 2.1 time: 0.516362 Aug 21 01:07:57.897305 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 193/431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:57 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1467 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:57.919687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:57.920618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:57.924550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1756162753", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:57.926815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.927757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.928351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.929586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:57.930617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:57.931265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:57.962186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lazy-loading 'flavor' on Instance uuid 7b191227-e668-49a2-bc32-e515bed64e53 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:07:58.010317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:07:58.111535 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cac5ee98-18af-4cee-a1ca-1ba20ab0d402 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53/action" status: 202 len: 0 microversion: 2.1 time: 0.196993 Aug 21 01:07:58.112546 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 194/432] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:07:57 2022] POST /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:07:58.120518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:58.121388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:58.130030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.130800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.131325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.132283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.133304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.133833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.432669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:58.443424 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f77b948-58fa-4c48-9aae-245ebc8308bc tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1473 microversion: 2.1 time: 0.329190 Aug 21 01:07:58.443670 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 195/433] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:58 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:58.466272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:58.467134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:58.477312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.477811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.478246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.478946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.479393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.479809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.765719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:07:58.766631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:07:58.767434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:07:58.768019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:07:58.768821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:07:58.793458 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=7 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:58.816163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.817633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.818451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.820199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.820851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.821510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.877217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:58.881799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Getting quotas for project 74a87c21538344c7ac51835993e5839d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:07:58.885185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acc7d8c2-c5a4-4841-832c-c24116124b2c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1475 microversion: 2.1 time: 0.440363 Aug 21 01:07:58.896533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Getting quotas for user 9ebc6e77ecbc4a61a6f13803cd1a1589 and project 74a87c21538344c7ac51835993e5839d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:07:58.901455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 196/434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:58 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1475 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:58.906633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b476691a-9615-4e96-ab87-6f3d90b3e7ee", "name": "network-vif-deleted", "tag": "9ccc7040-9a7a-4f9c-bf53-e6a75e549910"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:58.915594 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:58.927030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:07:58.929680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:07:58.932172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.934073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.934312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.952563 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] Creating event network-vif-deleted:9ccc7040-9a7a-4f9c-bf53-e6a75e549910 for instance b476691a-9615-4e96-ab87-6f3d90b3e7ee on n-h1-master-1 Aug 21 01:07:58.958663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-98c8706a-f0bf-4ccc-89f3-caa5b31a014a req-862e6484-8b8c-4559-b356-1d17b071470a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055864 Aug 21 01:07:58.960390 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 197/435] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:58.969423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:58.969607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:58.975426 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:58.979866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.980391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.980907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:58.982188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:58.982866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:58.983575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.032728 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86b0f21a-18ab-411c-b767-3392781bd3c5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282701 Aug 21 01:07:59.034104 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 239/436] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:07:59.034287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.034773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.035255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.035991 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lazy-loading 'fault' on Instance uuid b476691a-9615-4e96-ab87-6f3d90b3e7ee {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:07:59.046958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:59.047576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:59.065068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.065554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.067927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.068784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.069939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.070518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.201372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9f99d20b344589961aa679179adbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9e0038aadf42e8be2911efd9bfb896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.213861 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-feb39755-c8ce-4038-b57c-100dc315763f tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 200 len: 1313 microversion: 2.1 time: 0.252190 Aug 21 01:07:59.215515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 198/437] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:58 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:59.241524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f792eb6-906d-43f4-976f-8ef61bf914f9 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:59.245095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1f792eb6-906d-43f4-976f-8ef61bf914f9 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:59.304560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.317881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.320677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.326676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52e02351-41ca-4497-beed-6578ec849ce3 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.291087 Aug 21 01:07:59.327857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 240/438] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:07:59 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:07:59.469764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:59.470738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:59.482921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.486465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.491485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.492268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.494296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.494745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.642111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.658019 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6843dcc0-c9dd-4274-a524-e7f0f98bc063 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 200 len: 1431 microversion: 2.1 time: 0.193192 Aug 21 01:07:59.659347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 241/439] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:59 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 1431 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:07:59.703701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1f792eb6-906d-43f4-976f-8ef61bf914f9 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:07:59.707049 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=27 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:59.714807 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f792eb6-906d-43f4-976f-8ef61bf914f9 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1222 microversion: 2.1 time: 0.487324 Aug 21 01:07:59.718438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 199/440] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:59 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1222 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:07:59.750095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86bf180-918f-4cd9-a821-c185a370dab9", "name": "network-vif-deleted", "tag": "5bf5e45f-20b1-4528-97e7-c89c98c430f7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:07:59.760683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.761464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.762042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.794302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] Creating event network-vif-deleted:5bf5e45f-20b1-4528-97e7-c89c98c430f7 for instance c86bf180-918f-4cd9-a821-c185a370dab9 on n-h2-master-1 Aug 21 01:07:59.804279 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8a683b85-518c-4fe1-a409-935806108c62 req-e0ca1189-5634-4195-b775-4a8c7488b7b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057617 Aug 21 01:07:59.804804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 242/441] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:07:59.909858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:07:59.910755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:07:59.926235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.927005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.927514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:07:59.931311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:07:59.931693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:07:59.932239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.053988 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:00.237226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:00.237914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] [instance: b476691a-9615-4e96-ab87-6f3d90b3e7ee] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:00.250716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.251468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.253498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.256424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.256942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.257443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.287203 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] HTTP exception thrown: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Request method failure captured: Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee HTTP/1.1 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVNXpYPoeOtNOcjDN8g3g36-1fpM1MuNEXGv6OgaOTuPGPNi7E4SECD1I01jZvO2lSAAhI83MmcWlMj3CmW2XSX0_zYbGn9JcIefHIqNs1RucYiKaPGR5No4qyMEOkKxnl664raClzlBpkcj98kl6AOw4wV5o9PfQz2xu5xgI1-BZ0 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ee9e0038aadf42e8be2911efd9bfb896 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:00.288923 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee9e0038aadf42e8be2911efd9bfb896"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee9e0038aadf42e8be2911efd9bfb896", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee9e0038aadf42e8be2911efd9bfb896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee9e0038aadf42e8be2911efd9bfb896"}]}] Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ee9e0038aadf42e8be2911efd9bfb896 Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-716852830 Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiagnosticsNegativeTest-716852830-project Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: dd9f99d20b344589961aa679179adbb1 Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-716852830-project Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. Aug 21 01:08:00.290168 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b476691a-9615-4e96-ab87-6f3d90b3e7ee'} Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:00.290841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. Aug 21 01:08:00.291964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.293030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] Returning 404 to user: Instance b476691a-9615-4e96-ab87-6f3d90b3e7ee could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:00.293030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62475faa-3e48-4611-9950-3a42c0d12ff8 tempest-ServerDiagnosticsNegativeTest-716852830 tempest-ServerDiagnosticsNegativeTest-716852830-project] 10.222.0.46 "GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee" status: 404 len: 111 microversion: 2.1 time: 0.057492 Aug 21 01:08:00.293030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 243/442] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:00 2022] GET /compute/v2.1/servers/b476691a-9615-4e96-ab87-6f3d90b3e7ee => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:08:00.333937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:00.349311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-091d95e7-ee25-4f52-a0d0-dfb329d4e851 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1458 microversion: 2.1 time: 0.443193 Aug 21 01:08:00.350652 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 200/443] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:07:59 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1458 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:00.351729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:00.352532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:00.363733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.364496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.365114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.366003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.366590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.372898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:00.373696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.374339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:00.383584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.384202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.384717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.385597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.386138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.386639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.475086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:00.491494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:00.494590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:00.504704 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7a8f43f-8c76-4da6-8e5f-3fa554a7301a tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.156973 Aug 21 01:08:00.523311 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 244/444] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:00 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:00.685234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:00.685991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:00.694660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.696798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.697497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.702493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.703595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.704250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.733312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 HTTP/1.1 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:00.735282 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: exception: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:00.736457 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c86bf180-918f-4cd9-a821-c185a370dab9'} Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:00.737205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:00.738243 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:00.747424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:00.748422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06718170-3c09-4682-a7bd-c6ca3bfb1583 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 404 len: 111 microversion: 2.1 time: 0.068320 Aug 21 01:08:00.758693 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 245/445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:00 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:00.758693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:00.758693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:00.764172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.764881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.765399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.766185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:00.766725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:00.767245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:00.852312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:00.862722 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1acfe2b6-e552-4e41-be4b-fa690824410d tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1274 microversion: 2.1 time: 0.112099 Aug 21 01:08:00.869820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 246/446] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:00 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:00.991450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1878484294", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:01.060984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6fd20443-d1e2-450a-9da5-d456c5f3db23 tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1609 microversion: 2.1 time: 0.692329 Aug 21 01:08:01.069298 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 201/447] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:00 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1609 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:01.081722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:08:01.091807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:01.095288 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:01.095288 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:01.096697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.097471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.098258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.099211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.099961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.100604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.128822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f2ede346-0e1a-46b5-b512-aa18f89bb12d tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040617 Aug 21 01:08:01.139404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 202/448] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:08:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:08:01.145557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:01.153647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:01.171179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.171832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.172667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.178583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.179355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.180019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.336689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Lazy-loading 'flavor' on Instance uuid 7b191227-e668-49a2-bc32-e515bed64e53 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:01.359472 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7b191227-e668-49a2-bc32-e515bed64e53 while it is in vm_state suspended Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Request method failure captured: Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53/action HTTP/1.1 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 97 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUzm5bmQQYXgwUtviC7ZjAruMttmtQPK4tFV6xKb8hhCxLBnjCRr4BqsBJGiTV1ZnbGAEDHBXrVzfas1FepyOvxSH48QiEOPSm5DN-FCz0mZXI70By9JVBmYbScDo5puec_ik7kPWe1rlqbTe-9cI5ey8xrqUukJxfRARPYW9bIkFE Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: aa7ed056a25f4e0eac5fb20571f85a61 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:08:01.362451 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa7ed056a25f4e0eac5fb20571f85a61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa7ed056a25f4e0eac5fb20571f85a61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa7ed056a25f4e0eac5fb20571f85a61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa7ed056a25f4e0eac5fb20571f85a61"}]}] Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: aa7ed056a25f4e0eac5fb20571f85a61 Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1429790141 Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-LiveMigrationNegativeTest-1429790141-project-admin Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9163e0cbd5ae479cb49905b804c3dbba Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-LiveMigrationNegativeTest-1429790141-project-admin Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Aug 21 01:08:01.363852 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'os-migrateLive' instance 7b191227-e668-49a2-bc32-e515bed64e53 while it is in vm_state suspended Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b191227-e668-49a2-bc32-e515bed64e53', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 21 01:08:01.364577 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b191227-e668-49a2-bc32-e515bed64e53 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:01.365703 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7b191227-e668-49a2-bc32-e515bed64e53 while it is in vm_state suspended Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7b191227-e668-49a2-bc32-e515bed64e53 while it is in vm_state suspended Aug 21 01:08:01.366960 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:01.373123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7b191227-e668-49a2-bc32-e515bed64e53 while it is in vm_state suspended {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:01.374829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-037e51b9-292b-4bce-a3a1-14c258ff951a tempest-LiveMigrationNegativeTest-1429790141 tempest-LiveMigrationNegativeTest-1429790141-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53/action" status: 409 len: 155 microversion: 2.1 time: 0.234043 Aug 21 01:08:01.387077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 203/449] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:01 2022] POST /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53/action => generated 155 bytes in 247 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:08:01.395602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:01.396492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:01.413190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.415528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.416260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.417487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.418223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.418998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.489325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:01.669919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97456f10-f112-4de7-ac1e-4c698de0da33 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 204 len: 0 microversion: 2.1 time: 0.281118 Aug 21 01:08:01.681379 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 204/450] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:01 2022] DELETE /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:01.687685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:01.690869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:01.702542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.707634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.710761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.712039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.714531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.717413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.915040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:01.919186 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:01.933203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:01.934250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:01.934971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:01.935520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:01.936144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:01.941647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:01.951444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:01.962230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.962706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.963128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.964011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:01.964599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:01.965161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:01.986257 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce790efb-2610-4f50-9c50-9db361b77cbd tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.303279 Aug 21 01:08:02.001313 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 205/451] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:01 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:02.008421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:02.009051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:02.027110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:02.027591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:02.031848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:02.034747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:02.035884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:02.037290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:02.047273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Getting quotas for project 58c64f1c2dba41298be11cd0772e8792. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:02.059696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Getting quotas for user 49f609273d3d4d18a9ef755ed5359da9 and project 58c64f1c2dba41298be11cd0772e8792. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:02.119689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:08:02.144945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:08:02.272386 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc77cd1e-b034-42cf-8c9e-fe9befcff980 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283292 Aug 21 01:08:02.281054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 247/452] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:08:02.291884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:02.294825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:02.315087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:02.317020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:02.318196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:02.319317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:02.320106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:02.320691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:02.555166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:02.573701 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3be48365-794a-43b7-8af7-d68e709824f1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1464 microversion: 2.1 time: 0.571187 Aug 21 01:08:02.578152 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 206/453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:02 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:02.588211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:02.597881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8a7e781-dcd3-445d-822e-13ab4b272caa tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:02.602885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8a7e781-dcd3-445d-822e-13ab4b272caa tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:02.603102 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9eedca6-e39a-40ea-88c2-f3e259a52e79 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1280 microversion: 2.1 time: 0.317696 Aug 21 01:08:02.605074 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 248/454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:02 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:02.820550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8a7e781-dcd3-445d-822e-13ab4b272caa tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:02.828729 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8a7e781-dcd3-445d-822e-13ab4b272caa tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1220 microversion: 2.1 time: 0.248616 Aug 21 01:08:02.831693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 207/455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:02 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1220 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:03.015027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:03.015564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:03.032317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.042325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.042799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.043551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.044020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.045129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.226889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:03.261406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:03.263373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:03.282974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ae6d05c-ae0e-4fc3-ba8b-31b3e0c4b443 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.272510 Aug 21 01:08:03.284229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 249/456] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:03 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:03.600708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:03.601396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:03.626382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:03.627450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:03.640066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.648080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.650027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.653547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.655156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.655774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.657472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.667048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.668759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.671693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:03.677804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:03.681929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:03.984460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:03.999650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5d147d0-0175-42fc-a9dc-cbb99c10be35 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1280 microversion: 2.1 time: 0.377517 Aug 21 01:08:04.004030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 250/457] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:03 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1280 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:04.017026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:04.017890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:04.041082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:04.043809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:04.044253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:04.046807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:04.047682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:04.048803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:04.355767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:04.373885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6259aae3-852c-44ee-96b5-9ee89ef77682 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1280 microversion: 2.1 time: 0.367639 Aug 21 01:08:04.375209 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 251/458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:04 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1280 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:04.391103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:04.393738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:04.404009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:04.406684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:04.407474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:04.408543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:04.409702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:04.410293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:04.512460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:04.517427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:04.530244 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2358e1c5-67ff-40c9-af6e-40755c371fe4 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1464 microversion: 2.1 time: 0.935189 Aug 21 01:08:04.534948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 208/459] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:03 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1464 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:04.545957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:04.555672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:04.562579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2913e17f-5a64-453b-a986-50f102da0006 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.185087 Aug 21 01:08:04.564027 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 252/460] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:04 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:05.022016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:05.022624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:05.034685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.038007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.038747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.039606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.042629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.043808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.397739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:05.398507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:05.406147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.406864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.407431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.412901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.414250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.421207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.679674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:05.693043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d51420f-38c0-4b4d-98f5-e7e8cc834f5a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1278 microversion: 2.1 time: 0.299061 Aug 21 01:08:05.693220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:05.705198 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 253/461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:05 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:05.716326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:05.717026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:05.729020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.729721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.730557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.731347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.731805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.732756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.738124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d09a037d-9c43-4d02-a4f4-55e1048a8759 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.719469 Aug 21 01:08:05.739341 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 209/462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:05 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:05.757206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:05.761058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:05.775880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.778401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.779138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.784094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:05.784925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:05.786513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:05.968058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:05.984933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:05.986643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:06.000537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d94302c5-1754-474f-b768-895e0099539e tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.259917 Aug 21 01:08:06.002696 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 210/463] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:05 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:06.009732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b191227-e668-49a2-bc32-e515bed64e53", "name": "network-vif-deleted", "tag": "5599bdf2-250c-4f09-b2b3-46f3a5764d26"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:06.039335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:06.041892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:06.042675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:06.063654 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] Creating event network-vif-deleted:5599bdf2-250c-4f09-b2b3-46f3a5764d26 for instance 7b191227-e668-49a2-bc32-e515bed64e53 on n-h1-master-1 Aug 21 01:08:06.077048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cae50840-eee6-4ca4-b7ed-1a9f692743ee req-c457ebfd-74f4-4f4f-a06e-ac1dcfff813a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072519 Aug 21 01:08:06.078535 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 211/464] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:06.110959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:06.126213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fcdc9cb3-11a7-45a5-ab8f-57c0e789722c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 200 len: 1294 microversion: 2.1 time: 0.422879 Aug 21 01:08:06.126750 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 254/465] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:05 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 1294 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:06.718413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:06.719638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:06.731026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:06.732713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:06.734974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:06.735907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:06.736802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:06.739020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:06.759628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:06.760759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:06.775855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:06.794722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:06.801669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:06.804467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:06.806100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:06.808942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:06.823617 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:07.401632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:07.414829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7880faa0-aa08-4f9f-8cc5-87e34c7f535a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.701059 Aug 21 01:08:07.416013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 212/466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:06 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:07.422600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faa34102-2b7f-4f19-bfb4-be6fd6f7da1c", "tag": "6be9fda2-ba48-4d58-bd76-d36b7ac8da14"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:07.434373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.434938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.435525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.448079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] Creating event network-changed:6be9fda2-ba48-4d58-bd76-d36b7ac8da14 for instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c on n-h2-master-1 Aug 21 01:08:07.454885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c19fbee5-2b8e-44ab-b43f-1d063c3b991b req-b06df68f-bd2b-41e6-8249-6acfb2c1303b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037307 Aug 21 01:08:07.456037 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 213/467] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:07.461395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:07.462802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:07.469903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.470631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.471218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.472083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.473157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.473763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.602733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:07.623366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:07.627254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73128fef-74a9-48e2-9f72-e02462345780 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.870025 Aug 21 01:08:07.633540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 255/468] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:06 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:07.635284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:07.636922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: 7b191227-e668-49a2-bc32-e515bed64e53] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:07.649470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:07.651183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:07.651467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.652555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.653501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.654503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.655315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.656460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.663828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bb99592-db3e-47e1-967b-45a0c969e461 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.206400 Aug 21 01:08:07.673103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 214/469] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:07.699247 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] HTTP exception thrown: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Request method failure captured: Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 HTTP/1.1 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUx5VLnsuJbzuhUiA2rF3zd7RtEGO0i3wwmU6QUZLPo9xYySkrsW023eGgKD7n4d5xSiwXrwp6DYj3h8TzeOBn4CZsqATKgqybincv3jD2pV6yyDWWi4DI-93tMnpTt8ha14BWKffvnEhVKwW6DSq1UXfh9TOvVJ_uin849Qslfg-4 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: aa388d025cac48ada2e632d0df0b4cad Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:07.701141 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa388d025cac48ada2e632d0df0b4cad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa388d025cac48ada2e632d0df0b4cad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa388d025cac48ada2e632d0df0b4cad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa388d025cac48ada2e632d0df0b4cad"}]}] Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: aa388d025cac48ada2e632d0df0b4cad Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveMigrationNegativeTest-575292947-project Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 22500a157cbb43eab8e92270d59a2f2a Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveMigrationNegativeTest-575292947-project Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. Aug 21 01:08:07.702856 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b191227-e668-49a2-bc32-e515bed64e53'} Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:07.703889 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. Aug 21 01:08:07.705011 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.705997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Returning 404 to user: Instance 7b191227-e668-49a2-bc32-e515bed64e53 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:07.705997 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-45b0fcc6-9ebd-4adf-9071-8474fe7fe2de tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53" status: 404 len: 111 microversion: 2.1 time: 0.072628 Aug 21 01:08:07.707911 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 256/470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/servers/7b191227-e668-49a2-bc32-e515bed64e53 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:07.713672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:07.714405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:07.723209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.725301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.726521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.727886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.730209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.731504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.766707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:07.904238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d2dd19f-cc10-4ed1-a66d-149b36a6029c tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 204 len: 0 microversion: 2.1 time: 0.195005 Aug 21 01:08:07.911948 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 257/471] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:07 2022] DELETE /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:07.922447 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c773066-0c71-4f5d-a928-80760ccadbaf tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-20T01%3A08%3A07.352016&end=2022-08-22T01%3A08%3A07.352016" status: 404 len: 112 microversion: - time: 0.248019 Aug 21 01:08:07.923602 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 215/472] 10.222.0.46 () {58 vars in 1316 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-20T01%3A08%3A07.352016&end=2022-08-22T01%3A08%3A07.352016 => generated 112 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 21 01:08:07.933784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f754eac9-21c0-4b2e-a88b-38298db8ab08 tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] Calling method '.version_select at 0x7fc3fe774820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:07.934298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:07.937432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:07.943074 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f754eac9-21c0-4b2e-a88b-38298db8ab08 tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f754eac9-21c0-4b2e-a88b-38298db8ab08 tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] Request method failure captured: Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-simple-tenant-usage/cc27cc6473f245f3a9a23a05d0033a02?start=2022-08-22T01%3A08%3A07.352016&end=2022-08-20T01%3A08%3A07.352016 HTTP/1.1 Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV3bdLbjgRq3s4leR8tHK6Od8a1k0k6j9Jn9Z2oRdUxBHa3wMu3ogjdATgOVzIsJxkTf17XBeNRTASxq9HqsspmQLPXNkmsDumlCAy70NuPH3zLGyRw43XEc0wqv6b3ONlxHctcT7rln6H_jHdjUnDJKKACun98YMgL5bqtOZHqR5U Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 2e2b44ce465e4588b54b238cb766582f Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1425929837 Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:08:07.951266 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e2b44ce465e4588b54b238cb766582f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e2b44ce465e4588b54b238cb766582f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e2b44ce465e4588b54b238cb766582f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e2b44ce465e4588b54b238cb766582f"}]}] Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1425929837 Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 2e2b44ce465e4588b54b238cb766582f Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1425929837 Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 351aa6435f3243388739d58e960facf7 Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid start time. The start time cannot occur after the end time. Aug 21 01:08:07.952647 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'cc27cc6473f245f3a9a23a05d0033a02'} Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 21 01:08:07.953796 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 21 01:08:07.954860 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:07.956975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.957464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.959871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.960448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f754eac9-21c0-4b2e-a88b-38298db8ab08 tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:07.962504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f754eac9-21c0-4b2e-a88b-38298db8ab08 tempest-TenantUsagesNegativeTestJSON-1425929837 tempest-TenantUsagesNegativeTestJSON-1425929837-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/cc27cc6473f245f3a9a23a05d0033a02?start=2022-08-22T01%3A08%3A07.352016&end=2022-08-20T01%3A08%3A07.352016" status: 400 len: 111 microversion: 2.1 time: 0.032941 Aug 21 01:08:07.962659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:07.964983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:07.965942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:07.966211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 216/473] 10.222.0.46 () {58 vars in 1412 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/os-simple-tenant-usage/cc27cc6473f245f3a9a23a05d0033a02?start=2022-08-22T01%3A08%3A07.352016&end=2022-08-20T01%3A08%3A07.352016 => generated 111 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:08:08.232542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b8dc45e-951d-436d-86b6-92ceac3dc014 tempest-TenantUsagesNegativeTestJSON-550789712 tempest-TenantUsagesNegativeTestJSON-550789712-project] Calling method '.version_select at 0x7fc3fe757f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:08.239806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8b8dc45e-951d-436d-86b6-92ceac3dc014 tempest-TenantUsagesNegativeTestJSON-550789712 tempest-TenantUsagesNegativeTestJSON-550789712-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0d6319c7317f4d85b3e50ad26384e3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc27cc6473f245f3a9a23a05d0033a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b8dc45e-951d-436d-86b6-92ceac3dc014 tempest-TenantUsagesNegativeTestJSON-550789712 tempest-TenantUsagesNegativeTestJSON-550789712-project] Request method failure captured: Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-20T01%3A08%3A07.352016&end=2022-08-22T01%3A08%3A07.352016&detailed=1 HTTP/1.1 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV1fp2ONFZZPQiEtin25CziY2d5Mw6BCCM69I_JtmvHmcO45JCEiNjoKxpQ7Zw2co754jIY6Ni7q6aymq-F6qoOHZxyBnX3844ztDQPXllo2Xm449bzrtDKoUxl4rdvSoH6FLHCAyLtW4tYaJa6aJAmtruGj-AUo06b1hpZVurMpmg Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cc27cc6473f245f3a9a23a05d0033a02 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-550789712 Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:08.242799 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cc27cc6473f245f3a9a23a05d0033a02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cc27cc6473f245f3a9a23a05d0033a02", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cc27cc6473f245f3a9a23a05d0033a02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cc27cc6473f245f3a9a23a05d0033a02"}]}] Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-550789712 Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cc27cc6473f245f3a9a23a05d0033a02 Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-550789712 Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TenantUsagesNegativeTestJSON-550789712-project Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0d6319c7317f4d85b3e50ad26384e3e9 Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-550789712-project Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:08:08.244295 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:08.245229 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:08.247448 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:08.251201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 21 01:08:08.251201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:08.252513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b8dc45e-951d-436d-86b6-92ceac3dc014 tempest-TenantUsagesNegativeTestJSON-550789712 tempest-TenantUsagesNegativeTestJSON-550789712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:08.254572 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b8dc45e-951d-436d-86b6-92ceac3dc014 tempest-TenantUsagesNegativeTestJSON-550789712 tempest-TenantUsagesNegativeTestJSON-550789712-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-20T01%3A08%3A07.352016&end=2022-08-22T01%3A08%3A07.352016&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.282192 Aug 21 01:08:08.256036 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 217/474] 10.222.0.46 () {58 vars in 1335 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-20T01%3A08%3A07.352016&end=2022-08-22T01%3A08%3A07.352016&detailed=1 => generated 123 bytes in 284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:08.398835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95e8705-3686-41ea-ac36-52d8a173ad00", "tag": "1fc3faad-0d06-47eb-95da-f0222f20fbbe"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:08.425293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.425833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.426096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.447346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.457819 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c524531-7cea-4126-ab0b-cedfd4cafee1 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1475 microversion: 2.1 time: 0.536973 Aug 21 01:08:08.460645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 258/475] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:07 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:08.477685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:08.478459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:08.484253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] Creating event network-changed:1fc3faad-0d06-47eb-95da-f0222f20fbbe for instance f95e8705-3686-41ea-ac36-52d8a173ad00 on n-h2-master-1 Aug 21 01:08:08.486937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.487434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.488130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.488749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.489041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.489544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.497273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8f3e3469-429a-45bb-b386-943efe6cc1ea req-f4e19d57-8666-4311-8588-5e8853025557 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104094 Aug 21 01:08:08.504951 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 218/476] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:08:08.649857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:08.651228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:08.662332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.663873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.664611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.666463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.668401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.669713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.741995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.751986 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-188a3aa9-6107-4c68-aced-d0b88a97f13e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.290441 Aug 21 01:08:08.756017 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 259/477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:08 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:08.780102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:08.782653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:08.800100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.800675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.801130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.803112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:08.806623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:08.807109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:08.918189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.928193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.929997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:08.936104 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30d2d5df-1d77-422b-ad19-d9ec713568bc tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.179956 Aug 21 01:08:08.936864 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 260/478] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:08 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:08.999740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:09.009449 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ffdb849-9571-4962-9d7a-c5ff27047430 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.365025 Aug 21 01:08:09.014368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 219/479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:08 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:09.487631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:09.488319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:09.507040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:09.510996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:09.512614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:09.517855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:09.518392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:09.518963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:09.774586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:09.775206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:09.787646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:09.790592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:09.792841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:09.794476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:09.794956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:09.797902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:10.097591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.113367 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbd6d7f0-f819-4c87-ae01-dc8611011139 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1475 microversion: 2.1 time: 0.634796 Aug 21 01:08:10.115408 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 261/480] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:09 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1475 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:10.133369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:10.137543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:10.152254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:10.157643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:10.161161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:10.162206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:10.162892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:10.164934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:10.203619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.215261 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcdb8c89-5b70-4d74-8720-9ef354bcb8f5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.445994 Aug 21 01:08:10.217464 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 220/481] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:09 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:10.249627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:10.253288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:10.267872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:10.269859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:10.270527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:10.281503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:10.282527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:10.283623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:10.333673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.346014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.350153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.367382 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-783704e3-afb8-47fb-b696-fff1b43f22cb tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.250666 Aug 21 01:08:10.372177 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 262/482] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:10 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:10.601097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:10.619769 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21e52d36-2c42-4ebd-92b2-514a218409f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.385668 Aug 21 01:08:10.620751 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 221/483] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:10 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:11.135724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:11.137398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:11.145724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.146407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.146979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.147825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.148453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.149432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.241754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:11.243855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:11.247260 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:11.255790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.257062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.257654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.258559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.259328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.261101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.543436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:11.568808 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aeb205b1-9c3c-4cf3-b3c0-e4f520aa6500 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.333776 Aug 21 01:08:11.573158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 222/484] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:11 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:11.574601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:11.575364 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:11.583506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.584159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.584740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.585912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.586995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.587896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.705492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:11.720599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:11.722338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:11.728992 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4807f0bd-d57b-4cb5-b7a6-6f6af1aa1523 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.158135 Aug 21 01:08:11.729985 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 223/485] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:11 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:11.739245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:11.740302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:11.778556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:11.786071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.788704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.790200 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8064e2fc-d8fe-425d-8164-efe98e9e09dc tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1475 microversion: 2.1 time: 0.659276 Aug 21 01:08:11.791056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:11.791348 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 263/486] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:11 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:11.795599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:11.796303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:11.798205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:12.037932 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:12.081411 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=11 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:12.367351 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:12.381812 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f14f246b-c71e-4bf7-9898-a7a18d65d4e7 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.650623 Aug 21 01:08:12.382594 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 224/487] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:11 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:12.534964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-798639040", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:12.590357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:12.590964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:12.604717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:12.605235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:12.605662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:12.607165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:12.607632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:12.611039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:12.626765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:08:12.828458 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:13.083008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:13.091840 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-78764073-300c-4edc-98c4-e9ef539d292e tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.505608 Aug 21 01:08:13.094692 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 225/488] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:12 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:13.334715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd13c7f3-f42d-42be-93d2-319b53553c1d tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe7980d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkLCHzl3xyNwhv5yux06O5JIN+89djrQE34tn2tNIqxbMSJ2pqbzsQM3BOPpdTrUPkrWAbqnRxA7wxSdFi/iiWFNxYX4LUYMSrVUaPl0aBSG7sEPL5kI3x7kro8rky2Ww=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd13c7f3-f42d-42be-93d2-319b53553c1d tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 257 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:13.341239 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:13.343585 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkLCHzl3xyNwhv5yux06O5JIN+89djrQE34tn2tNIqxbMSJ2pqbzsQM3BOPpdTrUPkrWAbqnRxA7wxSdFi/iiWFNxYX4LUYMSrVUaPl0aBSG7sEPL5kI3x7kro8rky2Ww=="}} Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkLCHzl3xyNwhv5yux06O5JIN+89djrQE34tn2tNIqxbMSJ2pqbzsQM3BOPpdTrUPkrWAbqnRxA7wxSdFi/iiWFNxYX4LUYMSrVUaPl0aBSG7sEPL5kI3x7kro8rky2Ww=='}}} Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.344394 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:13.346197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:08:13.347803 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:08:13.349228 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 21 01:08:13.349228 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.349228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd13c7f3-f42d-42be-93d2-319b53553c1d tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:13.349228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd13c7f3-f42d-42be-93d2-319b53553c1d tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.252133 Aug 21 01:08:13.352837 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 226/489] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:13 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:08:13.361358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:13.361976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:13.382032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.382646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.382952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.383661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.384113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.384526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.499483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:13.518254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:13.519987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:13.532450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1af76741-61a4-40ec-a077-93de163dc042 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.178265 Aug 21 01:08:13.533596 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 227/490] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:13 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:13.539448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:13.543619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:13.564194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.568247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.569232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.570722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.571660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.573926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.606998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:13.607507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:13.608133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:13.609228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:13.609999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:13.623054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.624359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.625031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.627557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.628319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.628924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.677123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:13.685133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:13.703317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:08:13.706648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:08:13.719492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:13.733447 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4fc8386-6dff-4edc-a8b0-d54acd3cdba0 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1433 microversion: 2.1 time: 0.198517 Aug 21 01:08:13.734130 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 228/491] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:13 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1433 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:13.750696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe774040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-153117670", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:13.754922 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:13.793269 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21154696-d193-4f11-93cb-114dfec33637 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758798 Aug 21 01:08:13.796751 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 264/492] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:08:13.799482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:13.810060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for user 698cee4e0a2a441c86037db6194eb603 and project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:13.810906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:13.811965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:13.844441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.846795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.848904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.850384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.852199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.854212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.866516 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 2166 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-153117670", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:13.886015 n-d-master-1 devstack@n-api.service[122483]: exception: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-153117670', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:13.888088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:13.891272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:13.895677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:13.896892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dfa58ae-992f-45e2-a6d5-4adbfbe384bc tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.150952 Aug 21 01:08:13.898061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 229/493] 10.222.0.46 () {60 vars in 1160 bytes} [Sun Aug 21 01:08:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:13.905647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6335189-ef66-469d-9ec9-aae1ebee7701", "name": "network-vif-deleted", "tag": "e35a7458-a0bf-44c7-a333-a8265cabbc00"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:13.931897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:13.934359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:13.936583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:13.957621 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] Creating event network-vif-deleted:e35a7458-a0bf-44c7-a333-a8265cabbc00 for instance c6335189-ef66-469d-9ec9-aae1ebee7701 on n-h2-master-1 Aug 21 01:08:13.963961 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-45d92898-abf4-42bc-80b3-ad4d9faa6257 req-b2e47b49-e124-4e86-81bd-c220b9beac64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064512 Aug 21 01:08:13.965883 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 230/494] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:13.973140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5360757-e45a-4888-9dd9-913c82e7af06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:13.974382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5360757-e45a-4888-9dd9-913c82e7af06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:14.067209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5360757-e45a-4888-9dd9-913c82e7af06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.075296 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5360757-e45a-4888-9dd9-913c82e7af06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1212 microversion: 2.1 time: 0.106751 Aug 21 01:08:14.078582 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 231/495] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:13 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:14.083869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6a09f70-e916-4407-86f8-b51ef7107155 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe86f430>, body: {"keypair": {"name": "tempest-keypair-1971039979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHdT3vq8/bKYr7KMuA9DoBpyPPniDoHAcoEgfocDn1+ZrpwMkPijJk9v673OCVOUEFXX68n6t5ojS0qdqeiWZBXabuF1OyUlI2L513oVP1vFWJUhkfn6VcFiZCQ5EX2Aw=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.111084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d6a09f70-e916-4407-86f8-b51ef7107155 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:14.116310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d6a09f70-e916-4407-86f8-b51ef7107155 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for user 698cee4e0a2a441c86037db6194eb603 and project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:14.119559 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:14.188519 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6a09f70-e916-4407-86f8-b51ef7107155 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108671 Aug 21 01:08:14.192731 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 232/496] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:14.203573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa34102-2b7f-4f19-bfb4-be6fd6f7da1c", "name": "network-vif-plugged", "status": "completed", "tag": "6be9fda2-ba48-4d58-bd76-d36b7ac8da14"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.224755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.225825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.226506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.241977 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:14.243732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.253023 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7339e99f-44b6-4b01-a1fd-e9b1db5be212 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.454700 Aug 21 01:08:14.258229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 265/497] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:13 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:14.267513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:14.269470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] Creating event network-vif-plugged:6be9fda2-ba48-4d58-bd76-d36b7ac8da14 for instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c on n-h2-master-1 Aug 21 01:08:14.270321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:14.279664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.282057 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-dd72e881-7fe2-44dd-8f38-0727d219223b req-cd24e69c-f32c-4d5b-8ab6-1a29e72efd7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087589 Aug 21 01:08:14.288824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.289224 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 233/498] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:14.289758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.290824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.293284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.294070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.310315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe7578b0>, body: {"keypair": {"name": "tempest-keypair-1971039979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoVX0lL64LdDg6kDTJUuRbMwCCck+OYXMub7vRzSJEO0w+pz8GuiEy8YYdSTlsItKdmHFB9mEsiMep/nPy4fTULSWSsbWygcAyvb/JG7WMGgCBrGhbhYACTdERww+sqkQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.375414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:14.385672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for user 698cee4e0a2a441c86037db6194eb603 and project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:14.417381 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] HTTP exception thrown: Key pair 'tempest-keypair-1971039979' already exists. Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 273 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "tempest-keypair-1971039979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoVX0lL64LdDg6kDTJUuRbMwCCck+OYXMub7vRzSJEO0w+pz8GuiEy8YYdSTlsItKdmHFB9mEsiMep/nPy4fTULSWSsbWygcAyvb/JG7WMGgCBrGhbhYACTdERww+sqkQ=="}} Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: exception: Key pair 'tempest-keypair-1971039979' already exists. Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1971039979', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoVX0lL64LdDg6kDTJUuRbMwCCck+OYXMub7vRzSJEO0w+pz8GuiEy8YYdSTlsItKdmHFB9mEsiMep/nPy4fTULSWSsbWygcAyvb/JG7WMGgCBrGhbhYACTdERww+sqkQ=='}}} Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '698cee4e0a2a441c86037db6194eb603-tempest-keypair-1971039979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 21 01:08:14.452381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi session.flush() Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result.read() Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 21 01:08:14.457484 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '698cee4e0a2a441c86037db6194eb603-tempest-keypair-1971039979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 21, 1, 8, 14, 407616), 'updated_at': None, 'name': 'tempest-keypair-1971039979', 'user_id': '698cee4e0a2a441c86037db6194eb603', 'fingerprint': '35:b2:20:bf:1e:c7:89:68:a4:ee:57:4b:e3:c8:d0:0c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoVX0lL64LdDg6kDTJUuRbMwCCck+OYXMub7vRzSJEO0w+pz8GuiEy8YYdSTlsItKdmHFB9mEsiMep/nPy4fTULSWSsbWygcAyvb/JG7WMGgCBrGhbhYACTdERww+sqkQ==', 'type': 'ssh'}] Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair.create() Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._create() Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1971039979' already exists. Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 21 01:08:14.461041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1971039979' already exists. Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1971039979' already exists. Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 409 to user: Key pair 'tempest-keypair-1971039979' already exists. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d814709c-757e-4f7b-89c2-64006814f4da tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.162184 Aug 21 01:08:14.468741 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 234/499] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:08:14.473040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c52ae287-0471-4b20-8e07-fcba867bdb95 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Calling method '.version_select at 0x7fc3fe798dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:14.531845 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c52ae287-0471-4b20-8e07-fcba867bdb95 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971039979" status: 202 len: 0 microversion: 2.1 time: 0.069356 Aug 21 01:08:14.532607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 235/500] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971039979 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:14.547032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68f22684-452f-44ff-87d9-b4a1f99bc2bd tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe7f3ee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5N+ZLUdAQETMxOLrk54tfR94ikk0650+XazTpxJNMEJonqWPjDTKMugQQIadZ67QYcKXyJlY3ptTEtbPrNSpl36ELbFlCw2/e6g1s4bfeZggD2GSOlhxNIcyaOrUJ60g=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68f22684-452f-44ff-87d9-b4a1f99bc2bd tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 247 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5N+ZLUdAQETMxOLrk54tfR94ikk0650+XazTpxJNMEJonqWPjDTKMugQQIadZ67QYcKXyJlY3ptTEtbPrNSpl36ELbFlCw2/e6g1s4bfeZggD2GSOlhxNIcyaOrUJ60g=="}} Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5N+ZLUdAQETMxOLrk54tfR94ikk0650+XazTpxJNMEJonqWPjDTKMugQQIadZ67QYcKXyJlY3ptTEtbPrNSpl36ELbFlCw2/e6g1s4bfeZggD2GSOlhxNIcyaOrUJ60g=='}}} Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '' Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:08:14.550789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68f22684-452f-44ff-87d9-b4a1f99bc2bd tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.556746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68f22684-452f-44ff-87d9-b4a1f99bc2bd tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013410 Aug 21 01:08:14.558956 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 236/501] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:08:14.569431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:14.571745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:14.589171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.590242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.591082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.593636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.594513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.595447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.695985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.702685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.711973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.713478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.719487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d81d698-6e70-423d-b73a-08dd49a9e9ca tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.159180 Aug 21 01:08:14.720583 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 237/502] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:14 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:14.731804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe5708b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1008151970", "public_key": " "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.747433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94564579-fe8b-4960-852f-ffe53c47ee82 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.487607 Aug 21 01:08:14.750504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:14.750696 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 266/503] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:14 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:14.763812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:14.766635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for user 698cee4e0a2a441c86037db6194eb603 and project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:14.767105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:14.786408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.788969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.789656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.791334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:14.793448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:14.793883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:14.799828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 95 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1008151970", "public_key": " "}} Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: exception: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1008151970', 'public_key': ' '}}} Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.807173 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.811670 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.816662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.817734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3fca26f-f40b-4cf7-a286-e55adda9af77 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.092999 Aug 21 01:08:14.818521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 238/504] 10.222.0.46 () {60 vars in 1158 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:14.841188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-172e9449-c5c9-4961-a18e-86124eff8e81 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe57a8b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG46aTfgPGOVt9jAK3SumahCls6EQOFwOr53ajUbe6PIpjHe8bmYSPesmXMdTKUSX/mutokCtPDnFNvOuyNka/FTCYJ/KwByFDqxmcZz+jk9zFcwtwqU+ce7fm0TRC/1Q=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-172e9449-c5c9-4961-a18e-86124eff8e81 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 507 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG46aTfgPGOVt9jAK3SumahCls6EQOFwOr53ajUbe6PIpjHe8bmYSPesmXMdTKUSX/mutokCtPDnFNvOuyNka/FTCYJ/KwByFDqxmcZz+jk9zFcwtwqU+ce7fm0TRC/1Q=="}} Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG46aTfgPGOVt9jAK3SumahCls6EQOFwOr53ajUbe6PIpjHe8bmYSPesmXMdTKUSX/mutokCtPDnFNvOuyNka/FTCYJ/KwByFDqxmcZz+jk9zFcwtwqU+ce7fm0TRC/1Q=='}}} Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 21 01:08:14.849299 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-172e9449-c5c9-4961-a18e-86124eff8e81 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.852060 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-172e9449-c5c9-4961-a18e-86124eff8e81 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017632 Aug 21 01:08:14.857007 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 239/505] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:08:14.862299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Action: 'create', calling method: .version_select at 0x7fc3fe7f39d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-363709099", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:14.881220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:14.892056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Getting quotas for user 698cee4e0a2a441c86037db6194eb603 and project 0ca9a15019fa4648a678781cbaf227bb. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:14.911088 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 117 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-363709099", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: exception: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-363709099', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 21 01:08:14.913781 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d848e7f1-8e10-480c-8643-23a3b22333a1 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057523 Aug 21 01:08:14.917384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 240/506] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:08:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:08:14.925371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:14.926946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60ebc901-9236-4ca0-869f-ced46e5cf055 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Calling method '.version_select at 0x7fc3fe570550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:14.930375 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dfc72df1-bf39-44f7-b72d-2e0e770e6c50 tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1433 microversion: 2.1 time: 0.175893 Aug 21 01:08:14.933831 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 267/507] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:14 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1433 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:14.944342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-60ebc901-9236-4ca0-869f-ced46e5cf055 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60ebc901-9236-4ca0-869f-ced46e5cf055 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Request method failure captured: Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1490314561 HTTP/1.1 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV8rh9u7rbU_rAZGqXFOx1XbGMDzrLUmJKa8s81rnu8wdReeOSHg-9Sm_MqZzLMUm8uADOKmSKHRyojDKD9wRw2rVOQeMl-PU1ozADn1eFXDAUa_-EnyX1ih8QVmB7iajobkZhwUbI8DyR653VvRohqC73nRju_JRCiF0fN5Fojvv8 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0ca9a15019fa4648a678781cbaf227bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0ca9a15019fa4648a678781cbaf227bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0ca9a15019fa4648a678781cbaf227bb"}]}] Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0ca9a15019fa4648a678781cbaf227bb Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-662312013 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-KeyPairsNegativeTestJSON-662312013-project Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: exception: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'tempest-keypair-non-existent-1490314561'} Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.946154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 Aug 21 01:08:14.949902 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:14.953592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60ebc901-9236-4ca0-869f-ced46e5cf055 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1490314561 not found for user 698cee4e0a2a441c86037db6194eb603 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:14.954653 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60ebc901-9236-4ca0-869f-ced46e5cf055 tempest-KeyPairsNegativeTestJSON-662312013 tempest-KeyPairsNegativeTestJSON-662312013-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1490314561" status: 404 len: 145 microversion: 2.1 time: 0.031774 Aug 21 01:08:14.960191 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 241/508] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1490314561 => generated 145 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:15.099323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:15.104419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:15.144136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.148385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.149520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.150736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.159091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.160244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.281387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:15.282273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:15.294281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.296806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.298847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.300720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.302116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.304258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.537533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:15.550044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f63c7ec3-6159-4ca4-a41e-cf00c54ea2e9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1264 microversion: 2.1 time: 0.457946 Aug 21 01:08:15.552259 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 268/509] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:15 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1264 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:15.709886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:15.726410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11fbfdf1-e78a-4efd-ab5b-6b7e4d453ca5 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.451081 Aug 21 01:08:15.730516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 242/510] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:15 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:15.752742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:15.754005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:15.760959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.761686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.762257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.763123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.763710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.764317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.772322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:15.773155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:15.787157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.790490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.792297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.794168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:15.797168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:15.797976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:15.993180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.010311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.011898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.018321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69216f14-3a99-48bc-a592-306199f85190 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.270415 Aug 21 01:08:16.019244 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 269/511] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:15 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:16.039035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:16.039949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:16.048293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.050951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.053336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.054578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.055338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.056576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.100520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.101281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.101776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.102316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lazy-loading 'fault' on Instance uuid c6335189-ef66-469d-9ec9-aae1ebee7701 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:16.220348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22500a157cbb43eab8e92270d59a2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa388d025cac48ada2e632d0df0b4cad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.232894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-132dd060-26f7-4abc-8d5c-afdec2309b1d tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 200 len: 1309 microversion: 2.1 time: 0.212344 Aug 21 01:08:16.234695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 270/512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:16 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:16.251299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.272716 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6214db6-6dac-4500-8d8d-821a52916472 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.505029 Aug 21 01:08:16.275672 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 243/513] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:15 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:16.577406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:16.578357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:16.598232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.599014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.599817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.600731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.601519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.602199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.611834 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:16.742559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:16.752096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:16.752987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:16.755148 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4bbfbbb-7e0e-41e1-a530-503d8adc8e5e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1270 microversion: 2.1 time: 0.185631 Aug 21 01:08:16.756312 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 271/514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:16 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:16.768947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.769775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.770224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:16.771242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:16.771847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:16.772338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.039239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:17.051214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:17.051929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:17.056939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d37918f5-4042-4f6e-a274-76d763369253 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1322 microversion: 2.1 time: 0.310259 Aug 21 01:08:17.060852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 244/515] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:16 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:17.061843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.062338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.062793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.063488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.064172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.064588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.190573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:17.203679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:17.205716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:17.215374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a4bbd4a-b1be-4d27-ac23-2f72c74c24c4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.171692 Aug 21 01:08:17.221049 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 272/516] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:17 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:17.256951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:17.257788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] [instance: c6335189-ef66-469d-9ec9-aae1ebee7701] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:17.280495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.283061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.285646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.287634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.288294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.290156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.330757 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] HTTP exception thrown: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Request method failure captured: Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 HTTP/1.1 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUx5VLnsuJbzuhUiA2rF3zd7RtEGO0i3wwmU6QUZLPo9xYySkrsW023eGgKD7n4d5xSiwXrwp6DYj3h8TzeOBn4CZsqATKgqybincv3jD2pV6yyDWWi4DI-93tMnpTt8ha14BWKffvnEhVKwW6DSq1UXfh9TOvVJ_uin849Qslfg-4 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: aa388d025cac48ada2e632d0df0b4cad Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa388d025cac48ada2e632d0df0b4cad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa388d025cac48ada2e632d0df0b4cad", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa388d025cac48ada2e632d0df0b4cad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa388d025cac48ada2e632d0df0b4cad"}]}] Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: aa388d025cac48ada2e632d0df0b4cad Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-575292947 Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-LiveMigrationNegativeTest-575292947-project Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 22500a157cbb43eab8e92270d59a2f2a Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-LiveMigrationNegativeTest-575292947-project Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c6335189-ef66-469d-9ec9-aae1ebee7701'} Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:17.339440 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. Aug 21 01:08:17.343298 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:17.344504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] Returning 404 to user: Instance c6335189-ef66-469d-9ec9-aae1ebee7701 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:17.348877 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fee5c4d8-761a-4987-aab5-26bae915a38f tempest-LiveMigrationNegativeTest-575292947 tempest-LiveMigrationNegativeTest-575292947-project] 10.222.0.46 "GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701" status: 404 len: 111 microversion: 2.1 time: 0.094567 Aug 21 01:08:17.350523 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 245/517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:17 2022] GET /compute/v2.1/servers/c6335189-ef66-469d-9ec9-aae1ebee7701 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:17.360592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:17.361776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:17.370120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.371103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.372075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.373136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.375323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.376559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.755953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:17.768079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f89248cd-384e-4cd9-8e6e-571ec8b023db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.414645 Aug 21 01:08:17.791085 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 246/518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:17 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:17.802745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-821130805", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "733da70d-73b5-4a16-a93a-dec288bd5761"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:17.814527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:17.820627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:17.838370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.838917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.839366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.840247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:17.840588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:17.841037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:17.886527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] validate_networks() for [('733da70d-73b5-4a16-a93a-dec288bd5761', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:08:18.292200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:18.304820 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4692b957-3d37-4139-970e-c521f9e3d79e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.512089 Aug 21 01:08:18.305329 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 247/519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:17 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:18.330630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:18.331269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:18.350732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.352120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.352974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.354323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.356993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.358217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.707999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:18.708708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:18.709650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:18.710542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:18.711256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:18.740195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.741285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.742539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.743848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.744854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.745800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.770791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:18.777824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for user 547522b0b07f472a91ec83f15a36bb90 and project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:18.794473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:08:18.798201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:08:18.814679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:18.828687 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2322bc6a-b5f7-4f9c-a6a7-b370b0e511ed tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1471 microversion: 2.1 time: 0.519626 Aug 21 01:08:18.830144 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 248/520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:18 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:18.844897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:18.845993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:18.862899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.865343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.866132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.867481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.869311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.869987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.916029 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43598000-1253-4452-b196-6e6ef06a1a38 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.637184 Aug 21 01:08:18.918399 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 273/521] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:08:18.923869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:18.925083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:18.932735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.933642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.935468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:18.936526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:18.937205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:18.940883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:19.019388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.029904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.034393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.051738 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45829e50-90b4-44e4-9f94-f1726364e8be tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.218314 Aug 21 01:08:19.052591 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 249/522] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:18 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:19.189202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.200127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6c0f294-26b9-4b3d-88ec-8aa7a6803582 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.279505 Aug 21 01:08:19.206357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 274/523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:18 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:19.213882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:19.215867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:19.374002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.391567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.393798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.394922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52d9b831-255b-45c8-858b-163af905756a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1261 microversion: 2.25 time: 0.187352 Aug 21 01:08:19.395473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 275/524] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:19 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:19.409579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:19.410192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:19.417236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:19.417719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:19.421264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:19.422056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:19.422549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:19.422979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:19.614116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:19.614773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] [instance: 97791586-eaa8-4130-8b24-2ce5e66b9013] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:19.633412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] HTTP exception thrown: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Request method failure captured: Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/97791586-eaa8-4130-8b24-2ce5e66b9013/action HTTP/1.1 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 15 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVthRSAqf05_jLKiLM0GkeXsdgZLrra0W7G_FzhoLeSJNhysGORbxsczGH_PC3E5G7MA6f-PP67rllwm5eifg5XPUC6k0AuLqaag6uA8rD4mAlwFrKnOxNfBvDtOh2fUWIVFD605kMYgdc7T4x8uhQUVOe6hzgt8ywjv-meAtBmIIk Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a420e5cee9a64a2db8b85ce4a4158bf8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}] Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7abd7dd96a1e4264ba8b374857d1ef89 Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: {"migrate": {}} Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '97791586-eaa8-4130-8b24-2ce5e66b9013', 'body': {'migrate': {}}} Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:19.635094 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Returning 404 to user: Instance 97791586-eaa8-4130-8b24-2ce5e66b9013 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:19.641654 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ba9d31b-e506-40ed-8936-27ab1598e3c9 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/97791586-eaa8-4130-8b24-2ce5e66b9013/action" status: 404 len: 111 microversion: 2.1 time: 0.582594 Aug 21 01:08:19.649610 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 250/525] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:19 2022] POST /compute/v2.1/servers/97791586-eaa8-4130-8b24-2ce5e66b9013/action => generated 111 bytes in 596 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:19.657036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:19.695338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:19.705744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:19.707603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:19.734061 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] Creating event network-changed:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h1-master-1 Aug 21 01:08:19.749683 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d57ccba5-ddbd-4ffe-b609-bf5acc1970d0 req-150a57c4-d60f-43be-bf33-bb8dcb0da5ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093095 Aug 21 01:08:19.750510 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 251/526] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:19.804347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:19.822288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d62b148-92f1-48ff-8dee-4eaca8f1dcb0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.425754 Aug 21 01:08:19.828914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1265206309", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:19.832535 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 276/527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:19 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:19.948159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:08:20.091653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:20.093918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:20.103476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.104307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.104916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.105819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.106410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.106971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.416882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:20.417417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:20.417996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:20.418502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:20.419012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:20.437757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.441085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.441677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.442567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.445933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.446709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.488621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Getting quotas for project 74a87c21538344c7ac51835993e5839d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:20.494802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Getting quotas for user 9ebc6e77ecbc4a61a6f13803cd1a1589 and project 74a87c21538344c7ac51835993e5839d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:20.509429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:08:20.512257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:08:20.575489 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1396850f-fc8b-4b81-b2f0-809c61dd74da tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752291 Aug 21 01:08:20.583210 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 252/528] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:08:20.589671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:20.590479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:20.598139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.598861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.599635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.601907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.602608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.603259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.640401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.652409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.654326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.660524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26e7d7bb-f7e2-43df-985c-0e6563e5e9cf tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.581155 Aug 21 01:08:20.661635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 277/529] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:20 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:20.666913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:20.667993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:20.675878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.676666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.677507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.678544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.679202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.679990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.822488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.835020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.837009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.838518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c6ef471-1d2f-4981-bcf8-da89ecbd9999 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1313 microversion: 2.25 time: 0.175619 Aug 21 01:08:20.853742 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 278/530] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:20 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:20.875456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19582d80-886c-42b2-aa5f-b7a442b3af4b tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:20.876302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19582d80-886c-42b2-aa5f-b7a442b3af4b tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:20.915522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:20.926578 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab3dbadb-d251-4427-b1fb-ced627d2be17 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.341938 Aug 21 01:08:20.933973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 253/531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:20 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:20.971602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:20.975015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:20.983529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.984286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.985004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:20.985920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:20.986578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:20.987257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:21.135320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19582d80-886c-42b2-aa5f-b7a442b3af4b tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:21.153415 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19582d80-886c-42b2-aa5f-b7a442b3af4b tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1222 microversion: 2.1 time: 0.282949 Aug 21 01:08:21.161308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 279/532] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:20 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:21.287929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:21.300469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1ed441d-b36b-4a1f-a65e-a76b6a45fe71 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.348638 Aug 21 01:08:21.301263 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 254/533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:20 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:21.689027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:21.689945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:21.707770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:21.708284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:21.710867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:21.714003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:21.715938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:21.717021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:21.878219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:21.879641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:21.919112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:21.928734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:21.929292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:21.930412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:21.931041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:21.932216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:21.933300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:21.943430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:21.943637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:21.954733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2bb74ec4-b74d-4126-8094-608d6a36edb9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.271335 Aug 21 01:08:21.958659 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 280/534] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:21 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:21.976739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:21.981724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:21.994397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:21.998283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.009167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.010870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.011497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.012072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.271070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.280265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.287029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.296423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9136428e-5f69-475e-ae00-67feac393ffb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1319 microversion: 2.25 time: 0.424700 Aug 21 01:08:22.297328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 255/535] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:21 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:22.303305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:22.304967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:22.327043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.330654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.331390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.332367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.339492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.340273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.415999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.433204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb244904-fcf6-4de2-81b7-77dbc33ad73a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.468329 Aug 21 01:08:22.433849 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 281/536] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:21 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:22.464147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:22.465157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:22.480299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.482314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.483846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.484759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.490357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.491114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.606845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.627058 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8d3e76e6-1988-43e5-93ff-df38694736fc tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1274 microversion: 2.1 time: 0.328434 Aug 21 01:08:22.630057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 256/537] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:22 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:22.644997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95e8705-3686-41ea-ac36-52d8a173ad00", "name": "network-vif-plugged", "status": "completed", "tag": "1fc3faad-0d06-47eb-95da-f0222f20fbbe"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:22.679117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:22.679825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:22.685153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:22.722594 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] Creating event network-vif-plugged:1fc3faad-0d06-47eb-95da-f0222f20fbbe for instance f95e8705-3686-41ea-ac36-52d8a173ad00 on n-h2-master-1 Aug 21 01:08:22.733458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-25dab1a3-ae6e-4599-9a38-9bff97ed805f req-fb1c575a-bf17-42aa-9c74-3dded5e4a369 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100586 Aug 21 01:08:22.741397 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 257/538] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:22.852502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:22.867450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fa1f460-c90d-4fb5-a6f0-6e95e28295a0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.415481 Aug 21 01:08:22.870572 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 282/539] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:22 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:22.991026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:22.991721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:23.001827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.002316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.002745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.003446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.003893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.004309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.100526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.115231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.118002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.131538 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:23.134999 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e63eda87-40d3-4eb6-b5f8-9b2235332109 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1447 microversion: 2.75 time: 0.147949 Aug 21 01:08:23.141140 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 258/540] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:22 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:23.319830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:23.320427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:23.333632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.334149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.334583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.335297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.335739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.336233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.473293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d94bc590-edbe-4100-bd80-6521e477cdbc tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] Calling method '.version_select at 0x7fc3fa66a1f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:23.494743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.504453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.511473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.518699 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9ea78a7-7da0-420a-8c38-a9da4f89eaa1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1319 microversion: 2.25 time: 0.202189 Aug 21 01:08:23.519499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 259/541] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:23 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:23.524465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:23.526731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:23.543395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.546014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.546773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.547755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.548431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.549455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.753657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d94bc590-edbe-4100-bd80-6521e477cdbc tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 5399 microversion: 2.1 time: 0.494431 Aug 21 01:08:23.757994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 283/542] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:08:23 2022] GET /compute/v2.1/os-networks => generated 5399 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:23.763410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:23.764295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:23.771167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.772718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.773694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.775586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:23.776568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:23.777569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:23.903541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:23.919173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34d2863e-a709-4c93-ac50-f36234cd3c0f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1280 microversion: 2.1 time: 0.159811 Aug 21 01:08:23.921761 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 284/543] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:23 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:23.938463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1cab6a4a-cf79-4d09-821a-0c5c5bf144ae tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] Calling method '.version_select at 0x7fc3fa5ab1f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:24.046276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:24.072405 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9e2da79-0b45-4221-b4c0-00b4ecc34571 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1320 microversion: 2.1 time: 0.551312 Aug 21 01:08:24.076167 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 260/544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:23 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:24.086531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:24.087477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:24.105085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.106203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.107692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:24.114016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.114879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.116683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:24.129240 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:24.217667 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1cab6a4a-cf79-4d09-821a-0c5c5bf144ae tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks/747ccea1-029c-4226-a640-bd1cbebbd4e4" status: 200 len: 652 microversion: 2.1 time: 0.291042 Aug 21 01:08:24.220930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 285/545] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:08:23 2022] GET /compute/v2.1/os-networks/747ccea1-029c-4226-a640-bd1cbebbd4e4 => generated 652 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:24.225436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:24.226046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:24.238209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.238706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.239140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:24.244143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.244720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.245879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:24.378120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:24.389971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:24.391542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:24.407967 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c8b1abf-e0df-4010-b718-9112c227c9ee tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1453 microversion: 2.75 time: 0.187721 Aug 21 01:08:24.424794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 286/546] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:24 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:24.431261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5a15fee-b797-422d-b5e5-e488e1cb92a9 tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] Calling method '.version_select at 0x7fc3fa5739d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:24.688450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5a15fee-b797-422d-b5e5-e488e1cb92a9 tempest-NetworksTest-1681550108 tempest-NetworksTest-1681550108-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 5399 microversion: 2.1 time: 0.273723 Aug 21 01:08:24.689066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 287/547] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:08:24 2022] GET /compute/v2.1/os-networks => generated 5399 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:24.693851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:24.694456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:24.738646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.739118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.739545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:24.740299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:24.750200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:24.751343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.105278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.116607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.129119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.130843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68ce69a3-aaa5-4775-97a3-dcc2c5cb731e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.440859 Aug 21 01:08:25.131944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 288/548] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:24 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:25.137002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:25.137643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:25.160494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.161369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.162068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.162947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.163549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.164219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.469121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.487387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1398b1c-53d0-4b55-b32a-b621349ad1a7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 1.406858 Aug 21 01:08:25.489714 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 261/549] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:24 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:25.506851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:25.508860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:25.525313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.526218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.526844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.527791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.528573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.529047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.574012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.583449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-530c9fe8-a26b-491e-80b1-02b7f28e1a26 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1280 microversion: 2.1 time: 0.450225 Aug 21 01:08:25.597914 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 289/550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:25 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1280 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:25.603754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:25.604595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:25.611873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.612636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.613280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.614139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.614742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.615345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.753409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.770301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.775105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.791103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6fea3b76-3138-4770-92f4-1b35062961e8 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1453 microversion: 2.75 time: 0.191118 Aug 21 01:08:25.792177 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 290/551] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:25 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1453 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:25.837834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:25.861902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f215c70-2ebb-46bb-ab27-78212b4373c1 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1470 microversion: 2.1 time: 0.367243 Aug 21 01:08:25.862553 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 262/552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:25 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:25.887605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:25.890068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:25.897968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.898458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.898932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:25.899636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:25.900101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:25.900518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.146685 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:26.156753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:26.158074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:26.168886 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fcbe4d75-2481-487f-83d0-4108f746504f tempest-DeleteServersAdminTestJSON-1922247502 tempest-DeleteServersAdminTestJSON-1922247502-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00/action" status: 202 len: 0 microversion: 2.1 time: 0.285384 Aug 21 01:08:26.174548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.175532 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 291/553] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:25 2022] POST /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:26.175793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.177627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.179525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.182321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.183037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.185932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:26.186855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:26.204880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.206252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.206934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.208040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.208703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.209404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.307064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.307871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.309178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.309847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lazy-loading 'fault' on Instance uuid f95e8705-3686-41ea-ac36-52d8a173ad00 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:26.762337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:26.775408 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5953a36f-65c5-4dc1-ab71-ce73a62a046a tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1453 microversion: 2.1 time: 0.597552 Aug 21 01:08:26.778484 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 292/554] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:26 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1453 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:26.794416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfe02f3-fc88-49b2-b376-6d362bdc1b4c", "tag": "59e99352-1bdf-4d06-9a88-cd5f4b0ba642"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:26.813881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.814367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.814790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.852016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] Creating event network-changed:59e99352-1bdf-4d06-9a88-cd5f4b0ba642 for instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c on n-h1-master-1 Aug 21 01:08:26.863113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a751f62b-5964-4ecd-8b86-78d847f71921 req-3785e375-4a7d-4286-9f5a-2e88af79c502 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082510 Aug 21 01:08:26.866219 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 293/555] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:26.877963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "name": "network-vif-plugged", "status": "completed", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:26.888158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.888905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.893061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.923135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] Creating event network-vif-plugged:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h1-master-1 Aug 21 01:08:26.934946 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-cbf0d1db-23b2-48cd-a969-10c8697d5515 req-f0595fe8-b18b-400b-a7a5-e2ff74b5a935 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067077 Aug 21 01:08:26.936634 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 294/556] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:26.956724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:26.957491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:26.968209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.968917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.969543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:26.970513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:26.971163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:26.971794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.191165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.208677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.211280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.230071 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-063c9255-53c3-43ac-88e6-a57484a0379b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 1.077441 Aug 21 01:08:27.234203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 263/557] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:26 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:27.251574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:27.253135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:27.254769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.265070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.266798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.269620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.270590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.271375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.271624 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4577c4b0-d922-4080-b726-75ecfb7c788b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.334646 Aug 21 01:08:27.272692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.275914 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 295/558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:26 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:27.282943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:27.283437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:27.316630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.316999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.328441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.329354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.329837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.330272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.424404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:27.625868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aaf3c904-0068-4614-9d60-f82775a7dda2 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 204 len: 0 microversion: 2.1 time: 0.348638 Aug 21 01:08:27.630089 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 296/559] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:27 2022] DELETE /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:27.644545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:27.646327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:27.659863 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:27.678294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.679604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.683130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.688617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.690036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.690653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.807664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.838325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.840107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.848537 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-279e9e3e-53fa-4270-8b4a-3767a00040d1 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1438 microversion: 2.75 time: 0.215809 Aug 21 01:08:27.864802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 297/560] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:27 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1438 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:27.864802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:27.864802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:27.868042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.868566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.869028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.869728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.870790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.876595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.908304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:27.908905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:27.909853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:27.909998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lazy-loading 'fault' on Instance uuid f95e8705-3686-41ea-ac36-52d8a173ad00 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:27.974476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:27.986862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-585343b5-0e34-4944-aad3-c996fd5c248c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.750950 Aug 21 01:08:28.003101 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 264/561] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:27 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:28.104973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:28.115465 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65ad8561-3706-4615-b88c-fb617f0d2793 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1459 microversion: 2.1 time: 0.264028 Aug 21 01:08:28.117284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 298/562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:27 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1459 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:28.280436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6372af24-d84a-44bb-b633-aaf454865ad6 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fe574ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-682213221", "description": "tempest-description-543401837"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:28.435068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:28.438481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:28.445759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.446437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.447090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.448092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.448719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.449301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.614039 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6372af24-d84a-44bb-b633-aaf454865ad6 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.609121 Aug 21 01:08:28.615126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 265/563] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:28 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:28.619518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:28.619935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:28.620395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:28.620532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:28.620839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:28.621248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:28.621415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:28.639038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.645575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.646425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.647355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.647975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.648865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.730974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:28.740362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.741095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.741744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.742595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.743223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.744257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.784961 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:28.843776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:28.854142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:28.855604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:28.856681 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59dbf014-3ba9-4962-addd-798939b3987e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.240405 Aug 21 01:08:28.864607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 266/564] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:28 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:28.874577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:28.875322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:28.881998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.882629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.883150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.883938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:28.884472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:28.884999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:28.936579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:29.004468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33373a0f-f5bb-4abc-8a73-4d4789907d92 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78/action" status: 202 len: 1942 microversion: 2.75 time: 0.885877 Aug 21 01:08:29.005573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 299/565] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:08:28 2022] POST /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78/action => generated 1942 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 21 01:08:29.011389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6edc59e8-5e42-47ac-bd3a-7e6dcd1eea07 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa446280>, body: {"security_group_rule": {"parent_group_id": "6066900b-2175-4ffd-ad52-f82bbbef9fcd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:29.106524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:29.118034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0bbbb3bf-b4db-4f49-941d-891aa4410724 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1312 microversion: 2.1 time: 0.252026 Aug 21 01:08:29.119040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 267/566] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:28 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:29.124890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70f465e-d9bc-4069-8232-82fb4560edf7", "tag": "a92d393c-d03c-48b0-b0cb-dab8a6c38d9d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:29.137030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.137867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.138559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.154793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] Creating event network-changed:a92d393c-d03c-48b0-b0cb-dab8a6c38d9d for instance b70f465e-d9bc-4069-8232-82fb4560edf7 on n-h2-master-1 Aug 21 01:08:29.162029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-17857177-a2da-45da-bc89-5a5870c36926 req-fb54e654-be4a-4b40-aabf-e96a5e6c809a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041488 Aug 21 01:08:29.162945 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 268/567] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:29.170482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:29.171580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:29.178550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.179317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.180041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.180927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.181688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.182273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.318703 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6edc59e8-5e42-47ac-bd3a-7e6dcd1eea07 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.311937 Aug 21 01:08:29.319911 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 300/568] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:29.326616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:29.327540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:29.349416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.349849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.350290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.355750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.356543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.356930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.513882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:29.561858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1d1c876-1640-4406-b2ef-0d6112e3b169 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.238957 Aug 21 01:08:29.564404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 301/569] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:29 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:29.570863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:29.571655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:29.588645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.591095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.591680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.593714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.595547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.596057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.680510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:29.681099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:29.681522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:29.682170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lazy-loading 'fault' on Instance uuid f95e8705-3686-41ea-ac36-52d8a173ad00 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:30.031021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.046695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd7dec07-d4c1-4a2a-a33a-93b920165511 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.882159 Aug 21 01:08:30.049538 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 269/570] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:29 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:30.075147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-85776ea8-49e4-466b-9958-5155646f5f06 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3feb24940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-922181137", "description": "tempest-description-1774664514"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:30.080641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.089489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42ff322d-8bfd-4b70-b2f7-4a68270082db tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1459 microversion: 2.1 time: 0.523851 Aug 21 01:08:30.092561 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 302/571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:29 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1459 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:30.097420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:30.104981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:30.114858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.126142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.126596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.128915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.129379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.130782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.421149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.445474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.449055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.450549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b2c983f-f217-4e8e-b6d0-7190dd11e206 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.356783 Aug 21 01:08:30.465662 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 303/572] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:30 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:30.467347 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:30.501819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:30.503840 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=28 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:30.504522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:30.524534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.525357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.527575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.530313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.532099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.533699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.871351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:30.879425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-141fe22b-3304-4142-b60a-9882b642ac48 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1462 microversion: 2.1 time: 0.411450 Aug 21 01:08:30.880313 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 304/573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:30 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1462 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:30.886711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:30.887476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:30.894933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.895639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.896235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.897284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.897885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.898452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.903402 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:30.948529 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-85776ea8-49e4-466b-9958-5155646f5f06 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.897726 Aug 21 01:08:30.949579 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 270/574] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:30.954812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95e8705-3686-41ea-ac36-52d8a173ad00", "name": "network-vif-deleted", "tag": "1fc3faad-0d06-47eb-95da-f0222f20fbbe"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:30.974784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:30.975264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:30.975684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:30.993117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:30.996629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] Creating event network-vif-deleted:1fc3faad-0d06-47eb-95da-f0222f20fbbe for instance f95e8705-3686-41ea-ac36-52d8a173ad00 on n-h2-master-1 Aug 21 01:08:31.002826 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f425b56b-d808-4464-a38c-6a2626739499 req-18089937-80e3-4567-9184-143410e3f7ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051962 Aug 21 01:08:31.004362 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 271/575] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:31.014532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4b8442a-e73d-4514-826f-894442ab4f36 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.132317 Aug 21 01:08:31.021346 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 305/576] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:30 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:31.028313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fea99237-259e-4b2f-a1fd-9ebeb4dc36f2 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa5e9ee0>, body: {"security_group_rule": {"parent_group_id": "4a423171-db8e-4b08-b63c-70ce2dc2ed2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:31.148065 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=16 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:31.229960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:31.230776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:31.242842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.243327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.243756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.245264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fea99237-259e-4b2f-a1fd-9ebeb4dc36f2 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.222609 Aug 21 01:08:31.245969 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 306/577] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:31.255008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.255977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.256099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.306345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80c99f7f-3d22-475e-ab5c-55402c9a40a4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fa4288b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:31.377385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80c99f7f-3d22-475e-ab5c-55402c9a40a4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d" status: 200 len: 371 microversion: 2.1 time: 0.127360 Aug 21 01:08:31.378176 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 307/578] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:08:31 2022] GET /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:31.382696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:31.383458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:31.389905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.390653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.391236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.392141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.392744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.393192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.534197 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de4e154e-0e20-4254-96b7-9e2ecaf7c9e8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1613 microversion: 2.1 time: 0.528319 Aug 21 01:08:31.548665 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 272/579] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:31 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1613 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:31.553935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:31.555026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:31.562475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.562906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.563648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.564876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.565599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.565903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.566356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.573844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50ba9690-febe-449a-8437-3dd68406b229 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.194538 Aug 21 01:08:31.574640 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 308/580] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:31 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:31.580354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce37b734-ea2d-41bd-8bad-816e29eb22de tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa5e9040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1988968241", "description": "tempest-description-633177469"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:31.621053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.621614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.622100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.622763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lazy-loading 'fault' on Instance uuid f95e8705-3686-41ea-ac36-52d8a173ad00 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:31.669530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.677484 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e0c76185-c992-4b20-8f06-6a0b88d5d0c7 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1288 microversion: 2.1 time: 0.127439 Aug 21 01:08:31.691428 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 273/581] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:31 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1288 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:31.691428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe574ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:31.738789 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce37b734-ea2d-41bd-8bad-816e29eb22de tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.162953 Aug 21 01:08:31.739366 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 309/582] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:31.752498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:31.753122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:31.754598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.755074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.755494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.756198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.756662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.757092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.759014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.759477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.759895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.760609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.761079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.761493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.818522 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cfcc4715-e334-4b26-84dd-7125c7967fe6 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d" status: 200 len: 328 microversion: 2.1 time: 0.139271 Aug 21 01:08:31.825349 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 274/583] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:08:31 2022] PUT /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d => generated 328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:31.825349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:31.825349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:31.830350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.830856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.831292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.831974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:31.832410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:31.832841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:31.894311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.902677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.904519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.905678 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79c76507-1915-4d2a-b84c-2f07dc2fb00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.157191 Aug 21 01:08:31.906265 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 310/584] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:31 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:31.909321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b35f092e6bfa489c910de20007267a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27f9d1ac44947208d478968f0ced360', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:31.909898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] flavor_id is None. Assuming migration. {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 21 01:08:31.910322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:08:31.910972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e26185a0-045d-440d-847b-ea0c5aaa5457 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa398820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-404963213", "description": "tempest-description-1525832441"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:32.071153 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e26185a0-045d-440d-847b-ea0c5aaa5457 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.163433 Aug 21 01:08:32.072048 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 311/585] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:32.082906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0abf028-8246-4263-abf4-1f3288d4e3eb tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.083220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62906467-3108-443e-8750-fa2d3946ded8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.262761 Aug 21 01:08:32.087077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 275/586] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:31 2022] POST /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:32.092947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.093992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:32.102192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.102865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.103391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.104243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.104909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.105471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.107906 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0abf028-8246-4263-abf4-1f3288d4e3eb tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d" status: 202 len: 0 microversion: 2.1 time: 0.034657 Aug 21 01:08:32.108950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 312/587] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:08:32 2022] DELETE /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:32.114481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ab0f637-7683-41db-8953-a9dfbcbbcd59 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa4f7c10>, body: {"security_group_rule": {"parent_group_id": "d78a9fcb-fb8b-401d-ae3f-4f8785e1e286", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a876e349-a4f6-4000-abac-d3a74c4ff868"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:32.259157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:32.329475 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-632a20b2-ed71-4234-90d9-7f3f0ab00865 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.241014 Aug 21 01:08:32.340795 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 276/588] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:32.340795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.340795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:32.342660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.343532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.344521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.345592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.346249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.346870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.499824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ab0f637-7683-41db-8953-a9dfbcbbcd59 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.389655 Aug 21 01:08:32.501133 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 313/589] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:32 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:32.506690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6579b49-b93e-4582-ae3a-5685d8d359e9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fa446af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.538977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:32.548023 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9066d4f6-009a-4d2c-9106-dd701a464611 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1471 microversion: 2.1 time: 0.216626 Aug 21 01:08:32.548447 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 277/590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:32.566925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9595dd4b-7705-4ae2-85aa-2f5e0ba16534 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fe511f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1083990546", "description": "tempest-description-966743703"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:32.615224 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6579b49-b93e-4582-ae3a-5685d8d359e9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d" status: 200 len: 371 microversion: 2.1 time: 0.112764 Aug 21 01:08:32.615992 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 314/591] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/os-quota-sets/c0a15a335a8d4c91bf3df11af031416d => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:32.622703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.623638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:32.631171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.632355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.632980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.634186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.634887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.636217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.842279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:32.864587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6abaaf4e-dd4e-4057-8b9a-79d7914b9dd6 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.246978 Aug 21 01:08:32.865137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 315/592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:32.869598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.870192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:32.877187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.878112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.878546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.879227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.879660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.880071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.885609 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9595dd4b-7705-4ae2-85aa-2f5e0ba16534 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.327489 Aug 21 01:08:32.886616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 278/593] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:32.892648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-85f7f82c-da67-4409-a08d-23fc867175c4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fe511160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:32.919827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:32.920437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:32.922668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:32.923319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lazy-loading 'fault' on Instance uuid f95e8705-3686-41ea-ac36-52d8a173ad00 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:32.971485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f609273d3d4d18a9ef755ed5359da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c64f1c2dba41298be11cd0772e8792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:32.979984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-38dad7b4-8b3c-401f-af4e-229fbcea6f34 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 200 len: 1288 microversion: 2.1 time: 0.113879 Aug 21 01:08:32.980870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 316/594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:32.985330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa4b062f-9df1-475c-8627-7a8b39f6f1b9 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa428ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-713692518", "description": "tempest-description-1093821982"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:33.113617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-85f7f82c-da67-4409-a08d-23fc867175c4 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.225800 Aug 21 01:08:33.114373 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 279/595] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:08:32 2022] GET /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f/defaults => generated 371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:33.125672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:33.126354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:33.135758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.136369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.136928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.138585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.139187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.139679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.164552 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa4b062f-9df1-475c-8627-7a8b39f6f1b9 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.182633 Aug 21 01:08:33.165465 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 317/596] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:33.187220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b3a9ba2-c0f0-4ec0-9356-fe9f33d904db tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa4f7280>, body: {"security_group_rule": {"parent_group_id": "612bb5cb-b1c6-4aca-ac55-84b6cfe31531", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "16203944-c773-47fd-aa09-d437223ae3c6"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:33.303159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:33.313247 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:33.321144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:33.327494 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf1b3250-aafd-4e0a-bfe5-fe7c7e13225c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.204228 Aug 21 01:08:33.328631 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 280/597] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:33 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:33.355974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:33.356740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:33.370442 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.378884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.380612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.381575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.382384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.384637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.413126 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:33.492993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:33.517842 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6e9f242a-408a-443f-802e-bc8c4d2d6939 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.165813 Aug 21 01:08:33.528911 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 281/598] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:33 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:33.528911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe774040>, body: {"quota_set": {"ram": "5120"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:33.596805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b3a9ba2-c0f0-4ec0-9356-fe9f33d904db tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.412995 Aug 21 01:08:33.597543 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 318/599] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:33 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:33.602187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:33.602894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:33.617331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.621154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.622518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.623535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.624834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.625558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.757393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.757787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.758186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.758899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.759639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.759766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.827640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4501c20f-2d68-4b17-bd98-d901212b9fd7 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2" status: 200 len: 328 microversion: 2.1 time: 0.307448 Aug 21 01:08:33.837103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 282/600] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:08:33 2022] PUT /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2 => generated 328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:33.845233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-380c96a3-9779-4b70-9372-d4fdf9f8db31 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe3cc040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:33.886723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:33.896522 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7428f40-7fa4-456d-817b-a8432ef9edcc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1471 microversion: 2.1 time: 0.297479 Aug 21 01:08:33.898453 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 319/601] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:33 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:33.903245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fa4461f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:33.987159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.987980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.988563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:33.989527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:33.989960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:33.990378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.017166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4767feda-4802-4fc3-ac07-d4c8366e8155 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2/detail" status: 200 len: 916 microversion: 2.1 time: 0.117301 Aug 21 01:08:34.029204 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 320/602] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:08:33 2022] GET /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2/detail => generated 916 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.037448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.038501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.049214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.049810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.050369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.051341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.051810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.052372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.321876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:34.335350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1dc59f50-daae-4b34-8ccb-acfc403ad03c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.306279 Aug 21 01:08:34.336446 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 321/603] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:34.340250 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-380c96a3-9779-4b70-9372-d4fdf9f8db31 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/16203944-c773-47fd-aa09-d437223ae3c6" status: 202 len: 0 microversion: 2.1 time: 0.501506 Aug 21 01:08:34.341355 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 283/604] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:33 2022] DELETE /compute/v2.1/os-security-groups/16203944-c773-47fd-aa09-d437223ae3c6 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:34.347882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe574c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:34.350322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.352343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.365622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.366270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.367385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.368510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.369155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.371080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.388894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 HTTP/1.1 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f95e8705-3686-41ea-ac36-52d8a173ad00'} Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.391184 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.396083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:34.398158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f329c1a-cd8a-4e4d-9fbd-c2183b1193d5 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 404 len: 111 microversion: 2.1 time: 0.059929 Aug 21 01:08:34.403953 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 322/605] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:34.409434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94ba664a-e690-4f03-8697-aa620eb24740 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fa428310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.478624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.479032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.480675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.481476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.481998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.482521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.495016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94ba664a-e690-4f03-8697-aa620eb24740 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/612bb5cb-b1c6-4aca-ac55-84b6cfe31531" status: 200 len: 247 microversion: 2.1 time: 0.094661 Aug 21 01:08:34.504946 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 323/606] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/os-security-groups/612bb5cb-b1c6-4aca-ac55-84b6cfe31531 => generated 247 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.509835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.510716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.517783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.518550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.519052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.520093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.520666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.521182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.535182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.535751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.536249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.537092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.537801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.538319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.621341 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1cf5b16-9a61-4ce4-94b4-bf0c5602503e tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2?user_id=a4b18a4fb3584bdc857ebfd30e2ad59e" status: 200 len: 328 microversion: 2.1 time: 0.278002 Aug 21 01:08:34.623180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 284/607] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:08:34 2022] PUT /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2?user_id=a4b18a4fb3584bdc857ebfd30e2ad59e => generated 328 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.629410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfe02f3-fc88-49b2-b376-6d362bdc1b4c", "name": "network-vif-plugged", "status": "completed", "tag": "59e99352-1bdf-4d06-9a88-cd5f4b0ba642"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:34.643836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.644919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.645679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.659082 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] Creating event network-vif-plugged:59e99352-1bdf-4d06-9a88-cd5f4b0ba642 for instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c on n-h1-master-1 Aug 21 01:08:34.667173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cf152361-e16e-4c55-b785-014a919bb32c req-6eed6945-8640-4b7c-96b4-afd14cf7159d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Aug 21 01:08:34.668472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 285/608] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.680934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.683259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.685962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:34.687431 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:34.695936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.696574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.697195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.698093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.698688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.699302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.707493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:34.715927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:34.716498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.718025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12f5a044-93eb-46af-96c6-71d72b6d16ca tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.211936 Aug 21 01:08:34.718601 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 324/609] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 HTTP/1.1 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f95e8705-3686-41ea-ac36-52d8a173ad00'} Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:34.719324 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.723652 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.725258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:34.726365 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6d50b6d-e9fb-40be-ac86-91ba631bfaba tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 404 len: 111 microversion: 2.1 time: 0.055156 Aug 21 01:08:34.729868 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 286/610] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:34 2022] DELETE /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:34.741714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.741963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39c62670-e0b4-4e7f-8d78-6285e8e6489f tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa4281f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1002495432", "description": "tempest-description-1989501264"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:34.742330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.752264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.752749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.753580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.753968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.754451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.755011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.841870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:34.859832 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a0909de-92cf-43da-9a77-fa78ca1f3603 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.131223 Aug 21 01:08:34.860592 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 287/611] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:34.872928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee19f1db-e686-47e1-b33c-722e6a13ab72 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fe368a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.914239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-39c62670-e0b4-4e7f-8d78-6285e8e6489f tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.180648 Aug 21 01:08:34.916125 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 325/612] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:08:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.926955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.927726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: f95e8705-3686-41ea-ac36-52d8a173ad00] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.934269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.934746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.935255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.935953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.936395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.936839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.949749 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee19f1db-e686-47e1-b33c-722e6a13ab72 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2?user_id=a4b18a4fb3584bdc857ebfd30e2ad59e" status: 200 len: 370 microversion: 2.1 time: 0.087982 Aug 21 01:08:34.950172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.950392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 288/613] 10.222.0.46 () {58 vars in 1323 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/os-quota-sets/87c34935e0f64083a0b699d34b6a68d2?user_id=a4b18a4fb3584bdc857ebfd30e2ad59e => generated 370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 HTTP/1.1 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f95e8705-3686-41ea-ac36-52d8a173ad00'} Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:34.952280 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance f95e8705-3686-41ea-ac36-52d8a173ad00 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b398b98-b66a-4658-8ec4-aad6917037ae tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00" status: 404 len: 111 microversion: 2.1 time: 0.031374 Aug 21 01:08:34.956709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 326/614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/f95e8705-3686-41ea-ac36-52d8a173ad00 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:34.958386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:34.958992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:34.964976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-265d552c-42a6-4dd6-bceb-f90906f21a61 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa4f7310>, body: {"security_group_rule": {"parent_group_id": "108940a9-48ba-490f-92a1-51fd59fca638", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:34.965378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.965853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.966382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:34.967427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:34.967888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:34.968309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.145175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:35.158697 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd02d0d2-38f1-45b0-93db-57436a0ebded tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1471 microversion: 2.1 time: 0.207196 Aug 21 01:08:35.159280 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 289/615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:34 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:35.178259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.178745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:35.185181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.185481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.185970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.186655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.187116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.187507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.187873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-265d552c-42a6-4dd6-bceb-f90906f21a61 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.232279 Aug 21 01:08:35.188801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 327/616] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:35.199838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3930132-fa39-4ca9-8229-b37a06b2d78e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Action: 'create', calling method: .version_select at 0x7fc3fa5e9040>, body: {"security_group_rule": {"parent_group_id": "108940a9-48ba-490f-92a1-51fd59fca638", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:35.209024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 HTTP/1.1 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c86bf180-918f-4cd9-a821-c185a370dab9'} Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:35.210560 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f4322db-3f32-4bfa-bede-3e86bb75d266 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 404 len: 111 microversion: 2.1 time: 0.037969 Aug 21 01:08:35.215040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 290/617] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:35 2022] DELETE /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:35.222091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.222785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] [instance: c86bf180-918f-4cd9-a821-c185a370dab9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:35.228630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.229344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.230606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.231476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.232265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.232942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.250530 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] HTTP exception thrown: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Request method failure captured: Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 HTTP/1.1 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVRSEsE7rVzK8Ure9abxIah7dDPpJ310tKfRllT-I0TYuCPsV5xMU7-u9mdV7LHPOgFvo4glK2MCitDTK8KTI1c0hHO9tmKmuHI1Rj0CckXeCZFvvMlVONKwWWpRFgugzR6c86pNpK5EVb8W05L7gHuyoc0zqzXglMhlvTLUI0Bn94 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_58c64f1c2dba41298be11cd0772e8792", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/58c64f1c2dba41298be11cd0772e8792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/58c64f1c2dba41298be11cd0772e8792"}]}] Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 58c64f1c2dba41298be11cd0772e8792 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-405196479 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 49f609273d3d4d18a9ef755ed5359da9 Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersAdminTestJSON-405196479-project Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c86bf180-918f-4cd9-a821-c185a370dab9'} Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:35.252356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. Aug 21 01:08:35.256671 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:35.258106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] Returning 404 to user: Instance c86bf180-918f-4cd9-a821-c185a370dab9 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:35.259079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-beef1ec9-7915-48af-bcb3-9afe1accdc84 tempest-DeleteServersAdminTestJSON-405196479 tempest-DeleteServersAdminTestJSON-405196479-project] 10.222.0.46 "GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9" status: 404 len: 111 microversion: 2.1 time: 0.041487 Aug 21 01:08:35.263264 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 291/618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:35 2022] GET /compute/v2.1/servers/c86bf180-918f-4cd9-a821-c185a370dab9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:35.357246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.359187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:35.369097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.370687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.371320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.372247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.374192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.375907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.436911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3930132-fa39-4ca9-8229-b37a06b2d78e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.240691 Aug 21 01:08:35.437573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 328/619] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:08:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:08:35.444942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ebe6b72-ed16-4425-a749-c09b4daf09be tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Calling method '.version_select at 0x7fc3fa3985e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.547678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:35.555768 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4aa39aee-040d-4177-bda2-e139acb3bc1a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.202428 Aug 21 01:08:35.569880 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 292/620] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:35 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:35.576291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c6f7a8c-9517-49ae-abf2-2d0dcf1c162a tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe3681f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.677695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c6f7a8c-9517-49ae-abf2-2d0dcf1c162a tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/108940a9-48ba-490f-92a1-51fd59fca638" status: 200 len: 665 microversion: 2.1 time: 0.105996 Aug 21 01:08:35.678390 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 293/621] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:08:35 2022] GET /compute/v2.1/os-security-groups/108940a9-48ba-490f-92a1-51fd59fca638 => generated 665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:35.691787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbf7d265-d133-4efc-8498-c63c926d0958 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe368700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.730660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ebe6b72-ed16-4425-a749-c09b4daf09be tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.291556 Aug 21 01:08:35.731228 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 329/622] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:08:35 2022] GET /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f/defaults => generated 371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:35.747283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:35.748789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:35.767333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.767938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.768483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.769297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:35.769835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:35.770339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:35.950006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:35.958927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:35.961249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:35.963038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f62367cd-928c-4105-a7df-6360747c7d36 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1361 microversion: 2.25 time: 0.223445 Aug 21 01:08:35.972987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 330/623] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:35 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:35.978825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa428d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:36.093556 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbf7d265-d133-4efc-8498-c63c926d0958 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/c036c0de-715f-4bbd-9caf-602fd51f1420" status: 202 len: 0 microversion: 2.1 time: 0.405745 Aug 21 01:08:36.098398 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 294/624] 10.222.0.46 () {58 vars in 1287 bytes} [Sun Aug 21 01:08:35 2022] DELETE /compute/v2.1/os-security-group-rules/c036c0de-715f-4bbd-9caf-602fd51f1420 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:08:36.100238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.100961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:36.108098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.108659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.109186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.109952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.110450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.110924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.181589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.182168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.182665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.183465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.183919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.184417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.218049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:36.253206 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ba44084-f473-42c9-b23f-f410224754fd tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.157519 Aug 21 01:08:36.264930 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 295/625] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:36 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:36.264930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af1ed8f8-9115-439f-b249-beb6e23264ab tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe3553a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.502151 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:36.542019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af1ed8f8-9115-439f-b249-beb6e23264ab tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/108940a9-48ba-490f-92a1-51fd59fca638" status: 202 len: 0 microversion: 2.1 time: 0.285771 Aug 21 01:08:36.543612 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 296/626] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:36 2022] DELETE /compute/v2.1/os-security-groups/108940a9-48ba-490f-92a1-51fd59fca638 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:36.550306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.551197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:36.560243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.561138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.561889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.563502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.564238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.564661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.603220 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d6a06f1-f3f2-4090-8af6-b984aa65aca9 tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f" status: 200 len: 329 microversion: 2.1 time: 0.638267 Aug 21 01:08:36.604077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 331/627] 10.222.0.46 () {60 vars in 1263 bytes} [Sun Aug 21 01:08:35 2022] PUT /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f => generated 329 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:36.615555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3faf49d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.642348 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:08:36.643001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Neutron security group 16203944-c773-47fd-aa09-d437223ae3c6 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:08:36.643531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] HTTP exception thrown: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.643531 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Request method failure captured: Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/16203944-c773-47fd-aa09-d437223ae3c6 HTTP/1.1 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWL4dhcKFPR6v9WPLRexkVf7tPFmBNbXLmYKmm4b1CBigjFTvwlSuXX78VMp8H9Sl8IvXYWHX_7m2vZhwANOnQdKdUbi02u-XRF0ZEJmryFzixojfenYLtZEF_HbfOA1lqc4EBtPsmu545PH3qNyq0U9zOVV2mweX1isCUyYIz3BOo Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 5f1cb43a57c442fda7d778cac048765a Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-656579606 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f1cb43a57c442fda7d778cac048765a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5f1cb43a57c442fda7d778cac048765a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5f1cb43a57c442fda7d778cac048765a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5f1cb43a57c442fda7d778cac048765a"}]}] Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupRulesTestJSON-656579606 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 5f1cb43a57c442fda7d778cac048765a Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-656579606 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupRulesTestJSON-656579606-project Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 857c9f7c3ced41ff88104ae41ea3427e Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupRulesTestJSON-656579606-project Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: exception: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '16203944-c773-47fd-aa09-d437223ae3c6'} Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:08:36.651295 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Returning 404 to user: Security group 16203944-c773-47fd-aa09-d437223ae3c6 does not exist Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-3a492b7c-33f9-4fa8-9647-5087c48f145a'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:36.656303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9df3ede2-9616-4e07-8852-72c94d0ec48e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/16203944-c773-47fd-aa09-d437223ae3c6" status: 404 len: 194 microversion: 2.1 time: 0.047445 Aug 21 01:08:36.663030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 332/628] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:36 2022] DELETE /compute/v2.1/os-security-groups/16203944-c773-47fd-aa09-d437223ae3c6 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:36.666814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.667417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:36.676026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.676597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.677139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.677757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.678211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.678623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.713231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:36.721619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-267ae0f2-ccd4-4b9f-aaf0-48f52a482db6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.176726 Aug 21 01:08:36.722301 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 297/629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:36 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:36.726860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe511550>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:36.863560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:36.873035 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5aef06af-6881-425f-8189-4dbbe4550bea tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.212283 Aug 21 01:08:36.873948 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 333/630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:36 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:36.878775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f718049-649c-4c0d-8234-8f6624a0a57c tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fa4281f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:36.934366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.934842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.935274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:36.935990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:36.936464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:36.936907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.138342 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f718049-649c-4c0d-8234-8f6624a0a57c tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/612bb5cb-b1c6-4aca-ac55-84b6cfe31531" status: 202 len: 0 microversion: 2.1 time: 0.263103 Aug 21 01:08:37.142394 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 334/631] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:36 2022] DELETE /compute/v2.1/os-security-groups/612bb5cb-b1c6-4aca-ac55-84b6cfe31531 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:37.147420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f465e-d9bc-4069-8232-82fb4560edf7", "name": "network-vif-plugged", "status": "completed", "tag": "a92d393c-d03c-48b0-b0cb-dab8a6c38d9d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:37.169700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.170510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.171444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.184855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] Creating event network-vif-plugged:a92d393c-d03c-48b0-b0cb-dab8a6c38d9d for instance b70f465e-d9bc-4069-8232-82fb4560edf7 on n-h2-master-1 Aug 21 01:08:37.190306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c9042686-18e6-4fdf-8ae9-94735a4d2fc3 req-9dbc2771-dece-4453-8c65-87a050873534 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046348 Aug 21 01:08:37.191417 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 335/632] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:37.197383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.198412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:37.208200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.208606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.209101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.209795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.210423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.210998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.351498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d6350c0-87e6-4158-a867-687db806762a tempest-QuotasAdminTestJSON-1296049606 tempest-QuotasAdminTestJSON-1296049606-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f" status: 200 len: 329 microversion: 2.1 time: 0.628057 Aug 21 01:08:37.352360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 298/633] 10.222.0.46 () {60 vars in 1263 bytes} [Sun Aug 21 01:08:36 2022] PUT /compute/v2.1/os-quota-sets/b0c60f4d25f340e38920b223b711dc8f => generated 329 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:37.359207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95cc197b-4f6f-4beb-82ab-4e6d8404aa22 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe511b80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.395606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:37.407485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:37.410156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:37.412044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c82ba348-c149-4ec0-bc98-4dfd0202635f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1557 microversion: 2.25 time: 0.219074 Aug 21 01:08:37.412596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 336/634] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:37 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:37.420453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.421724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:37.428324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.429013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.429963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.431590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.432188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.433291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.531930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:37.560654 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c6caa60-9643-4f2a-a2c5-bd5fba5532c3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.146492 Aug 21 01:08:37.569018 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 337/635] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:37 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:37.619246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95cc197b-4f6f-4beb-82ab-4e6d8404aa22 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/a876e349-a4f6-4000-abac-d3a74c4ff868" status: 202 len: 0 microversion: 2.1 time: 0.265646 Aug 21 01:08:37.619925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 299/636] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:37 2022] DELETE /compute/v2.1/os-security-groups/a876e349-a4f6-4000-abac-d3a74c4ff868 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:37.628291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-520fd0aa-8bdb-418b-85f3-fd57c878dd4a tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe3685e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.839160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-520fd0aa-8bdb-418b-85f3-fd57c878dd4a tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/d78a9fcb-fb8b-401d-ae3f-4f8785e1e286" status: 202 len: 0 microversion: 2.1 time: 0.213469 Aug 21 01:08:37.840848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 300/637] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:37 2022] DELETE /compute/v2.1/os-security-groups/d78a9fcb-fb8b-401d-ae3f-4f8785e1e286 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:08:37.849816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.850746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:37.871619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.872247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.872587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.873435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.873766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.874185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.905823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:37.907269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:37.914321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.915071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.915671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:37.918058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:37.918678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:37.919292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.044896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:38.053410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-75bcc7c9-30d6-476a-befb-0af32041f61e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.210535 Aug 21 01:08:38.054222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 301/638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:37 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:38.071790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0677f62-bbab-4ec8-a0c8-7c995810681e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fe3551f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.086610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:38.103291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c0b6608-2fe3-47c0-a6a8-54cb060f8e8d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 2049 microversion: 2.25 time: 0.533122 Aug 21 01:08:38.104418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 338/639] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:37 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 2049 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:38.110476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.111508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:38.117667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.118356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.118943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.119793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.120389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.121006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.315722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0677f62-bbab-4ec8-a0c8-7c995810681e tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4a423171-db8e-4b08-b63c-70ce2dc2ed2f" status: 202 len: 0 microversion: 2.1 time: 0.259927 Aug 21 01:08:38.318898 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 302/640] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:38 2022] DELETE /compute/v2.1/os-security-groups/4a423171-db8e-4b08-b63c-70ce2dc2ed2f => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:38.327928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.328627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:38.337082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:38.347847 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:38.352076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.353259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.354408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.355292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.355867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.356303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.360988 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffe622cb-c2a3-4b05-afeb-c60b3a1582f0 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1322 microversion: 2.1 time: 0.255291 Aug 21 01:08:38.364100 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 339/641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:38 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:38.383794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ee6f0fd-c459-453d-9c7c-ed263d152532 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] Calling method '.version_select at 0x7fc3fa2a3310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.570260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:38.595131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40d61af1-6bc8-4921-be8c-39609412831f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 2049 microversion: 2.25 time: 0.274095 Aug 21 01:08:38.609488 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 303/642] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:38 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 2049 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:38.621465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.622119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:38.628269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.628754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.629217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.630058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.630496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.631172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ee6f0fd-c459-453d-9c7c-ed263d152532 tempest-SecurityGroupRulesTestJSON-656579606 tempest-SecurityGroupRulesTestJSON-656579606-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6066900b-2175-4ffd-ad52-f82bbbef9fcd" status: 202 len: 0 microversion: 2.1 time: 0.264966 Aug 21 01:08:38.631313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.632422 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 340/643] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:08:38 2022] DELETE /compute/v2.1/os-security-groups/6066900b-2175-4ffd-ad52-f82bbbef9fcd => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:38.640818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:38.650757 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:38.650757 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:08:38.661903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.668462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.670375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.677120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.677646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.678080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.710773 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f81639b-a6b6-4705-87cc-be7fa6c2e96f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076226 Aug 21 01:08:38.711414 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 341/644] 10.222.0.46 () {60 vars in 1217 bytes} [Sun Aug 21 01:08:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:08:38.723743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:38.726128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:38.733613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.734449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.735094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.735986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:38.736650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:38.737071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:38.770012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'flavor' on Instance uuid 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:38.793289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Going to try to live migrate instance to n-h2-master-1 {{(pid=122482) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:08:39.006978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:39.050207 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:39.057592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0e85a475-4a9b-4c48-9c32-7b00c2f2dc2f tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.446846 Aug 21 01:08:39.069669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 304/645] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:38 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:39.082382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:39.083303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:39.091035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:39.091766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:39.092532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:39.093853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:39.094547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:39.095175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:39.468506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:39.479041 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62417782-d342-471c-8b19-e5adf9b2d3cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.407794 Aug 21 01:08:39.480204 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 305/646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:39 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:39.486665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:39.487995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:39.494925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:39.495626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:39.496255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:39.497900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:39.498540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:39.499227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:39.826698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:39.835067 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91d40003-c218-4025-aff5-92faad37eb0e tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1471 microversion: 2.1 time: 0.353415 Aug 21 01:08:39.835852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 306/647] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:39 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:40.166730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6308c84e-e34a-46e3-a4f6-88377dd428aa tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Calling method '.version_select at 0x7fc3fe3713a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:40.168405 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:40.168405 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:40.170009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6308c84e-e34a-46e3-a4f6-88377dd428aa tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '54fde4c52ab1472fa83fdc2d136aa557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c33fdd699445f49624b53f427abe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6308c84e-e34a-46e3-a4f6-88377dd428aa tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Request method failure captured: Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWWf2NWIxtDDR6TYGFisbQ_c6t81cesmtXxNMHnw_Jo73c9TlAyiq6rbJye4MBqa5Ph68_YEbcw7DRKXwBPqSKtOR2UKAZKFdKKNIsoqYkqegaEN5AGVCTx1NApo0LyCKGXuCGCm-1E3Pt67o0pi9gAzG_fi7vKRjz_0umCe2C1B_E Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d6c33fdd699445f49624b53f427abe17", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}] Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 54fde4c52ab1472fa83fdc2d136aa557 Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 21 01:08:40.172747 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 21 01:08:40.176486 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.180218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6308c84e-e34a-46e3-a4f6-88377dd428aa tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:40.182308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6308c84e-e34a-46e3-a4f6-88377dd428aa tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.345360 Aug 21 01:08:40.183408 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 307/648] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:08:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 347 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:40.195535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:40.196266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:40.213757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.214726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.218484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:40.220300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.221424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.222543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:40.251188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lazy-loading 'flavor' on Instance uuid b70f465e-d9bc-4069-8232-82fb4560edf7 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:40.297053 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:40.337002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d54aa3ec-1e46-47f0-b4ca-beba06ce92ca tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7/action" status: 202 len: 0 microversion: 2.1 time: 0.146570 Aug 21 01:08:40.338548 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 308/649] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:40 2022] POST /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:08:40.345154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:40.346466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:40.354375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.354857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.355310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:40.356060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.356497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.356979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:40.529771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:40.559983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-325d2c10-4740-4500-b2db-a48fe4c0bc65 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.219916 Aug 21 01:08:40.561231 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 309/650] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:40 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:40.565872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81adc56a-932a-4165-807e-5b85267da576 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Calling method '.version_select at 0x7fc3fe32fc10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:40.566982 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:40.566982 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:40.568302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81adc56a-932a-4165-807e-5b85267da576 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '54fde4c52ab1472fa83fdc2d136aa557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c33fdd699445f49624b53f427abe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81adc56a-932a-4165-807e-5b85267da576 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Request method failure captured: Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWWf2NWIxtDDR6TYGFisbQ_c6t81cesmtXxNMHnw_Jo73c9TlAyiq6rbJye4MBqa5Ph68_YEbcw7DRKXwBPqSKtOR2UKAZKFdKKNIsoqYkqegaEN5AGVCTx1NApo0LyCKGXuCGCm-1E3Pt67o0pi9gAzG_fi7vKRjz_0umCe2C1B_E Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d6c33fdd699445f49624b53f427abe17", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}] Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 54fde4c52ab1472fa83fdc2d136aa557 Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 21 01:08:40.570180 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 21 01:08:40.574011 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:40.576382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81adc56a-932a-4165-807e-5b85267da576 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:40.577763 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81adc56a-932a-4165-807e-5b85267da576 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015617 Aug 21 01:08:40.578773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 310/651] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:08:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:40.583763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:40.584629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:40.592076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.592841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.593495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:40.594475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:40.595107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:40.595890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.019846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e20d5ec-e8d7-42ed-9042-ca609a7c9c56 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c/action" status: 202 len: 0 microversion: 2.25 time: 2.299638 Aug 21 01:08:41.024809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 342/652] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:08:38 2022] POST /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c/action => generated 0 bytes in 2305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:41.030186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.031039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:41.039451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.039904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.040359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.041178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.041652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.042155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.139124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d2c5dc9-3ec2-4782-a28a-d15aeec7a65b tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1630 microversion: 2.1 time: 0.559095 Aug 21 01:08:41.139840 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 311/653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:40 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1630 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:41.167246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40539730-7a30-4431-8fdf-8b902b2e39ed tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Calling method '.version_select at 0x7fc3fe315dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.171414 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.171414 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:41.172726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-40539730-7a30-4431-8fdf-8b902b2e39ed tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '54fde4c52ab1472fa83fdc2d136aa557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c33fdd699445f49624b53f427abe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40539730-7a30-4431-8fdf-8b902b2e39ed tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Request method failure captured: Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWWf2NWIxtDDR6TYGFisbQ_c6t81cesmtXxNMHnw_Jo73c9TlAyiq6rbJye4MBqa5Ph68_YEbcw7DRKXwBPqSKtOR2UKAZKFdKKNIsoqYkqegaEN5AGVCTx1NApo0LyCKGXuCGCm-1E3Pt67o0pi9gAzG_fi7vKRjz_0umCe2C1B_E Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d6c33fdd699445f49624b53f427abe17", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}] Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 54fde4c52ab1472fa83fdc2d136aa557 Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.174422 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40539730-7a30-4431-8fdf-8b902b2e39ed tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40539730-7a30-4431-8fdf-8b902b2e39ed tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.017754 Aug 21 01:08:41.178574 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 312/654] 10.222.0.46 () {58 vars in 1179 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:41.189949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.190626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:41.198207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.198893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.199550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.200684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.201983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.202506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.246053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.255474 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-528f66a4-23ae-4d4c-a3b5-fdafdf085b58 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.229285 Aug 21 01:08:41.256553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 343/655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:41.477636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.481752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Calling method '.version_select at 0x7fc3fa253a60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.483075 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.483075 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:08:41.484877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.485715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.486409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.491422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.502625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.504144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3bd6387-795c-456b-8b08-97eb17d46fa8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.326921 Aug 21 01:08:41.505097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 313/656] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:41.507827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.508523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.509228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.522102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.522888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.523470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.531174 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21a81f9e-6dc2-4441-9876-70dd543765cd tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.272733 Aug 21 01:08:41.532065 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 344/657] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:41.547808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f743219-1278-49d4-90b9-bda19e8b454e tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Calling method '.version_select at 0x7fc3fe3710d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.548692 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.548692 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:41.549861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1f743219-1278-49d4-90b9-bda19e8b454e tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '54fde4c52ab1472fa83fdc2d136aa557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c33fdd699445f49624b53f427abe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f743219-1278-49d4-90b9-bda19e8b454e tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Request method failure captured: Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWWf2NWIxtDDR6TYGFisbQ_c6t81cesmtXxNMHnw_Jo73c9TlAyiq6rbJye4MBqa5Ph68_YEbcw7DRKXwBPqSKtOR2UKAZKFdKKNIsoqYkqegaEN5AGVCTx1NApo0LyCKGXuCGCm-1E3Pt67o0pi9gAzG_fi7vKRjz_0umCe2C1B_E Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d6c33fdd699445f49624b53f427abe17", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}] Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 54fde4c52ab1472fa83fdc2d136aa557 Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '1'} Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.551459 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f743219-1278-49d4-90b9-bda19e8b454e tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:41.556279 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f743219-1278-49d4-90b9-bda19e8b454e tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013372 Aug 21 01:08:41.560621 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 314/658] 10.222.0.46 () {58 vars in 1173 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:41.564635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4c6ade2-031a-419f-96bb-6f2da667bf5c tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Calling method '.version_select at 0x7fc3fa282d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.565435 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.565435 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:08:41.566290 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d4c6ade2-031a-419f-96bb-6f2da667bf5c tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] HTTP exception thrown: Hypervisor with ID '00757b9d-922b-4af1-9658-d97639272b32' could not be found. Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4c6ade2-031a-419f-96bb-6f2da667bf5c tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Request method failure captured: Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hypervisors/00757b9d-922b-4af1-9658-d97639272b32/uptime HTTP/1.1 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWXllFFo4tWyxWuH144iqXKpVKHnRUNvf5JYTNnDw8uMV20gML7YW1x4rfqFYks7_pRxVLg6n3vQxyEY4Zjfyuh2u4-B1jUb1olqAPrqLPkH-ZEOGohn68TffLnbNbE7AxZ-Ml0aW5eCCXQN4YJq1Yis-ySu0fKRA7F-bM9Lh2uyyM Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 35ad432585fe44afa4256b672e510c64 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/35ad432585fe44afa4256b672e510c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_35ad432585fe44afa4256b672e510c64", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/35ad432585fe44afa4256b672e510c64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/35ad432585fe44afa4256b672e510c64"}]}] Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 35ad432585fe44afa4256b672e510c64 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a03689bd09574f029ce1a626ad784d17 Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: exception: Hypervisor with ID '00757b9d-922b-4af1-9658-d97639272b32' could not be found. Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '00757b9d-922b-4af1-9658-d97639272b32'} Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '00757b9d-922b-4af1-9658-d97639272b32' Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:41.587436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '00757b9d-922b-4af1-9658-d97639272b32' could not be found. Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '00757b9d-922b-4af1-9658-d97639272b32' could not be found. Aug 21 01:08:41.592928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.594230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.594230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:41.595952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.596432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.596939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4c6ade2-031a-419f-96bb-6f2da667bf5c tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Returning 404 to user: Hypervisor with ID '00757b9d-922b-4af1-9658-d97639272b32' could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:41.597054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.597630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.597811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4c6ade2-031a-419f-96bb-6f2da667bf5c tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/00757b9d-922b-4af1-9658-d97639272b32/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037392 Aug 21 01:08:41.598199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.598603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.603221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 345/659] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors/00757b9d-922b-4af1-9658-d97639272b32/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:08:41.609212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Calling method '.version_select at 0x7fc3fa2a39d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.610041 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.610041 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:08:41.611127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.611607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.612035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.632237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.632828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.633888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.647335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:41.647814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:41.648246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:41.654499 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae568c7a-f7dd-4cc7-a4c4-ae3810ef97c1 tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050111 Aug 21 01:08:41.655141 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 346/660] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:41.665855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1225c2e-10b8-4b41-9c5e-3eac223b8627 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Calling method '.version_select at 0x7fc3fa4461f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.666793 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:41.666793 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:08:41.667688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1225c2e-10b8-4b41-9c5e-3eac223b8627 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '54fde4c52ab1472fa83fdc2d136aa557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c33fdd699445f49624b53f427abe17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1225c2e-10b8-4b41-9c5e-3eac223b8627 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Request method failure captured: Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWWf2NWIxtDDR6TYGFisbQ_c6t81cesmtXxNMHnw_Jo73c9TlAyiq6rbJye4MBqa5Ph68_YEbcw7DRKXwBPqSKtOR2UKAZKFdKKNIsoqYkqegaEN5AGVCTx1NApo0LyCKGXuCGCm-1E3Pt67o0pi9gAzG_fi7vKRjz_0umCe2C1B_E Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d6c33fdd699445f49624b53f427abe17", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d6c33fdd699445f49624b53f427abe17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d6c33fdd699445f49624b53f427abe17"}]}] Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: d6c33fdd699445f49624b53f427abe17 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 54fde4c52ab1472fa83fdc2d136aa557 Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1890956775-project Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '1'} Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 21 01:08:41.669327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1225c2e-10b8-4b41-9c5e-3eac223b8627 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:41.674411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1225c2e-10b8-4b41-9c5e-3eac223b8627 tempest-HypervisorAdminNegativeTestJSON-1890956775 tempest-HypervisorAdminNegativeTestJSON-1890956775-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.008782 Aug 21 01:08:41.675972 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 347/661] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:08:41.680646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6919d1e6-2749-407a-829a-b139fe06f11b tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Calling method '.version_select at 0x7fc3fa25e160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:41.682239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6919d1e6-2749-407a-829a-b139fe06f11b tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] HTTP exception thrown: Hypervisor with ID 'da216f52-9b00-414a-8078-15d3e162409f' could not be found. Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6919d1e6-2749-407a-829a-b139fe06f11b tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Request method failure captured: Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-hypervisors/da216f52-9b00-414a-8078-15d3e162409f HTTP/1.1 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWXllFFo4tWyxWuH144iqXKpVKHnRUNvf5JYTNnDw8uMV20gML7YW1x4rfqFYks7_pRxVLg6n3vQxyEY4Zjfyuh2u4-B1jUb1olqAPrqLPkH-ZEOGohn68TffLnbNbE7AxZ-Ml0aW5eCCXQN4YJq1Yis-ySu0fKRA7F-bM9Lh2uyyM Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 35ad432585fe44afa4256b672e510c64 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/35ad432585fe44afa4256b672e510c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_35ad432585fe44afa4256b672e510c64", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/35ad432585fe44afa4256b672e510c64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/35ad432585fe44afa4256b672e510c64"}]}] Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 35ad432585fe44afa4256b672e510c64 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-634081466 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a03689bd09574f029ce1a626ad784d17 Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: exception: Hypervisor with ID 'da216f52-9b00-414a-8078-15d3e162409f' could not be found. Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'da216f52-9b00-414a-8078-15d3e162409f'} Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'da216f52-9b00-414a-8078-15d3e162409f' Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:08:41.683900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'da216f52-9b00-414a-8078-15d3e162409f' could not be found. Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'da216f52-9b00-414a-8078-15d3e162409f' could not be found. Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6919d1e6-2749-407a-829a-b139fe06f11b tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] Returning 404 to user: Hypervisor with ID 'da216f52-9b00-414a-8078-15d3e162409f' could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:41.689072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6919d1e6-2749-407a-829a-b139fe06f11b tempest-HypervisorAdminNegativeTestJSON-634081466 tempest-HypervisorAdminNegativeTestJSON-634081466-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/da216f52-9b00-414a-8078-15d3e162409f" status: 404 len: 123 microversion: 2.1 time: 0.008464 Aug 21 01:08:41.690764 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 348/662] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/os-hypervisors/da216f52-9b00-414a-8078-15d3e162409f => generated 123 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:41.964231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:41.997022 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b40d963-6f42-4448-8996-e06de87fdb7c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.413011 Aug 21 01:08:41.998482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 315/663] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:41 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:42.165544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:42.166961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:42.175046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.175789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.176218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.177048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.177500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.178196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.278180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:42.283976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:42.304057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.305061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.306827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.309448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.310001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.311128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.372286 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cda945c0-a038-4b55-9cfc-9f0c08a52b85 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1613 microversion: 2.1 time: 0.215355 Aug 21 01:08:42.373364 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 349/664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:42 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1613 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:42.394685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:42.395238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:42.411146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.413772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.418563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.421274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.421655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.426680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.527575 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] HTTP exception thrown: Cannot 'migrate' instance b70f465e-d9bc-4069-8232-82fb4560edf7 while it is in vm_state suspended Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Request method failure captured: Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7/action HTTP/1.1 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVthRSAqf05_jLKiLM0GkeXsdgZLrra0W7G_FzhoLeSJNhysGORbxsczGH_PC3E5G7MA6f-PP67rllwm5eifg5XPUC6k0AuLqaag6uA8rD4mAlwFrKnOxNfBvDtOh2fUWIVFD605kMYgdc7T4x8uhQUVOe6hzgt8ywjv-meAtBmIIk Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a420e5cee9a64a2db8b85ce4a4158bf8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}] Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7abd7dd96a1e4264ba8b374857d1ef89 Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: {"migrate": {}} Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'migrate' instance b70f465e-d9bc-4069-8232-82fb4560edf7 while it is in vm_state suspended Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b70f465e-d9bc-4069-8232-82fb4560edf7', 'body': {'migrate': {}}} Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 in vm_state suspended. Cannot resize while the instance is in this state. Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:42.529474 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b70f465e-d9bc-4069-8232-82fb4560edf7 while it is in vm_state suspended Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b70f465e-d9bc-4069-8232-82fb4560edf7 while it is in vm_state suspended Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Returning 409 to user: Cannot 'migrate' instance b70f465e-d9bc-4069-8232-82fb4560edf7 while it is in vm_state suspended {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2781b22f-396c-4a22-b9f2-6ee562a78caf tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7/action" status: 409 len: 148 microversion: 2.1 time: 0.142061 Aug 21 01:08:42.534135 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 350/665] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:42 2022] POST /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7/action => generated 148 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:08:42.543843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:42.544667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:42.550776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.551504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.552309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.554136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.554781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.555390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.797398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:42.802156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:42.810294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:42.812505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:42.813855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df3adcbb-4db3-497e-af66-465274a2d556 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.280817 Aug 21 01:08:42.815034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-43e3b606-38d4-4a92-b87e-14f7ad3b3fc4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.541763 Aug 21 01:08:42.815493 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 351/666] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:42 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:42.830430 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 316/667] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:42 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:42.833874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7edd6886-0571-4103-8096-2f60ace2c445 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7edd6886-0571-4103-8096-2f60ace2c445 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Request method failure captured: Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action HTTP/1.1 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 39 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVthRSAqf05_jLKiLM0GkeXsdgZLrra0W7G_FzhoLeSJNhysGORbxsczGH_PC3E5G7MA6f-PP67rllwm5eifg5XPUC6k0AuLqaag6uA8rD4mAlwFrKnOxNfBvDtOh2fUWIVFD605kMYgdc7T4x8uhQUVOe6hzgt8ywjv-meAtBmIIk Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a420e5cee9a64a2db8b85ce4a4158bf8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}] Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7abd7dd96a1e4264ba8b374857d1ef89 Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: {"os-resetState": {"state": "invalid"}} Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'faa34102-2b7f-4f19-bfb4-be6fd6f7da1c', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'invalid' Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:08:42.839569 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7edd6886-0571-4103-8096-2f60ace2c445 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7edd6886-0571-4103-8096-2f60ace2c445 tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action" status: 400 len: 144 microversion: 2.1 time: 0.024218 Aug 21 01:08:42.844166 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 352/668] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:42 2022] POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:08:42.852799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f9085ea-5668-4e05-ae9e-3fe5d3fdbfbc tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f9085ea-5668-4e05-ae9e-3fe5d3fdbfbc tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Request method failure captured: Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action HTTP/1.1 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 31 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVthRSAqf05_jLKiLM0GkeXsdgZLrra0W7G_FzhoLeSJNhysGORbxsczGH_PC3E5G7MA6f-PP67rllwm5eifg5XPUC6k0AuLqaag6uA8rD4mAlwFrKnOxNfBvDtOh2fUWIVFD605kMYgdc7T4x8uhQUVOe6hzgt8ywjv-meAtBmIIk Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a420e5cee9a64a2db8b85ce4a4158bf8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}] Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7abd7dd96a1e4264ba8b374857d1ef89 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: {"os-resetState": {"state": 1}} Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'faa34102-2b7f-4f19-bfb4-be6fd6f7da1c', 'body': {'os-resetState': {'state': 1}}} Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 1 Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 21 01:08:42.858740 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 21 01:08:42.863406 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.865020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f9085ea-5668-4e05-ae9e-3fe5d3fdbfbc tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:42.865870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f9085ea-5668-4e05-ae9e-3fe5d3fdbfbc tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action" status: 400 len: 120 microversion: 2.1 time: 0.018737 Aug 21 01:08:42.866607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 317/669] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:08:42 2022] POST /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:08:42.877038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:42.881787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Failed to fetch instance by id 999 {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:08:42.882607 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Request method failure captured: Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 37 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVthRSAqf05_jLKiLM0GkeXsdgZLrra0W7G_FzhoLeSJNhysGORbxsczGH_PC3E5G7MA6f-PP67rllwm5eifg5XPUC6k0AuLqaag6uA8rD4mAlwFrKnOxNfBvDtOh2fUWIVFD605kMYgdc7T4x8uhQUVOe6hzgt8ywjv-meAtBmIIk Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a420e5cee9a64a2db8b85ce4a4158bf8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a420e5cee9a64a2db8b85ce4a4158bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a420e5cee9a64a2db8b85ce4a4158bf8"}]}] Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a420e5cee9a64a2db8b85ce4a4158bf8 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-189311644 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7abd7dd96a1e4264ba8b374857d1ef89 Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminNegativeTestJSON-189311644-project-admin Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: {"os-resetState": {"state": "error"}} Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 999 could not be found. Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:42.890143 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:42.894067 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:42.894067 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 21 01:08:42.894067 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:42.896373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:42.897849 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24fa1e2f-bcf5-4b03-84a7-8aeddfa77e8e tempest-ServersAdminNegativeTestJSON-189311644 tempest-ServersAdminNegativeTestJSON-189311644-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025297 Aug 21 01:08:42.899261 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 353/670] 10.222.0.46 () {60 vars in 1179 bytes} [Sun Aug 21 01:08:42 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:08:42.911346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:42.912666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:42.925862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.927681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.929277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.930294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:42.931719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:42.932369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:42.967257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:43.027186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:43.028367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:43.040516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.042268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.043311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.046196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.049212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.051601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.126951 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32af134f-b3de-4145-8e10-8ad6120394ba tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 204 len: 0 microversion: 2.1 time: 0.221561 Aug 21 01:08:43.129788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 318/671] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:42 2022] DELETE /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:43.140885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:43.141591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:43.162952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.165255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.166811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.168306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.169884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.170862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.190448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:43.228957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-916e226d-8b08-48c6-a8cd-3dfe9cd5b695 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.206230 Aug 21 01:08:43.230629 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 354/672] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:43 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:43.693813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:43.705179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-363e3420-2bd1-478d-9eca-896b1606decf tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1468 microversion: 2.1 time: 0.570660 Aug 21 01:08:43.705760 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 319/673] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:43 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1468 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:43.838322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:43.838984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:43.839535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:43.840350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:43.847200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.852522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.853280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.854233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.854933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.855563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.856132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.856902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.857486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:43.858697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:43.859151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:43.863155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:44.154454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:44.155405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:44.164724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9fa2dde-86ff-41aa-9dfd-336066ccf755 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.329521 Aug 21 01:08:44.165343 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 320/674] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:43 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:44.178895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:44.180380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:44.187807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edff61e1-4f21-429f-8223-dfd701f1db42 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.348133 Aug 21 01:08:44.202304 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 355/675] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:43 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:44.258848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:44.259460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:44.267714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:44.268201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:44.268631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:44.269364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:44.269811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:44.270225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:44.401924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:44.425637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2439f249-c539-48a0-bf12-39823f383ef3 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.170357 Aug 21 01:08:44.426935 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 321/676] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:44 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:44.731782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:44.733690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:44.748244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:44.748967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:44.751162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:44.751953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:44.752415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:44.755526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.081197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:45.089328 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-451eda1a-37be-4e98-9d77-3c353b03e3fe tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1468 microversion: 2.1 time: 0.363984 Aug 21 01:08:45.089905 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 356/677] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:44 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1468 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:45.187445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:45.188117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:45.212791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:45.214030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:45.219781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.221664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.225567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.227470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.234491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.235878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.238663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.239472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.242658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.248740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.249525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.257072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.578646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:45.597987 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-efdd05bd-2f61-4ce2-9718-49b99ac08976 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.413625 Aug 21 01:08:45.601547 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 322/678] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:45 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:45.613223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:45.618107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:45.636514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.645034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.646643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.651475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:45.654170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:45.660989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:45.805795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:45.838835 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59af4c34-8ba5-4388-80ee-dc6456a8ddd1 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.234926 Aug 21 01:08:45.863870 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 323/679] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:45 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:46.112550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:46.113312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:46.122006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.129457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.130263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.135835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.136538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.138333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.393531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:46.401764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:46.415046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:46.416256 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-491a6ad6-5b2c-443b-9bf3-b16b4d53781a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 1.208274 Aug 21 01:08:46.416986 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 357/680] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:45 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:46.421781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfe02f3-fc88-49b2-b376-6d362bdc1b4c", "name": "network-vif-unplugged", "status": "completed", "tag": "59e99352-1bdf-4d06-9a88-cd5f4b0ba642"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:46.459776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.460528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.461356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.475580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] Creating event network-vif-unplugged:59e99352-1bdf-4d06-9a88-cd5f4b0ba642 for instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c on n-h1-master-1 Aug 21 01:08:46.481098 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-209267c7-4e3b-4be2-93e7-f474dfb1ca5b req-2cdb7ded-48b3-4a48-9628-ec6d5e274ff5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062791 Aug 21 01:08:46.481976 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 358/681] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:46.618296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:46.620076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:46.620795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:46.629722 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=40 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:46.634751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.635135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0cd79733-ba8b-4794-ac9c-87fcb617399f tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1468 microversion: 2.1 time: 0.527518 Aug 21 01:08:46.635597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.635816 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 324/682] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:46 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1468 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:46.649371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.650481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.651114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.651699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.876228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:46.877149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:46.899165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.900520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.901149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.902065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:46.905662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:46.908301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:46.949501 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=11 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:47.067996 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:47.083565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:47.127120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26807d7e-0402-4aac-84f8-7d4841ae4e61 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.249374 Aug 21 01:08:47.128314 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 325/683] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:46 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:47.178111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f465e-d9bc-4069-8232-82fb4560edf7", "name": "network-vif-deleted", "tag": "a92d393c-d03c-48b0-b0cb-dab8a6c38d9d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:47.196828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.197618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.198230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.227908 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] Creating event network-vif-deleted:a92d393c-d03c-48b0-b0cb-dab8a6c38d9d for instance b70f465e-d9bc-4069-8232-82fb4560edf7 on n-h2-master-1 Aug 21 01:08:47.234489 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-84451f89-3482-4157-864b-caca25f739f4 req-c274e71a-4822-4b3d-babc-a8314269da39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060070 Aug 21 01:08:47.244003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 326/684] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:08:47.345610 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=66 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:47.356065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:47.364892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-493f6d1b-0ae2-4dc8-9dcb-e36197ddeac2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.749086 Aug 21 01:08:47.365471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 359/685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:46 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:47.444435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:47.445683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:47.453919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.454576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.455160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.456173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.456859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.457437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.546109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac4c6239-b535-403b-9219-d9e40e9d099c tempest-InstanceUsageAuditLogTestJSON-1860737981 tempest-InstanceUsageAuditLogTestJSON-1860737981-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:47.547083 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:47.547083 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:47.568391 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ac4c6239-b535-403b-9219-d9e40e9d099c tempest-InstanceUsageAuditLogTestJSON-1860737981 tempest-InstanceUsageAuditLogTestJSON-1860737981-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-21 01:08:47" status: 200 len: 318 microversion: 2.1 time: 0.322734 Aug 21 01:08:47.569740 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 327/686] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:08:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-21%2001%3A08%3A47 => generated 318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:47.585885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08d62392-d4c2-457e-b811-8d2d68280b59 tempest-InstanceUsageAuditLogTestJSON-1860737981 tempest-InstanceUsageAuditLogTestJSON-1860737981-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:47.587548 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:08:47.587548 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:08:47.608148 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08d62392-d4c2-457e-b811-8d2d68280b59 tempest-InstanceUsageAuditLogTestJSON-1860737981 tempest-InstanceUsageAuditLogTestJSON-1860737981-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025527 Aug 21 01:08:47.609190 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 328/687] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:08:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:47.657863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:47.659018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:47.670641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.671159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.671590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.672631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.676750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.677424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.714224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:47.745081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:47.752892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:47.756646 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3bf2539-34b2-49cb-b931-16b6adcaa31d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.320435 Aug 21 01:08:47.759667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 360/688] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:47 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:47.772098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:47.773050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:47.779603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:47.781323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lazy-loading 'fault' on Instance uuid b70f465e-d9bc-4069-8232-82fb4560edf7 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:47.876483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:47.888180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3f27111-df7d-4751-8fa6-82e3e6af62ca tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 200 len: 1312 microversion: 2.1 time: 0.235820 Aug 21 01:08:47.891802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 329/689] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:47 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:48.156380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:48.157022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:48.168080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.169563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.170190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.171421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.172078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.172704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.268551 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:48.276804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:48.320925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-920bb04e-42fa-470f-be02-2293d28794ca tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.169878 Aug 21 01:08:48.333258 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 361/690] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:48 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:48.389121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:48.390045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:48.398159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.398922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.399503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.400496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.401118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.401761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.562592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfe02f3-fc88-49b2-b376-6d362bdc1b4c", "tag": "59e99352-1bdf-4d06-9a88-cd5f4b0ba642"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:48.587344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.588195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.588991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.617734 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] Creating event network-changed:59e99352-1bdf-4d06-9a88-cd5f4b0ba642 for instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c on n-h1-master-1 Aug 21 01:08:48.626295 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bf526564-6bf6-47fb-a2cd-b48a3a7f4383 req-55642cb0-60e5-4b06-acc4-c87002744f5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067532 Aug 21 01:08:48.627690 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 362/691] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:48.744982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:48.788187 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-456b8b82-0fb4-4dfd-a7cf-4b8e01d87bd7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.397599 Aug 21 01:08:48.795970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 330/692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:48 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:48.812353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:48.813163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:48.815227 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:48.821528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.822756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.823174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.824119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.824538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.825225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.912334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:48.913085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: b70f465e-d9bc-4069-8232-82fb4560edf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:48.921548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.922044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.922541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.923336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.923933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.924818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.939821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] HTTP exception thrown: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Request method failure captured: Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 HTTP/1.1 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYVrw_201FC90EORjBiGyxJYoY-jprl4OLEsi18dwKEJkQwEu5adnjzhGuYobcEfKzeZ05s-57xx_FA44ZK_QLusr2thgaMBcbumxP_WSj4_3OKfUeyRvH35nU9l6iDSowrz0SpztX4BI4llNt6M10UzlGN2WU6ggUeA_u8zO04a9dg Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 74a87c21538344c7ac51835993e5839d Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74a87c21538344c7ac51835993e5839d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_74a87c21538344c7ac51835993e5839d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/74a87c21538344c7ac51835993e5839d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74a87c21538344c7ac51835993e5839d"}]}] Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 74a87c21538344c7ac51835993e5839d Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminNegativeTestJSON-991242915-project Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9ebc6e77ecbc4a61a6f13803cd1a1589 Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminNegativeTestJSON-991242915-project Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b70f465e-d9bc-4069-8232-82fb4560edf7'} Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:48.941809 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. Aug 21 01:08:48.946078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:08:48.946920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Returning 404 to user: Instance b70f465e-d9bc-4069-8232-82fb4560edf7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:48.948322 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-304b057e-2c97-4fb3-bb26-1428991d8026 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7" status: 404 len: 111 microversion: 2.1 time: 0.039869 Aug 21 01:08:48.953361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 331/693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:48 2022] GET /compute/v2.1/servers/b70f465e-d9bc-4069-8232-82fb4560edf7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:48.958907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:48.959532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:48.966531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.967507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.968138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:48.969070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:48.969709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:48.970321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.002843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:49.130870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64699265-4a0d-4df1-ab2a-e46936e87d6a tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 204 len: 0 microversion: 2.1 time: 0.175501 Aug 21 01:08:49.138122 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 332/694] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:48 2022] DELETE /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:49.144958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:49.145786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:49.169581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.170402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.171025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.172109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.173742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.173884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.221620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:49.238111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:49.239798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:49.243955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-872304cc-4eee-429e-af0a-aa8464747799 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.450043 Aug 21 01:08:49.244742 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 363/695] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:48 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:49.348194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:49.348845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:49.360949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.361452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.361883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.362596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.363059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.363466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.653211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:49.693896 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19aea084-db85-4acf-9706-dcc643e8335e tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.350261 Aug 21 01:08:49.708798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:49.710059 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 364/696] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:49 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:49.716584 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-662fd35a-4ae5-4df2-ad12-c886a2d217f1 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1477 microversion: 2.1 time: 0.567238 Aug 21 01:08:49.716584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 333/697] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:49 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:49.813131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:49.813951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:49.832241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.833293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.833881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:49.834740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:49.835408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:49.835990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.058133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:50.070349 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bd57cc5-1bfc-400f-b350-1a71d2e9057d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.260148 Aug 21 01:08:50.072746 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 365/698] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:49 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:50.269994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:50.271224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:50.280042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.280752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.281214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.281967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.282419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.282885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.672190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:50.684671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:50.686308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:50.691848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-788f01c6-3c57-42ac-bd5b-92e2fb96d1af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.427553 Aug 21 01:08:50.693384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 334/699] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:50 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:50.723712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:50.725065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:50.738325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.739320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.739991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.741025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.741141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:50.743169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:50.743801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.744456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.753438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.753932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.754644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.755345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:50.755942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:50.756506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:50.902899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:50.967900 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b96e3e8-ff52-489a-85ee-53aa71f460b9 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.248144 Aug 21 01:08:50.971998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 366/700] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:50 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:51.093923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:51.094543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:51.101396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:51.101885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:51.102328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:51.103034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:51.103484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:51.103902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:51.175414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:51.184057 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df537693-1fe4-44bb-8ee7-b7452d17190c tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1477 microversion: 2.1 time: 0.447600 Aug 21 01:08:51.185608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 335/701] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:50 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:51.661934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:51.675515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e881e7b-e803-462f-9f0d-e59ad8c23544 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.585320 Aug 21 01:08:51.676924 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 367/702] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:51 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:51.720002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:51.720516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:51.738598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:51.739081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:51.739541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:51.740216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:51.744615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:51.745523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:51.996369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:51.997782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:52.004291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.006087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.006794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.007835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.008693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.009404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.176089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:52.221887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f4bc71e-57c9-4a77-844d-066fa58ec8f5 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.229378 Aug 21 01:08:52.222700 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 368/703] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:51 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:52.229352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:52.230134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:52.252311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.252832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.253241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.262929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.263402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.263841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.514631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ebc6e77ecbc4a61a6f13803cd1a1589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a87c21538344c7ac51835993e5839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:52.524593 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed3c1e7f-e13b-46ed-be17-efa2bc841f95 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 200 len: 1435 microversion: 2.1 time: 0.299977 Aug 21 01:08:52.529560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 369/704] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:52 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 1435 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:52.534491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faa34102-2b7f-4f19-bfb4-be6fd6f7da1c", "name": "network-vif-deleted", "tag": "6be9fda2-ba48-4d58-bd76-d36b7ac8da14"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:52.564843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.565597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.566173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.592603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] Creating event network-vif-deleted:6be9fda2-ba48-4d58-bd76-d36b7ac8da14 for instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c on n-h2-master-1 Aug 21 01:08:52.599638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7d779b22-ba08-4659-974d-74803b6ce2b1 req-48565a2e-1e56-4307-997f-6fd91f4fd1ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068579 Aug 21 01:08:52.600521 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 370/705] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:08:52.697820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:52.698742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:52.711561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.712372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.715131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.716245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:52.719480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:52.725886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:52.737913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:52.755495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:52.761471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:52.764604 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bec4395e-ec5c-4f6e-8463-6ac5678476f4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 1.048602 Aug 21 01:08:52.767265 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 336/706] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:51 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:53.253268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:53.254182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:53.266807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.267636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.269972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.272160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.272826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.275974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.622710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:53.643617 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d360ebd-715e-4482-9b8f-ce01103d8a9a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.950275 Aug 21 01:08:53.644747 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 371/707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:52 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:08:53.649673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:53.650558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] [instance: faa34102-2b7f-4f19-bfb4-be6fd6f7da1c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:53.661441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.662022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.663631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.674376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.675081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.675775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.710903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] HTTP exception thrown: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Request method failure captured: Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c HTTP/1.1 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVrw_201FC90EORjBiGyxJYoY-jprl4OLEsi18dwKEJkQwEu5adnjzhGuYobcEfKzeZ05s-57xx_FA44ZK_QLusr2thgaMBcbumxP_WSj4_3OKfUeyRvH35nU9l6iDSowrz0SpztX4BI4llNt6M10UzlGN2WU6ggUeA_u8zO04a9dg Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 74a87c21538344c7ac51835993e5839d Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74a87c21538344c7ac51835993e5839d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_74a87c21538344c7ac51835993e5839d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/74a87c21538344c7ac51835993e5839d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74a87c21538344c7ac51835993e5839d"}]}] Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 74a87c21538344c7ac51835993e5839d Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-991242915 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminNegativeTestJSON-991242915-project Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9ebc6e77ecbc4a61a6f13803cd1a1589 Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminNegativeTestJSON-991242915-project Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: exception: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'faa34102-2b7f-4f19-bfb4-be6fd6f7da1c'} Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:53.712649 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:08:53.717893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] Returning 404 to user: Instance faa34102-2b7f-4f19-bfb4-be6fd6f7da1c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:08:53.719154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62fa7f24-e847-4257-b5ba-e537585a1873 tempest-ServersAdminNegativeTestJSON-991242915 tempest-ServersAdminNegativeTestJSON-991242915-project] 10.222.0.46 "GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c" status: 404 len: 111 microversion: 2.1 time: 0.073214 Aug 21 01:08:53.724195 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 372/708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:53 2022] GET /compute/v2.1/servers/faa34102-2b7f-4f19-bfb4-be6fd6f7da1c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:53.795060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:53.796066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:53.818837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.826600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.827376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.828353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:53.830518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:53.831085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:53.869638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:53.921532 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9552117c-4b0a-4314-bc35-cc6e9e790a8a tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.673798 Aug 21 01:08:53.943435 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 337/709] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:53 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:08:54.314479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:54.332600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:54.338207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:54.340538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-44352e4c-5113-49cb-9d46-b755507efa19 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.550297 Aug 21 01:08:54.344672 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 373/710] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:53 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:54.521628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:54.522192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:54.538564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:54.539189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:54.539668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:54.540569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:54.541202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:54.541771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:54.591421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:08:54.669029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:54.669666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:54.681952 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:54.684197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:54.684933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:54.685375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:54.686277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:54.686725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:54.687137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:54.736369 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-122b6b12-6220-494f-9a89-ab9026c7ba28 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 204 len: 0 microversion: 2.1 time: 0.217275 Aug 21 01:08:54.738705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 338/711] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:08:54 2022] DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:08:54.950144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-843782125", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "1816049612", "adminPass": "***", "networks": [{"uuid": "38022af8-b00a-4407-8953-c3cf46d57e62"}], "security_groups": [{"name": "tempest-securitygroup--880624571"}], "key_name": "tempest-keypair-1473760196", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:08:55.088307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:55.102574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-711b5fcb-6280-4e3d-a8f9-863962a2cec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.437051 Aug 21 01:08:55.107888 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 374/712] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:54 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:55.117007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:55.120209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:55.131243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:55.131974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:55.132582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:55.134373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:55.135036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:55.135600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:55.267439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:55.296634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] validate_networks() for [('38022af8-b00a-4407-8953-c3cf46d57e62', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:08:55.311857 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f38743ae-5a4a-4a02-a23d-a3163766d671 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.202240 Aug 21 01:08:55.313517 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 375/713] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:55 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:55.373711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:55.374325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:55.392323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:55.392846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:55.397208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:55.398312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:55.399044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:55.399627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:55.744313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:55.767840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:55.772449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:55.787036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-90b1538f-f3e1-42f2-a590-6c7d64d11d78 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.417274 Aug 21 01:08:55.806593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 376/714] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:55 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:56.137080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:56.142834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:56.164137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:56.165695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:56.166465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:56.167391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:56.168104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:56.169077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:56.549526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:56.572353 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab9ec67e-73e6-403a-a27f-68c1d43540b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 0.446594 Aug 21 01:08:56.575068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 377/715] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:56 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:56.592164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:56.593893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:56.618260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:56.620610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:56.634687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:56.637776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:56.645071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:56.645714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:56.906921 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:56.934569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:56.979300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-806d2c54-dd93-4014-b264-ee5c84c1943c tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.402950 Aug 21 01:08:56.980985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 378/716] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:56 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:57.004124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:57.010126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:57.018958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.021364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.022026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.022967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.023577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.024732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.218726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:08:57.219207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:08:57.219600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:08:57.220007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:08:57.220495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:08:57.238335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.238805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.239234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.239961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.240405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.248136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.317332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for project c81f6af23f174318870b6ef8633f5cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:08:57.378942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Getting quotas for user 52db969e85344bb6a40150cedc205df8 and project c81f6af23f174318870b6ef8633f5cf3. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:08:57.396964 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:57.400032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:08:57.417130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:08:57.599106 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a75ea367-9715-4dba-b7ef-58030c802e90 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.659101 Aug 21 01:08:57.599757 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 339/717] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:08:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:08:57.634750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:57.637914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:57.647336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.648027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.648611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.649500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:57.650283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:57.654212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:57.941352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:57.964619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:57.982977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:57.987103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7dbd445e-fa5b-43e5-bb26-8ca5a12a6621 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 0.986895 Aug 21 01:08:57.993424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 379/718] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:56 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:58.015359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d689b0bf-92f3-4409-bb79-e3321d4e5f5e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:58.015985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d689b0bf-92f3-4409-bb79-e3321d4e5f5e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:58.252163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d689b0bf-92f3-4409-bb79-e3321d4e5f5e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:58.261768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d689b0bf-92f3-4409-bb79-e3321d4e5f5e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1264 microversion: 2.1 time: 0.268019 Aug 21 01:08:58.276248 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 380/719] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:57 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:58.290572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:58.291466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:58.323234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:58.323725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:58.324156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:58.332487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:58.333100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:58.333542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:58.649854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:08:58.712312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df17319c-5084-46bf-bb60-3842d18017d6 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.434283 Aug 21 01:08:58.713148 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 381/720] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:58 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:08:59.018278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:59.019863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:59.034205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.040297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.042128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.051961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.067943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.070620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.234714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:59.258370 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-502b9fc7-7496-4657-a226-0b1cb045e8e0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1476 microversion: 2.1 time: 1.651206 Aug 21 01:08:59.260071 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 340/721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:57 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1476 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:59.292715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:59.310771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:59.327906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.330995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.331547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.332553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.333939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.336023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.702399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:08:59.721487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02386444-f2ec-47dc-8370-9f7dd3440413 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1260 microversion: 2.1 time: 0.428658 Aug 21 01:08:59.722603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 341/722] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:08:59 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1260 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:08:59.745975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:08:59.746535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:08:59.761179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.763123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.764915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.766484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:08:59.769168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:08:59.771086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:08:59.785599 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:00.101161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:00.124180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:00.139702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:00.144065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:00.149020 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50b297bf-6575-4a29-ad0a-8bacab6d772d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 1.135128 Aug 21 01:09:00.165205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 382/723] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:59 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:00.174515 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e099e797-5189-4f3d-a7d9-ffcf38ea5dde tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1929 microversion: 2.75 time: 0.439140 Aug 21 01:09:00.181194 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 342/724] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:08:59 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1929 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:00.281398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:00.282137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:00.298262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:00.299002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:00.299547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:00.300372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:00.301019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:00.301501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:00.750659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:00.751949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:00.771423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:00.772642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:00.773468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:00.781676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:00.783616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:00.784254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:01.301366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:01.315680 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-315712f9-7eca-4fd5-9962-392e18a359ca tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1322 microversion: 2.1 time: 0.570085 Aug 21 01:09:01.328825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 343/725] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:00 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:01.336890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:01.337523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:01.366497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:01.367020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:01.368168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:01.369909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:01.372361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:01.372861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:02.097982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:02.113230 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68f4cd27-feff-4a9c-9d55-b254c6e68817 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1475 microversion: 2.1 time: 1.836962 Aug 21 01:09:02.114159 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 383/726] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:00 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1475 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:02.143872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:02.144487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:02.170558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:02.171364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:02.171976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:02.172885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:02.173338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:02.181172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:02.545596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:02.601696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-447eb4c8-b080-4795-8d26-86c02e373aba tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1935 microversion: 2.75 time: 0.486324 Aug 21 01:09:02.602661 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 384/727] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:02 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1935 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:02.631956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "name": "network-vif-unplugged", "status": "completed", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:02.668214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:02.669140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:02.669739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:02.704714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Creating event network-vif-unplugged:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h2-master-1 Aug 21 01:09:02.720651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:09:02.743138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9e91ba14-8bb1-40c5-abc8-bd3946685868 req-e4818fc4-8b4b-465e-bca7-4fc7bf1092a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123666 Aug 21 01:09:02.748276 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 385/728] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:02.754329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:02.755446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:02.778618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:02.779425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:02.780291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:02.781475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:02.782079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:02.782677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.256329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:03.273170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:03.278676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:03.288998 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c91f160f-7a56-4574-bd45-f45dfccac8d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1567 microversion: 2.25 time: 1.971236 Aug 21 01:09:03.289599 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 344/729] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:01 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1567 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:03.324782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:03.329207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:03.349613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:03.350953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:03.354162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.356352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:03.357801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:03.360150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.395804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:03.425150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f654582-b9ae-4129-bc62-a199e2409aef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1322 microversion: 2.1 time: 0.675011 Aug 21 01:09:03.426825 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 386/730] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:02 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:03.644561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:03.650401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:03.673642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:03.676477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:03.678806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.680248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:03.681204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:03.698132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.895874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] Lazy-loading 'services' on Instance uuid 64bbda22-10c6-4718-89ac-7d9dff0c1b78 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:03.934668 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f77e243-7f93-4328-ac0f-5b6c925c4d34 tempest-ServersAdmin275Test-648671267 tempest-ServersAdmin275Test-648671267-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1920 microversion: 2.75 time: 0.303944 Aug 21 01:09:03.935922 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 387/731] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:03 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1920 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:09:03.957785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f3ee72-efe7-436d-8834-88e9a01ef0ad", "name": "network-vif-deleted", "tag": "fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:03.971950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:03.972478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:03.973103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:03.997175 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] Creating event network-vif-deleted:fcc67a9f-cda6-4aac-bcb6-4f3fa300f1ea for instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad on n-h2-master-1 Aug 21 01:09:04.010337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c715e25b-bdd7-4b72-af07-b76a2e26e714 req-0a468e30-8cee-482c-b759-4f5af378c531 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072935 Aug 21 01:09:04.013634 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 388/732] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:04.026714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:04.028122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:04.038984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.039480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.039915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.041492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.041965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.042499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.085636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:09:04.169806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:04.186334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2dc4f40d-2518-4b5c-9e7a-b91de208f50e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1475 microversion: 2.1 time: 0.889699 Aug 21 01:09:04.189892 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 345/733] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:03 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1475 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:04.287280 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ce53ed1-6667-4b20-a47d-cfd9623e53f2 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "DELETE /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 204 len: 0 microversion: 2.75 time: 0.268259 Aug 21 01:09:04.291729 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 389/734] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:09:04 2022] DELETE /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:09:04.302641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:04.304626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:04.319779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:04.324199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.326142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.326370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:04.327693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.330548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.331203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.333783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.350517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.353323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.355846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.357194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.363904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.365214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.728686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:04.751081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:04.752625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:04.766196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84e54e57-062e-4b87-b6ab-e3341d7911a9 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1444 microversion: 2.75 time: 0.469005 Aug 21 01:09:04.766829 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 346/735] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:04 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1444 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:04.783532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:04.784168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:04.800023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.800622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.801094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:04.812969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:04.813467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:04.813905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:05.020187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:05.039366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:05.040750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:05.041942 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-680e9a82-98b7-4e96-bb67-cf85e384b272 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1557 microversion: 2.25 time: 0.734086 Aug 21 01:09:05.058772 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 390/736] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:04 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1557 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:05.070927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:05.085706 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1288d6a8-10e6-4802-9d16-42315d41757a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1322 microversion: 2.1 time: 0.313396 Aug 21 01:09:05.086657 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 347/737] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:04 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:05.095566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3319365f-7026-42d5-863d-3b2504c48fb9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '.version_select at 0x7fc3fe2a6790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:05.105366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3319365f-7026-42d5-863d-3b2504c48fb9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:05.106277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3319365f-7026-42d5-863d-3b2504c48fb9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:05.110117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3319365f-7026-42d5-863d-3b2504c48fb9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:05.164190 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3319365f-7026-42d5-863d-3b2504c48fb9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 865 microversion: 2.25 time: 0.075988 Aug 21 01:09:05.165020 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 348/738] 10.222.0.46 () {60 vars in 1184 bytes} [Sun Aug 21 01:09:05 2022] GET /compute/v2.1/os-migrations => generated 865 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:09:05.178411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:05.179167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:05.189575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:05.190062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:05.190494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:05.191199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:05.191647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:05.192063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:05.295019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52f5e753-ec53-4e64-8a0b-9f75fb4cec86 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa2fc700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-924705613", "description": "tempest-description-1746758317"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:05.501152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:05.532830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d036b98-67d1-482e-99fd-341935348417 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 2049 microversion: 2.25 time: 0.357912 Aug 21 01:09:05.533402 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 349/739] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:05 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 2049 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:05.544063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:05.547838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:05.565234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:05.565981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:05.566555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:05.569102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:05.569790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:05.570369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:06.250542 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52f5e753-ec53-4e64-8a0b-9f75fb4cec86 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.189310 Aug 21 01:09:06.259836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 391/740] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:09:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:06.265238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:06.276095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:06.283085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:06.283774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:06.293954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:06.310893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b8c4029-ecee-48b2-a114-410a016cd7c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1475 microversion: 2.1 time: 0.770110 Aug 21 01:09:06.313184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 350/741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:05 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1475 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:06.321627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:06.324362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:06.335893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Creating event network-changed:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h2-master-1 Aug 21 01:09:06.343570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:06.344638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:06.345753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:06.346799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:06.348734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:06.352025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:06.360511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:09:06.403429 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-72a0f764-6dd4-4e8b-9c01-55e92c551858 req-1c8cdf50-0d09-4429-9e6f-648f9d2158fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139746 Aug 21 01:09:06.403651 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 392/742] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:06.421053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1505265840", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "733da70d-73b5-4a16-a93a-dec288bd5761"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:06.528075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] validate_networks() for [('733da70d-73b5-4a16-a93a-dec288bd5761', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:06.656632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:06.665383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:06.666875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c396660456743b19abe19dccdb9ba2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a30211c0624285b0d861b43a2036c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:06.682695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1010bcf-7498-4496-8afb-7b6b856726a4 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 200 len: 1444 microversion: 2.75 time: 0.368550 Aug 21 01:09:06.698155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 351/743] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:06 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 1444 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:06.706631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:06.707644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:06.714140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:06.714822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:06.715437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:06.716310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:06.716925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:06.717495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:07.275625 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:07.390847 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=14 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:07.473203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:07.512103 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51e47084-1a0c-4cb6-8c91-19f9e28c343b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.812429 Aug 21 01:09:07.530873 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 352/744] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:06 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:07.581772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10b9dc83-5bb9-4f48-b217-4d318600098c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe512550>, body: {"security_group_rule": {"parent_group_id": "11b390ea-8887-4508-bf18-cc3226fd1f31", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:07.720371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:07.720918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:07.721302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:07.721721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:07.722258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:07.741917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:07.744031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:07.745074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:07.747436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:07.747900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:07.750617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:07.797524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:07.810690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for user 547522b0b07f472a91ec83f15a36bb90 and project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:07.838863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:07.842539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:07.913935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26047403-f193-402f-bf1b-0f3086cf99f1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.509197 Aug 21 01:09:07.924562 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 393/745] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:09:07.929681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:07.930737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:07.969275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:07.973414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:07.974206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:07.977480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:07.979320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:07.979985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:08.775746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:08.794533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68cb7f29-47fd-4313-a1cb-3af22f89b528 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1473 microversion: 2.1 time: 0.862558 Aug 21 01:09:08.795631 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 394/746] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:07 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1473 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:08.801033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:08.805631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] [instance: 64bbda22-10c6-4718-89ac-7d9dff0c1b78] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:08.824708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:08.827573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:08.828138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:08.830845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:08.831605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:08.832389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:08.865436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] HTTP exception thrown: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Request method failure captured: Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 HTTP/1.1 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYVjX4cxW6jJuRereEaWAbQuih1ltD6kT2otsXDGTjIjPqKkXi9olyQ4m3P1EMMfVTgO6eAj4IPo0LtQa1tkbumXV8rg-CAJk_sVleJ5H69oDg5LyfdPP3_OWost6pXu7wjbDNPVBr-y8NNGCs0_R7c0nzuY91vQVewmA2e5dQ6fvPM Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.75 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 10a30211c0624285b0d861b43a2036c4 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdmin275Test-1749171591 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10a30211c0624285b0d861b43a2036c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10a30211c0624285b0d861b43a2036c4", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10a30211c0624285b0d861b43a2036c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10a30211c0624285b0d861b43a2036c4"}]}] Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdmin275Test-1749171591 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 10a30211c0624285b0d861b43a2036c4 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdmin275Test-1749171591 Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdmin275Test-1749171591-project Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1c396660456743b19abe19dccdb9ba2e Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdmin275Test-1749171591-project Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '64bbda22-10c6-4718-89ac-7d9dff0c1b78'} Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:08.867547 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. Aug 21 01:09:08.872288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:08.877701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] Returning 404 to user: Instance 64bbda22-10c6-4718-89ac-7d9dff0c1b78 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:08.878583 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3ce9cd9-dc12-47e3-aff7-4444c5a61749 tempest-ServersAdmin275Test-1749171591 tempest-ServersAdmin275Test-1749171591-project] 10.222.0.46 "GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78" status: 404 len: 111 microversion: 2.75 time: 0.081809 Aug 21 01:09:08.884755 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 395/747] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:08 2022] GET /compute/v2.1/servers/64bbda22-10c6-4718-89ac-7d9dff0c1b78 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:09:08.895587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:08.896209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:08.919066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:08.920929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:08.922304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:08.923793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:08.924452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:08.925169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:09.253258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:09.272898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:09.280541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:09.286926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-887bfc11-68e2-475a-8caa-c3a5fa7a79ad tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1258 microversion: 2.25 time: 0.400814 Aug 21 01:09:09.287928 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 396/748] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:08 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1258 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:09.322846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:09.323489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:09.346512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:09.347017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:09.347444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:09.348154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:09.348605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:09.349105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:09.375304 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:09.523871 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10b9dc83-5bb9-4f48-b217-4d318600098c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.979478 Aug 21 01:09:09.525390 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 353/749] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:09.537338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f822ce4-b56e-48c9-a757-9fbc6809414a tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe2985e0>, body: {"security_group_rule": {"parent_group_id": "11b390ea-8887-4508-bf18-cc3226fd1f31", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:10.212599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1f822ce4-b56e-48c9-a757-9fbc6809414a tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f822ce4-b56e-48c9-a757-9fbc6809414a tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 138 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: {"security_group_rule": {"parent_group_id": "11b390ea-8887-4508-bf18-cc3226fd1f31", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: exception: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'security_group_rule': {'parent_group_id': '11b390ea-8887-4508-bf18-cc3226fd1f31', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:10.216593 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f822ce4-b56e-48c9-a757-9fbc6809414a tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: This rule already exists in group 11b390ea-8887-4508-bf18-cc3226fd1f31 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f822ce4-b56e-48c9-a757-9fbc6809414a tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.685902 Aug 21 01:09:10.220589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 354/750] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:09 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 687 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:09:10.236345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:10.240353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:10.257592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:10.259628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:10.265701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:10.266484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:10.267109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:10.274629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:10.315645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:10.338944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eec23944-4795-48b9-b75c-ee28d53ebe85 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 1.049564 Aug 21 01:09:10.340337 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 397/751] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:09 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:10.348723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f22bf56-27bb-4a68-8a07-a74355e513ad tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fa1b9d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:11.891871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:11.903124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1c65013-33f9-4127-a0ae-e36c3283c41d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1470 microversion: 2.1 time: 1.681832 Aug 21 01:09:11.904400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f22bf56-27bb-4a68-8a07-a74355e513ad tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/b12fe4e7-0e66-4198-801b-051d05aa57cd" status: 202 len: 0 microversion: 2.1 time: 1.562699 Aug 21 01:09:11.905843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 398/752] 10.222.0.46 () {58 vars in 1287 bytes} [Sun Aug 21 01:09:10 2022] DELETE /compute/v2.1/os-security-group-rules/b12fe4e7-0e66-4198-801b-051d05aa57cd => generated 0 bytes in 1565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:11.910431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 355/753] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:10 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1470 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:11.922304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:11.923257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:11.924172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:11.924313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:11.932585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:11.939618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:11.940142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:11.941215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:11.941378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:11.941795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:11.942740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:11.943362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:11.943938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:11.944905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:11.945401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:11.945852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:12.359191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:12.375075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:12.380508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:12.384507 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-07a701ea-37ca-4683-9912-2208850aed8a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1320 microversion: 2.25 time: 0.477546 Aug 21 01:09:12.386295 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 399/754] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:11 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:12.403895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aeaa82cc-53b2-40a4-8183-c0e0e8a09958 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa1eb700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-98179461", "description": "tempest-description-486268581"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:12.671674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:12.686733 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-271434ad-118b-48eb-91de-593b64d3ada3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.773981 Aug 21 01:09:12.689360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 356/755] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:11 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:12.706114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:12.710119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:12.724520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:12.727763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:12.728266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:12.729065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:12.731191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:12.732318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:12.807554 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aeaa82cc-53b2-40a4-8183-c0e0e8a09958 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.419341 Aug 21 01:09:12.825300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 400/756] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:09:12 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:12.842704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be78182f-0f12-407c-b886-a716da34715d tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa1b9d30>, body: {"security_group_rule": {"parent_group_id": "0c8ec721-786f-4960-8932-f421db016e35", "ip_protocol": "tcp", "from_port": 920486775, "to_port": 22}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:12.906783 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7e51abe-e27d-4b26-b99d-6938cb417010 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e/action" status: 204 len: 0 microversion: 2.1 time: 0.215699 Aug 21 01:09:12.911607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 357/757] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:09:12 2022] POST /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e/action => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:09:12.924903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:12.926339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:12.940424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:12.943084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:12.946402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:12.947467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:12.950053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:12.951074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:13.184886 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-be78182f-0f12-407c-b886-a716da34715d tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Invalid port range 920486775:22. Former value cannot be greater than the later Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be78182f-0f12-407c-b886-a716da34715d tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 145 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: {"security_group_rule": {"parent_group_id": "0c8ec721-786f-4960-8932-f421db016e35", "ip_protocol": "tcp", "from_port": 920486775, "to_port": 22}} Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid port range 920486775:22. Former value cannot be greater than the later Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0c8ec721-786f-4960-8932-f421db016e35', 'ip_protocol': 'tcp', 'from_port': 920486775, 'to_port': 22}}} Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 920486775:22. Former value cannot be greater than the later Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 920486775:22. Former value cannot be greater than the later Aug 21 01:09:13.187057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 920486775:22. Former value cannot be greater than the later Aug 21 01:09:13.190665 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.192485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be78182f-0f12-407c-b886-a716da34715d tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: Invalid port range 920486775:22. Former value cannot be greater than the later {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:13.193850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be78182f-0f12-407c-b886-a716da34715d tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.358445 Aug 21 01:09:13.194575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 401/758] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:12 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:09:13.209141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fc26483-3da2-43d0-a13e-0d6ed5f0f276 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa14e0d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1398349075", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:13.211392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8fc26483-3da2-43d0-a13e-0d6ed5f0f276 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Security group id should be uuid Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fc26483-3da2-43d0-a13e-0d6ed5f0f276 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 131 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1398349075", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: exception: Security group id should be uuid Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1398349075', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:13.212866 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:13.217452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 21 01:09:13.217452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:13.217452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fc26483-3da2-43d0-a13e-0d6ed5f0f276 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: Security group id should be uuid {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:13.217452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fc26483-3da2-43d0-a13e-0d6ed5f0f276 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.011989 Aug 21 01:09:13.217452 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 402/759] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:13 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 21 01:09:13.226921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fc6ac18-9db7-4914-9d05-10991bb592b9 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa1b9dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-52182056", "description": "tempest-description-1701543822"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:13.987875 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fc6ac18-9db7-4914-9d05-10991bb592b9 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.764962 Aug 21 01:09:13.989055 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 403/760] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:09:13 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:09:14.003343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:14.005945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:14.021978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:14.022606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:14.023131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:14.024527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:14.025522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:14.026072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:14.636909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:14.656041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:14.659581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:14.661291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19e9a636-1dba-476c-a917-294f03b00eec tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.671022 Aug 21 01:09:14.663428 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 404/761] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:13 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:14.676284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:14.680050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:14.694145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:14.694976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:14.695109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:14.697895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:14.698381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:14.698798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:15.306483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:15.321107 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e259261-9ca2-4f61-9f3a-3fa8d14830d9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1470 microversion: 2.1 time: 2.404870 Aug 21 01:09:15.321761 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 358/762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:12 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1470 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:15.356258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6cc3a799-7a35-43ce-8f6e-ad5fa9f5bffb tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe2a6700>, body: {"security_group_rule": {"parent_group_id": "eb80ead8-9511-4dd9-b7e4-437aa80a5f28", "ip_protocol": "tempest-999-93216565", "from_port": 22, "to_port": 22}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:15.432112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:15.445514 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54d7d0ff-8c33-49ef-ba7c-0e88b1eb076e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.778967 Aug 21 01:09:15.445997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 405/763] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:14 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:15.509317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "name": "network-vif-plugged", "status": "completed", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:15.529538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:15.541138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:15.542893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:15.588339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Creating event network-vif-plugged:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h2-master-1 Aug 21 01:09:15.596114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:09:15.609492 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d89e1c95-9f6d-448f-9c52-7ccaada0139c req-e93aa33e-0d9e-4b9e-acc8-7f8c5d4f09d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105662 Aug 21 01:09:15.610622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 406/764] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:15.617195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083884b8-1dc6-40b1-92b8-0d67af962ab7", "tag": "7651feac-9dde-44da-9a1f-302b7a036f8c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:15.629521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:15.630249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:15.630847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:15.663055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] Creating event network-changed:7651feac-9dde-44da-9a1f-302b7a036f8c for instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 on n-h2-master-1 Aug 21 01:09:15.677462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a9098b6b-4f0a-4e8b-a3cb-78c27c3f5c1c req-c971711a-6d2b-4bb2-80dd-e7cee19ca3c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064691 Aug 21 01:09:15.679553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 407/765] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:15.690475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:15.692256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:15.707958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:15.710220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:15.710847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:15.713179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:15.715026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:15.715653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:15.943631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:15.956286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:15.958378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:15.959563 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c711161-38dd-4ab4-9fe8-5003d6e06926 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.274473 Aug 21 01:09:15.972792 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 408/766] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:15 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:16.094251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6cc3a799-7a35-43ce-8f6e-ad5fa9f5bffb tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Invalid IP protocol tempest-999-93216565. Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6cc3a799-7a35-43ce-8f6e-ad5fa9f5bffb tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 155 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: {"security_group_rule": {"parent_group_id": "eb80ead8-9511-4dd9-b7e4-437aa80a5f28", "ip_protocol": "tempest-999-93216565", "from_port": 22, "to_port": 22}} Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid IP protocol tempest-999-93216565. Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'eb80ead8-9511-4dd9-b7e4-437aa80a5f28', 'ip_protocol': 'tempest-999-93216565', 'from_port': 22, 'to_port': 22}}} Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-93216565. Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-93216565. Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:16.097256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-93216565. Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6cc3a799-7a35-43ce-8f6e-ad5fa9f5bffb tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: Invalid IP protocol tempest-999-93216565. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6cc3a799-7a35-43ce-8f6e-ad5fa9f5bffb tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.756050 Aug 21 01:09:16.108312 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 359/767] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:15 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 783 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:09:16.112446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8f5964a-b3fe-4763-a8dd-ea18d2dd1248 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe2bcf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1313673023", "description": "tempest-description-871665498"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:16.276989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28d2999d-7924-4dbd-a0e4-35abea5334fb tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Action: 'create', calling method: .version_select at 0x7fc3fa1eb550>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:17.776149 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:17.819602 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8f5964a-b3fe-4763-a8dd-ea18d2dd1248 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.711788 Aug 21 01:09:17.829625 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 360/768] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:09:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:17.832548 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:17.833952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:17.834075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:17.853094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:17.853589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:17.854011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:17.854718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:17.856357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:17.857164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:17.897991 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:18.504853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28d2999d-7924-4dbd-a0e4-35abea5334fb tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.542666 Aug 21 01:09:18.505687 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 409/769] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:09:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:18.510682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:18.511708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:18.520662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:18.522909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:18.523593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:18.524550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:18.525226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:18.526660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:18.753518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:18.766874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42814214-bedf-4541-b552-4aba76ab375b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1470 microversion: 2.1 time: 0.938886 Aug 21 01:09:18.785341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:18.799676 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 361/770] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:17 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1470 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:18.802322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c17c85f2-cc0e-45cb-be7e-d4c6343793a4 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.295051 Aug 21 01:09:18.806050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 410/771] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:18 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:18.813478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:18.815166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:18.824195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:18.824854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:18.825614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:18.826329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:18.826888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:18.827468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:19.070230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:19.081688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:19.083477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:19.084859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ddb5a60a-3841-4ef0-9ad2-a11c4dfeb220 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.277052 Aug 21 01:09:19.086079 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 411/772] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:18 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:19.220686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1379388857", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:19.234967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62f88c94-de9d-4514-99ad-bc7aed33d524 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Action: 'create', calling method: .version_select at 0x7fc3fe2e03a0>, body: {"keypair": {"name": "tempest-keypair-857815837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqanaxMEx0DTsfZ+qvsDXN6ErFNeWbmZguyNg09hCeo/P3kBJugOsj9zK8LIZO8X5T/Xl2QS4mu7WwMoO73DMrfFqeftaxoJPIxmm8ZMJlKKjf8XVH+wzs37yyLyh9CGQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:19.289192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-62f88c94-de9d-4514-99ad-bc7aed33d524 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for project 238f21f4c486416caa3eb44c58d2b452. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:19.301269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:19.308538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-62f88c94-de9d-4514-99ad-bc7aed33d524 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for user 9174038735de4d78b4ad527105d06624 and project 238f21f4c486416caa3eb44c58d2b452. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:19.374603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62f88c94-de9d-4514-99ad-bc7aed33d524 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.573702 Aug 21 01:09:19.376158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 362/773] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:09:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:19.389308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88743972-8218-4a3b-a873-32d454c56038 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe5129d0>, body: {"security_group_rule": {"parent_group_id": "82acce67-d839-4169-8a93-fe69d95c26ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:19.693461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:19.694560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:19.694812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:19.695441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:19.696000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:19.721442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:19.722915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:19.723712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:19.724807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:19.727408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:19.728309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:19.779106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:19.789060 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-88743972-8218-4a3b-a873-32d454c56038 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88743972-8218-4a3b-a873-32d454c56038 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 138 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: {"security_group_rule": {"parent_group_id": "82acce67-d839-4169-8a93-fe69d95c26ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'security_group_rule': {'parent_group_id': '82acce67-d839-4169-8a93-fe69d95c26ee', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 21 01:09:19.791503 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 21 01:09:19.795730 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:19.796376 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:19.799380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88743972-8218-4a3b-a873-32d454c56038 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:19.800582 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88743972-8218-4a3b-a873-32d454c56038 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.424456 Aug 21 01:09:19.800712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for user 897d73e68cc44589ac64edfb23770a66 and project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:19.802056 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 363/774] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:19 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 426 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:09:19.811348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91599286-4ee8-4562-bfa9-ef9dcd86a343 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Action: 'create', calling method: .version_select at 0x7fc3fe2bc3a0>, body: {"pool": null} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:19.839041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:19.842988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:19.913632 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50d17620-a7cb-4f0e-84df-0d7c7a657bcf tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826258 Aug 21 01:09:19.914641 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 412/775] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:19.925492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fda47c-a559-4695-9f5d-0776c831994e", "tag": "b6c935c7-030a-4ece-808c-f233e7f14c4d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:19.984606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:19.987979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:19.988435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:20.010866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] Creating event network-changed:b6c935c7-030a-4ece-808c-f233e7f14c4d for instance d1fda47c-a559-4695-9f5d-0776c831994e on n-h1-master-1 Aug 21 01:09:20.022961 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-85605697-3b2c-44a3-b51a-36e03849c082 req-a54988f0-54c3-4d89-943f-cd0ed913a146 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106253 Aug 21 01:09:20.024216 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 413/776] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:20.030101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:20.031032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:20.038096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:20.038988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:20.039572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:20.041137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:20.041837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:20.042697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:20.345474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:20.354637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fa1905b-cc95-4643-8449-64e3e2f17314 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1462 microversion: 2.1 time: 0.328942 Aug 21 01:09:20.357433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 414/777] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:20 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1462 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:20.367612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26c2500b-fc91-43e7-856d-576bd749ab10 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa166940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-882797043", "description": "tempest-description-185362272"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:20.650547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26c2500b-fc91-43e7-856d-576bd749ab10 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.291724 Aug 21 01:09:20.652038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 415/778] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:09:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:20.663634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:20.665322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:20.676922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:20.677675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:20.678831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:20.679978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:20.680736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:20.681339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:20.844734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:20.854844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7980ad0-34c6-4d37-9b03-2b7e830280ee tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.201735 Aug 21 01:09:20.855425 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 416/779] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:20 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:20.865477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1319840006", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:20.920464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:21.211286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:21.212135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:21.213929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:21.214574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:21.215526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:21.228389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.229325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.230131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:21.231276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.231925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.232531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:21.258496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:21.265274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for user 897d73e68cc44589ac64edfb23770a66 and project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:21.280715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:21.289424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:21.387922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28d92335-4199-4b1f-98ec-3e2695d969f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530483 Aug 21 01:09:21.388828 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 417/780] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:21.394130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:21.395128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:21.402335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.403123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.403722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:21.404624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.405296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.405904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:21.616472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:21.627258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:21.628808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:21.632368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c412de5a-5267-459c-acc1-30d5ff788d7f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.242041 Aug 21 01:09:21.633067 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 418/781] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:21 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:21.656422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:21.657067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:21.663583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.664066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.664494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:21.665224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:21.665668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:21.666084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:22.751770 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a54ad58-d659-4fe1-bad8-0fbf4e0dba73 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1613 microversion: 2.1 time: 1.104863 Aug 21 01:09:22.765437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 419/782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:21 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1613 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:22.786760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-731c4425-5fb1-49d0-87b5-663f9dd64eba tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fa166670>, body: {"security_group_rule": {"parent_group_id": "a295cf3f-c673-4480-8fc7-c84c34cd51a4", "ip_protocol": "tcp", "from_port": 22, "to_port": 315153665}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:22.972996 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-731c4425-5fb1-49d0-87b5-663f9dd64eba tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-731c4425-5fb1-49d0-87b5-663f9dd64eba tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 145 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: {"security_group_rule": {"parent_group_id": "a295cf3f-c673-4480-8fc7-c84c34cd51a4", "ip_protocol": "tcp", "from_port": 22, "to_port": 315153665}} Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a295cf3f-c673-4480-8fc7-c84c34cd51a4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 315153665}}} Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 Aug 21 01:09:22.974566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-731c4425-5fb1-49d0-87b5-663f9dd64eba tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 400 to user: Invalid port range 22:315153665. Valid TCP ports should be between 1-65535 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-731c4425-5fb1-49d0-87b5-663f9dd64eba tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.209345 Aug 21 01:09:22.978702 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 420/783] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:22 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:09:22.986050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:22.994046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:23.008936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:23.009435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:23.009867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:23.010575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:23.011021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:23.011582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:23.348007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:23.358517 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fccd2b20-52ae-437d-9863-961c1c31ac41 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1266 microversion: 2.1 time: 0.375154 Aug 21 01:09:23.360153 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 421/784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:22 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:23.371693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:23.374989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:23.401408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:23.402267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:23.402876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:23.403859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:23.405041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:23.405686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:23.999049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:24.017995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-805ddfac-4732-445d-9917-6d334b132d81 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.656167 Aug 21 01:09:24.018623 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 422/785] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:23 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:24.028955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:24.028955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:24.046007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:24.046707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:24.047316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:24.048211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:24.048857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:24.049436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:24.427762 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91599286-4ee8-4562-bfa9-ef9dcd86a343 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.624264 Aug 21 01:09:24.428391 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 364/786] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:09:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:24.438034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3fa1fac3-38de-41ac-bbe4-8fca7a60288e tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '.version_select at 0x7fc3fe798e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:24.442803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fa1fac3-38de-41ac-bbe4-8fca7a60288e tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:24.443503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fa1fac3-38de-41ac-bbe4-8fca7a60288e tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:24.444129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fa1fac3-38de-41ac-bbe4-8fca7a60288e tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:24.463152 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3fa1fac3-38de-41ac-bbe4-8fca7a60288e tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.033262 Aug 21 01:09:24.468148 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 365/787] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:09:24 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:24.477172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Action: 'create', calling method: .version_select at 0x7fc3fe87e5e0>, body: {"security_group_rule": {"parent_group_id": "f684ded0-33af-4e56-9d0e-7706eb6e08a0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:24.517175 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:09:24.518009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Neutron security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:09:24.518822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.518822 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 138 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: {"security_group_rule": {"parent_group_id": "f684ded0-33af-4e56-9d0e-7706eb6e08a0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: exception: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f684ded0-33af-4e56-9d0e-7706eb6e08a0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:09:24.525313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 404 to user: Security group f684ded0-33af-4e56-9d0e-7706eb6e08a0 does not exist Aug 21 01:09:24.530687 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-971f72cd-b79a-46fb-aec4-7efe0048ef23'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:24.533637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f800ed67-7b4b-47a5-a66d-54df1574c8c1 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.061619 Aug 21 01:09:24.533637 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 366/788] 10.222.0.46 () {60 vars in 1195 bytes} [Sun Aug 21 01:09:24 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:09:24.541147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-348609552", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "aac520b3-13de-4f64-925a-a1a9fa9a25f1"}], "security_groups": [{"name": "tempest-securitygroup--1461232546"}], "key_name": "tempest-keypair-857815837", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:24.715318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:24.730575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:24.732579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:24.734310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-705913ff-9659-47bc-b9e4-9598705fab22 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.714786 Aug 21 01:09:24.735923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 423/789] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:24 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:24.743576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:24.744388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:24.750932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] validate_networks() for [('aac520b3-13de-4f64-925a-a1a9fa9a25f1', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:24.752359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:24.753062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:24.754058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:24.754999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:24.755626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:24.756494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:24.956893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:24.961469 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:24.972013 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf3797f9-8f85-4966-83c9-eff25baa5028 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1272 microversion: 2.1 time: 0.234189 Aug 21 01:09:24.973205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 424/790] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:24 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:24.981237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06a58118-3a8a-4936-8cd9-09bce79b766d tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Action: 'create', calling method: .version_select at 0x7fc3fa282430>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:26.023441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:26.024582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:26.025449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:26.026004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:26.030892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:26.040333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:26.040730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:26.041388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:26.042316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:26.042955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:26.043557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:26.063582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for project 238f21f4c486416caa3eb44c58d2b452. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:26.070534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for user 9174038735de4d78b4ad527105d06624 and project 238f21f4c486416caa3eb44c58d2b452. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:26.084923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:26.087863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:26.173031 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6661f27f-4b9f-49ce-b50a-b32e435ef629 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.637132 Aug 21 01:09:26.173647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 367/791] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:26.178217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fe86faf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:26.259161 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:09:26.259767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Neutron security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 not found {{(pid=122483) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 21 01:09:26.260297 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] HTTP exception thrown: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.260297 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Request method failure captured: Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-security-group-rules/830a1192-5cf7-49b4-973d-9234d5fff5c1 HTTP/1.1 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWwhPzYFaZXV2_PzlUz_cz-CUq3Yi-fNnsgianMRIt4lpromaEQFxDPK6LjE7ucbQkHH9sAMEL9deHgtg96ShO0EMlp0i7MPUQ4h0IPGnrnrZCBPc9OfMA2UpMnHe794badTnlzBTJmiLTf5gOVCFtY9l2IoLJPQ-LSGqgVohIcnJU Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cea8924d4c34c6b95038df1e44346d1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cea8924d4c34c6b95038df1e44346d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cea8924d4c34c6b95038df1e44346d1"}]}] Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7cea8924d4c34c6b95038df1e44346d1 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a27d91386a2d445097c01390045e7a18 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: exception: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '830a1192-5cf7-49b4-973d-9234d5fff5c1'} Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:09:26.262552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Returning 404 to user: Security group rule 830a1192-5cf7-49b4-973d-9234d5fff5c1 does not exist Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-a754be06-36ef-4154-b9b3-c135558e5951'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:26.267867 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c820b5d7-6450-444d-9930-e611d3cd395c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/830a1192-5cf7-49b4-973d-9234d5fff5c1" status: 404 len: 199 microversion: 2.1 time: 0.089808 Aug 21 01:09:26.275108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 368/792] 10.222.0.46 () {58 vars in 1287 bytes} [Sun Aug 21 01:09:26 2022] DELETE /compute/v2.1/os-security-group-rules/830a1192-5cf7-49b4-973d-9234d5fff5c1 => generated 199 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:09:26.275108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2128466230", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:26.354048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:27.055810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:27.056394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:27.056681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:27.057268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:27.057868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:27.077173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.077865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.078477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:27.085518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.086174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.086767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:27.145293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:27.155822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:27.187804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:27.192366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:27.280363 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9a499f93-b7d6-4c9b-a03c-85f3518aaff0 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010042 Aug 21 01:09:27.283205 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 369/793] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:27.297107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:27.298408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:27.310639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.312239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.313240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:27.314397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.316455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.317238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:27.607111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:27.618439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91c3862a-a1f1-43a3-b789-4f2496c6f26c tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.332956 Aug 21 01:09:27.619732 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 370/794] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:27 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:27.626843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:27.627913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:27.649583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.650594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.651321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:27.653513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:27.654439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:27.655026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.233709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:28.243803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:28.253168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:28.254512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-567efaa7-2250-4537-b03a-b988f58f805b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.633462 Aug 21 01:09:28.255849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 371/795] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:27 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:28.266118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:28.267111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:28.270233 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:28.283915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:28.290188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:28.290968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.292021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:28.293920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:28.294765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.567006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:28.575967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83b48fcd-233d-44cd-aa8b-2c7ef2e5edff tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.318915 Aug 21 01:09:28.576542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 372/796] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:28 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:28.581445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:28.582045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:28.587970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:28.588630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:28.589319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.590409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:28.591037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:28.591460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.695221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:28.708555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe7b60d6-1d6e-41b7-b5d7-bfe659302aa3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1298 microversion: 2.1 time: 0.129555 Aug 21 01:09:28.716288 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 373/797] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:28 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:28.722193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64bf3f99-735b-4e98-b1c8-b7c40890fa3f tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fe798dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:28.916714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06a58118-3a8a-4936-8cd9-09bce79b766d tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.942107 Aug 21 01:09:28.918159 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 425/798] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:09:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:28.932874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:28.946453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:28.946990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:28.947648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:28.987772 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] Creating event network-changed:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:09:29.012116 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5d0acbc3-e351-406f-96ca-99fafc3e5a41 req-08ea0e7c-0813-4750-b08b-1369b0da27ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090369 Aug 21 01:09:29.013406 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 426/799] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:29.023494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083884b8-1dc6-40b1-92b8-0d67af962ab7", "name": "network-vif-plugged", "status": "completed", "tag": "7651feac-9dde-44da-9a1f-302b7a036f8c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:29.041485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:29.042507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:29.043144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:29.058676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] Creating event network-vif-plugged:7651feac-9dde-44da-9a1f-302b7a036f8c for instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 on n-h2-master-1 Aug 21 01:09:29.067137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2dd78cc5-f3f9-4e56-b137-e1448aab4f05 req-54282797-2078-4110-894b-4f13e56523bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052132 Aug 21 01:09:29.077204 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 427/800] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:29.084346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:29.086294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:29.109765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:29.110658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:29.111780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:29.112685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:29.113908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:29.127288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:29.134241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64bf3f99-735b-4e98-b1c8-b7c40890fa3f tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/a295cf3f-c673-4480-8fc7-c84c34cd51a4" status: 202 len: 0 microversion: 2.1 time: 0.423256 Aug 21 01:09:29.146367 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 374/801] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:09:28 2022] DELETE /compute/v2.1/os-security-groups/a295cf3f-c673-4480-8fc7-c84c34cd51a4 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:29.264255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-412356906", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "89ad451d-4568-43da-b498-e71b39d2698e"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:29.340901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] validate_networks() for [('89ad451d-4568-43da-b498-e71b39d2698e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:29.394435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:29.415470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3f1937a-133b-47cd-8fe4-9225f34733c3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1265 microversion: 2.1 time: 0.335848 Aug 21 01:09:29.416639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 428/802] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:29 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:29.469313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:29.474527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:29.487942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:29.488636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:29.490297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:29.492645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:29.495301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:29.496046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:29.669340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:29.680569 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b3cf570-2978-45d7-b7c8-b3b06fd922ef tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1389 microversion: 2.1 time: 0.260408 Aug 21 01:09:29.681482 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 429/803] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:29 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1389 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:29.686954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff1d89cf-34a6-49dd-91ee-c262698d04ae tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Action: 'create', calling method: .version_select at 0x7fc3fa265dc0>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:30.895434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:30.895939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:30.896490 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:30.897025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:30.897605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:30.907632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:30.908195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:30.908685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:30.909518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:30.910035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:30.910516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:30.931316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:30.936626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for user b0bd3eeeb578465a8f5e5eaa3b3fdc85 and project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:30.971401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:30.973630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:31.054490 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-443ace1b-fa1f-4464-9b01-8a85ac6d27a7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905349 Aug 21 01:09:31.059178 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 375/804] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:31.066183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4faf18-6966-40a5-b84e-f92cddd58982", "tag": "d534adbc-f58f-46f7-81d0-9a20484c70a3"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:31.095248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.096011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.097271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.110367 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] Creating event network-changed:d534adbc-f58f-46f7-81d0-9a20484c70a3 for instance 9a4faf18-6966-40a5-b84e-f92cddd58982 on n-h2-master-1 Aug 21 01:09:31.116751 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-96cfd425-1411-4868-8acd-55c41ec0beba req-c5d0bfdd-2177-4fc7-a758-763a8f10a9f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056025 Aug 21 01:09:31.118195 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 376/805] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:31.124503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bb47530-f652-4ef2-bc14-f29f862df03c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fe86f820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:31.247474 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:31.274327 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:31.569234 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff1d89cf-34a6-49dd-91ee-c262698d04ae tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.886433 Aug 21 01:09:31.570119 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 430/806] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:09:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:31.581819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:31.582434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:31.589906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.590808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.591506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.592421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.593067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.593644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.886111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:31.897115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:31.899162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:31.900371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce1ac6ec-d074-4fdf-b77c-9a2599133c14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.328841 Aug 21 01:09:31.901418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 431/807] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:31 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:31.909482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:31.910428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:31.918438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.918974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.919453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.920202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.921289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.922074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.968947 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bb47530-f652-4ef2-bc14-f29f862df03c tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/82acce67-d839-4169-8a93-fe69d95c26ee" status: 202 len: 0 microversion: 2.1 time: 0.849089 Aug 21 01:09:31.971095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 377/808] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:09:31 2022] DELETE /compute/v2.1/os-security-groups/82acce67-d839-4169-8a93-fe69d95c26ee => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:31.982092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:31.983500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:31.993322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.995025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.995871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:31.996935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:31.998055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:31.998688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.128077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:32.136291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-234c4f56-338b-405b-8435-923dd3697416 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.233494 Aug 21 01:09:32.137050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 432/809] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:31 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:32.147015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.147620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:32.155020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.155766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.156343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.157334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.158113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.158765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.306050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:32.314907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94f4d4e8-120a-492b-b300-1c3afffd3477 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.171848 Aug 21 01:09:32.315908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 433/810] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:32 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:32.322367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.323212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:32.330739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.331672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.332504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.333500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.334103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.334675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.372690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:32.388122 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95c92e35-4c7c-4696-8d5f-dd240c3d6f14 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.414515 Aug 21 01:09:32.391892 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 378/811] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:31 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:32.398355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.399079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:32.409407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.415993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.416977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.417971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.418921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.419654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.578045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:32.587891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee47d9fe-3f5d-493f-b76a-7c863a89ea64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1589 microversion: 2.1 time: 0.270098 Aug 21 01:09:32.589333 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 434/812] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:32 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1589 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:32.612393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fda47c-a559-4695-9f5d-0776c831994e", "name": "network-vif-plugged", "status": "completed", "tag": "b6c935c7-030a-4ece-808c-f233e7f14c4d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:32.622769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.623250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.623675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.629272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:32.640635 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bf29961-9252-4176-9ff7-1537c7fb53ab tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1206 microversion: 2.1 time: 0.247112 Aug 21 01:09:32.647151 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 379/813] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:32 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1206 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:32.660899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a16bd8a-512f-440d-9d62-72f7311d2caf tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fe512ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.662759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] Creating event network-vif-plugged:b6c935c7-030a-4ece-808c-f233e7f14c4d for instance d1fda47c-a559-4695-9f5d-0776c831994e on n-h1-master-1 Aug 21 01:09:32.671653 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-64e8b615-6a5e-4f82-95f8-e29a62cc1580 req-17524e0c-3cc7-44e1-b17e-e58c5bc845b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066350 Aug 21 01:09:32.678480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 435/814] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:32.685402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14d788f9-359c-4381-9420-1c9708457341 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fa1db550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.886821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14d788f9-359c-4381-9420-1c9708457341 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/eb80ead8-9511-4dd9-b7e4-437aa80a5f28" status: 202 len: 0 microversion: 2.1 time: 0.206718 Aug 21 01:09:32.892001 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 436/815] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:09:32 2022] DELETE /compute/v2.1/os-security-groups/eb80ead8-9511-4dd9-b7e4-437aa80a5f28 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:32.899409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7fc13f-00b1-4abc-a3f4-108799eede61", "tag": "5dac50bc-822d-432d-9f1a-32237d2110db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:32.912382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.913037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.913563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.930303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] Creating event network-changed:5dac50bc-822d-432d-9f1a-32237d2110db for instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 on n-h1-master-1 Aug 21 01:09:32.936462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-981e6eb3-6c2e-4e74-b082-bd64df8cc75a req-394e53b9-b881-4c3d-9303-6d7a4963bea2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042653 Aug 21 01:09:32.937676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 437/816] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:32.943019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:32.943723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:32.950639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.951830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.952352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:32.953188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:32.953861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:32.954377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.051277 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6011797-c7df-4c6f-bb91-a8fbd76589f3 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112161 Aug 21 01:09:33.051870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 438/817] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:09:32 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:33.058744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c035eb86-6fb8-40e6-a1d4-2e1ba289fbc7 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fa1a1940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:33.298803 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a16bd8a-512f-440d-9d62-72f7311d2caf tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/532ff15c-2284-40e5-99c9-3ac231d34636" status: 200 len: 141 microversion: 2.1 time: 0.650112 Aug 21 01:09:33.299287 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 380/818] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:09:32 2022] GET /compute/v2.1/os-floating-ips/532ff15c-2284-40e5-99c9-3ac231d34636 => generated 141 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:33.304527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:33.305615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:33.315572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.316556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.317450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.318420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.319080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.319660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.554602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c035eb86-6fb8-40e6-a1d4-2e1ba289fbc7 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0c8ec721-786f-4960-8932-f421db016e35" status: 202 len: 0 microversion: 2.1 time: 0.501264 Aug 21 01:09:33.555345 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 439/819] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:09:33 2022] DELETE /compute/v2.1/os-security-groups/0c8ec721-786f-4960-8932-f421db016e35 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:33.564060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:33.564963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:33.575284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.575823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.576889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.578687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.579396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.579974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.610885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:33.621781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:33.623262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:33.624413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6919643-2f29-45d1-af2e-660f41bcd139 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1362 microversion: 2.25 time: 0.324183 Aug 21 01:09:33.640146 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 381/820] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:33 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:33.646612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f8947c6-bcf8-4df9-a26d-9c5e4772dac9 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fe8428b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:33.921862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:33.930209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab6b8510-22ea-438e-ad29-c1b634a4e4be tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.373509 Aug 21 01:09:33.930998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 440/821] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:33 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:33.948535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:33.949149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:33.960655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.961341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.961925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:33.962774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:33.963400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:33.964190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:34.296499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:34.310376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7371f405-8973-4a1a-8c61-8e6450efb754 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.365723 Aug 21 01:09:34.311331 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 441/822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:33 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:34.318936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:34.322172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:34.330310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:34.330907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:34.331409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:34.332628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:34.333234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:34.333728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:34.593430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:34.607205 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1afb6485-34a3-4403-805f-194e6b49860a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.292891 Aug 21 01:09:34.609040 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 442/823] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:34 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:34.614621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a34788cb-2bab-4c4d-b8be-27d02154f629 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] Calling method '.version_select at 0x7fc3fa1dbe50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:35.262370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a34788cb-2bab-4c4d-b8be-27d02154f629 tempest-SecurityGroupRulesNegativeTestJSON-1284776605 tempest-SecurityGroupRulesNegativeTestJSON-1284776605-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/11b390ea-8887-4508-bf18-cc3226fd1f31" status: 202 len: 0 microversion: 2.1 time: 0.650368 Aug 21 01:09:35.265045 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 443/824] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:09:34 2022] DELETE /compute/v2.1/os-security-groups/11b390ea-8887-4508-bf18-cc3226fd1f31 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:35.282879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:35.287653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:35.312925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.314084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.315750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.317033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.317735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.318600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.513376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:35.523822 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6514160b-080e-4fd5-ac23-d8f747a2bf62 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1270 microversion: 2.1 time: 0.257472 Aug 21 01:09:35.538423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 444/825] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:35 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:35.546673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:35.548059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:35.555277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.555770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.556801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.557563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.559052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.559501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.664936 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f8947c6-bcf8-4df9-a26d-9c5e4772dac9 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/532ff15c-2284-40e5-99c9-3ac231d34636" status: 202 len: 0 microversion: 2.1 time: 2.023163 Aug 21 01:09:35.667498 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 382/826] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:09:33 2022] DELETE /compute/v2.1/os-floating-ips/532ff15c-2284-40e5-99c9-3ac231d34636 => generated 0 bytes in 2026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:35.675312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "name": "network-vif-plugged", "status": "completed", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:35.691780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.692720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.693351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.708835 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] Creating event network-vif-plugged:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:09:35.717262 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-481948d1-a0ab-4898-8275-406061580701 req-dd32fd49-80e4-43f2-88e0-4d23088f3fa3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047791 Aug 21 01:09:35.718114 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 383/827] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:35.727429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:35.728388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:35.739694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.743868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.744947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.746991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:35.748086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:35.749142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:35.994104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.003017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.004837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.006194 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba103139-da2c-4994-8054-9f056c64f316 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1559 microversion: 2.25 time: 0.466686 Aug 21 01:09:36.021961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 445/828] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:35 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1559 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:36.030780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:36.042426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.043354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.043950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.056780 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] Creating event network-changed:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h1-master-1 Aug 21 01:09:36.062693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6edd44d7-2283-4adb-9337-527013880efd req-9de2a682-7905-451f-a5c3-805d657e4bff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038682 Aug 21 01:09:36.063902 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 446/829] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:36.069867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.071066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:36.078359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.079103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.079742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.080613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.081246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.081852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.118633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.149592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-407b5cef-e5b7-4b73-9b8c-d9dbf0341a57 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.429077 Aug 21 01:09:36.150721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 384/830] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:35 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:36.156084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083884b8-1dc6-40b1-92b8-0d67af962ab7", "tag": "7651feac-9dde-44da-9a1f-302b7a036f8c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:36.165966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.166888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.167582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.179695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] Creating event network-changed:7651feac-9dde-44da-9a1f-302b7a036f8c for instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 on n-h2-master-1 Aug 21 01:09:36.186335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0752ed55-8dc1-414b-bf90-752c53424582 req-e91d3f35-2236-4151-b1d3-799da2c788d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Aug 21 01:09:36.190034 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 385/831] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:36.195852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.197233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:36.206752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.208003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.209452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.211495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.212535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.213226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.472314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.477726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.484704 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60713982-75bd-42ee-8e87-b42c576d455f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.293182 Aug 21 01:09:36.485328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 386/832] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:36.487628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c765d0c-d289-45b6-a20b-52c7fbcf9d64 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1589 microversion: 2.1 time: 0.422387 Aug 21 01:09:36.494295 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 447/833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1589 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:36.499687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c7c69af-3d4a-4153-a278-a6d63cc8af87 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fa1db160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.517152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.518040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:36.524412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.524924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.525358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.526275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.526816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.527400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.787669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:36.802075 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35543cf3-ac14-4e25-8dfd-2dfd4508f5de tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.304043 Aug 21 01:09:36.818878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 387/834] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:36.826979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.829254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:36.841220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.842460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.843155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.844096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.844717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.846379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.902194 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c7c69af-3d4a-4153-a278-a6d63cc8af87 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.406621 Aug 21 01:09:36.903090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 448/835] 10.222.0.46 () {58 vars in 1164 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:09:36.907858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:36.909245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:36.916983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.917463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.918163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:36.919470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:36.920204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:36.920917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.205780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:37.241911 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-359e6007-72da-44f5-af93-93df8d323c79 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 2052 microversion: 2.25 time: 0.421908 Aug 21 01:09:37.242513 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 388/836] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 2052 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:37.266037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce3fbd0c-f7d4-4e40-9289-960de4058888 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fe3e1310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:37.322711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:37.331999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b7a7c72-923e-4c97-8e65-a097bf8e0dc5 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.427691 Aug 21 01:09:37.349030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 449/837] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:36 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:37.355800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:37.356736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:37.365044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.366745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.367594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.368524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.370408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.371124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.665390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:37.673896 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-292adffb-0c04-481c-b45b-90e9519dca0d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.323269 Aug 21 01:09:37.674916 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 450/838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:37 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:37.679575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:37.680420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:37.687229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.688036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.688716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.689701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.690428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.691113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.696468 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:37.874478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:37.894666 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6111daf9-2dc3-4229-85a2-9d25358bef9d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 2052 microversion: 2.25 time: 0.218531 Aug 21 01:09:37.931107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 451/839] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:37 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 2052 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:37.942473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:37.943228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:37.956231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.956626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.957357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:37.958983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:37.959641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:37.969352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.079181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce3fbd0c-f7d4-4e40-9289-960de4058888 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.820996 Aug 21 01:09:38.080647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 389/840] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:09:37 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:38.085591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:38.086489 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:38.095666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.096183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.096997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.097784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.098310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.100036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.443180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:38.453044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6572cb89-04fb-44c9-ba12-58802e532025 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.371043 Aug 21 01:09:38.459617 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 390/841] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:38 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:38.469283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:38.473167 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:09:38.473167 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:09:38.475354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.482438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.483976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.485257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.486514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.487280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.528703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4cef539e-2eb7-4161-9b64-45e7705cfda9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.067339 Aug 21 01:09:38.529887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 391/842] 10.222.0.46 () {60 vars in 1217 bytes} [Sun Aug 21 01:09:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:09:38.537014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36bb8f27-b529-4e63-92d9-d936d751e7d9 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fe855c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:38.570964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:38.580703 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3930d619-5184-43f8-bf58-084278328c36 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.648005 Aug 21 01:09:38.581939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 452/843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:37 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:38.586818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:38.587698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:38.593994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.594836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.595484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.596439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.597108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.597730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.828323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:38.839358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bb73634-45a2-4e56-bded-63cb3e628795 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.255194 Aug 21 01:09:38.842131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 453/844] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:38 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:38.850036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:38.850567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:38.863189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.864160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.864794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.865740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.866377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.867005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:38.958430 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-934885cd-ef47-4834-bf24-68f452e22b7f tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e/action" status: 202 len: 0 microversion: 2.25 time: 0.114972 Aug 21 01:09:38.963211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 454/845] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:09:38 2022] POST /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:09:38.971826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4faf18-6966-40a5-b84e-f92cddd58982", "name": "network-vif-plugged", "status": "completed", "tag": "d534adbc-f58f-46f7-81d0-9a20484c70a3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:38.985779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:38.986826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:38.987423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.004345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] Creating event network-vif-plugged:d534adbc-f58f-46f7-81d0-9a20484c70a3 for instance 9a4faf18-6966-40a5-b84e-f92cddd58982 on n-h2-master-1 Aug 21 01:09:39.011291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-54cfd785-4b1c-4e73-a78a-59ff9a6a14c5 req-8f1547bc-d002-4720-8140-e0f01607c35f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044542 Aug 21 01:09:39.012862 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 455/846] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:39.021368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:39.022306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:39.030845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.031616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.032540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.033587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.034261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.035043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.408809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:39.421970 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b500798-3c46-4c10-9c63-8f97c71c8c9e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.407396 Aug 21 01:09:39.425011 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 456/847] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:39 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:39.443723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:39.444445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:39.456173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.457069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.457576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.458374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.459026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.459516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.722952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:39.738496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10b83c84-3ee2-48b7-80a5-c54e2cefecd9 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 2037 microversion: 2.25 time: 0.314863 Aug 21 01:09:39.739478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 457/848] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:39 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 2037 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:39.744027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace031ba-8e78-4cbe-b793-3f5b049e087a", "tag": "8e552111-0642-4a93-828e-0d461d33f953"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:39.756188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.757171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.757171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.775107 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] Creating event network-changed:8e552111-0642-4a93-828e-0d461d33f953 for instance ace031ba-8e78-4cbe-b793-3f5b049e087a on n-h2-master-1 Aug 21 01:09:39.780326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bec13471-d993-45f6-8958-cce3e1678c79 req-8a6c8da4-f487-4fe5-b97b-764ebc8f3a0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039566 Aug 21 01:09:39.780945 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 458/849] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:39.787970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:39.788666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:39.790714 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:39.796720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.797237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.797668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.798425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.798871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.799308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.811039 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36bb8f27-b529-4e63-92d9-d936d751e7d9 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/16006b63-c4ba-4996-ba76-e1efc6c7b415" status: 202 len: 0 microversion: 2.1 time: 1.279055 Aug 21 01:09:39.814513 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 392/850] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:09:38 2022] DELETE /compute/v2.1/os-floating-ips/16006b63-c4ba-4996-ba76-e1efc6c7b415 => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:39.817180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:39.818047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:39.826196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.827056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.828456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:39.829453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:39.830134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:39.830777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:40.014262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:40.025463 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08a8a737-1715-487a-b589-25101aa410e7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.212459 Aug 21 01:09:40.026088 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 393/851] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:39 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:40.038340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:40.054170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:40.062110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:40.062828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:40.063273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:40.063969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:40.064419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:40.064860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:40.069128 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:40.093502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'flavor' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:40.106138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Going to try to live migrate instance to n-h2-master-1 {{(pid=122483) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:09:40.174889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:40.183838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79e74289-7243-4316-af28-0547d1214b49 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.401649 Aug 21 01:09:40.184423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 459/852] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:39 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:40.189506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e82278b0-76fd-4c46-a610-79125d724498 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fa253b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:40.950648 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=22 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:41.450251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e82278b0-76fd-4c46-a610-79125d724498 tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/54c25c63-47db-48e6-8d70-e152625ea9cc" status: 202 len: 0 microversion: 2.1 time: 1.264209 Aug 21 01:09:41.451449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 460/853] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:09:40 2022] DELETE /compute/v2.1/os-floating-ips/54c25c63-47db-48e6-8d70-e152625ea9cc => generated 0 bytes in 1266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:41.457957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:41.458569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:41.466081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.466559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.466979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.467671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.468106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.468512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.616197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:41.636926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21649e0f-bd7c-47a0-89ad-4cea3caf6882 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.183964 Aug 21 01:09:41.638845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 461/854] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:41 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:41.643802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:41.644694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:41.651235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.651931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.652525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.653525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.654801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.655240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.799031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:41.807311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-75e092a4-deb6-40f4-b8f7-4d6480c67503 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.167142 Aug 21 01:09:41.808574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 462/855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:41 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:41.813215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7fc13f-00b1-4abc-a3f4-108799eede61", "name": "network-vif-plugged", "status": "completed", "tag": "5dac50bc-822d-432d-9f1a-32237d2110db"}, {"server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "name": "network-vif-plugged", "status": "completed", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:41.826113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.826669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.827163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.840454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Creating event network-vif-plugged:5dac50bc-822d-432d-9f1a-32237d2110db for instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 on n-h1-master-1 Aug 21 01:09:41.841037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] Creating event network-vif-plugged:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h1-master-1 Aug 21 01:09:41.848093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-75959e9d-9351-41d9-b02f-eaeaa23e1ab3 req-27d91144-ca97-4fd7-a58d-f0afd3220280 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038265 Aug 21 01:09:41.848976 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 463/856] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:41.853936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:41.854616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:41.860916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.861439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.861844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:41.862553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:41.863185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:41.863764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:42.008269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:42.016472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27817288-c8dd-48d9-992d-c56fe011b2a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.166487 Aug 21 01:09:42.017412 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 464/857] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:41 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:42.022112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:42.022885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:42.029017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:42.029667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:42.030270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:42.030954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:42.031402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:42.031820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:42.173260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:42.181024 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cce023c-c971-4fe6-834e-6950e1915585 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.162422 Aug 21 01:09:42.181599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 465/858] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:42 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:42.186287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d04e3ba4-54c0-4d4e-8a00-f16d941e2d5e tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] Calling method '.version_select at 0x7fc3fa3984c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:42.904240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d04e3ba4-54c0-4d4e-8a00-f16d941e2d5e tempest-FloatingIPDetailsTestJSON-2126425199 tempest-FloatingIPDetailsTestJSON-2126425199-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/3d36619e-d10e-4ec5-a714-877b9e911cda" status: 202 len: 0 microversion: 2.1 time: 0.721507 Aug 21 01:09:42.905049 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 466/859] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:09:42 2022] DELETE /compute/v2.1/os-floating-ips/3d36619e-d10e-4ec5-a714-877b9e911cda => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:42.917486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:42.918289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:42.924877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:42.925662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:42.926191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:42.927009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:42.927562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:42.928080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.068658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:43.077103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f32e7037-17a9-41c1-a2e3-5d587df846b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.170984 Aug 21 01:09:43.077765 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 467/860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:42 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:43.084696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:43.085500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:43.094007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.094587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.095080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.095826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.096894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.097330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.245837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:43.253684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df824241-a110-4b59-bf34-b75eba7a1dde tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1314 microversion: 2.1 time: 0.174072 Aug 21 01:09:43.254275 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 468/861] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:43 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:43.258748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:43.259347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:43.265281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.265775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.266218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.266890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.267334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.267750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.413462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:43.422714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c88c910-6417-46ce-96a4-2489e3aed64d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1313 microversion: 2.1 time: 0.167285 Aug 21 01:09:43.423310 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 469/862] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:43 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:43.436171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:43.436171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:43.437390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.438057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.438596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.439447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:43.439942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:43.440361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:43.444850 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:43.592348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:43.601114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76ffefdf-1bb2-40ce-9227-35f6ce1d3c1d tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1366 microversion: 2.1 time: 0.176735 Aug 21 01:09:43.605108 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 470/863] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:43 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:44.098313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:44.098986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:44.110148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:44.111914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:44.112651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:44.141980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:44.141980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:44.142232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:44.907420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:44.915284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0f402f2-fa50-45ed-87f2-86bc0b81209f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.821054 Aug 21 01:09:44.928564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 471/864] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:44 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:44.933804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:44.934713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:44.941747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:44.942775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:44.943390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:44.944319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:44.945016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:44.945495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.328216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:45.356197 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f9b1f9f-bf32-4dff-95a4-f2d6b7f77a29 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1463 microversion: 2.1 time: 0.421182 Aug 21 01:09:45.359167 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 472/865] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:44 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1463 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:45.371739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:45.374645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:45.390198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.391450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.391895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.392619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.393093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.397492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.696176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a17171d7-737e-4f30-a850-cfa9d263e492 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e/action" status: 202 len: 0 microversion: 2.25 time: 5.663512 Aug 21 01:09:45.701629 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 394/866] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:09:40 2022] POST /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e/action => generated 0 bytes in 5667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:09:45.708059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:45.709557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:45.723499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.724364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.725176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.726253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.731189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.732087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.765946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:45.782895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0221c42f-97ba-41ac-9fcc-5d31a6d577f9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1462 microversion: 2.1 time: 0.422338 Aug 21 01:09:45.783380 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 473/867] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:45 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1462 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:45.788700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:45.789410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:45.796199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.797124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.797799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:45.798677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:45.799302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:45.799876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.120253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.152902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.162899 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-975cd356-3bf1-4039-bfa8-1f15c555e351 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1463 microversion: 2.1 time: 0.378387 Aug 21 01:09:46.175562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f38affe8-3b16-43f8-a5c2-539443b7401c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1555 microversion: 2.1 time: 0.470994 Aug 21 01:09:46.177303 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 474/868] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:45 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1463 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:46.179314 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 395/869] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:45 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1555 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:46.196278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:46.205160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:46.214627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:46.215240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:46.225570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.226392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.227045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.228706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.229707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.230462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.245508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.245880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.246308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.247015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.247455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.247867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.492062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.506758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:09:46.520197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:46.522225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:46.523167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:46.524142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:46.524805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:46.591757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.600369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.601800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:46.602983 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2b62bfc-582d-4d0c-ac0d-8e1c8f59568b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.424335 Aug 21 01:09:46.603547 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 475/870] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:46 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:46.622891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:46.623506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:46.637136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.637668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.638102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.640740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.641311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.643361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.714788 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95a704c9-84e3-4ada-8c21-4de2c2f1cd6f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7/action" status: 202 len: 0 microversion: 2.1 time: 0.533656 Aug 21 01:09:46.716320 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 396/871] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:09:46 2022] POST /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:46.723753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:46.724535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:46.731892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.732631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.733259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.735498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:46.736156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:46.736742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:46.918494 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90384ee4-be08-44bc-89ab-53f90bb3a651 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200876 Aug 21 01:09:46.919180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 397/872] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:09:46 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:46.923899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1440336522", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "39ad2a8a-0292-465a-82f4-721071f3c1cf"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:46.989885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:09:47.302337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:47.313703 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a4021c3-f0e9-4c1f-8bb0-4464857b7697 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.708894 Aug 21 01:09:47.314302 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 476/873] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:46 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:47.332289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:47.332932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:47.352247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:47.352742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:47.353202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:47.354036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:47.354507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:47.354985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:47.810936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:47.822217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ddbf9ff-a68f-40b4-9bbc-a142b59ca329 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1471 microversion: 2.1 time: 0.493771 Aug 21 01:09:47.824587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 477/874] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:47 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:47.831559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace031ba-8e78-4cbe-b793-3f5b049e087a", "name": "network-vif-plugged", "status": "completed", "tag": "8e552111-0642-4a93-828e-0d461d33f953"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:47.845039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:47.846842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:47.847633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:47.862653 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] Creating event network-vif-plugged:8e552111-0642-4a93-828e-0d461d33f953 for instance ace031ba-8e78-4cbe-b793-3f5b049e087a on n-h2-master-1 Aug 21 01:09:47.868587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b248d602-377d-4eec-8772-60e67a380d1e req-76c74687-8f1a-4bff-b159-8156f32a12a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042079 Aug 21 01:09:47.873893 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 478/875] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:47.883140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:47.885039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:47.894432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:47.895393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:47.896164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:47.897715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:47.898642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:47.899288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.090048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:09:48.091073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:09:48.091704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:09:48.092261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:09:48.092890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:09:48.122433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.122862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.123348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.125616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.127862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.133741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.159728 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=9 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:48.181853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:48.209661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Getting quotas for user 897d73e68cc44589ac64edfb23770a66 and project 1b094e07a54b4d908fb9fcb60b1c87bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:48.243972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:09:48.248285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:09:48.380082 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9238ac93-8ff3-46a5-86ab-5e39cd978bbd tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459598 Aug 21 01:09:48.392489 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 398/876] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:09:48.397584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:48.398149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:48.426033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.433141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.433869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.434834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.435505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.436310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.629780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:48.641879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:48.643564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:48.644848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c9615d4-e4d6-4218-90af-509e1a895abd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.768851 Aug 21 01:09:48.645426 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 479/877] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:47 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:48.671406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6139c655-392b-42d2-a59f-f7e96a75a0f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:48.672868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6139c655-392b-42d2-a59f-f7e96a75a0f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:48.820198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6139c655-392b-42d2-a59f-f7e96a75a0f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:48.830815 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6139c655-392b-42d2-a59f-f7e96a75a0f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1214 microversion: 2.1 time: 0.184214 Aug 21 01:09:48.832120 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 480/878] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:48 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:48.853289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fda47c-a559-4695-9f5d-0776c831994e", "name": "network-vif-unplugged", "status": "completed", "tag": "b6c935c7-030a-4ece-808c-f233e7f14c4d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:48.868029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.868902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.870780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.890114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] Creating event network-vif-unplugged:b6c935c7-030a-4ece-808c-f233e7f14c4d for instance d1fda47c-a559-4695-9f5d-0776c831994e on n-h1-master-1 Aug 21 01:09:48.895849 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d00e2202-8c50-4909-9214-da4f774d91ef req-f54a9bcb-60ea-461d-9236-c46f627384ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048498 Aug 21 01:09:48.897371 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 481/879] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:48.904222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:48.905206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:48.913163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.913840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.914449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.915489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:48.916243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:48.917753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:48.970790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:48.983679 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-530362f7-578e-4935-9d40-d4f741a4c935 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.589876 Aug 21 01:09:48.984515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 399/880] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:48 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:49.259084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:49.270933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e4f8976-0ade-4088-8917-f8e2761b4f27 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1471 microversion: 2.1 time: 0.372108 Aug 21 01:09:49.272621 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 482/881] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:48 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:49.668652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:49.669380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:49.686752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:49.687533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:49.688118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:49.689341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:49.691225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:49.691845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:49.864591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:49.865165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:49.877406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:49.878201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:49.881318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:49.882228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:49.882850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:49.883429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.082928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:50.092478 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c66336c9-0b58-4ad3-9084-a62b52a9ea8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1274 microversion: 2.1 time: 0.231762 Aug 21 01:09:50.100571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 483/882] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:49 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:50.106234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7fc13f-00b1-4abc-a3f4-108799eede61", "tag": "5dac50bc-822d-432d-9f1a-32237d2110db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:50.122246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.124544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.125306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.159173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] Creating event network-changed:5dac50bc-822d-432d-9f1a-32237d2110db for instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 on n-h1-master-1 Aug 21 01:09:50.169251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f9ad1786-f797-4715-8531-d5d097f91ef9 req-3fdc33b4-b507-4c0c-86b3-47f214afd3c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067118 Aug 21 01:09:50.173335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 484/883] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:50.186416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:50.187471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:50.192442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:50.204406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:50.205851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.206575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.207067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.207960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.209436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.209558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:50.210911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.212949 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de0d1590-06ce-406d-91e1-a0bf6e02364b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.548153 Aug 21 01:09:50.214901 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 400/884] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:49 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:50.294792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:50.298960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:50.318691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.321700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.322169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.322985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.324392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.328063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:50.477451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:50.496269 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ca4bfc6-59a4-4c3f-892c-2dcddb581bfe tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1310 microversion: 2.1 time: 0.321341 Aug 21 01:09:50.501353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 485/885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:50 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1310 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:50.949796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fda47c-a559-4695-9f5d-0776c831994e", "tag": "b6c935c7-030a-4ece-808c-f233e7f14c4d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:50.972341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:50.985636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:50.986486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.011185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] Creating event network-changed:b6c935c7-030a-4ece-808c-f233e7f14c4d for instance d1fda47c-a559-4695-9f5d-0776c831994e on n-h1-master-1 Aug 21 01:09:51.017653 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ce987469-1869-4339-a575-5037fbd0e005 req-147a27ef-d4d1-4659-8ef3-6c9c24daf541 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071909 Aug 21 01:09:51.019016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 486/886] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:09:51.076806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:51.090307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-799b9c7a-d193-4b62-82a1-cf1711ebbf3b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1471 microversion: 2.1 time: 0.801419 Aug 21 01:09:51.095815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 401/887] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:50 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1471 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:51.124751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:51.125620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:51.140707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.141230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.147977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.148990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.149552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.150056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.237362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:51.238077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:51.247536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.250198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.250852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.254361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.255027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.255647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.277319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:51.293885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad16a4b4-d311-4164-a63b-2fa36109215d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1272 microversion: 2.1 time: 0.172562 Aug 21 01:09:51.295871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 487/888] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:51 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:51.523428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:51.524279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:51.543280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.546347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.546984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.548157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:51.549069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:51.549651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:51.954965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:51.966015 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad89f886-52aa-4f2e-8242-2bac1e076636 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1492 microversion: 2.1 time: 0.446870 Aug 21 01:09:51.976051 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 488/889] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:51 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1492 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:52.725241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:52.729040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:52.756537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:52.761411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:52.762824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:52.766006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:52.769296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:52.769859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:52.832636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:52.855274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:52.859287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:52.863145 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-055ec65f-447a-4846-aafa-bd3eeb0e5b32 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 1.628205 Aug 21 01:09:52.864632 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 402/890] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:51 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:09:52.898342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:52.901330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:52.923724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:52.929002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:52.929994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:52.930980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:52.932031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:52.932615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:53.053735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-faa5f77d-73a0-45fa-9984-6acefa4d0171 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1643 microversion: 2.1 time: 1.070873 Aug 21 01:09:53.069949 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 489/891] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:51 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1643 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:53.078104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:53.078815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:53.085547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:53.086153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:53.086649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:53.087435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:53.088014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:53.088496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:53.110875 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:53.159524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:53.167617 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3672ace7-6c0c-429b-8720-6a449dbe1dcb tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1272 microversion: 2.1 time: 0.096073 Aug 21 01:09:53.168197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 490/892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:53 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:53.455227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Action: 'create', calling method: .version_select at 0x7fc3fa2655e0>, body: {"keypair": {"name": "tempest-keypair-1178693014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW9Byvx+t1zJ5RIuIxsDAlwsZAWj4aKyMhU1KDoUi+QMceHUhJk+nhZAb97yvJTFaApFlvafvAo2JAkFSCigjrmx73L/iJr7mCritVnipkYtDHezGlLO16rgc+32rqU7w=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:53.473669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for project 3e58a6cdaef14d36a9afbaf330135478. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:09:53.479051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for user e8d05275c344461cb9bdef94c765de35 and project 3e58a6cdaef14d36a9afbaf330135478. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:09:53.492515 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 01:09:53.598393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:53.607079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-825fdfce-34fd-4606-b450-53f890d723b4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1471 microversion: 2.1 time: 0.720052 Aug 21 01:09:53.607656 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 403/893] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:52 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1471 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:53.622738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:53.623276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:53.630862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:53.631364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:53.631817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:53.632553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:53.633028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:53.633446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.039510 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8e4782ba-4615-4897-a201-2c7c248b7dc7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1643 microversion: 2.1 time: 0.430780 Aug 21 01:09:54.040745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 404/894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:53 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1643 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:54.149533 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65ef1e73-9433-4ea1-af16-b5435871787f tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.106802 Aug 21 01:09:54.155069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 405/895] 10.222.0.46 () {58 vars in 1128 bytes} [Sun Aug 21 01:09:54 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 21 01:09:54.160448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.161618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:54.168741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.169534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.170125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.170996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.171608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.172181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.450563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:54.459661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:54.461192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:54.462392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a248c9d6-eb1b-4f1a-af7b-76a8a7688e1f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.305933 Aug 21 01:09:54.478615 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 406/896] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:54 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:54.483648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.486314 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:09:54.486314 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:09:54.487439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.487921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.488356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.489120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.489571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.489987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.501570 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 45134. Aug 21 01:09:54.516487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be421976-2d07-4cd4-b08b-8e59ff8eaeca tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036399 Aug 21 01:09:54.517492 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 407/897] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:09:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:54.522421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08c73d59-b8c4-4927-bba8-788e310a4cc8 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Calling method '.version_select at 0x7fc3fe99d700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.528924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55df607e-a4cf-4fbc-a4ce-69625c7533e9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.359416 Aug 21 01:09:54.547588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 491/898] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:09:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:54.558366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.559023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:54.561620 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-08c73d59-b8c4-4927-bba8-788e310a4cc8 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] HTTP exception thrown: Image not found. Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08c73d59-b8c4-4927-bba8-788e310a4cc8 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Request method failure captured: Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYXhnGt17k6rL0HXZBMfLJQWx3N7ycdTDOsufyJsowFXaKr3UxmPjeac_kC1r4gFGwHT2ZUc-BbQn7GP7_vKQmxsLByzR11c7eiFK-2DKU1GQYF6BxuG1AJ1gmGoyNeD0Ly3NrQmmXxRjMfzLyKtr4iIjwj6uU2vUPX78kMqGvpGyXc Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ed4c6546835436c8182a67c787fbb61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}] Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2386f0dd3caf4191bb93ca2a2c950a51 Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '-1'} Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.572071 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:09:54.577651 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.579236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.582804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08c73d59-b8c4-4927-bba8-788e310a4cc8 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:54.585811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08c73d59-b8c4-4927-bba8-788e310a4cc8 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.065215 Aug 21 01:09:54.585811 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 408/899] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:09:54 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:09:54.610700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:54.613232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:54.636970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.637516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.637955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.638681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.641267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.643142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.677114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lazy-loading 'flavor' on Instance uuid ace031ba-8e78-4cbe-b793-3f5b049e087a {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:09:54.694231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Going to try to live migrate instance to n-h1-master-1 {{(pid=122483) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:09:54.756040 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:54.815315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:54.830913 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e5bf1fb-028a-4f38-8ce9-648f6ffa4d69 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.280032 Aug 21 01:09:54.833070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 492/900] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:54 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:54.843451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-530fb450-0287-497a-9330-b52c53f187a7 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Calling method '.version_select at 0x7fc3fa86a700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.889404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-530fb450-0287-497a-9330-b52c53f187a7 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] HTTP exception thrown: Image not found. Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-530fb450-0287-497a-9330-b52c53f187a7 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Request method failure captured: Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/9112aebf-e287-4680-a607-980aef64412j HTTP/1.1 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYXhnGt17k6rL0HXZBMfLJQWx3N7ycdTDOsufyJsowFXaKr3UxmPjeac_kC1r4gFGwHT2ZUc-BbQn7GP7_vKQmxsLByzR11c7eiFK-2DKU1GQYF6BxuG1AJ1gmGoyNeD0Ly3NrQmmXxRjMfzLyKtr4iIjwj6uU2vUPX78kMqGvpGyXc Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ed4c6546835436c8182a67c787fbb61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}] Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2386f0dd3caf4191bb93ca2a2c950a51 Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9112aebf-e287-4680-a607-980aef64412j'} Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9112aebf-e287-4680-a607-980aef64412j to delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9112aebf-e287-4680-a607-980aef64412j could not be found. Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.893633 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-530fb450-0287-497a-9330-b52c53f187a7 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:54.897438 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-530fb450-0287-497a-9330-b52c53f187a7 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/9112aebf-e287-4680-a607-980aef64412j" status: 404 len: 62 microversion: 2.1 time: 0.061527 Aug 21 01:09:54.901329 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 493/901] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:54 2022] DELETE /compute/v2.1/images/9112aebf-e287-4680-a607-980aef64412j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:09:54.907180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:54.907879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:54.917603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.917890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.935523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:54.937568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:54.938947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:54.941200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:55.210486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:55.236239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-75ae77d6-27d1-4b63-abbe-010d6653cc0a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.333404 Aug 21 01:09:55.238872 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 494/902] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:54 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:55.251374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a713395-fbba-448f-9d70-9a75d1bffaeb tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Calling method '.version_select at 0x7fc3fa8c8c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:55.291084 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5a713395-fbba-448f-9d70-9a75d1bffaeb tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] HTTP exception thrown: Image not found. Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a713395-fbba-448f-9d70-9a75d1bffaeb tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Request method failure captured: Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1 HTTP/1.1 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYXhnGt17k6rL0HXZBMfLJQWx3N7ycdTDOsufyJsowFXaKr3UxmPjeac_kC1r4gFGwHT2ZUc-BbQn7GP7_vKQmxsLByzR11c7eiFK-2DKU1GQYF6BxuG1AJ1gmGoyNeD0Ly3NrQmmXxRjMfzLyKtr4iIjwj6uU2vUPX78kMqGvpGyXc Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ed4c6546835436c8182a67c787fbb61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}] Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2386f0dd3caf4191bb93ca2a2c950a51 Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1'} Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1 to delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1 could not be found. Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.303339 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a713395-fbba-448f-9d70-9a75d1bffaeb tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a713395-fbba-448f-9d70-9a75d1bffaeb tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1" status: 404 len: 62 microversion: 2.1 time: 0.063939 Aug 21 01:09:55.310698 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 495/903] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:09:55 2022] DELETE /compute/v2.1/images/785de3f1-9d27-4fd0-bba6-c1a0e2fddb7c1 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:09:55.320431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec1e2ac-c307-4c49-812c-2052e0dabf4c", "tag": "8d249384-0f30-4305-af30-94860da13c84"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:09:55.331462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:55.331930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:55.332351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:55.353059 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] Creating event network-changed:8d249384-0f30-4305-af30-94860da13c84 for instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c on n-h1-master-1 Aug 21 01:09:55.359077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-550cfb5a-f639-4b1e-b135-5232a7423ba9 req-eb465dd9-d2d0-4c73-a5a5-ea8eb71e05b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052140 Aug 21 01:09:55.359669 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 496/904] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:09:55.365219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e541e97a-9942-4716-bad8-61044913b60c tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Calling method '.version_select at 0x7fc3fa1eb310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:55.419833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e541e97a-9942-4716-bad8-61044913b60c tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] HTTP exception thrown: Image not found. Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e541e97a-9942-4716-bad8-61044913b60c tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Request method failure captured: Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/tempest-invalid-82472401 HTTP/1.1 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYXhnGt17k6rL0HXZBMfLJQWx3N7ycdTDOsufyJsowFXaKr3UxmPjeac_kC1r4gFGwHT2ZUc-BbQn7GP7_vKQmxsLByzR11c7eiFK-2DKU1GQYF6BxuG1AJ1gmGoyNeD0Ly3NrQmmXxRjMfzLyKtr4iIjwj6uU2vUPX78kMqGvpGyXc Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ed4c6546835436c8182a67c787fbb61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}] Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2386f0dd3caf4191bb93ca2a2c950a51 Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'tempest-invalid-82472401'} Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-82472401 to delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-82472401 could not be found. Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.422449 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:09:55.427390 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.446428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e541e97a-9942-4716-bad8-61044913b60c tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:55.447910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e541e97a-9942-4716-bad8-61044913b60c tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/tempest-invalid-82472401" status: 404 len: 62 microversion: 2.1 time: 0.086886 Aug 21 01:09:55.453501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 497/905] 10.222.0.46 () {58 vars in 1200 bytes} [Sun Aug 21 01:09:55 2022] DELETE /compute/v2.1/images/tempest-invalid-82472401 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:09:55.471743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bad4c91-e9ee-4ffc-bea9-a2538ce40515 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Calling method '.version_select at 0x7fc3fa282940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:55.500451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0bad4c91-e9ee-4ffc-bea9-a2538ce40515 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] HTTP exception thrown: Image not found. Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bad4c91-e9ee-4ffc-bea9-a2538ce40515 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Request method failure captured: Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/4831a82b-38fc-49d5-ad7f-72ab72411bf6 HTTP/1.1 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYXhnGt17k6rL0HXZBMfLJQWx3N7ycdTDOsufyJsowFXaKr3UxmPjeac_kC1r4gFGwHT2ZUc-BbQn7GP7_vKQmxsLByzR11c7eiFK-2DKU1GQYF6BxuG1AJ1gmGoyNeD0Ly3NrQmmXxRjMfzLyKtr4iIjwj6uU2vUPX78kMqGvpGyXc Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ed4c6546835436c8182a67c787fbb61", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ed4c6546835436c8182a67c787fbb61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ed4c6546835436c8182a67c787fbb61"}]}] Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8ed4c6546835436c8182a67c787fbb61 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2386f0dd3caf4191bb93ca2a2c950a51 Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1771001016-project Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4831a82b-38fc-49d5-ad7f-72ab72411bf6'} Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4831a82b-38fc-49d5-ad7f-72ab72411bf6 to delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4831a82b-38fc-49d5-ad7f-72ab72411bf6 could not be found. Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.502417 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:09:55.506849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:09:55.509647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bad4c91-e9ee-4ffc-bea9-a2538ce40515 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:09:55.510511 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bad4c91-e9ee-4ffc-bea9-a2538ce40515 tempest-ImagesDeleteNegativeTestJSON-1771001016 tempest-ImagesDeleteNegativeTestJSON-1771001016-project] 10.222.0.46 "DELETE /compute/v2.1/images/4831a82b-38fc-49d5-ad7f-72ab72411bf6" status: 404 len: 62 microversion: 2.1 time: 0.054006 Aug 21 01:09:55.511233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 498/906] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:55 2022] DELETE /compute/v2.1/images/4831a82b-38fc-49d5-ad7f-72ab72411bf6 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:09:55.516308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:55.517477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:55.524834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:55.526155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:55.526861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:55.527799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:55.528248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:55.528659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:55.783278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:55.795708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:55.799320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:55.800617 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f19c686c-1dd6-4e3c-a701-47b5d834fe65 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.288082 Aug 21 01:09:55.806183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 499/907] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:55 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:55.855807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:55.858140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:55.867672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:55.868298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:55.868838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:55.870334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:55.870881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:55.871375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:56.104492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:56.119242 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e42207c-1247-4b0b-9b39-f17b817f686f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.269644 Aug 21 01:09:56.121185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 500/908] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:55 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:56.275137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:56.275922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:56.286084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:56.288440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:56.289425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:56.292987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:56.293709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:56.295013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.010449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:57.023113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9f9da54-890c-4990-b547-8a35f283fd72 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.752841 Aug 21 01:09:57.024335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 501/909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:56 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:57.029501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:57.030392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:57.037427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.038168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.039081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.040038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.040682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.042292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.268268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:57.277572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:57.279114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:57.280312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da18f90b-20f9-495e-b5bc-660d72abbeeb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.254547 Aug 21 01:09:57.280879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 502/910] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:57 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:57.285672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:57.286395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:57.294401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.295218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.295965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.297132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.297624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.298062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.373372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dce1b41c-577b-43f9-a826-b7dd14908eeb tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a/action" status: 202 len: 0 microversion: 2.1 time: 2.766207 Aug 21 01:09:57.374060 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 409/911] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:09:54 2022] POST /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a/action => generated 0 bytes in 2788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:09:57.391146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:57.392405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:57.395521 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:57.404047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.404910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.406261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.407009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:57.407506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:57.407872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:57.501599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:57.513452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab89fd3c-134f-449c-85fa-118ed0721a04 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.231106 Aug 21 01:09:57.515197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 503/912] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:57 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:58.046615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:58.048345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:58.057549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.059595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.060275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.061343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.061877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.062352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.107420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.133842 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee3ae1ba-406a-4c1a-9a97-fa2eacfe7f69 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.755037 Aug 21 01:09:58.153060 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 410/913] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:57 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:09:58.303502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:58.304618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:58.306876 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:58.312153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.327778 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5df68ed-1797-410e-8d68-abbbe2657287 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.282919 Aug 21 01:09:58.332830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.332830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.334296 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 504/914] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:58 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:09:58.335045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.335798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.336264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.336686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.534978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:58.535802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:58.551463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.551943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.552539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.553881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:58.554604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:58.555275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:58.814499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.830701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.832963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.834578 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9541290e-bae0-4aee-91f4-f17ddd674435 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.535521 Aug 21 01:09:58.835909 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 411/915] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:58 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:09:58.930459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:58.951582 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7f46390-0ebe-4adb-8f69-c1c97a4d68f5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.419614 Aug 21 01:09:58.954068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 505/916] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:58 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:59.176617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:59.177646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:59.186868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.188104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.189048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.190348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.191128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.191752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.350770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:59.351428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:59.375671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.376282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.377015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.377886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.379151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.379773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.473393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:59.491178 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-47a4bab9-d7f4-4567-bfc3-2fc159438b73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.319859 Aug 21 01:09:59.492123 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 412/917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:59 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:59.736166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:09:59.754723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffed7de1-eb7e-4507-85e0-c63d4cb8c955 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.405669 Aug 21 01:09:59.755936 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 506/918] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:59 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:09:59.864156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:59.864669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:59.879189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.879914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.880573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.881546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.882230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:09:59.883266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:09:59.979753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:09:59.980376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:09:59.998618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:09:59.999765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.001322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.002496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.003157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.003810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.251396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:00.261296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:00.263340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:00.264990 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fdb5f40b-2461-4749-a2e8-406cbc700898 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.405144 Aug 21 01:10:00.266126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 413/919] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:09:59 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:00.271480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:00.279617 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c55be44-25f7-47e6-bc79-2aa56f2fb6c0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.305431 Aug 21 01:10:00.293906 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 507/920] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:09:59 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:00.536183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:00.537459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:00.554882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.557702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.558492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.559889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.561779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.563765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.594130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace031ba-8e78-4cbe-b793-3f5b049e087a", "name": "network-vif-unplugged", "status": "completed", "tag": "8e552111-0642-4a93-828e-0d461d33f953"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:00.632511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.633896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.636499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.680070 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] Creating event network-vif-unplugged:8e552111-0642-4a93-828e-0d461d33f953 for instance ace031ba-8e78-4cbe-b793-3f5b049e087a on n-h2-master-1 Aug 21 01:10:00.694404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b53c979a-6d6d-4373-b60c-6c5175b758b4 req-360b4df3-c839-4bf8-bea3-90c6b9c2db4e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104892 Aug 21 01:10:00.701184 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 508/921] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:00.776728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:00.778640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:00.790842 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:00.794989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.800552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.801403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.802412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:00.803138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:00.803937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:00.962051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:00.974512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-82c222a2-cf58-4797-8f48-3f0b0eef9070 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.455944 Aug 21 01:10:00.979991 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 414/922] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:00 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:01.110684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:01.122628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85ab25bb-04b2-4eca-ab36-f4a88debe5a5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.350719 Aug 21 01:10:01.124753 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 509/923] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:00 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:01.208381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec1e2ac-c307-4c49-812c-2052e0dabf4c", "name": "network-vif-plugged", "status": "completed", "tag": "8d249384-0f30-4305-af30-94860da13c84"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:01.235856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:01.243429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:01.244215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:01.266177 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] Creating event network-vif-plugged:8d249384-0f30-4305-af30-94860da13c84 for instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c on n-h1-master-1 Aug 21 01:10:01.279211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5e9c0937-034d-454d-a5da-44722b489c1e req-a24f6fa6-7b02-4749-8729-b04b57632984 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075161 Aug 21 01:10:01.281125 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 415/924] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:01.289869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:01.291093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:01.304928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:01.310127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:01.316480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:01.318845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:01.319821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:01.320102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:01.322747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:01.323772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:01.347781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:01.351884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:01.353803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:01.358342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:01.365420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:01.366178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:01.622022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:01.631599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39e3aa50-00b1-4573-8078-c17884392d54 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.331626 Aug 21 01:10:01.646080 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 416/925] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:01 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:01.772925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:01.790232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:01.795947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:01.804986 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9b0f5f5-f885-4921-b521-65cdfa0eebfd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1569 microversion: 2.25 time: 0.520955 Aug 21 01:10:01.809943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 510/926] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:01 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1569 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:10:02.003717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:02.005065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:02.020697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.023423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.024380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.026348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.026978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.027739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.149647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:02.151342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:02.168514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.174163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.176079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.178349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.179027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.182736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.400168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:02.437642 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d406d5c-0f8c-43ca-9e43-3a98146cfc3b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.435129 Aug 21 01:10:02.445522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 417/927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:01 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:02.514631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:02.524917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-449207dd-d4b5-44fd-b55f-50d35ad4008d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.379401 Aug 21 01:10:02.532394 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 511/928] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:02 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:02.659668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:02.670763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:02.686988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.688372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.688835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.689549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.690161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.690573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.726368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ace031ba-8e78-4cbe-b793-3f5b049e087a", "tag": "8e552111-0642-4a93-828e-0d461d33f953"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:02.739967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.740785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.741526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.766393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] Creating event network-changed:8e552111-0642-4a93-828e-0d461d33f953 for instance ace031ba-8e78-4cbe-b793-3f5b049e087a on n-h2-master-1 Aug 21 01:10:02.772498 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-88820162-c164-4fa6-b893-986160fcbd00 req-9c3230c1-68eb-4e9b-aef4-5a0a16bd2949 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051887 Aug 21 01:10:02.773937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 512/929] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:02.833951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:02.835215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:02.847942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.848794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.849451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:02.850390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:02.853122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:02.853830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.002717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:03.027781 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-599acfa7-949a-413c-9848-f1764dab3b37 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1314 microversion: 2.1 time: 0.371992 Aug 21 01:10:03.040973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 418/930] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:02 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:03.194831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:03.217350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:03.221851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:03.226966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc6002ea-e969-401d-9cde-8734bdd488b1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1544 microversion: 2.25 time: 0.397680 Aug 21 01:10:03.227887 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 513/931] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:02 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1544 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:10:03.251613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a857e05-bb54-4911-b1bc-98137b883828 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '.version_select at 0x7fc3feb24670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:03.255551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a857e05-bb54-4911-b1bc-98137b883828 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.256041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a857e05-bb54-4911-b1bc-98137b883828 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.256578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a857e05-bb54-4911-b1bc-98137b883828 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.270921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a857e05-bb54-4911-b1bc-98137b883828 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2609 microversion: 2.25 time: 0.023039 Aug 21 01:10:03.283376 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 419/932] 10.222.0.46 () {60 vars in 1184 bytes} [Sun Aug 21 01:10:03 2022] GET /compute/v2.1/os-migrations => generated 2609 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:03.289069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:03.289688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:03.308173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.309400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.310953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.314454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.316874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.317593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.331617 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:03.467249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:03.467864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:03.486517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.487227 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:03.488208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.490928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.493664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.495119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.496699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.720466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:10:03.754584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:03.759673 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a13a2ee-39de-4386-8321-35dec1b808cb tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 2037 microversion: 2.25 time: 0.475357 Aug 21 01:10:03.761389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 514/933] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:03 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 2037 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:10:03.769349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:03.769552 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea690e67-5159-4527-9491-643bc15b43bd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.307627 Aug 21 01:10:03.770613 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 420/934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:03 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:03.774839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:03.786038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.787014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.788036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.798931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20323e3e-81e8-4b20-a7f7-5ec8028e7eaf tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: .version_select at 0x7fc3fea66550>, body: {"keypair": {"name": "tempest-keypair-1748135276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZX/8Fn4JRyW7r5Vt7yvdPiUaVFpNCgOv0OAqNJbojD8Wg18x0orTIhQ8acju7kLxlcuBhTkueOUANz7yaqscSHCrLlP4R2znAtCNSQ9f+TnXdZuhQIqlp9QXyfG1YOBg=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:03.799577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:03.800088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:03.800539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:03.838646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-20323e3e-81e8-4b20-a7f7-5ec8028e7eaf tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for project ce70f9ff025c4666be942f9399ae72dc. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:03.880800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-20323e3e-81e8-4b20-a7f7-5ec8028e7eaf tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for user 547522b0b07f472a91ec83f15a36bb90 and project ce70f9ff025c4666be942f9399ae72dc. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:03.961253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20323e3e-81e8-4b20-a7f7-5ec8028e7eaf tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.167603 Aug 21 01:10:03.962606 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 421/935] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:10:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 21 01:10:04.048538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:04.049318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:04.057695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:04.058529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:04.060237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:04.061339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:04.062055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:04.062838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:04.425287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:04.427902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:04.437011 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8000e9b-9410-4961-899a-36d98edcea18 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.673138 Aug 21 01:10:04.437304 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50d1b115-d9ed-4528-b9f9-2f59b9a6712a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1464 microversion: 2.1 time: 0.392806 Aug 21 01:10:04.438482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 422/936] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:04 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1464 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:04.449502 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 515/937] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:03 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:04.497054 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:04.793248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:04.793895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:04.815580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:04.816219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:04.816666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:04.817433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:04.823861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:04.824343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.023630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:05.028997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'deleted': False, 'project_id': '48c18b2fa4604803a8872ccabef18444'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:05.046874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.047402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.047769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.048480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.056124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.056984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.114837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:05.152461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb9f3567-c749-4e06-b7b6-5c2627b629a4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.364504 Aug 21 01:10:05.154244 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 516/938] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:04 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:05.273873 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f015187-1614-454b-a2dc-c9651be76452 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.816240 Aug 21 01:10:05.274746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 423/939] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:10:04 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:10:05.294324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:05.303463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'deleted': False} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:05.311245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.312055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.312706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.313827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.314333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.314809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.534635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:05.535746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:05.545639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.548723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.550121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.554222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.555057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.558078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.607457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:10:05.818919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:05.819578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:05.820001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:05.939933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:05.953585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84eea625-737f-44c3-aee0-9f1bf8dc40fd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.422607 Aug 21 01:10:05.957557 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 424/940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:05 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:06.184436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:06.187312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:06.212979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:06.222341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:06.225154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:06.227759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:06.228593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:06.229710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:06.669855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:06.679860 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-095edf0e-3ef4-4f20-ac21-2ab1d5f4b240 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.507976 Aug 21 01:10:06.682667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 425/941] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:06 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:06.847656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1886776875", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "733da70d-73b5-4a16-a93a-dec288bd5761"}], "security_groups": [{"name": "tempest-securitygroup--2110773982"}], "key_name": "tempest-keypair-1748135276", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:06.904187 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f86294b-c37f-444d-a354-8aeb0a435b31 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16658 microversion: 2.1 time: 1.614052 Aug 21 01:10:06.905766 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 517/942] 10.222.0.46 () {58 vars in 1171 bytes} [Sun Aug 21 01:10:05 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16658 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:10:06.949649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:06.955470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'deleted': False, 'project_id': '48c18b2fa4604803a8872ccabef18444'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:06.962053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:06.962574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:06.963191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:06.964636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:06.965264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:06.966042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.058677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] validate_networks() for [('733da70d-73b5-4a16-a93a-dec288bd5761', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:07.131295 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b87c21dc-c532-4521-a1b9-aa6494268b01 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?tenant_id=1b094e07a54b4d908fb9fcb60b1c87bf" status: 200 len: 15 microversion: 2.1 time: 0.186116 Aug 21 01:10:07.132449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 518/943] 10.222.0.46 () {58 vars in 1231 bytes} [Sun Aug 21 01:10:06 2022] GET /compute/v2.1/servers/detail?tenant_id=1b094e07a54b4d908fb9fcb60b1c87bf => generated 15 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:10:07.141176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:07.142540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:07.158528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.160064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.160679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.161611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.162219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.162793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.459005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:07.476973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e385d36a-3333-4f84-b0a8-7151b3442447 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.341722 Aug 21 01:10:07.477690 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 519/944] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:07 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:07.484955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:07.498228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'tenant_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'deleted': False} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:07.507278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.507900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.508561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.509824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.510528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.511498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.561391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:10:07.655368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.655996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.656492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.868876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db181307-81cc-40b2-a898-698b548ef3ee tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1b094e07a54b4d908fb9fcb60b1c87bf" status: 200 len: 4826 microversion: 2.1 time: 0.388733 Aug 21 01:10:07.880836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 520/945] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:10:07 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1b094e07a54b4d908fb9fcb60b1c87bf => generated 4826 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:07.889427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:07.890050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:07.901603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.905662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.906569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:07.907964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:07.908434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:07.908877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.003140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:08.005685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:08.006386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:08.007176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:08.007814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:08.049628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.050210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.050646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.051397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.051843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.052837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.097670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:08.107354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for user 547522b0b07f472a91ec83f15a36bb90 and project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:08.112250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:08.123588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4544a0d6-b35c-4d43-ac7d-2ca31ba7a00c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.251136 Aug 21 01:10:08.124530 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 521/946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:07 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:08.137678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:08.140186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:08.149581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:08.157373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'tenant_id': '48c18b2fa4604803a8872ccabef18444', 'deleted': False} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:08.164799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.165902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.166587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.167579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.168369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.169839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.216636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ac0140e-886b-4a1a-87bc-bf57b3c3ce4f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=48c18b2fa4604803a8872ccabef18444" status: 200 len: 15 microversion: 2.1 time: 0.072921 Aug 21 01:10:08.217879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 522/947] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:10:08 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=48c18b2fa4604803a8872ccabef18444 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:10:08.245334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc233365-e98e-4e77-b0bf-f9a9b69c86c2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.402156 Aug 21 01:10:08.253997 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 426/948] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:10:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:10:08.265471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7af2029-21cc-4ec3-9da4-2ccecbb77e50 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:08.283120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7af2029-21cc-4ec3-9da4-2ccecbb77e50 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.020028 Aug 21 01:10:08.296824 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 427/949] 10.222.0.46 () {58 vars in 1189 bytes} [Sun Aug 21 01:10:08 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:10:08.310719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:08.311342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:08.350141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4425ab98-eb26-4bfe-8e6c-5cfaf0feabbd tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Action: 'create', calling method: .version_select at 0x7fc3fa2fc5e0>, body: {"keypair": {"name": "tempest-keypair-49416603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhljK8rYuQrIXG0WqYhwL/YyyXg8BMP9R14Mi+PKn+tIpNuUOLtHnWwemcxcZJiNrjW30i0eGtDYpik4HALHOpRdbqBfJMxuTX9r/JoBeNtypMWrZ4RnT8lofoQe/1cXg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:08.391898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4425ab98-eb26-4bfe-8e6c-5cfaf0feabbd tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Getting quotas for project 9c67ffccd1f747798e073cb3aed71dda. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:08.399332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4425ab98-eb26-4bfe-8e6c-5cfaf0feabbd tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Getting quotas for user ef3cbcb0d2844ef78896e6044136e786 and project 9c67ffccd1f747798e073cb3aed71dda. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:08.454927 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4425ab98-eb26-4bfe-8e6c-5cfaf0feabbd tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.229617 Aug 21 01:10:08.455972 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 523/950] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:10:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:08.466528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:08.468807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:08.488164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:08.501247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.502287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:08.503297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.503876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:08.507459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.509268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.510899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.513527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.520461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3e541c0-291c-44ea-968c-0bd3265c8431 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1286 microversion: 2.25 time: 0.220208 Aug 21 01:10:08.522488 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 428/951] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:08 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:08.537620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:08.538377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:08.570431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.572974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.573782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.574531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.580655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.584875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.721793 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08603487-9eb3-493a-aed6-6aa76b71f4f9 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.263663 Aug 21 01:10:08.730807 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 524/952] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:08 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:10:08.737886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:08.752998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:08.753703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:08.773215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.773706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.774176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.782238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:08.782770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:08.783210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:08.911426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:10:09.003404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61826388-e88d-4e08-8f78-20272f0170c1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.270599 Aug 21 01:10:09.004013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 525/953] 10.222.0.46 () {58 vars in 1150 bytes} [Sun Aug 21 01:10:08 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:09.019736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:09.025427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:09.033405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.034356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.034974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.035884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.036863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.037861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.054338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:09.064991 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94b362d1-274e-43c3-8e32-3ff549c4d9d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.541334 Aug 21 01:10:09.066868 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 429/954] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:08 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:09.146737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:09.147434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:09.158106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.160367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.163465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.164496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.166681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.167363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.244876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa234678-7740-4435-93fa-24c2bade02b0 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.232217 Aug 21 01:10:09.245877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 526/955] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:09 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:10:09.255880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:09.258770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:09.272816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.273333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.273774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.274512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.275280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.276430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.603812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:09.616385 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3971cbc3-90d1-469f-a5a9-b4b40648de8f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1502 microversion: 2.1 time: 0.475307 Aug 21 01:10:09.617017 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 430/956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:09 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1502 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:09.645043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:09.645043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:09.655036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.655900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.661278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.661974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.662443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.662846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.706273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab01da19-0537-42fc-8e6a-d6db15a9bc47 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1614 microversion: 2.1 time: 0.455772 Aug 21 01:10:09.707587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 527/957] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:09 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1614 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:09.714735 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:09.734607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:09.735342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:09.743214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.744218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.744606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.745844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:09.746323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:09.746748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:09.753075 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:09.801214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:09.820980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:09.826400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:09.829196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2c946d2-5aea-4801-91c9-f1595dd5f760 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1282 microversion: 2.25 time: 0.211178 Aug 21 01:10:09.831187 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 431/958] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:09 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:10.043496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-617f96c5-fd42-436e-b3cb-c199a298c92d tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1614 microversion: 2.1 time: 0.313740 Aug 21 01:10:10.044416 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 528/959] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:09 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1614 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:10.071783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:10.088423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:10.089060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:10.097181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:10.100038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.101107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.101547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.102257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.103089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.103525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.111445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.114049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.117175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.118597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.119407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.120002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.242574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:10:10.412446 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-18a3c36e-f6a8-4ca9-822f-7523a57bd5b1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1641 microversion: 2.1 time: 0.345788 Aug 21 01:10:10.418419 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 432/960] 10.222.0.46 () {58 vars in 1190 bytes} [Sun Aug 21 01:10:10 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1641 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:10.432200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:10.469245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:10:10.485162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.485931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.486616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.487500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.488123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.488974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.560150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:10.566413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b377ded9-709e-4f97-ac63-95bb3e730baf tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.139385 Aug 21 01:10:10.570909 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 433/961] 10.222.0.46 () {58 vars in 1196 bytes} [Sun Aug 21 01:10:10 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:10:10.582055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:10.585690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:10.586449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3580707-1459-48d6-84e0-de8f1ec1803b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.502827 Aug 21 01:10:10.587835 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 529/962] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:10 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:10.599913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.600526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.601251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.602349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.602958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.603909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.638072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:10.639041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:10.649749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.655552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.658992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.661433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.663390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.663941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.765085 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d035bfd4-0469-4364-a31d-c86ce57a8f36 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.186546 Aug 21 01:10:10.766773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 434/963] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:10 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:10:10.777141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:10.781673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:10.791361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.792184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.792796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.794012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:10.794698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:10.795554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:10.984192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:10.996614 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-129422a3-d81b-4826-a5a9-f0416b09b6c2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1492 microversion: 2.1 time: 0.362630 Aug 21 01:10:10.997571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 530/964] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:10 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1492 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:10.998073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:10.998528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:10.999035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:10.999447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:10.999858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:11.006161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:11.008569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:11.022345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.024807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.025393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.026148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.026607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.027031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.195803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:11.211168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:11.217965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:11.221111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5ee20ba-d9bf-43a6-8112-fc8db39fc1c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1344 microversion: 2.25 time: 0.222433 Aug 21 01:10:11.221856 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 531/965] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:10 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1344 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:11.227205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:11.234082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae5277a8-ab68-4aa1-bb6b-f48b003909b7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '.version_select at 0x7fc3fa03a5e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:11.251819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5277a8-ab68-4aa1-bb6b-f48b003909b7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.254788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5277a8-ab68-4aa1-bb6b-f48b003909b7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.254954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.255443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.255699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5277a8-ab68-4aa1-bb6b-f48b003909b7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.255874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.256609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.268576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.268995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.287072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae5277a8-ab68-4aa1-bb6b-f48b003909b7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.060195 Aug 21 01:10:11.296054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 532/966] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:10:11 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:11.311820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:11.316076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:11.335369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.335892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.338469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.339285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.342649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.342889 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04cf9fd0-ae53-4dd7-b77c-8792b4db8a64 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 1067 microversion: 2.1 time: 0.571896 Aug 21 01:10:11.343118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.344817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 435/967] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:10 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 1067 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 21 01:10:11.363812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:11.364587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:11.373535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.374144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.374672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.375485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.376115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.377191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.637937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:11.649375 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d54fbe5-cce2-4baf-8d0e-4254d0eba5d3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.290838 Aug 21 01:10:11.651430 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 436/968] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:11 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:11.656969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:11.657580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:11.665888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.667280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.667883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.668782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:11.669391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:11.669990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:11.675897 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d93ae30e-05c6-414f-8746-f5d8b4e3262f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1643 microversion: 2.1 time: 0.373884 Aug 21 01:10:11.678279 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 533/969] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:11 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1643 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:11.693264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "9da44161-0f23-4146-a36d-8253b3b432dd"}], "security_groups": [{"name": "tempest-securitygroup--2143156926"}], "key_name": "tempest-keypair-49416603", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:11.944209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] validate_networks() for [('9da44161-0f23-4146-a36d-8253b3b432dd', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:12.489810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:12.501539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e43a70e0-bc81-4fb1-b6d8-68e82bb9d0dc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.848532 Aug 21 01:10:12.502112 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 437/970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:11 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:12.523595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-704888562", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "89ad451d-4568-43da-b498-e71b39d2698e"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:12.546451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:12.546979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:12.547726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:12.548168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:12.548663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:12.566310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.566797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.567229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:12.567947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.568574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.569022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:12.590123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Getting quotas for project 9c67ffccd1f747798e073cb3aed71dda. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:12.595982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Getting quotas for user ef3cbcb0d2844ef78896e6044136e786 and project 9c67ffccd1f747798e073cb3aed71dda. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:12.607222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] validate_networks() for [('89ad451d-4568-43da-b498-e71b39d2698e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:12.610222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:12.615625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:12.676824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d08efdcd-c7c9-4963-9cdc-0835a42fb2b3 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.994680 Aug 21 01:10:12.678043 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 534/971] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:10:12.684843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:12.685712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:12.694312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.695012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.695625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:12.696689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.697494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.698450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:12.810305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:12.829519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:12.831012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:12.834178 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df4dd756-72e0-4135-b1d2-349718572cb5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1344 microversion: 2.25 time: 0.154326 Aug 21 01:10:12.835020 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 535/972] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:12 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1344 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:12.840532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:12.841340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:12.848304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.849134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.849533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:12.850961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:12.851418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:12.851911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.121473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:13.143637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bc62b67-4260-4d24-ba66-be688e13bb46 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.307743 Aug 21 01:10:13.161813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 536/973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:12 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:13.175406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b18dbf4-3c89-469a-83b6-408b92cfb039 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:13.176193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b18dbf4-3c89-469a-83b6-408b92cfb039 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:13.246322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b18dbf4-3c89-469a-83b6-408b92cfb039 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:13.254799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b18dbf4-3c89-469a-83b6-408b92cfb039 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1224 microversion: 2.1 time: 0.091233 Aug 21 01:10:13.261268 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 537/974] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:13 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:13.527138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:13.528633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:13.535085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.535654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.536133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.536940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.537610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.538091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.578334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:13.579136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:13.579136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:13.579442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:13.580011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:13.598576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.599087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.599529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.600405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.600964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.601636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.621939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:13.627954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for user b0bd3eeeb578465a8f5e5eaa3b3fdc85 and project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:13.647747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:13.652338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:13.711835 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:13.744504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1d731c6-684a-4d97-8627-780e9b4d51ae tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226190 Aug 21 01:10:13.752438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 438/975] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:10:13.758682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-99f6e9f6-d1fa-44d1-ba40-ef35d7b1113f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:13.763485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-99f6e9f6-d1fa-44d1-ba40-ef35d7b1113f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:13.790230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:13.827191 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7310c534-e648-47ec-91e5-a3ad09bed9ac tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.303856 Aug 21 01:10:13.835629 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 538/976] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:13 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:13.853684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-99f6e9f6-d1fa-44d1-ba40-ef35d7b1113f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:13.861746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:13.862360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:13.870648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.871123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.871539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-99f6e9f6-d1fa-44d1-ba40-ef35d7b1113f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1210 microversion: 2.1 time: 0.116094 Aug 21 01:10:13.871666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.872260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:13.872714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:13.873161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:13.873837 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 439/977] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:13 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:14.103807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.116451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.119248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.120698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea468a3c-3609-44a1-b39d-de7fd1886762 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.262825 Aug 21 01:10:14.121850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 539/978] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:13 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:14.169949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:14.170564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:14.181683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.182172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.189254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.192976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.194773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.197047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.267178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:14.297109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.297588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.298019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.350253 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] Creating event network-changed:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h2-master-1 Aug 21 01:10:14.358157 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bda4c03e-b17b-48d4-83a9-4275933992e7 req-b04918f0-e80d-45b1-b164-14970eefe7ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102798 Aug 21 01:10:14.359149 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 540/979] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:14.389585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:14.391844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:14.410594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.411696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.412871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.414355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.415075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.415716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.505591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.514526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d378341-ebb0-44ab-83a1-74d270f2c291 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1284 microversion: 2.1 time: 0.137393 Aug 21 01:10:14.516451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 541/980] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:14 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:14.692518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.704524 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2c5c0fe-8d5e-4993-b557-43c303e62529 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.539840 Aug 21 01:10:14.714818 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 440/981] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:14 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:14.850251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:14.850919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:14.856240 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:14.865715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.866540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.867277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.875355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.875355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.875355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.897408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:14.898075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:14.907637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.908272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.908821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.910093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:14.911172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:14.911714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:14.986772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:14.994973 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-46d24960-96b2-4824-87b6-d69bdcc5a144 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1262 microversion: 2.1 time: 0.104736 Aug 21 01:10:14.995551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 441/982] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:14 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:15.017032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.025105 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad2daaa1-e00b-48aa-9b43-bcdb7a0f856b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.178858 Aug 21 01:10:15.026184 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 542/983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:14 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:15.144460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:15.145088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:15.152960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.153814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.154466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.161741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.162519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.163179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.418865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.429686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.431263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.432369 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de4f831b-5fe4-4e10-81bb-44cd18f4dd46 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.291905 Aug 21 01:10:15.432932 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 442/984] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:15 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:15.536475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:15.537141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:15.543794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.544283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.544729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.545499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.545944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.546349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.614465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.622928 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-78b4515e-137b-4c26-9f95-134cb877f43a tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1294 microversion: 2.1 time: 0.090636 Aug 21 01:10:15.623493 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 543/985] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:15 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:15.729385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:15.730034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:15.736153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.736631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.737164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.737857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:15.738339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:15.738751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:15.937231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:15.945367 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d5a6c4c0-ee19-4d70-94f8-09690e40e6fe tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.221400 Aug 21 01:10:15.946398 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 443/986] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:15 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:16.015723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:16.016331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:16.023342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.023951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.024557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.025577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.026089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.026596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.046362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:16.047057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:16.056177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.057110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.057751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.059469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.060401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.062159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.113439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.121718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e2c9559-80b1-4953-b8d8-a5d884be1cc6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1270 microversion: 2.1 time: 0.109946 Aug 21 01:10:16.135264 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 544/987] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:16 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:16.308645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.318108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0c55617-c19c-42bf-8a8c-fe37711f1584 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1476 microversion: 2.1 time: 0.275472 Aug 21 01:10:16.319560 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 444/988] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:16 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:16.454815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:16.455421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:16.461638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.462419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.463024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.463945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.464564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.465012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.612833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.621897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.623403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.624977 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0594d24b-7673-41ca-b6e1-f886c9707975 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.173678 Aug 21 01:10:16.625362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 545/989] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:16 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:16.643905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:16.644550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:16.654384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.654865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.655365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.655993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.656428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.656875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.923224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:16.933080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3abf3a43-a0c1-4b04-8d22-f8f72df93046 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.293347 Aug 21 01:10:16.934304 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 445/990] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:16 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:16.967878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:16.968581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:16.980884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.981500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.981949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:16.982741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:16.983192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:16.983629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.117622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.130466 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-059956c5-8566-4332-a620-117422e18e8a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.161622 Aug 21 01:10:17.130466 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 546/991] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:16 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:17.143062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:17.143670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:17.150199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.150682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.151127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.151820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.152260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.152679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.230006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.232525 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.239828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ee7bc7c-c71c-40a7-83b7-da2efb211719 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1270 microversion: 2.1 time: 0.101022 Aug 21 01:10:17.240563 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 446/992] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:17 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:17.339722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:17.340326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:17.346655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.347428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.348068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.349002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.349650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.350285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.477472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e56241-4887-4b48-80d6-863cb0d93f39", "tag": "62111f2b-0fe4-4fd4-909e-6f38509c7153"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:17.506051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.512217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.514461 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:17.514982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.515637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.523008 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11595bb4-acbb-4054-9e3f-b6a0c5446c85 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1475 microversion: 2.1 time: 0.187290 Aug 21 01:10:17.524348 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 547/993] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:17 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1475 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:17.547983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] Creating event network-changed:62111f2b-0fe4-4fd4-909e-6f38509c7153 for instance 71e56241-4887-4b48-80d6-863cb0d93f39 on n-h1-master-1 Aug 21 01:10:17.560909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6fc96afe-4007-433c-b948-dd3133e5f05a req-42136126-8970-4708-adb8-0f12fdfe3e60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086986 Aug 21 01:10:17.561619 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 447/994] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:17.647889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:17.648952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:17.656132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.656756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.657244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.658002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.658473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.658891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.796668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.805422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.807442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:17.808622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-570a70c0-c9ff-4135-9df9-7b511fcc98e7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.165089 Aug 21 01:10:17.809197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 548/995] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:17 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:17.955879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:17.956567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:17.963803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.964369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.964712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:17.965477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:17.966159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:17.966611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.109639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:18.118911 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c62c20c7-9349-48d9-a447-30443b006226 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.167293 Aug 21 01:10:18.119229 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 448/996] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:17 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:18.147434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:18.148122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:18.155830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.156315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.156749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.157583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.158028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.158449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.263922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:18.264738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:18.272294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.272294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.272869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.273657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.274601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.274601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.294090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:18.302900 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbc81479-ee29-49fb-8744-6aea70fb674b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.159613 Aug 21 01:10:18.304218 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 549/997] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:18 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:18.476731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:18.485682 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8367832-a2e7-4175-8ecd-8b305f20b78a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1270 microversion: 2.1 time: 0.227945 Aug 21 01:10:18.486861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 449/998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:18 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:18.546586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:18.547220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:18.553809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.554431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.554963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.556085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.556724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.557329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.813550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:18.827798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f97ac5b8-4f59-4319-8e05-404da156e27e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1475 microversion: 2.1 time: 0.284937 Aug 21 01:10:18.829395 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 550/999] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:18 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1475 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:18.841007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:18.842143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:18.850531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.851525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.852416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:18.853647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:18.854312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:18.855906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.141517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:19.143087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:19.150735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.151885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.152524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.153477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.154125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.155005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.312004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.322094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc539dae-0930-4d65-afdf-83e3a27db9bb tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.185786 Aug 21 01:10:19.323328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 551/1000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:19 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:19.341058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:19.341680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:19.348408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.349168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.349758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.350463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.350912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.351332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.379743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.398093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.401174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.406743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0448609-934e-4440-8a46-cf716b8df00d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.570839 Aug 21 01:10:19.410109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 450/1001] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:18 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:19.509518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:19.511647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:19.520633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.521503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.522286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.523249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.523973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.524459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.525128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.537321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6274fc3e-88c0-4f44-a9e7-33c0fbf2598d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.203020 Aug 21 01:10:19.538229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 552/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:19 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:19.690246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:19.707216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-657be6d8-e8e8-4de0-bbfb-bd7dd3d3b962 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1268 microversion: 2.1 time: 0.203490 Aug 21 01:10:19.724094 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 451/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:19 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:19.849529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:19.850143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:19.857181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.857673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.858191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.858898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.859704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.860129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.871841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "name": "network-vif-unplugged", "status": "completed", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:19.885891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:19.887272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:19.888051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:19.908126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Creating event network-vif-unplugged:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h2-master-1 Aug 21 01:10:19.915858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:10:19.945687 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c8e766a0-84c6-4841-938d-e4b31c64c512 req-7f518618-59e9-4862-9d60-e2768a4eba88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077897 Aug 21 01:10:19.947074 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 452/1004] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:20.051854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.085512 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84da3f39-dcbc-4635-ad5f-ce838be00e2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1475 microversion: 2.1 time: 0.238183 Aug 21 01:10:20.087925 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 553/1005] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:19 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1475 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:20.352630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:20.354059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:20.362299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.365403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.366110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.366918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.367735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.368419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.429724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:20.430339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:20.437514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.438513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.439015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.440105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.440992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.441778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.622188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.632982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.635262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.659432 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-621e6872-0e47-4ee7-a743-eaa1e33bec72 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.233390 Aug 21 01:10:20.662041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 554/1006] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:20 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:10:20.672162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.684553 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b494ccb5-8bcc-4918-afdd-db4e553aadd1 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.339468 Aug 21 01:10:20.685502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 453/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:20 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:20.692098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:20.693045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:20.706872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.708943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.709550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.711230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.711941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.712548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.733524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:20.734627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:20.756374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.756883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.757312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.758003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:20.758457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:20.758900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:20.944056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:20.955935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98f6ceda-f37b-4e5a-9bf2-cbe5781eb941 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.283196 Aug 21 01:10:20.963261 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 555/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:20 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:21.114149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:21.115175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:21.128031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.140695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.142145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.142508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.143263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.143863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.144397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.152587 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b7b2601-eb26-4a00-b079-1980affbb356 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.424746 Aug 21 01:10:21.173781 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 454/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:20 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:21.311282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "name": "network-vif-plugged", "status": "completed", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:21.336857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.337400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.338153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.364719 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] Creating event network-vif-plugged:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h2-master-1 Aug 21 01:10:21.367759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.374283 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d8740ffc-eec4-4943-9b8f-426aa90a36ef req-d005f1e9-22ba-498a-a13e-dbd5df7bb7d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066555 Aug 21 01:10:21.375207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 455/1010] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:21.378079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de8ba5b9-6e1f-4091-b054-36a7b9d77cd1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1475 microversion: 2.1 time: 0.273345 Aug 21 01:10:21.379172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 556/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:21 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:21.686336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:21.688168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:21.696182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.696906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.697868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.698573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.699179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.699601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.706536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:21.707162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:21.716187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.716670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.717125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.717824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.718267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.718682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.871509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.885355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f93e575f-15d7-494e-b7d0-8417544be5ba tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.182349 Aug 21 01:10:21.897381 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 557/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:21 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:21.910789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.919295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.920800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:21.921925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-068b36cc-b758-4ddc-af51-645af9d6c679 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.240336 Aug 21 01:10:21.922477 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 456/1013] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:21 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:21.963789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}, {"name": "network-changed", "server_uuid": "e0a5c00c-30be-4977-82a9-9a81a38ff941", "tag": "e56fb51b-dbea-4d39-a86b-679406b04734"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:21.974485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.975150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.975637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.978933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:21.979535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:21.986109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.986633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.987007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.987697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:21.988138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:21.988558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:21.989768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Creating event network-changed:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h2-master-1 Aug 21 01:10:21.990369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Creating event network-changed:e56fb51b-dbea-4d39-a86b-679406b04734 for instance e0a5c00c-30be-4977-82a9-9a81a38ff941 on n-h2-master-1 Aug 21 01:10:21.997621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:10:22.011264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-63e831c2-31db-45e9-8da7-9c7b6c01d9a6 req-688518b0-97cc-4cda-ab89-6ec17b6c4e77 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051490 Aug 21 01:10:22.012199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 558/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:22.182210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:22.183180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:22.189972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.193584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.194310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.195242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.196123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.197301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.356183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:22.365658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1e88e0a-7176-4745-b59c-feb73ccbaa8d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.187932 Aug 21 01:10:22.366264 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 559/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:22 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:22.400237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:22.400830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:22.407514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.408147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.408651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.409463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.410183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.410673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.562650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:22.572163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95974866-88df-4858-a368-16ffaebcd822 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1475 microversion: 2.1 time: 0.176246 Aug 21 01:10:22.576739 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 560/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:22 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:22.596825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:22.606243 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b8f13f4-14f4-4034-ad0e-419b6109cbc1 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.631289 Aug 21 01:10:22.606880 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 457/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:21 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:22.911983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:22.914507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:22.937221 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:22.946619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:22.947330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:22.951151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.953011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.954498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.956854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.957675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.958620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.960668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.966617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.968599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:22.972101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:22.973954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:22.975642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.129616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.142602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-826b192f-ffec-4051-9959-a85f09b68537 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.237648 Aug 21 01:10:23.146003 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 561/1018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:22 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:23.319331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.329644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.331720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.332901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13815705-9e0d-48ad-a1ee-0ea55f63c8d3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.390604 Aug 21 01:10:23.333458 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 458/1019] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:22 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:23.394379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e56241-4887-4b48-80d6-863cb0d93f39", "name": "network-vif-plugged", "status": "completed", "tag": "62111f2b-0fe4-4fd4-909e-6f38509c7153"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:23.395705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:23.396461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:23.398809 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=16 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:23.412455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.413056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.413193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.413564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.413674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.414034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.414418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.415325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.415823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.428323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] Creating event network-vif-plugged:62111f2b-0fe4-4fd4-909e-6f38509c7153 for instance 71e56241-4887-4b48-80d6-863cb0d93f39 on n-h1-master-1 Aug 21 01:10:23.434852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6a4859e5-f5ce-40e8-92df-879704122ea8 req-bdefc853-ab13-4f63-8fa9-2c89239d391c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044502 Aug 21 01:10:23.435492 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 459/1020] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:23.585180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.594127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:23.594819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:23.604239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.604663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dcb51a7a-0b34-4554-8a65-983461fb067f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.219975 Aug 21 01:10:23.605386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.605878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.606801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.607138 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 562/1021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:23 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:23.607683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.608166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.611974 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:23.627718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:23.628823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:23.635444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.635925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.636371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.637089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:23.637535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:23.637948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:23.763447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.774854 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09c39171-2106-477d-9d14-00998729c376 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1473 microversion: 2.1 time: 0.183905 Aug 21 01:10:23.777157 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 460/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:23 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:23.794680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:23.802610 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a55e621-922d-4017-b32a-b4573ecf4a2a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.179273 Aug 21 01:10:23.803392 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 563/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:23 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:24.164072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:24.165042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:24.166740 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=20 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:24.173404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.173888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.174317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.175023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.175470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.175888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.314452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.324028 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10e1b301-1f8b-4932-b0a2-1d4ad17e7d6e tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1350 microversion: 2.1 time: 0.163618 Aug 21 01:10:24.325098 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 461/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:24 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:24.358334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:24.359067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:24.365697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.366185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.366646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.367351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.367920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.369053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.503062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.506673 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:24.512250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.513803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.514900 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14499fe5-237d-4ea2-9b93-a774c60fc74b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.160675 Aug 21 01:10:24.515436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 564/1025] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:24 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:24.631105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:24.632149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:24.644031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.645161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.645820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.646754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.647476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.648194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.788331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.796836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de236a3b-0fb4-4713-ad4d-1fd92a56e8b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.172035 Aug 21 01:10:24.797463 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 462/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:24 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:24.802443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:24.803053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:24.814635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.815203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.815739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.816504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.817060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.817557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.823888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:24.824474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:24.830675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.831141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.831573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.832447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:24.832891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:24.833495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:24.963125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.968317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:24.970951 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb873473-e4a0-4538-bc3b-44fce5987429 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1473 microversion: 2.1 time: 0.172456 Aug 21 01:10:24.971529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 565/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:24 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:24.976787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1187879959", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "230b68b9-da72-49a0-8ed8-c7a881994c12"}], "security_groups": [{"name": "tempest-securitygroup--387512771"}], "key_name": "tempest-keypair-1178693014", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "43dcc48c-f023-4fb6-8192-f4119de24237", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:24.977137 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a9b011e7-bc86-4bb0-a041-48888932d9e4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.157482 Aug 21 01:10:24.977940 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 463/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:24 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:25.113986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] validate_networks() for [('230b68b9-da72-49a0-8ed8-c7a881994c12', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:25.346681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:25.347278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:25.354004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.354476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.354898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.355577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.356019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.356454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.495441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:25.503472 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4bdfd446-945a-4ef8-b2c4-6464c568bbb5 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1540 microversion: 2.1 time: 0.160705 Aug 21 01:10:25.504024 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 464/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:25 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1540 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:25.508406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for project 3e58a6cdaef14d36a9afbaf330135478. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:25.513259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for user e8d05275c344461cb9bdef94c765de35 and project 3e58a6cdaef14d36a9afbaf330135478. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:25.524006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:25.524573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:25.525412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:25.525853 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:25.526318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:25.526717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:25.527117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:25.530632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.531049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.531479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.532173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.532619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.533330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.535935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.536401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.536857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.537569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.538008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.538420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.557591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for project 3e58a6cdaef14d36a9afbaf330135478. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:25.562252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Getting quotas for user e8d05275c344461cb9bdef94c765de35 and project 3e58a6cdaef14d36a9afbaf330135478. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:25.611059 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b13f6793-f655-452a-b0e4-7c52f0d6ceca tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090780 Aug 21 01:10:25.611732 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 465/1030] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:10:25 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:25.617416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:25.618378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:25.622542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:25.624812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43dcc48c-f023-4fb6-8192-f4119de24237',volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:25.626819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.627205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.627641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.628334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.632934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.633493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.638894 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:25.910604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f32227c-641f-40ff-a084-09cd903f9880 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.937840 Aug 21 01:10:25.911743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 566/1031] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:10:25.917176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:25.918095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:25.926341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.926980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.927512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.928320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:25.929004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:25.929521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:25.931127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:25.941637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:25.943146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:25.944253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c3b8cfa-cb48-46bf-be3c-dd418b2eabbd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1412 microversion: 2.25 time: 0.330539 Aug 21 01:10:25.950289 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 466/1032] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:25 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1412 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:25.955238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-115e0ed3-cdf8-4acc-8161-108615c9eb34 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:25.955834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-115e0ed3-cdf8-4acc-8161-108615c9eb34 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:26.063031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-115e0ed3-cdf8-4acc-8161-108615c9eb34 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:26.075695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-115e0ed3-cdf8-4acc-8161-108615c9eb34 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1122 microversion: 2.1 time: 0.124048 Aug 21 01:10:26.076207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 467/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:25 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1122 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:26.088950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:26.088950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:26.094126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.100952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.101470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:26.102446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.102921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.103801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:26.146031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:26.157658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcfb465b-0539-4069-b8f3-680d8c61fdb6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.243901 Aug 21 01:10:26.158310 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 567/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:25 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:26.165260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:26.165891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:26.178539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.179093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.179558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:26.180491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.182527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.182887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:26.396827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:26.397420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:26.407641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc6cfa9a-0d05-4b3d-a4a6-cdc593ee9ff9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1473 microversion: 2.1 time: 0.329875 Aug 21 01:10:26.408238 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 468/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:26 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:26.413694 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9632cbf-8f96-43e4-a162-c4cc85b20328 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.247830 Aug 21 01:10:26.414547 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 568/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:26 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:26.969621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:26.970317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:26.984873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.985463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.986111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:26.987051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:26.987679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:26.988283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.096075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.097362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.122504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.124180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.129388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.131834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.132618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.135047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.258931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.275490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37f84fd8-7793-423d-b42f-14f44253bc73 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1220 microversion: 2.1 time: 0.180509 Aug 21 01:10:27.276593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 569/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:27.289195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.290026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.299208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.300167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.300689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.302093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.302544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.303279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.420991 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.431391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.444001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.445911 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0b63e4a-996e-4947-a878-abc0895829c1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1608 microversion: 2.25 time: 0.480308 Aug 21 01:10:27.446890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 469/1038] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:10:26 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1608 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:10:27.451747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e56241-4887-4b48-80d6-863cb0d93f39", "tag": "62111f2b-0fe4-4fd4-909e-6f38509c7153"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:27.491637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.492399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.496269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.520711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.530516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de2b307c-f135-48e8-b9ed-67de8db5a7eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.252373 Aug 21 01:10:27.531943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 570/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:27.539078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.540185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.548377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.549267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.550038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.551080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.551729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.552340 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] Creating event network-changed:62111f2b-0fe4-4fd4-909e-6f38509c7153 for instance 71e56241-4887-4b48-80d6-863cb0d93f39 on n-h1-master-1 Aug 21 01:10:27.552557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.571953 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5de8ee8d-3e68-4b5f-ab9f-84d2190f4fdf req-b0866d87-9c33-4c1e-89c7-ee511283a85b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123469 Aug 21 01:10:27.576587 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 470/1040] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:27.586106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.588888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.605053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.606067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.607154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.608214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.609018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.612610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.721783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:27.731439 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-575bcddb-9e4e-42ac-9f5d-413dd4e1325c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.197427 Aug 21 01:10:27.732005 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 571/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:27.737363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.738387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.745217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.746095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.746858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.748026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.748724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.749238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.836323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f212397-e4c3-4af1-a874-fa6df04d20c9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.102982 Aug 21 01:10:27.837134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 572/1042] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:10:27.846062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:27.846605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.856186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.856684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.858589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.859664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.860147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.860579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.964335 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b5dfec0-dbe8-4202-b975-fd3af4a17924 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7/action" status: 204 len: 0 microversion: 2.1 time: 0.124976 Aug 21 01:10:27.965997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 573/1043] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:27 2022] POST /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7/action => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:10:27.979700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:27.982783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:27.995882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.996434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.997005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:27.997781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:27.998291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:27.998764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.070558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:28.081110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-430e8096-f4a4-48ab-81b1-5cdb4d4e0861 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1471 microversion: 2.1 time: 0.502476 Aug 21 01:10:28.095215 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 471/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:28.298514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:28.299270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:28.306424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.307006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.307691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.308456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.308996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.309470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.388373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:28.398817 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5e56a3e-f171-48cc-b688-e8e097ccba55 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1220 microversion: 2.1 time: 0.105140 Aug 21 01:10:28.411437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 472/1045] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:28 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:28.551414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:28.560402 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77b1ed1f-ac47-4904-ad3d-3f1f4907beeb tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.590322 Aug 21 01:10:28.560633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:28.561924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:28.573447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.589240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.590257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.594936 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 574/1046] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:27 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:28.595416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.597900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.601128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.703104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9de9e6ac-8679-48ad-9503-96ed5a23dbd3"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:28.705520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:28.712683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.713229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.713682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:28.714956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:28.714956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:28.715320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.088352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:29.099430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f7de344-b4ce-4be2-a598-01390b3b8155 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.548933 Aug 21 01:10:29.100380 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 473/1047] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:28 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:29.105493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:29.108809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:29.123065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.123920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.124644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.125758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.126356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.127020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.222379 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ddb321ab-3ade-4dda-b3ae-700d7c388ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "POST /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523108 Aug 21 01:10:29.228744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 575/1048] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:10:28 2022] POST /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:29.423439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:29.424751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:29.435033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.435572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.436007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.436707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.437364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.437590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.513047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:29.520944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1753446d-e706-4a29-b39b-7c495ec40496 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1238 microversion: 2.1 time: 0.103714 Aug 21 01:10:29.521727 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 576/1049] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:29 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:29.534706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:29.536957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:29.543229 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8bc3926-f7ef-4540-a5ed-5282bd1d6f7c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.441566 Aug 21 01:10:29.543808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 474/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:29 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:29.548633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.549142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.549566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.561580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] Creating event network-changed:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h2-master-1 Aug 21 01:10:29.566853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b0926b86-3e62-4236-937e-5198b4b5255f req-0a726408-909e-49f9-9690-5aed7c120cc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034025 Aug 21 01:10:29.567444 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 577/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:29.582739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:29.583416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:29.589458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.589933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.590355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.591034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:29.591471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:29.592082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:29.728463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:29.739336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-850e6bd5-24cf-484d-9c6d-5ce85704b827 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.160319 Aug 21 01:10:29.739942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 475/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:29 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:30.124755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:30.125986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:30.144662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.145193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.145615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.146310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.146752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.147161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.155725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "name": "network-vif-plugged", "status": "completed", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:30.170348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.171315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.172049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.189048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Creating event network-vif-plugged:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h2-master-1 Aug 21 01:10:30.198675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:10:30.211570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-75a64cae-40bf-479c-ae51-c8ad9c781c09 req-3689ad55-d72d-4ffb-b7ec-7aa0fe1b6df0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059536 Aug 21 01:10:30.212435 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 476/1053] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:30.287689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:30.302380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e433d59-57f1-457c-844c-6f1a85d00c38 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.181524 Aug 21 01:10:30.303022 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 578/1054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:30 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:30.542677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:30.543928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:30.560142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.560955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.563049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.564046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:30.564866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.565521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.567058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.569300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:30.579108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.584677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.584677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.584677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.584677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.584677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.763232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:30.772890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b86d1f35-c0c8-44be-b838-fbf8d3f58b62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.212933 Aug 21 01:10:30.784805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 579/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:30 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:30.784805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:30.784805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:30.784805 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:30.791906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.791906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.791906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.792308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:30.792592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:30.793036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:30.820718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:30.830631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14f44f8f-5d87-4bef-a784-ea41135c9d5e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1238 microversion: 2.1 time: 0.293489 Aug 21 01:10:30.836195 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 477/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:30 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1238 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:31.006109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:31.008917 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:31.019134 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed8e19ef-38ab-4d2a-bf15-754259ead346 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.244187 Aug 21 01:10:31.022685 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 580/1057] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:30 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:31.323643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:31.324518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:31.331365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:31.332102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:31.332720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:31.333621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:31.334242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:31.334836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:31.803116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:31.805113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:31.821319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:31.823683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:31.824476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:31.825600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:31.826669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:31.827466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:31.995706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:32.016391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9bfd3ed-ce35-4735-8245-91f7727f9fd6 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.219747 Aug 21 01:10:32.019989 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 581/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:31 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:32.028363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:32.029024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:32.044790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:32.045291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:32.045726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:32.046436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:32.046889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:32.047311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:32.115622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:32.124692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b747b69-8861-41cd-a46a-f811bafff152 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1238 microversion: 2.1 time: 0.101356 Aug 21 01:10:32.130450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 582/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:32 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:32.130450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:32.130450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:32.139723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:32.271206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:32.282050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dca5e7db-9c67-4d86-a06d-12c60aaa1b9b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.962484 Aug 21 01:10:32.282832 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 478/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:31 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:32.300508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:32.311676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c751f2e-7ea2-433e-9231-ba116566a4cf tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.185334 Aug 21 01:10:32.312424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 583/1061] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:32 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:32.906487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "name": "network-vif-unplugged", "status": "completed", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:32.922562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:32.923512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:32.924602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:32.944872 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] Creating event network-vif-unplugged:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:10:32.951229 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-add1e6c1-0647-40a1-8ae9-34ad3141017f req-9f8e2eb1-c19f-4027-b7a5-038c0c371651 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054997 Aug 21 01:10:32.952429 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 479/1062] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:33.038382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:33.039844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:33.048156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.048685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.049418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.050336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.050840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.051599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.154304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:33.156465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:33.168181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.169103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.169985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.171099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.171806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.172435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.232877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:33.243253 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8817a99-10cc-45fd-a104-733c0105f97e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.208340 Aug 21 01:10:33.252635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 584/1063] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:33 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:33.304787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:33.305325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:33.315675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.318743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.319206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.319951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.320410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.320973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.491899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:33.500261 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ff24c6c-8575-4848-9c5d-8d2e7f7fd6da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.200891 Aug 21 01:10:33.513618 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 585/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:33 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:33.518623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:33.519233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:33.525767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.526254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.526680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.527375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:33.527819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:33.528237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:33.660178 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:33.672896 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f1ef4a90-beeb-45d9-8921-e5993b88d420 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.525887 Aug 21 01:10:33.674705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 480/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:33 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:33.710217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:33.718426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e93d3a23-d02b-4cfe-8dd7-b5af7e272060 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1470 microversion: 2.1 time: 0.203644 Aug 21 01:10:33.719181 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 586/1066] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:33 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:34.264896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:34.265578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:34.272720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.273224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.273704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.274429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.274962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.275380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.495116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:34.505307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970cdff0-7cdd-485c-b8d9-5ef7351b8990", "tag": "f6b0b79c-66d3-486a-a132-508aae6a65b4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:34.509919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e64ec18a-81b0-4b1e-a629-bcb82b2f2f55 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.249062 Aug 21 01:10:34.511116 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 481/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:34 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:34.521705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:34.522848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:34.537931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.538474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.539641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.539930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.540662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.540898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.541423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.541546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.542097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.559252 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] Creating event network-changed:f6b0b79c-66d3-486a-a132-508aae6a65b4 for instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 on n-h1-master-1 Aug 21 01:10:34.566529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-19ae0b6d-c6c2-487a-9648-e9ac45d54ecf req-f8365b70-c929-429f-8348-ce654127203a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074102 Aug 21 01:10:34.567668 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 587/1068] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:34.699917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:34.701149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:34.710353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.711183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.712871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.714053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.715582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.716570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.769130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:34.777747 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91796a3f-2587-43d4-aae6-e8de5195c1ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.260774 Aug 21 01:10:34.779889 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 482/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:34 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:34.788791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:34.791675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:34.807441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.811161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.812422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.814102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.814560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.814977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:34.884142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:34.902896 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57447168-195b-4ff9-9915-a8f8ef816b1c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.208397 Aug 21 01:10:34.916808 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 588/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:34 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:34.975689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a5c00c-30be-4977-82a9-9a81a38ff941", "name": "network-vif-plugged", "status": "completed", "tag": "e56fb51b-dbea-4d39-a86b-679406b04734"}, {"server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "name": "network-vif-plugged", "status": "completed", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:34.991987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:34.993115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:34.993991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.015568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Creating event network-vif-plugged:e56fb51b-dbea-4d39-a86b-679406b04734 for instance e0a5c00c-30be-4977-82a9-9a81a38ff941 on n-h2-master-1 Aug 21 01:10:35.016082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] Creating event network-vif-plugged:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:10:35.025410 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d7c94bcb-9f67-48df-972d-63f5ed692a2b req-c69344e5-aa9c-443e-ad89-3bca6ee3ed4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053124 Aug 21 01:10:35.026291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 589/1071] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:35.067490 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:35.078708 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc67ce9b-f241-46bc-be67-d16b6459e1b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1462 microversion: 2.1 time: 0.297219 Aug 21 01:10:35.079840 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 483/1072] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:34 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1462 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:35.101192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:35.102885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:35.113288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.116501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.117131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.119545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.121199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.122367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.309662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:35.318392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2c95cad-94a5-4c32-83a3-ee6b2f609a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1462 microversion: 2.1 time: 0.222657 Aug 21 01:10:35.319483 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 590/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:35 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1462 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:35.343247 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2b237727-dd18-4a3b-93a0-049f9a74de32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'create', calling method: .version_select at 0x7fc3fe0efb80>, body: {"keypair": {"name": "tempest-keypair-1301436823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK935fprqfGjqRqPLLxsRbbnLzzcQaGu0uPKMkn9tmpk4auE4ryIsrpkH4GTcBxGhb9O+Zg33Vv+gCP1bnngBV4Az+ZpbcKFfhQgg60sY1PrwzYCDIAr7knD701pmBJnVQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:35.361275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2b237727-dd18-4a3b-93a0-049f9a74de32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:35.366430 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:35.368193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2b237727-dd18-4a3b-93a0-049f9a74de32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:35.399846 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2b237727-dd18-4a3b-93a0-049f9a74de32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060506 Aug 21 01:10:35.400442 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 484/1074] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:10:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:35.530798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:35.532007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:35.539998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.540759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.541382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.542259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.542914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.543484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.548553 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:35.569959 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:35.701263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:35.710382 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71eccdaa-976d-4dbc-8ea4-7a41f6424340 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.183541 Aug 21 01:10:35.711892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 591/1075] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:35 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:35.799672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:35.800739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:35.808648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.809235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.810051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.810892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.811551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.812035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.923636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:35.925949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:35.937137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.938170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.938570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:35.940407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:35.940407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:35.941288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:36.012543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:36.027343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e07b6fcc-4aea-4653-8953-1e73d32e17bb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.230963 Aug 21 01:10:36.028071 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 485/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:35 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:36.153474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:36.168464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-719ffcd5-869e-4e5f-9ecd-a69577c1f065 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.248644 Aug 21 01:10:36.169194 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 592/1077] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:35 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:36.737766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:36.738515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:36.747068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:36.747977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:36.748582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:36.749332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:36.749876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:36.750455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:36.767966 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:37.030967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:37.043352 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7de1a1a-20f7-49bf-8cbe-79bee20822f7 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1477 microversion: 2.1 time: 0.309253 Aug 21 01:10:37.043950 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 486/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:36 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1477 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:37.049247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:37.050458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:37.059350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.059786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.060385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.061133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.061567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.062146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.195478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:37.196476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:37.208965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.212845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.214350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.218559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.220161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.221267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.221417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:37.229502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3526ad9-5c37-4ee4-b236-fb2fd3fcdb74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1310 microversion: 2.1 time: 0.185810 Aug 21 01:10:37.231396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 593/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:37 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:37.462883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:37.472838 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60a4ba72-7f4a-4f0d-b5a4-6d22abbbe616 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.285235 Aug 21 01:10:37.473060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f041b39-f3f1-4d47-bbda-476592112278 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '.version_select at 0x7fc3fa172f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:37.480865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 487/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:37 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:37.481043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f041b39-f3f1-4d47-bbda-476592112278 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.481043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f041b39-f3f1-4d47-bbda-476592112278 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.481043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f041b39-f3f1-4d47-bbda-476592112278 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.489050 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f041b39-f3f1-4d47-bbda-476592112278 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.019794 Aug 21 01:10:37.489654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 594/1081] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:10:37 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:37.514521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c754d3b-b31c-486a-beca-b6461e461b63 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:37.522199 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c754d3b-b31c-486a-beca-b6461e461b63 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013640 Aug 21 01:10:37.522850 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 488/1082] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:10:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:37.534889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b5d7ec1-6642-4b1d-9bf0-60413f61f34a tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-817082000", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:37.537966 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:10:37.537966 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:10:37.555059 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b5d7ec1-6642-4b1d-9bf0-60413f61f34a tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.024128 Aug 21 01:10:37.555645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 595/1083] 10.222.0.46 () {60 vars in 1146 bytes} [Sun Aug 21 01:10:37 2022] POST /compute/v2.1/flavors => generated 498 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:37.567131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-407da211-80f3-4714-b96c-b4e97f070927 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:37.576122 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-407da211-80f3-4714-b96c-b4e97f070927 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012542 Aug 21 01:10:37.576861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 489/1084] 10.222.0.46 () {58 vars in 1182 bytes} [Sun Aug 21 01:10:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:10:37.681379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-400268604", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "a9c95d5d-c6be-415c-a386-b51f2a8d824c"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:37.733410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:37.947199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:37.947634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:37.948094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:37.948483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:37.948920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:37.958297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.958789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.959223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.959935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:37.960378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:37.960801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:37.978364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:37.983192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:37.995237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:37.997651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:38.045840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8cd31d5-d7c9-4167-b9fc-e8a2d01c20bc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.368618 Aug 21 01:10:38.051914 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 596/1085] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:10:38.057875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2720a483-c36d-45f2-88e6-875041e28cab tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.058564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2720a483-c36d-45f2-88e6-875041e28cab tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.068301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.068967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.078255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.078752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.079185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.079894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.080572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.081316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.158016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2720a483-c36d-45f2-88e6-875041e28cab tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:38.165404 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2720a483-c36d-45f2-88e6-875041e28cab tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1278 microversion: 2.1 time: 0.111620 Aug 21 01:10:38.177428 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 490/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.236747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:38.245255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa21e2d8-ed53-40d4-8154-7c266c407cf3 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1463 microversion: 2.1 time: 0.183497 Aug 21 01:10:38.254142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.254923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.260718 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 597/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1463 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.262975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.263697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.264627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.265574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.265688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.266998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.267332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.267929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.273502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.274087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.274611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.275228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.275680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.276100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.440492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:38.443018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:38.451764 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f035ea3-e102-4729-a137-ad23d2eb4bad tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1463 microversion: 2.1 time: 0.189898 Aug 21 01:10:38.452464 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 598/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.454433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d888ea6c-0819-42a0-a61d-039562d78d2b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1492 microversion: 2.1 time: 0.206113 Aug 21 01:10:38.455292 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 491/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1492 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.474479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:38.475001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.475623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.477943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.483021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.483510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.484004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.484653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.485478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.485668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.485931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.486420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.489267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.491704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.492293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.492733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.590295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:38.590613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:38.591147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:38.591615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:38.592088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:38.652863 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:38.669328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.675991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.676577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.677239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.677959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.678507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.679015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.680602 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f70f2c92-fb78-4113-9292-c153b6ba145e tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1643 microversion: 2.1 time: 0.204868 Aug 21 01:10:38.687815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 492/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1643 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.705945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.706971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.722766 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-465613f5-bc23-462a-9158-0c52bb18f8af tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 1067 microversion: 2.1 time: 0.252283 Aug 21 01:10:38.726701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.727395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.727831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.732489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.733877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.735726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.736710 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 599/1091] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:38 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 1067 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 21 01:10:38.741977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.742894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.750951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.751552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.752075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.753054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.753616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.754126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.924895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-721b8bc6-883b-419b-8836-28be52265e9d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1643 microversion: 2.1 time: 0.186744 Aug 21 01:10:38.925725 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 600/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1643 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:38.931548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:38.932478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:38.938801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.939236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.939830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:38.940713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:38.941198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:38.941798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.005310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:39.016573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2696f699-74c4-4b7a-a69d-b99da0e87098 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.326781 Aug 21 01:10:39.017462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 493/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:39.022819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:39.026561 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:10:39.026561 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:10:39.029101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.029782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.030435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.031403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.032657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.033130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.060306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd5dfd21-0381-486e-9125-1552299e295a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041607 Aug 21 01:10:39.061655 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 494/1094] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:10:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:39.073742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:39.074278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:39.081265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.081748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.082179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.082873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.083321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.083738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.104040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:39.113840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c51e1ffa-7c93-4991-a232-a5dad8da1460 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.186802 Aug 21 01:10:39.116812 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 601/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:38 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:39.157351 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-337b06a0-b026-493d-9fc6-4b1eeaa041cd tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941/action" status: 202 len: 0 microversion: 2.1 time: 0.088042 Aug 21 01:10:39.158174 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 495/1096] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:39 2022] POST /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:10:39.167799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:39.168551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:39.175105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.175819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.176353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.177190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.177767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.178272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.188073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:39.189493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:39.200132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.200893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.202077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.202881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:39.203469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:39.203968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:39.294378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:39.307612 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a64e2187-939e-4465-87f3-725b0e85aa5f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1330 microversion: 2.1 time: 0.124202 Aug 21 01:10:39.313953 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 496/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:39 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:39.338148 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d46f7634-b917-484a-bbae-75eaa2babd94 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1648 microversion: 2.1 time: 0.175709 Aug 21 01:10:39.338926 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 602/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:39 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1648 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:40.038511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:40.039372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:40.046041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.046638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.047321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.048211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.048819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.049508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.148441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:40.150086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:40.161187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.161933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.163904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.165233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.166713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.167333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.332650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:40.341583 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8bf3e17-190b-40ad-b17c-71fe6f15764c tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1305 microversion: 2.1 time: 0.307261 Aug 21 01:10:40.346275 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 497/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:40 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1305 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:40.351532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:40.355928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:40.362062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.362736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.363314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.364189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.364795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.365522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.416839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:40.426317 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54d37ed4-a09b-4df6-aa03-e650e057669d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.284606 Aug 21 01:10:40.428116 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 603/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:40 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:40.433205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:40.434278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:40.455220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.455710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.456165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.456906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.457355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.457774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.640031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cf12152-67a5-432c-b4d3-4921288f678a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1628 microversion: 2.1 time: 0.210391 Aug 21 01:10:40.640697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:40.641149 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 604/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:40 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1628 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:40.661409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:40.665393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:40.666747 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8cf1df5-07d6-45d5-aa2a-30db9ee70773 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.317792 Aug 21 01:10:40.669076 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 498/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:40 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:40.687631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.688363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.689008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.689986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:40.690682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:40.691441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:40.722728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lazy-loading 'flavor' on Instance uuid e0a5c00c-30be-4977-82a9-9a81a38ff941 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:10:40.737521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Going to try to live migrate instance to n-h1-master-1 {{(pid=122482) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:10:41.184429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:41.213867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.214600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.215474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.229631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] Creating event network-changed:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:10:41.234377 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-dc669736-efcf-432f-989c-4a7c65f7dc3c req-e25e0d6f-4902-405f-8651-e9d22ba3eec2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054575 Aug 21 01:10:41.235061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 499/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:41.371024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:41.371703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:41.378204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.378673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.379095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.379766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.380204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.380618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.591792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:41.600036 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2ebe5d2-cee0-4739-82bf-bfbf72c5998f tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.233525 Aug 21 01:10:41.600690 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 500/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:41 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:41.605232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:41.605928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:41.612045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.612809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.613393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.614240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.614877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.615324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.777593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:41.785935 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-226a6a16-f42f-4920-b9d8-4249b2b98a4b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.184145 Aug 21 01:10:41.786798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 501/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:41 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:41.803684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:41.804301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:41.811665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.812153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.812589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:41.813344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:41.814012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:41.814436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.014543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4847497-aa5f-4f10-bdc7-7c7d81cb3142 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941/action" status: 202 len: 0 microversion: 2.1 time: 1.356998 Aug 21 01:10:42.016642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 605/1106] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:40 2022] POST /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941/action => generated 0 bytes in 1360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:10:42.025560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:42.026952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:42.037563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:42.049290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.050133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.050398 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f6fa6dd2-e673-4603-afce-f176a25b36ee tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.260851 Aug 21 01:10:42.051668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.052064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 502/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:41 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:42.053069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.054095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.054852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.211528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:42.221047 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0b44e2d-751d-42e2-906a-977c1e0f2363 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.200340 Aug 21 01:10:42.221884 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 606/1108] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:42 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:42.625238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:42.625993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:42.635992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.636665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.637330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.638302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.638937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.639532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.781270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:42.792218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eb2e95e4-bb37-4c40-985a-27fb9124abaf tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.172689 Aug 21 01:10:42.792812 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 503/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:42 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:42.808160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:42.808793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:42.816351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.816870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.817308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.818006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:42.818452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:42.818879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:42.973467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:42.982301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e51e228-892b-4bc6-8c5b-30d2d2fef295 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.178628 Aug 21 01:10:42.982871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 607/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:42 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:43.073349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:43.073982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:43.080202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.080684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.081135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.081830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.082283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.082700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.212920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:43.220868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36a98e9f-546e-427b-9c16-5a426a1e7a56 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.152892 Aug 21 01:10:43.221438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 504/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:43 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:43.242975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:43.243598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:43.250861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.251411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.251778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.252476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.253005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.253434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.385532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:43.393888 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-680b9031-768b-45ed-90b0-5f85aaeb6e12 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.155380 Aug 21 01:10:43.394461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 608/1112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:43 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:43.816648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:43.817693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:43.825600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.826077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.826521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.827186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:43.827635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:43.828058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:43.974271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:43.982737 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-07c770ca-b9fd-459a-9e89-03ebffbffb51 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.172432 Aug 21 01:10:43.983316 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 505/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:43 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:44.003967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:44.004792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:44.012582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.014016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.014456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.015147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.015567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.016017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.161038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:44.170112 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0a29359-3539-4982-ac3e-72b33c546a62 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.170072 Aug 21 01:10:44.170573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 609/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:43 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:44.245804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:44.246841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:44.257107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.257984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.258509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.259196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.259644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.260055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.274965 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:44.414692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:44.415303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:44.421852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:44.422350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.422842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.423327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.424032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:44.424478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:44.424932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:44.429494 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d666f0b1-44ba-4e8a-9fb6-e5de07bfd1d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.190338 Aug 21 01:10:44.430187 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 506/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:44 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:44.582927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:44.591762 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa0cb056-1a74-4580-9dbb-b188b56ff2cb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.181199 Aug 21 01:10:44.592336 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 610/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:44 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:45.008479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:45.009132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:45.016139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.016641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.017093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.017778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.018220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.018633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.191985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:45.192598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:45.201041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.201499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.201966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.202659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.203107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.203527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.363743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:45.372240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2eda26f3-03dc-4c72-8c7a-e870995c0cf9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.184468 Aug 21 01:10:45.383312 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 611/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:45 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:45.439469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:45.449250 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19cd6d48-b6f0-4cd4-ba75-e347108c7027 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.446845 Aug 21 01:10:45.450766 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 507/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:45 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:45.455914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:45.456518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:45.465312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.465796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.466225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.467214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.467963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.468388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.613163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:45.613764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:45.620601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.624440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.624919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.625644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.626097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.626630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.629386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:45.638177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e173f06d-8be6-411a-97ae-a7982368a6f1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.186433 Aug 21 01:10:45.639013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 612/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:45 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:45.822136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:45.830743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ac60f244-f1de-4fee-9c6e-1b08a1c3b8eb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.221319 Aug 21 01:10:45.831831 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 508/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:45 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:45.833296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a5c00c-30be-4977-82a9-9a81a38ff941", "name": "network-vif-unplugged", "status": "completed", "tag": "e56fb51b-dbea-4d39-a86b-679406b04734"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:45.843928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:45.844382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:45.845617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:45.856995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] Creating event network-vif-unplugged:e56fb51b-dbea-4d39-a86b-679406b04734 for instance e0a5c00c-30be-4977-82a9-9a81a38ff941 on n-h2-master-1 Aug 21 01:10:45.863172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8c49d47e-e3f5-43a5-bfb3-cac84db5ce88 req-1c7a7f93-78d5-464c-aeec-90e75b4af7c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034027 Aug 21 01:10:45.863962 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 613/1121] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:46.393523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:46.394227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.401520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.402087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.402731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.403402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.403881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.404504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.514184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e8644f5f-0f07-4168-995d-13085851adaf"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:46.516567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.522946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.523610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.524038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.524730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.525213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.525629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.538510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:46.539506 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:46.546567 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8038e450-f161-45eb-933b-0f12827e8c74 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.156841 Aug 21 01:10:46.547153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 509/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:46 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:46.551724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:46.552332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.558933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.559413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.559844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.560566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.561036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.561455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.697508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:46.700498 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] HTTP exception thrown: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Request method failure captured: Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments/9de9e6ac-8679-48ad-9503-96ed5a23dbd3 HTTP/1.1 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 74 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYW8BG-POG5UH8Sua3tqbIceOqktYP9b7I5kkTa3elqSgEj655Gd4FRNDc5Po17ta8NWy-j76N-YcJ6qkug_yPl4o2FDSoL2iT9e8KEwnB2L15WQWxO1mL6hEfU4VRgDOb6s6Ltv9WxOgKlBZ80Zx1R1o3dxF_1zeFsv9h7eT_z-ypU Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 773ea26cd1f0413bb0a785fb7bc6f04b Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/773ea26cd1f0413bb0a785fb7bc6f04b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_773ea26cd1f0413bb0a785fb7bc6f04b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/773ea26cd1f0413bb0a785fb7bc6f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/773ea26cd1f0413bb0a785fb7bc6f04b"}]}] Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 773ea26cd1f0413bb0a785fb7bc6f04b Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesAdminNegativeTest-1017810714-project-admin Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 784f69623b6e4401a90fc5ab58e9545e Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesAdminNegativeTest-1017810714-project-admin Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: {"volumeAttachment": {"volumeId": "e8644f5f-0f07-4168-995d-13085851adaf"}} Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: exception: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': '9b7fc13f-00b1-4abc-a3f4-108799eede61', 'id': '9de9e6ac-8679-48ad-9503-96ed5a23dbd3', 'body': {'volumeAttachment': {'volumeId': 'e8644f5f-0f07-4168-995d-13085851adaf'}}} Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. (HTTP 404) (Request-ID: req-7f0700e3-31fc-4e56-8b68-b0bcd7cf2b90) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:10:46.704290 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:10:46.708441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Returning 400 to user: Volume e8644f5f-0f07-4168-995d-13085851adaf could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:10:46.711714 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-274e4af4-1407-45f8-9f0f-65e2a01c7ea6 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.157548 Aug 21 01:10:46.711805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53568e36-2f83-4144-8317-5917ef22d1e4 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments/9de9e6ac-8679-48ad-9503-96ed5a23dbd3" status: 400 len: 107 microversion: 2.1 time: 0.309472 Aug 21 01:10:46.711883 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 510/1123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:46 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:46.711957 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 614/1124] 10.222.0.46 () {60 vars in 1433 bytes} [Sun Aug 21 01:10:46 2022] PUT /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments/9de9e6ac-8679-48ad-9503-96ed5a23dbd3 => generated 107 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:10:46.712031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:46.712031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.717031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.717727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.718159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.718846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.719288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.719701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.779584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:46.780072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.787415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.788123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.788552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.789719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.790175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.790599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.857381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:46.867121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f831c9e1-87f9-4a16-911a-3b0f232a8e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.159589 Aug 21 01:10:46.867942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 511/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:46 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:46.888198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:46.888849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:46.899314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.899802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.900886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.901593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:46.902038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:46.902455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:46.924675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lazy-loading 'services' on Instance uuid 9b7fc13f-00b1-4abc-a3f4-108799eede61 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:10:47.041933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:47.048744 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97213fe7-63bc-4349-8d1f-e3427be894a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments/9de9e6ac-8679-48ad-9503-96ed5a23dbd3" status: 202 len: 0 microversion: 2.1 time: 0.272945 Aug 21 01:10:47.049393 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 615/1126] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:10:46 2022] DELETE /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments/9de9e6ac-8679-48ad-9503-96ed5a23dbd3 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:10:47.052837 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f75a235-85be-4aa6-bd9c-ff8de050be56 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.168466 Aug 21 01:10:47.052837 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 512/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:46 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:47.054451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-plugged", "status": "completed", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:47.064314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:47.064474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.064892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.065317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.066594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:47.072897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.073376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.073859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.074559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.075002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.075416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.077620 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] Creating event network-vif-plugged:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:10:47.082426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3b1df6b3-9dee-4b35-b832-f90e5745d9b7 req-9593dbb8-a9c6-495b-baf9-ef3859eec934 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Aug 21 01:10:47.083017 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 616/1128] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:47.106142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f951025-34c9-4990-bc4b-f81ae3d53e90 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Aug 21 01:10:47.106696 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 513/1129] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:47 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:47.572391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:47.573096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:47.579404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.579875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.580298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.581009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.581471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.581875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.724816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:47.726119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:47.726998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:47.732805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86ebce37-c7a0-4442-9921-18d3151ba2a4 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.167995 Aug 21 01:10:47.733509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 617/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:47 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:47.734516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.734970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.735396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.736097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.736537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.736988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.878690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0a5c00c-30be-4977-82a9-9a81a38ff941", "tag": "e56fb51b-dbea-4d39-a86b-679406b04734"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:47.879805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:47.888555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.888842 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5aae7cfd-3614-4837-bd5a-aa0576fb28d9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.166249 Aug 21 01:10:47.894632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.894821 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 514/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:47 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:47.894921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.895009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:47.895009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:47.901288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.901727 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] Creating event network-changed:e56fb51b-dbea-4d39-a86b-679406b04734 for instance e0a5c00c-30be-4977-82a9-9a81a38ff941 on n-h2-master-1 Aug 21 01:10:47.901853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.902205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.902905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:47.903353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:47.903767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:47.906769 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-964941fd-4632-48a1-97e8-921364f8e1e6 req-1ce48e9f-b295-4aaf-bd41-0b62bcbd1016 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Aug 21 01:10:47.907405 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 618/1132] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:48.067924 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.068692 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.073564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:48.074265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:48.081573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.082054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.082496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.083210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.083676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.084121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.089722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:48.099641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-79cb6e62-e432-40e3-a04f-ceea8a48d042 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.209005 Aug 21 01:10:48.100810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 515/1133] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:47 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:48.119725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:48.122538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:48.135134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.141813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.142502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.143320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.143844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.144920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.163949 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.183504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83ab7ba3-a002-46b6-96fe-ec1a0b5eece4 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068220 Aug 21 01:10:48.184287 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 516/1134] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:48 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:48.252210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:48.262485 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26b50753-dc88-458b-8be2-65413f99b37a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.195420 Aug 21 01:10:48.264548 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 619/1135] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:48 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:48.754278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:48.755099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:48.763796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.764273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.764925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.765773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.766495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.766617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.910080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:48.910680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:48.917600 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:48.919684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.920154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.920962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.921685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:48.922141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:48.922558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:48.926641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:48.936295 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-454ac4d9-e231-444e-8223-c29b66a0fe51 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.185855 Aug 21 01:10:48.949365 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 517/1136] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:48 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:49.066705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:49.075994 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bdb59a8b-2854-41c2-8496-25ad9a0afbbc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.169904 Aug 21 01:10:49.077005 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 620/1137] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:48 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:49.118976 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:49.123602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:49.124220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:49.137010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.137010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.137010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.137010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.137453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.137711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.197019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:49.199386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:49.205839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.207685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.208146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.208860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.209325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.210499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.240135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6af757f-6f46-483b-b576-e0fae3bda348 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Aug 21 01:10:49.241295 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 621/1138] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:49 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:49.282987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:49.283607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:49.286865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:49.291048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.291528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.291958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.292730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.293115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.293526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.294789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16b90698-f1c3-4f20-a41d-ffb2b03d5a2b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1378 microversion: 2.1 time: 0.176672 Aug 21 01:10:49.297618 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 518/1139] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:49 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1378 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:49.422952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:49.431150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0097c574-b1b9-49fa-b417-b7ac1766afc2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.152011 Aug 21 01:10:49.431756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 622/1140] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:49 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:49.961490 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:49.962116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:49.970122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.970781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.971222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:49.971925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:49.972375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:49.972808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.097241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.098686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.109135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.110167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.110904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.111791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.112637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.113278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.159479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.169700 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b07b5ddc-a78e-4866-981b-1693b9ab6f66 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.214228 Aug 21 01:10:50.170647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 519/1141] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:49 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:50.252103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.254731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.261732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.262352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.262912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.263865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.264525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.265079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.272666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.283156 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08a18189-cd7d-4ba8-9640-8ee208d7d07a tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.189366 Aug 21 01:10:50.285146 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 623/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:50.297108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-626ae544-a1bd-4794-88c9-8a519f46709e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049111 Aug 21 01:10:50.297849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 520/1143] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:50.315780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.316484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.322992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.323544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.324035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.324975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.325482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.325956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.452574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.453488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.459714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.460464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.461074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.462097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.462851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.463425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.472636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.485599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff902115-f6e7-4cae-ad64-38e89c784783 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1527 microversion: 2.1 time: 0.173324 Aug 21 01:10:50.487857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 624/1144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:50.506634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.507557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.514705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.515388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.515970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.516848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.517443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.518020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.673679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.683716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06890ff2-6363-4462-b375-60533978fbce tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1527 microversion: 2.1 time: 0.180618 Aug 21 01:10:50.684398 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 625/1145] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:50.695005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.705595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e905f642-9df4-48a9-97b1-221f16a35bd8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.707015 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:10:50.707015 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:10:50.709809 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d870a3f2-c7f6-4993-b1e7-22d443408aed tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.261288 Aug 21 01:10:50.710875 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 521/1146] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:50.731154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e905f642-9df4-48a9-97b1-221f16a35bd8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/a9c95d5d-c6be-415c-a386-b51f2a8d824c" status: 202 len: 0 microversion: 2.1 time: 0.029488 Aug 21 01:10:50.732176 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 626/1147] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:10:50 2022] DELETE /compute/v2.1/flavors/a9c95d5d-c6be-415c-a386-b51f2a8d824c => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:10:50.740253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6fd0cd0-d9d4-48ed-b622-b267d38853d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:50.761786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6fd0cd0-d9d4-48ed-b622-b267d38853d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.025439 Aug 21 01:10:50.762541 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 522/1148] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:10:50 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:50.782044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:50.784419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:50.791021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.791502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.791928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.792622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:50.793101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:50.793517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:50.881793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:50.890425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Old instance type tempest-test_resize_flavor_-817082000, new instance type m1.heat {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:10:50.900185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:50.900529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:50.901034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:50.901440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:50.901851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:51.021966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1996a79-3de7-4118-8387-fc0ca610740f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0/action" status: 202 len: 0 microversion: 2.1 time: 0.244399 Aug 21 01:10:51.023001 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 627/1149] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:10:50 2022] POST /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:10:51.032701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:51.033323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:51.046485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.046971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.047585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.048458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.049087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.049652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.199501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:51.200522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:51.219563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.223905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.224450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.225234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.225985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.227599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.307679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:51.316547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c33ba3a-de3d-46e3-bbdd-3dd36bad4c37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1536 microversion: 2.1 time: 0.288732 Aug 21 01:10:51.317494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 523/1150] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:51 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1536 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:51.323223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970cdff0-7cdd-485c-b8d9-5ef7351b8990", "name": "network-vif-plugged", "status": "completed", "tag": "f6b0b79c-66d3-486a-a132-508aae6a65b4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:51.334119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.334909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.336525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.352189 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:51.355187 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] Creating event network-vif-plugged:f6b0b79c-66d3-486a-a132-508aae6a65b4 for instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 on n-h1-master-1 Aug 21 01:10:51.361696 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-45073ea6-01be-4b39-9671-d78a53ff3780 req-e94f9461-2589-4571-8410-6cb4c644952e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042510 Aug 21 01:10:51.362969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 524/1151] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:51.368680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:51.369886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:51.388271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.389420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.389919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.390950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.391617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.392382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.512541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:51.525980 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b8d01df-b9d5-4fd5-878d-8d03267c0224 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.334321 Aug 21 01:10:51.526604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 628/1152] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:51 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:51.534583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:51.537619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:51.544039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.549736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.551047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.552292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.553015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.553745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.606708 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4ecbc43-0711-459c-8e49-382d652873fc tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078020 Aug 21 01:10:51.607735 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 629/1153] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:51 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:51.694424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:51.703874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-adb5f88a-050b-445e-a3ca-ae0476fd3bba tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.339502 Aug 21 01:10:51.704455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 525/1154] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:51 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:51.731123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:51.731861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:51.738553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.739032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.739462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.740151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:51.740633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:51.741078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:51.879712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:51.888211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-327c33f1-34cc-41d4-8c92-6900fc9042e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.160922 Aug 21 01:10:51.889005 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 630/1155] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:51 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:52.343581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:52.344472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:52.357018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.357698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.358342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.359454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.360123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.360694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.502307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:52.511933 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02e6facf-90ca-4574-b006-0c232361c122 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1536 microversion: 2.1 time: 0.173655 Aug 21 01:10:52.512494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 526/1156] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:52 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:52.551655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:52.552358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:52.559815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.560296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.560724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.561485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.561987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.562413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.619642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:52.621889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:52.633507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.634001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.634430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.635359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.636274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.636884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.674650 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a00bad3-cd13-427d-be81-94e4a931f1ac tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058990 Aug 21 01:10:52.675542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 527/1157] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:10:52 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:10:52.724603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:52.725249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:52.733465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.733921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.734345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.735206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.735804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.736625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.777349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:52.780923 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:52.790820 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb889c76-14d6-45e7-bebd-ab3b8d2038f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.242974 Aug 21 01:10:52.809833 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 631/1158] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:52 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:52.874113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-327589568", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "aac520b3-13de-4f64-925a-a1a9fa9a25f1"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:52.895714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:52.904192 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6ffa465-1de9-4030-b4c6-ab24a99b7b20 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1293 microversion: 2.1 time: 0.183994 Aug 21 01:10:52.904794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 528/1159] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:52 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:52.909465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:52.910058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:52.912927 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:52.916660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.917196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.917597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.918471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:52.918966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:52.919419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:52.934188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] validate_networks() for [('aac520b3-13de-4f64-925a-a1a9fa9a25f1', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:53.059520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:53.067416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-619b2f07-a8d0-4ff7-b475-24727c09d1d7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1502 microversion: 2.1 time: 0.161627 Aug 21 01:10:53.068030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 529/1160] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:52 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:53.319119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:53.319940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:53.320416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:53.320804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:53.321561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:53.333824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.335021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.335021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.335655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.336082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.336711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.355422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for project 238f21f4c486416caa3eb44c58d2b452. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:53.360826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Getting quotas for user 9174038735de4d78b4ad527105d06624 and project 238f21f4c486416caa3eb44c58d2b452. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:53.374783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:53.377528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:53.427359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8220cf62-ad78-44fb-ae70-9bd371ecd8a2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557101 Aug 21 01:10:53.427978 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 632/1161] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:10:53.438972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9130f4d9-741c-4b68-8e84-cc100eb2d029 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:53.439574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9130f4d9-741c-4b68-8e84-cc100eb2d029 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:53.534767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:53.535464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:53.542586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.543168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.543691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.544525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.545098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.545648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.554851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9130f4d9-741c-4b68-8e84-cc100eb2d029 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:53.562386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9130f4d9-741c-4b68-8e84-cc100eb2d029 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1217 microversion: 2.1 time: 0.127386 Aug 21 01:10:53.563528 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 530/1162] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:53 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:53.689716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:53.702281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-046883c2-e061-43a7-98ff-c8529f387963 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1536 microversion: 2.1 time: 0.171210 Aug 21 01:10:53.703212 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 633/1163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:53 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:53.818120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:53.818737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:53.826663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.827363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.827796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.828502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.828971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.829718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.928822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:53.929561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:53.939448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.940234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.940864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:53.941720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:53.942445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:53.943093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.096887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:54.098421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:54.106523 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b366648-20d1-45ea-a1ee-18df17686d49 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1482 microversion: 2.1 time: 0.183400 Aug 21 01:10:54.107396 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf08c1ac-1384-4e27-8312-3ced4cc15eaa tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.293219 Aug 21 01:10:54.107971 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 531/1164] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:53 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.112577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.113007 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 634/1165] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:53 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1482 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.113744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:54.121790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.122273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.122699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.123416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.123860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.124271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.129020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.129020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:54.141267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.142445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.142445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.143330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.143953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.144467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.256182 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b136372f-1dcd-40db-8228-df8d43cebce1 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133821 Aug 21 01:10:54.257023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 635/1166] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:54.331184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:54.341943 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7c5d2b84-b3ed-4825-b374-3c034f6859b0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1477 microversion: 2.1 time: 0.232900 Aug 21 01:10:54.342729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 532/1167] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.363923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0aecfca6-629e-4658-aa98-87e779a61237 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '.version_select at 0x7fc3f9cb5820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.368641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0aecfca6-629e-4658-aa98-87e779a61237 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.369183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0aecfca6-629e-4658-aa98-87e779a61237 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.369621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0aecfca6-629e-4658-aa98-87e779a61237 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.381474 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0aecfca6-629e-4658-aa98-87e779a61237 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2733 microversion: 2.1 time: 0.022002 Aug 21 01:10:54.382090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 636/1168] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/os-migrations => generated 2733 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.401235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.401848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:54.409217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.409708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.410139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.411079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.411621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.412046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.545148 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a148ab58-6fdc-4fe3-9b96-c6a9fc32fc6f tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1628 microversion: 2.1 time: 0.147707 Aug 21 01:10:54.546083 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 533/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1628 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.583923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.584569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-616dc9f6-9d09-4f85-a780-17bd85049758 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: .version_select at 0x7fc3f9b8f160>, body: {"keypair": {"name": "tempest-keypair-1098711560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAJLXOARkg1rs9CTj9Xephs/boqZVU7FAoULoivVN1OqZXLYNFaXklPQ4E6vReji0dOevClF/GiHZMUkKL2sVd8xFH3Qfm3C/RLG4cNK/1tiDb8cQCDT4lPQaKyQQ62UA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:54.585017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:54.591668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.592348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.592953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.593807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.594410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.594971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.606165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-616dc9f6-9d09-4f85-a780-17bd85049758 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for project 6073ae2e8036492faa2a4f7a26489134. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:54.619601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-616dc9f6-9d09-4f85-a780-17bd85049758 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for user b0bd3eeeb578465a8f5e5eaa3b3fdc85 and project 6073ae2e8036492faa2a4f7a26489134. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:54.652692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-616dc9f6-9d09-4f85-a780-17bd85049758 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072470 Aug 21 01:10:54.653621 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 637/1170] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:10:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:54.673463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:54.684869 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c624233-bbf0-4acc-bcfd-f478cee82f7a tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1269 microversion: 2.1 time: 0.104539 Aug 21 01:10:54.684869 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 534/1171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:54.728608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:54.729252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:54.737159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.742099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.743591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:54.744350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:54.744844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:54.745272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:55.084562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:55.093939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-038e4ae6-6934-4adf-8ee5-b18e30b7e115 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.373529 Aug 21 01:10:55.094651 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 638/1172] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:54 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:55.145925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:55.146531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:55.154395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:55.154877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:55.155298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:55.156313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:55.156969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:55.157630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:55.461727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:55.471445 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76d59022-8524-44c8-b12d-6146cf8f4504 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.329502 Aug 21 01:10:55.472834 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 535/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:55 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:55.706621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:55.707310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:55.716391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:55.717306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:55.717989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:55.719516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:55.720337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:55.721000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.031199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:56.043873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:56.045487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:56.047359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fdfe5978-d25c-47b8-a6f1-2bc131de465b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.344512 Aug 21 01:10:56.048305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 639/1174] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:55 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:56.068748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.071691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.072605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.078386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.079036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.082615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.089916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970cdff0-7cdd-485c-b8d9-5ef7351b8990", "tag": "f6b0b79c-66d3-486a-a132-508aae6a65b4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:56.101994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.102639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.103468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.118603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] Creating event network-changed:f6b0b79c-66d3-486a-a132-508aae6a65b4 for instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 on n-h1-master-1 Aug 21 01:10:56.124753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8dcdc7ce-8528-4616-8e3f-b69527565fc9 req-43afc38e-2bdf-4af0-8e4e-e74e95be88cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038583 Aug 21 01:10:56.125969 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 640/1175] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:10:56.132619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:56.133579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:56.141328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.142155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.142750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.143620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.144491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.145084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.378729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:56.390821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f7e14cd-d3ed-4097-b111-50a1cf27ad88 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.263458 Aug 21 01:10:56.392213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 641/1176] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:56 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:56.494626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:56.495245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:56.502270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.503616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.504314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.505840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.506552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.507896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:56.711693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:56.723580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f48d7be6-d944-401b-9851-b13489ee0c9d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.233503 Aug 21 01:10:56.725097 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 642/1177] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:56 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:56.777019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:56.792799 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26b18465-4fdb-475a-a2ee-cb8ef905c686 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1482 microversion: 2.1 time: 0.755279 Aug 21 01:10:56.793918 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 536/1178] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:56 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1482 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:56.943245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be", "tag": "8ea10899-f345-4d30-9d98-bd8970efcc5b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:56.971626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:56.972518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:56.974039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.007633 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] Creating event network-changed:8ea10899-f345-4d30-9d98-bd8970efcc5b for instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be on n-h1-master-1 Aug 21 01:10:57.014124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a76f9a04-08da-457e-a9ad-3c9ab8742531 req-f767fc9a-3d92-49fc-aba7-b0c44c098240 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081730 Aug 21 01:10:57.015267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 643/1179] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:10:57.049789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-988932201", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "89ad451d-4568-43da-b498-e71b39d2698e"}], "security_groups": [{"name": "tempest-securitygroup--1938394365"}], "key_name": "tempest-keypair-1098711560", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:10:57.071555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:57.074158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:57.082402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.083046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.083867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.084564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.085025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.085719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.265469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:57.275436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-181f7064-678a-4092-9d69-b9a54b464672 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.211076 Aug 21 01:10:57.276253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 644/1180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:57 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:57.297299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] validate_networks() for [('89ad451d-4568-43da-b498-e71b39d2698e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:10:57.411950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:57.413083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:57.419400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.419878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.420328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.421068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.421518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.421937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.564831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:57.574033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-925df1e1-8a51-4a02-b704-4942115925ef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.166036 Aug 21 01:10:57.574613 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 645/1181] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:57 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:57.745494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:57.746099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:57.753019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.753496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.753920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.754594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.755040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.755455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.894948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:57.902927 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f60c6f74-20e7-4d0f-beaa-dd5a1dab432a tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.161377 Aug 21 01:10:57.903578 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 646/1182] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:57 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:57.959597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:10:57.959998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:10:57.960428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:10:57.960968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:10:57.961347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:10:57.970551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.971043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.971518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.972251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:57.972690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:57.973134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:57.990667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:10:57.995610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for user b0bd3eeeb578465a8f5e5eaa3b3fdc85 and project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:10:58.008134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:10:58.010450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:10:58.061065 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c61451a3-a287-4afe-999a-00fcb58a4644 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.015847 Aug 21 01:10:58.062030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 537/1183] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:10:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:10:58.072969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1af5d0b1-3561-4ac5-99ae-a506b8cc5edf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:58.073530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1af5d0b1-3561-4ac5-99ae-a506b8cc5edf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:58.133140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1af5d0b1-3561-4ac5-99ae-a506b8cc5edf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:58.141264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1af5d0b1-3561-4ac5-99ae-a506b8cc5edf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1234 microversion: 2.1 time: 0.072498 Aug 21 01:10:58.141999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 647/1184] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:58 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1234 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:58.301875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:58.302841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:58.309458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.309975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.310414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:58.311238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.311770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.312363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:58.452919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:58.461899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45e82b71-fefe-40dd-8955-a6ed33ba4b9c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.167272 Aug 21 01:10:58.462715 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 538/1185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:58 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:10:58.595654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:58.596401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:58.602911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.603390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.603810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:58.604507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.604988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.605404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:58.747415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:58.756356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f532384-b6f8-4759-a046-f8c515b31f7a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.164593 Aug 21 01:10:58.757095 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 648/1186] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:58 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:58.924918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:58.925644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:58.932460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.932973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.933403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:58.934092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:58.934537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:58.934951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.077317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:59.085847 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0cb22c7c-2a00-4154-8719-7aea4a20aee2 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.165481 Aug 21 01:10:59.086434 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 539/1187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:58 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:59.164380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:59.165224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:59.171327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.171807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.172238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.172957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.173403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.173819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.251784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:10:59.262823 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28b7c90a-17fd-47f1-952e-f34e2a641069 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1294 microversion: 2.1 time: 0.103833 Aug 21 01:10:59.263688 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 649/1188] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:59 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:10:59.483254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:59.484174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:59.491671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.492452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.492911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.493626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.494105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.494503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.778087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:10:59.778778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:10:59.785783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.786277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.786696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:10:59.787393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:10:59.787846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:10:59.788335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:00.142696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:00.151073 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bacc911-7fd2-481f-ade0-4e7307d49b1c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.376961 Aug 21 01:11:00.151745 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 650/1189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:59 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:00.156556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:00.157263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:00.163750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:00.164300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:00.164852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:00.165532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:00.165973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:00.166383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:00.264164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:00.274179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed6374cd-6570-49b9-a9df-9851306548b3 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.794775 Aug 21 01:11:00.275040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 540/1190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:10:59 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:00.284542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:00.285155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:00.291665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:00.292505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:00.292984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:00.293679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:00.294344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:00.294768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:00.311556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:00.320690 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef0e2e98-fe63-41da-a288-0960e18c2583 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.167797 Aug 21 01:11:00.328891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 651/1191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:00 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:00.405051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:00.413131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f068f4cc-2085-4ad6-8995-11001236b088 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1292 microversion: 2.1 time: 0.132906 Aug 21 01:11:00.413923 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 541/1192] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:00 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:01.172822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:01.173451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:01.186786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.187283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.187885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.191440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.191928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.193364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.296212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:01.297043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:01.308000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.314356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.314913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.315880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.316454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.316999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.371817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:01.382370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b4544cf-0f0d-42d5-b3d4-5d66f9643284 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.213232 Aug 21 01:11:01.396690 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 652/1193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:01 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:01.402061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:01.402883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:01.406799 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:01.410897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.411547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.412174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.413162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.413852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.414419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.442061 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:01.541305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:01.549144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9be545b-edf3-401a-8c03-20219ee83f1b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.257225 Aug 21 01:11:01.550311 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 542/1194] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:01 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:01.555764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:01.557359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:01.563907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.564670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.565453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.566473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.567064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.567909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:01.571997 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:01.580389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:01.589545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f28b5d2a-e1ac-4c6e-a120-c41dfff80ae9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.191171 Aug 21 01:11:01.590316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 653/1195] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:01 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:01.807079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:01.815821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d667fc8c-d625-40e7-99f9-3c636c3e909b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.264251 Aug 21 01:11:01.816617 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 543/1196] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:01 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:01.983173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:01.994831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:01.996559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:01.997332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.009308 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] Creating event network-changed:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h2-master-1 Aug 21 01:11:02.014720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-68274d25-c1b3-4376-8802-a450bfd0130d req-c70a7d50-20f0-491c-a143-b5fbae179c56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036952 Aug 21 01:11:02.015927 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 654/1197] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:02.403090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:02.403877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:02.410792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.411266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.411687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.412369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.412842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.413489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.556315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:02.565077 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef1daeda-47a3-4654-9d83-a4d8eeadfec5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.165860 Aug 21 01:11:02.565729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 544/1198] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:02 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:02.571306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:02.572192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:02.579524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.580132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.580572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.581304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.581753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.582172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.610711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:02.611312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:02.617626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.618102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.618528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.619218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.619664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.620076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.721471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:02.730854 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af076563-9ef2-4d7f-8d8d-fb75792f9bef tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.164131 Aug 21 01:11:02.731675 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 655/1199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:02 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:02.758158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:02.766118 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af5d7960-f85f-4349-8f6c-c29e8716d3f0 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.159308 Aug 21 01:11:02.766677 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 545/1200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:02 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:02.837851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:02.838471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:02.847300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.848097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.848816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.849921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:02.850680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:02.851735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:02.998067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:03.005921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-545e75e7-e7ca-4bf6-9109-c51b4689457c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.172347 Aug 21 01:11:03.006416 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 656/1201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:02 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:03.205445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be", "name": "network-vif-plugged", "status": "completed", "tag": "8ea10899-f345-4d30-9d98-bd8970efcc5b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:03.215129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.215606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.216061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.227305 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] Creating event network-vif-plugged:8ea10899-f345-4d30-9d98-bd8970efcc5b for instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be on n-h1-master-1 Aug 21 01:11:03.232289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1f67000b-a36a-40d6-aac8-f458768bd9f1 req-eacb4e80-88cd-4817-861c-4689d2eb67d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 Aug 21 01:11:03.233089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 546/1202] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:03.588252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:03.588908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:03.591111 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:03.598230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.598805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.599279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.600049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.600730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.601282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.736485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:03.744471 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c2d69e2-109d-4f9f-b750-32feb927c0c7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.160880 Aug 21 01:11:03.745057 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 657/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:03 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:03.752642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:03.753349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:03.759985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.760526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.761022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.761761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.762203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.762695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.788556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:03.789321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:03.795634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.796185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.796617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.797337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:03.797787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:03.798203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:03.902661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:03.910473 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae16b649-0def-4b51-9198-c79c876e763b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.162776 Aug 21 01:11:03.911049 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 547/1204] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:03 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:03.936076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:03.943948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3500360d-5e6b-4c1c-b233-bd9a437713ce tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.159814 Aug 21 01:11:03.945249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 658/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:03 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:04.028507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:04.029104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:04.036634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.037138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.037578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.039018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.039471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.039894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.176179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:04.184659 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92d87334-7059-412b-a2ab-5eb9d9a04839 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.160941 Aug 21 01:11:04.185305 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 548/1206] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:04 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:04.775926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:04.777030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:04.789113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.789587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.790016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.790709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.791149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.791565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.922916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:04.931103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85ddbcd5-95d4-41b7-b06c-081fe93b152c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.162460 Aug 21 01:11:04.931673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 659/1207] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:04 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:04.932206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:04.932818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:04.940071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.940556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.941101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.941799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.942247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.942670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.966312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:04.966917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:04.973069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.973541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.973965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:04.974945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:04.975149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:04.975668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:05.078860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:05.086970 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c70cc070-0c6c-4528-95b2-ba3d97c6bd88 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.159304 Aug 21 01:11:05.087551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 549/1208] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:04 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:05.109001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:05.117175 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a6cc091-1473-4427-955d-0d3fe8996f1c tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.154667 Aug 21 01:11:05.117775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 660/1209] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:04 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:05.210068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:05.210748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:05.217444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:05.218270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:05.218699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:05.219393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:05.219840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:05.220257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:05.360729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:05.372881 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cdc8c5a6-fd4f-449b-a7ee-748fe956e142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.169420 Aug 21 01:11:05.373722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 550/1210] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:05 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:05.953557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:05.954145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:05.961811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:05.962349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:05.962778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:05.963470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:05.963919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:05.964332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.107794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:06.108487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:06.117975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.118807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.119429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.120623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.121268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.121894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.143276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:06.174767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee3eb311-2997-4f8f-893a-a6d9a0a46892 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.225526 Aug 21 01:11:06.176743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 661/1211] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:05 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:06.183235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:06.184230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:06.205230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.205983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.207144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.208385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.209245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.210363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.384314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:06.394289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9093659a-0d4d-4945-958b-ee3090869fda tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1317 microversion: 2.1 time: 0.290379 Aug 21 01:11:06.399126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:06.405201 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 551/1212] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:06 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:06.407517 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2968435-2cab-4852-b48b-f4e2ce63609e tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1472 microversion: 2.1 time: 0.229542 Aug 21 01:11:06.408134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 662/1213] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:06 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:06.412968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:06.413747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:06.419866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.420435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.420962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.421713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:06.422221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:06.422640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:06.560674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:06.568663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9384a79d-c97c-4502-89cc-ed8dbf35327a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.162346 Aug 21 01:11:06.569304 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 552/1214] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:06 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:07.196502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.197167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.204808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.205396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.205835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.206624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.207049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.207526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.327786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.328419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.335505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.336056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.336451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.337227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.337671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.338129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.348226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:07.356583 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b404d4d-f870-4c1e-b0f9-b3446453bc1e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.164802 Aug 21 01:11:07.357231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 663/1215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:07 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:07.364210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:07.417912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.418606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.425721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.426295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.426744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.427450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.427900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.428321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.448892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba0ff01b-1578-48b1-a318-165c46b75cb8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 204 len: 0 microversion: 2.1 time: 0.124849 Aug 21 01:11:07.450197 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 553/1216] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:07 2022] DELETE /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:11:07.456515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.457547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.464074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.464572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.465078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.465780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.466302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.466780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.585842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:07.594411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77b6719d-feb9-4c37-9c89-30279d067ec6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1507 microversion: 2.1 time: 0.180393 Aug 21 01:11:07.595105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 664/1217] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:07 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:07.599942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.601343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.607324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.607812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.608244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.609039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:07.609199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.609883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.610315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.617793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf515cd2-3cfc-4c17-82e7-019e5f7e21d8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1478 microversion: 2.1 time: 0.166040 Aug 21 01:11:07.618446 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 554/1218] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:07 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1478 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:07.628077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:07.629144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:07.636517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.637136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.637633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.638371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:07.638918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:07.639624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:07.746199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:07.754735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6125181-df8a-4dcc-85fe-9b7165fb5c19 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1712 microversion: 2.1 time: 0.158616 Aug 21 01:11:07.755577 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 665/1219] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:07 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1712 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:07.781045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:07.789629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13ef0c20-e976-4bd9-858d-8297eca5806c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.166137 Aug 21 01:11:07.790209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 555/1220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:07 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:08.265099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "name": "network-vif-plugged", "status": "completed", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:08.272035 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:08.279711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.280479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.280959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.294998 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] Creating event network-vif-plugged:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h2-master-1 Aug 21 01:11:08.300637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ddec9d6e-3e70-439e-ad9d-817d4844cd25 req-d36b2325-d60b-4f7c-a7ff-d5707f7d5bbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038987 Aug 21 01:11:08.301574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 666/1221] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:08.378616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:08.379231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:08.381556 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:08.382873 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:08.392443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.392957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.393394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.394129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.394577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.394998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.539571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:08.550683 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4678d482-da22-4a2a-9bd4-9661bd311d66 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.176050 Aug 21 01:11:08.551285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 556/1222] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:08 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:08.639815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:08.640962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:08.649367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.650190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.650849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.651741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.652385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.653030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.776736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:08.777379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:08.783558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.784032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.784461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.785166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.785617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.786034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.794032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:08.803381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd2cdd59-b061-4200-a8f8-ada0e169f76d tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1478 microversion: 2.1 time: 0.167484 Aug 21 01:11:08.804113 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 667/1223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:08 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1478 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:08.822570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:08.823320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:08.830492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.831075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.831596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.832368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:08.832902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:08.833505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:08.977625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:08.982784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:08.988505 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcbb4b6c-90ba-45b3-8c9b-e365f72f27f5 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1712 microversion: 2.1 time: 0.215682 Aug 21 01:11:08.989392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 557/1224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:08 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1712 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:08.996154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eff13a13-d00c-4414-a816-4dc1b5814199 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.177960 Aug 21 01:11:08.996945 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 668/1225] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:08 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:09.003449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "823cb54c-0adc-46a1-b096-752853bd44a1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:09.005891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:09.012557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.013059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.013489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.014190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.014633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.015035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.084087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] HTTP exception thrown: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Request method failure captured: Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be/os-volume_attachments/63cfdb30-20b9-448b-a022-753a186a591a HTTP/1.1 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 74 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYW8BG-POG5UH8Sua3tqbIceOqktYP9b7I5kkTa3elqSgEj655Gd4FRNDc5Po17ta8NWy-j76N-YcJ6qkug_yPl4o2FDSoL2iT9e8KEwnB2L15WQWxO1mL6hEfU4VRgDOb6s6Ltv9WxOgKlBZ80Zx1R1o3dxF_1zeFsv9h7eT_z-ypU Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 773ea26cd1f0413bb0a785fb7bc6f04b Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/773ea26cd1f0413bb0a785fb7bc6f04b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_773ea26cd1f0413bb0a785fb7bc6f04b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/773ea26cd1f0413bb0a785fb7bc6f04b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/773ea26cd1f0413bb0a785fb7bc6f04b"}]}] Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 773ea26cd1f0413bb0a785fb7bc6f04b Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1017810714 Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesAdminNegativeTest-1017810714-project-admin Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 784f69623b6e4401a90fc5ab58e9545e Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesAdminNegativeTest-1017810714-project-admin Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: {"volumeAttachment": {"volumeId": "823cb54c-0adc-46a1-b096-752853bd44a1"}} Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: exception: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be', 'id': '63cfdb30-20b9-448b-a022-753a186a591a', 'body': {'volumeAttachment': {'volumeId': '823cb54c-0adc-46a1-b096-752853bd44a1'}}} Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. (HTTP 404) (Request-ID: req-4124fb63-88f0-4293-ae8c-337d9ec72057) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:11:09.088049 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] Returning 404 to user: Volume 63cfdb30-20b9-448b-a022-753a186a591a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:09.092836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8444d0e3-1967-4851-a956-9426ad320e68 tempest-VolumesAdminNegativeTest-1017810714 tempest-VolumesAdminNegativeTest-1017810714-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be/os-volume_attachments/63cfdb30-20b9-448b-a022-753a186a591a" status: 404 len: 109 microversion: 2.1 time: 0.099034 Aug 21 01:11:09.097109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 558/1226] 10.222.0.46 () {60 vars in 1433 bytes} [Sun Aug 21 01:11:08 2022] PUT /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be/os-volume_attachments/63cfdb30-20b9-448b-a022-753a186a591a => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:09.571989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:09.572760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:09.580141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.580978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.581416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.582123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.582581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.583024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.723074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:09.731853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d41611e-76f2-41ac-be7a-e83a61a6dd5d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.164191 Aug 21 01:11:09.732428 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 669/1227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:09 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:09.826842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:09.827467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:09.835339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.835912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.836353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.837107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:09.837559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:09.837981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:09.843303 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:09.977592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:09.986273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2c39228-a614-453a-8122-16eb046ef17b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1463 microversion: 2.1 time: 0.166123 Aug 21 01:11:09.995631 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 559/1228] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:09 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:10.016102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.016752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.025878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:10.028153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.034361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.034972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.035290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.036277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.036409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.036837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.044564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.054966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.055407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.056128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.056577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.057022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.144526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc28daf6-4d2d-4821-bcc2-566ef3e79c03 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.124153 Aug 21 01:11:10.145745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 560/1229] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:11:10 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:10.150937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.151537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.158337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.158822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.159251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.159942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.160645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.161096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.189968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:10.199982 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed595345-302d-4550-a76e-d7df1c66ce2d tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1712 microversion: 2.1 time: 0.189515 Aug 21 01:11:10.200558 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 670/1230] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1712 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:10.205444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.206046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.212873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.213885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.214426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.215395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.215945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.216436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.244095 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:10.257742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.258276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.258707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.259153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lazy-loading 'fault' on Instance uuid 39ad2a8a-0292-465a-82f4-721071f3c1cf {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:10.313532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:10.323521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0cb9ba90-4764-49cc-878e-03b9b3782101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1360 microversion: 2.1 time: 0.176560 Aug 21 01:11:10.324204 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 561/1231] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:10.389313 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3375f198-cb59-4817-bd46-5d0b6368bb3f tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1597 microversion: 2.1 time: 0.186827 Aug 21 01:11:10.390132 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 671/1232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1597 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:10.410003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:10.413831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.420441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.421393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.421840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.422568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.423020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.423436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.509085 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7c61f490-46af-41e7-bf2c-d5d7522c7421 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.102853 Aug 21 01:11:10.509845 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 562/1233] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:11:10 2022] POST /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:10.518248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.518941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.525900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.526461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.526979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.528217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.528217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.528740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.664065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-256c8e80-019c-4b48-822a-449645a215c1 tempest-ServersAdminTestJSON-589773241 tempest-ServersAdminTestJSON-589773241-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1614 microversion: 2.1 time: 0.149531 Aug 21 01:11:10.677042 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 672/1234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:10.685726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.686569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.692818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.693376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.694019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.695380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.696453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.697065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.724832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:10.754497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.755499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.767253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.768162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.769421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.770284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.770843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.771326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.843443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4646b6e-2707-472c-b265-a8f0c7fedff9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 204 len: 0 microversion: 2.1 time: 0.161436 Aug 21 01:11:10.844922 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 563/1235] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:10 2022] DELETE /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:10.853619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:10.854569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:10.856690 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:10.862289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.862988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.863576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.864413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:10.865035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:10.865600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:10.968197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:10.976860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e14bc055-ea37-4b83-be50-8fe8443c6049 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.227005 Aug 21 01:11:10.977759 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 673/1236] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:11.077817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:11.085904 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42d660ff-8512-41b9-92e8-bf1438d9c3f8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1470 microversion: 2.1 time: 0.237005 Aug 21 01:11:11.099242 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 564/1237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:10 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:11.221767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.222383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:11.228660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.229573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.230076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.230859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.231531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.232288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.311618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db969e85344bb6a40150cedc205df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c81f6af23f174318870b6ef8633f5cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:11.322124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0569d39-9078-4f7d-b23b-0f62ad510fbe tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 200 len: 1645 microversion: 2.1 time: 0.104142 Aug 21 01:11:11.333072 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 674/1238] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:11 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 1645 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:11.344667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.345298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:11.351913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.352493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:11.354586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.355069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.355493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.356184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.356624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.357065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.360510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.361269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.362081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.364250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.365153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.365868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.407920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:11.529168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0949ea8a-e367-482d-9931-d1e9760d38ae tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 204 len: 0 microversion: 2.1 time: 0.181263 Aug 21 01:11:11.530017 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 675/1239] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:11 2022] DELETE /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:11.535873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "name": "network-vif-plugged", "status": "completed", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:11.547876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.548362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.548824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.567012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] Creating event network-vif-plugged:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:11:11.572996 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c934356b-20f0-410d-93a4-0abee6417be1 req-9d5eba7a-408c-4541-b2f7-61623867bbae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041778 Aug 21 01:11:11.573945 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 676/1240] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:11.582056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.583002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:11.592745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.593804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.594505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.595715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.596613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.597287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.630604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:11.642909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21d30859-2c78-49ec-9370-8134bc573324 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1543 microversion: 2.1 time: 0.298327 Aug 21 01:11:11.644069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 565/1241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:11 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1543 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:11.660903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083884b8-1dc6-40b1-92b8-0d67af962ab7", "name": "network-vif-deleted", "tag": "7651feac-9dde-44da-9a1f-302b7a036f8c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:11.689571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.690853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.692739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.709123 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] Creating event network-vif-deleted:7651feac-9dde-44da-9a1f-302b7a036f8c for instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 on n-h2-master-1 Aug 21 01:11:11.715589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cf8d972a-f840-493c-addc-0a68f635a879 req-7023d53d-462d-4b45-b015-fc029f60d01c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062211 Aug 21 01:11:11.720383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 566/1242] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:11.726650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.727495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:11.734895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.735689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.736365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.737359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:11.738111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:11.738814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:11.804297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:11.823180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bf1690f-a2bc-4dec-9aea-dc8bf146e80e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1513 microversion: 2.1 time: 0.246035 Aug 21 01:11:11.825561 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 677/1243] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:11 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:11.837566 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-757aab2e-133a-428c-91be-1cb63801ddb7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115454 Aug 21 01:11:11.838223 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 567/1244] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:11:11 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:11.998529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:11.999005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.005184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.005664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.006122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.006850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.007489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.007909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.108053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.108748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.115794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.116642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.117337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.118048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.118712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.119324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.338828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:12.348182 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64260810-927b-4889-b926-b11ce81881a5 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1470 microversion: 2.1 time: 0.244663 Aug 21 01:11:12.349258 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 568/1245] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:12 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:12.368362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.370268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.387170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.389317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.389767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.390480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.390926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.391338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.408062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:12.425510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7983eac-c9cd-438c-9960-1ad8b0e9c0a3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.431157 Aug 21 01:11:12.426655 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 HTTP/1.1 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '083884b8-1dc6-40b1-92b8-0d67af962ab7'} Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.428512 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.433481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:12.434650 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0bb01f67-6dd7-42b3-bd86-30c0a9bc8f01 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 404 len: 111 microversion: 2.1 time: 0.080696 Aug 21 01:11:12.435214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 569/1246] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:12 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:12.447946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.448894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 678/1247] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:11 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:12.449039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.458973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.459773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.460034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.460923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.462366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.464179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.498294 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad HTTP/1.1 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '65f3ee72-efe7-436d-8834-88e9a01ef0ad'} Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:12.501249 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.505221 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.508847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:12.510127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb69831f-dbe4-42b6-8bb4-4d445b61f8b8 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 404 len: 111 microversion: 2.1 time: 0.070657 Aug 21 01:11:12.511516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 570/1248] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:12 2022] DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:12.520428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.521362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.531445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.531935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.532368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.542428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.543256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.544376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.564760 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad HTTP/1.1 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '65f3ee72-efe7-436d-8834-88e9a01ef0ad'} Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.566951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:12.571463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:12.573388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:12.575071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c45e83b2-8c6b-465b-91ac-753de03f30d9 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 404 len: 111 microversion: 2.1 time: 0.059528 Aug 21 01:11:12.576154 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 679/1249] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:12 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:11:12.585451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87737de3-c91e-417c-ac52-2b54a79bcb8b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '.version_select at 0x7fc3fdd7eee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.610815 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87737de3-c91e-417c-ac52-2b54a79bcb8b tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473760196" status: 202 len: 0 microversion: 2.1 time: 0.030163 Aug 21 01:11:12.611498 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 571/1250] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:11:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473760196 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:12.847458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:12.848076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:12.856803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.857309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.857745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:12.858587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:12.859048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:12.859645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.161814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:13.169829 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7393ce5-dbf7-45e5-ba8c-169d422a5076 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1513 microversion: 2.1 time: 0.326590 Aug 21 01:11:13.170415 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 680/1251] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:12 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:13.371246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:13.372137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:13.379908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:13.380546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:13.381279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.382230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:13.382979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:13.383493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.458336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:13.461029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:13.468861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:13.469762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:13.471283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.472208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:13.472870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:13.473472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.539703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:13.547885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd26b5e2-21d4-4d9a-ab41-df9ae3018a0f tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1470 microversion: 2.1 time: 0.181345 Aug 21 01:11:13.549330 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 572/1252] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:13 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:13.732258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:13.744360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:13.744809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:13.745405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:13.760125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] Creating event network-changed:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h2-master-1 Aug 21 01:11:13.765897 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ab85c057-ac1d-4e28-8f55-224df30a39b2 req-6757c2fa-7459-4f09-af40-4ce7b6d58bd3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041556 Aug 21 01:11:13.766495 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 573/1253] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:13.838531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:13.849402 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f87f5a4c-1375-4163-93bc-0c03f965341b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.396693 Aug 21 01:11:13.857235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 681/1254] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:13 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:13.935767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc7fce45-dbb3-4f35-92c1-7c08b9b61a29 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:13.936898 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:13.936898 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:13.956886 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc7fce45-dbb3-4f35-92c1-7c08b9b61a29 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/778805818" status: 202 len: 0 microversion: 2.1 time: 0.025563 Aug 21 01:11:13.957822 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 574/1255] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:11:13 2022] DELETE /compute/v2.1/flavors/778805818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:13.966284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b87cbf8-971e-49aa-a808-018cc99d3cb3 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:13.991546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b87cbf8-971e-49aa-a808-018cc99d3cb3 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.028969 Aug 21 01:11:13.992900 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 682/1256] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:11:13 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:14.010580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c08ce03-401b-4987-9571-8284b5cafb1a tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.028613 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c08ce03-401b-4987-9571-8284b5cafb1a tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1816049612" status: 202 len: 0 microversion: 2.1 time: 0.021876 Aug 21 01:11:14.029288 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 575/1257] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:11:14 2022] DELETE /compute/v2.1/flavors/1816049612 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:14.041905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a844e2b3-fcfd-4f15-936a-959197459907 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.064042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a844e2b3-fcfd-4f15-936a-959197459907 tempest-ServersWithSpecificFlavorTestJSON-2002646985 tempest-ServersWithSpecificFlavorTestJSON-2002646985-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029635 Aug 21 01:11:14.065113 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 683/1258] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:14.091651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.092306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.099143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.099637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.100096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.101196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.101667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.102303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.117156 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 HTTP/1.1 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '083884b8-1dc6-40b1-92b8-0d67af962ab7'} Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:14.118867 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:14.122631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-670b4d4c-2ac3-4fe2-8f22-02423e339966 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 404 len: 111 microversion: 2.1 time: 0.032660 Aug 21 01:11:14.125387 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 576/1259] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:14 2022] DELETE /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:14.138141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.141097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 083884b8-1dc6-40b1-92b8-0d67af962ab7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.147261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.147814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.148270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.149066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.149515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.150098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.164934 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 HTTP/1.1 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '083884b8-1dc6-40b1-92b8-0d67af962ab7'} Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.166871 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. Aug 21 01:11:14.171366 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.172980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 083884b8-1dc6-40b1-92b8-0d67af962ab7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:14.173994 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cda6ace0-ae24-46e6-9330-95de14ad5c8a tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7" status: 404 len: 111 microversion: 2.1 time: 0.049026 Aug 21 01:11:14.177624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 684/1260] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/servers/083884b8-1dc6-40b1-92b8-0d67af962ab7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:14.183767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.186082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.192688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.193084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.193733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.194193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.194610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.195836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.196496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.197164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.205349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.206129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.206272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.209285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.212417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.213593 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.213864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad HTTP/1.1 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '65f3ee72-efe7-436d-8834-88e9a01ef0ad'} Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:14.215278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:14.219009 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-229f8f09-4e0f-4361-94d6-cb845f794fd7 tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 404 len: 111 microversion: 2.1 time: 0.037146 Aug 21 01:11:14.220672 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 577/1261] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:14 2022] DELETE /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:14.226254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.226828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] [instance: 65f3ee72-efe7-436d-8834-88e9a01ef0ad] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.233544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.234118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.234625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.235405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.235917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.236405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.252101 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] HTTP exception thrown: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Request method failure captured: Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad HTTP/1.1 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYUyV6Cs1znRS-N5MwjVV2FB7_JMG8xfvXTdorHy2Uz0_koQ7CULc1A-RM5UUqrqbdCrGGpFrf3BVecy_WefXannCnvrxyLp9RzXA59z3eEbAn0OgIY69NJv2cADliOvRXdEGnt1HMFZ7KnjReaJVXT2vyHXDPlIznKX61H7Q5ZxkW4 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c81f6af23f174318870b6ef8633f5cf3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c81f6af23f174318870b6ef8633f5cf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c81f6af23f174318870b6ef8633f5cf3"}]}] Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c81f6af23f174318870b6ef8633f5cf3 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 52db969e85344bb6a40150cedc205df8 Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-476445960-project Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '65f3ee72-efe7-436d-8834-88e9a01ef0ad'} Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.254148 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] Returning 404 to user: Instance 65f3ee72-efe7-436d-8834-88e9a01ef0ad could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d2023da8-03cb-418e-8f6e-54bcd69d5f8e tempest-ServersWithSpecificFlavorTestJSON-476445960 tempest-ServersWithSpecificFlavorTestJSON-476445960-project] 10.222.0.46 "GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad" status: 404 len: 111 microversion: 2.1 time: 0.033524 Aug 21 01:11:14.258573 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 578/1262] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/servers/65f3ee72-efe7-436d-8834-88e9a01ef0ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:14.455560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:14.471844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6318500-d86f-4c2b-8170-b7f7014eb49c tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1513 microversion: 2.1 time: 0.283677 Aug 21 01:11:14.473336 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 685/1263] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:14.570849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.573006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.580570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.581483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.582163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.583082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.583858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.584723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.590018 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:14.870944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:14.871589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:14.878118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.878854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.879292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:14.879983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:14.880684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:14.881133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.116978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:15.127925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:15.137469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13542ad4-d613-4e8d-923d-123a87ea0271 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.270464 Aug 21 01:11:15.147949 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 686/1264] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:15.151666 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec8ef9f1-e868-459a-a2af-9812b665f6ca tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1470 microversion: 2.1 time: 0.585497 Aug 21 01:11:15.153395 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 579/1265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:14 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1470 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:15.505573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:15.506278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:15.506543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:15.507159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:15.524059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.525475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.525616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.526531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.526914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.527073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.527668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.528126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.528586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.531451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.532307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.532423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.656209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:15.705718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:15.716075 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04eb5f9f-5c6e-4598-a346-de75d0c596d2 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1471 microversion: 2.1 time: 0.213415 Aug 21 01:11:15.716665 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 580/1266] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:15 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:15.734368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec1e2ac-c307-4c49-812c-2052e0dabf4c", "name": "network-vif-deleted", "tag": "8d249384-0f30-4305-af30-94860da13c84"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:15.759400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.760075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.762286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.788542 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] Creating event network-vif-deleted:8d249384-0f30-4305-af30-94860da13c84 for instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c on n-h1-master-1 Aug 21 01:11:15.806790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a96b491f-9ded-4e15-9511-13cd0312b155 req-1cbc184a-8595-40e7-a57c-b26d33eb4cd6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087039 Aug 21 01:11:15.807624 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 581/1267] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:15.852611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-07de87cd-42c0-43f7-a798-e2db7ee65e11 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "DELETE /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 204 len: 0 microversion: 2.1 time: 0.347611 Aug 21 01:11:15.858734 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 687/1268] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:15 2022] DELETE /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:15.863437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:15.864463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:15.881413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.881922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.882514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:15.883256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:15.884229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:15.885168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.043628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:16.057429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5912bb2-967e-410c-bfa9-23b92c77f683 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1665 microversion: 2.1 time: 0.193325 Aug 21 01:11:16.058102 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 582/1269] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:15 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1665 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:16.160305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:16.161227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:16.168870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.169247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.169672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.170555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.170995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.171409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.174131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:16.175218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:16.182115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.182943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.183539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.184361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.185293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.185929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.196088 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:16.230620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.231291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.231956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.232373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lazy-loading 'fault' on Instance uuid 1ec1e2ac-c307-4c49-812c-2052e0dabf4c {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:16.341259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:16.351253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:16.353362 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6829a565-099c-4be3-acf7-96553d9d3c25 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.198631 Aug 21 01:11:16.361413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1d0205f-bd3b-4352-839c-55660f214e18 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1304 microversion: 2.1 time: 0.191978 Aug 21 01:11:16.364803 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 583/1270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:16 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:16.365809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 688/1271] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:16 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:16.738775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:16.739678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:16.746707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.747298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.747821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.748622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:16.749295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:16.749983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:16.852404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:16.860729 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dab44aed-6016-45f6-ab5a-8fd798f1cf9b tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1302 microversion: 2.1 time: 0.126294 Aug 21 01:11:16.861333 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 584/1272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:16 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1302 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:17.082446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:17.083177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:17.091377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.092055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.092538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.093310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.093898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.094329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.256369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:17.264592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b8477bc-72cd-4ac5-ad79-4ac3eaa82b40 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1665 microversion: 2.1 time: 0.186829 Aug 21 01:11:17.265188 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 689/1273] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:17 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1665 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:17.377515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:17.378122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:17.384931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:17.385624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.385855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:17.386472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.387149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.388843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.389455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.390026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.393883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.394363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.395120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.396098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.397725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.399430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.447977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.448468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.449058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.449521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lazy-loading 'fault' on Instance uuid 1ec1e2ac-c307-4c49-812c-2052e0dabf4c {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:17.492919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:17.501923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8be8d9f-d90e-487c-94c6-608b67658605 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 200 len: 1304 microversion: 2.1 time: 0.122172 Aug 21 01:11:17.502689 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 690/1274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:17 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:17.711974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:17.720014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-96a7bb13-6ce1-4614-9ddb-0ca6536aa71a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.347818 Aug 21 01:11:17.733053 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 585/1275] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:17 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:17.834421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be", "name": "network-vif-deleted", "tag": "8ea10899-f345-4d30-9d98-bd8970efcc5b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:17.854359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.855588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.856515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.883200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:17.888637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:17.906528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.909687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.910945 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] Creating event network-vif-deleted:8ea10899-f345-4d30-9d98-bd8970efcc5b for instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be on n-h1-master-1 Aug 21 01:11:17.911571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.912505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.916525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.917259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.927261 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3c45a207-b2d4-4646-90cc-5497fa3dca29 req-ce552343-362c-48c6-aab5-0183c84ebf2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097267 Aug 21 01:11:17.929461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 691/1276] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:11:17.961824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:17.962388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:17.963287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:17.963745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lazy-loading 'fault' on Instance uuid b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:18.090847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:18.099238 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d253aad0-ab4f-449b-ab5a-52dd7658a9c8 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 200 len: 1307 microversion: 2.1 time: 0.220029 Aug 21 01:11:18.100123 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 586/1277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:17 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:18.290098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:18.290801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:18.297359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.297813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.298292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.299007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.299944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.300370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.524144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:18.525817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 1ec1e2ac-c307-4c49-812c-2052e0dabf4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:18.535599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.536107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.536731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.538397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.538898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.539432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.555227 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] HTTP exception thrown: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Request method failure captured: Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c HTTP/1.1 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYW8Tv01USgxttP9QsyVxLhxprYEAZMjVLMslKyREklY5FsVPvURIAptRqEnZigy4OGq-4W81zgHX2MohMmiCt_QfSVBTEzN4OBUGurR_CubI9E9jgH7IacSJPKq96pvYHwRXBnLUhB8cqITaoJ5UPgTPyMfGLY5Xhx3IMNF1jdwInE Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b094e07a54b4d908fb9fcb60b1c87bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}] Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 897d73e68cc44589ac64edfb23770a66 Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '1ec1e2ac-c307-4c49-812c-2052e0dabf4c'} Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:18.556906 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Returning 404 to user: Instance 1ec1e2ac-c307-4c49-812c-2052e0dabf4c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bbf474c-2fdc-40b6-a791-41b4d722899b tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c" status: 404 len: 111 microversion: 2.1 time: 0.039362 Aug 21 01:11:18.562104 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 587/1278] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:18 2022] GET /compute/v2.1/servers/1ec1e2ac-c307-4c49-812c-2052e0dabf4c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:18.566732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:18.567485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:18.575201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.575898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.576495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.577396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.578020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.578623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.597764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:18.617847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:18.631231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19048148-4cf1-4693-b94a-ae25440d7f32 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1665 microversion: 2.1 time: 0.347533 Aug 21 01:11:18.637080 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 692/1279] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:18 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1665 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:18.705621 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-06c737b4-fa65-45ba-a163-bce3b8fbd317 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 204 len: 0 microversion: 2.1 time: 0.141979 Aug 21 01:11:18.706640 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 588/1280] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:18 2022] DELETE /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:18.718412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:18.719331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:18.726563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.727555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.728174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.729128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.729932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.730578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.745888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:18.746589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:18.766901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.767406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.768749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.769518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:18.770016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:18.770375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:18.957809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:18.966481 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ee578fa-77c3-4017-8626-392db25c6e02 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.228327 Aug 21 01:11:18.967665 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 589/1281] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:18 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:18.978739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:18.988724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b61bd1b-9ebc-4ea6-8b0a-02218a82eb24 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1469 microversion: 2.1 time: 0.275553 Aug 21 01:11:18.990546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 693/1282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:18 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:19.122837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:19.123450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:19.138736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.139225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.139668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.140370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.144128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.144842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.165973 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] HTTP exception thrown: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Request method failure captured: Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be HTTP/1.1 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWhAX0W-D1fmEixQJ3dMb4x9l-xBXY1d4_iJJaf3HpWBHxJ0kbv873S9v41wkeo4jHChMD4v1TVaS_DIS61vSRM9oY7geLgXHzM2RjmpQcPH7DTK57h4cDPG-Zxp7OTuiUvNe0-TZpd9BFdr60NTuAZm_pb0DdcmhQZ-m6BenR_gpE Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 238f21f4c486416caa3eb44c58d2b452 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/238f21f4c486416caa3eb44c58d2b452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_238f21f4c486416caa3eb44c58d2b452", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/238f21f4c486416caa3eb44c58d2b452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/238f21f4c486416caa3eb44c58d2b452"}]}] Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 238f21f4c486416caa3eb44c58d2b452 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesAdminNegativeTest-2091872975-project Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9174038735de4d78b4ad527105d06624 Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesAdminNegativeTest-2091872975-project Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be'} Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:19.168648 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. Aug 21 01:11:19.174509 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:19.176132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Returning 404 to user: Instance b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:19.177275 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1322ea25-7291-4c5b-84e9-4da47d129a8f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be" status: 404 len: 111 microversion: 2.1 time: 0.058498 Aug 21 01:11:19.178194 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 590/1283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:19 2022] GET /compute/v2.1/servers/b88d6323-b7a2-4fd7-8fa4-474bd8d7a5be => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:19.665427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:19.669509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:19.698698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.699899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.700453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.701377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.702172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.702923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.781741 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:19.792316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.794055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.794779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.795509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lazy-loading 'fault' on Instance uuid 71e56241-4887-4b48-80d6-863cb0d93f39 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:19.938670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3cbcb0d2844ef78896e6044136e786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c67ffccd1f747798e073cb3aed71dda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:19.947691 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c00736c3-e689-49c3-9337-71886b7e85a2 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 200 len: 1314 microversion: 2.1 time: 0.291862 Aug 21 01:11:19.948281 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 694/1284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:19 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:19.969406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e56241-4887-4b48-80d6-863cb0d93f39", "name": "network-vif-deleted", "tag": "62111f2b-0fe4-4fd4-909e-6f38509c7153"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:19.985494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:19.986242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:19.986827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:19.995817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:19.997224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:20.001136 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] Creating event network-vif-deleted:62111f2b-0fe4-4fd4-909e-6f38509c7153 for instance 71e56241-4887-4b48-80d6-863cb0d93f39 on n-h1-master-1 Aug 21 01:11:20.007870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.009750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-423d812a-9c9d-4ddb-910b-f6aebd781dde req-1254ee18-2ca0-4f30-b8b4-7a672c95a7b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043859 Aug 21 01:11:20.011014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 591/1285] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:20.027207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:20.027717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.028509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:20.028973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:20.029568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.030285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.030869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:20.039537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.040478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.043331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:20.045198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.045838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.046464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:20.234253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:20.249124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4b93b46-9ba4-436f-8c50-1bd9c5f56909 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.262533 Aug 21 01:11:20.250047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 695/1286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:19 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:20.263585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:20.286012 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0eacb2b-a6c1-4c8e-a292-de9b394474c8 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1469 microversion: 2.1 time: 0.273524 Aug 21 01:11:20.286603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 592/1287] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:20 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:20.975479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:20.977977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] [instance: 71e56241-4887-4b48-80d6-863cb0d93f39] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:20.985893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.986749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.987519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:20.988569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:20.989849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:20.992751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:21.013750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] HTTP exception thrown: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Request method failure captured: Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 HTTP/1.1 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYXvo4_hmFHCFYVIT9JnMhPaauPRogDooauzUBcYhHF6HaM5g6TbSHCDNFU_mtMICg5m7Y4olIQip-BZf1jnWRXTxPAblhYipO6edvJtF0Qrg-o3AZrjSr38PRaTr-GSBbPftd3nc6Xq0J-ngtyP_txbsqixzmZYbx9g1tar7gptuB0 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9c67ffccd1f747798e073cb3aed71dda Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestFqdnHostnames-1880825758 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c67ffccd1f747798e073cb3aed71dda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c67ffccd1f747798e073cb3aed71dda", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c67ffccd1f747798e073cb3aed71dda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c67ffccd1f747798e073cb3aed71dda"}]}] Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestFqdnHostnames-1880825758 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9c67ffccd1f747798e073cb3aed71dda Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1880825758 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestFqdnHostnames-1880825758-project Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: ef3cbcb0d2844ef78896e6044136e786 Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestFqdnHostnames-1880825758-project Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '71e56241-4887-4b48-80d6-863cb0d93f39'} Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:21.016266 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. Aug 21 01:11:21.021264 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:21.025486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Returning 404 to user: Instance 71e56241-4887-4b48-80d6-863cb0d93f39 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:21.026770 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5513f81e-14a5-4e2f-87dc-0c73cac3861d tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39" status: 404 len: 111 microversion: 2.1 time: 0.060262 Aug 21 01:11:21.028794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 696/1288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:20 2022] GET /compute/v2.1/servers/71e56241-4887-4b48-80d6-863cb0d93f39 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:21.042987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62510b85-ece4-4022-8669-188cf1bb3877 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] Calling method '.version_select at 0x7fc3fdd78310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:21.079022 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62510b85-ece4-4022-8669-188cf1bb3877 tempest-ServersTestFqdnHostnames-1880825758 tempest-ServersTestFqdnHostnames-1880825758-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49416603" status: 202 len: 0 microversion: 2.1 time: 0.045666 Aug 21 01:11:21.080490 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 593/1289] 10.222.0.46 () {58 vars in 1215 bytes} [Sun Aug 21 01:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49416603 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:21.282529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:21.283401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:21.303889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:21.312124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:21.313564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:21.321962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:21.327299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:21.329062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:21.332508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:21.335382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:21.336204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:21.337060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:21.338515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:21.343298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:21.350433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:21.354073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:21.567256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:21.582801 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28f50dca-e775-462b-8bbf-ba0711df9c06 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 200 len: 1299 microversion: 2.1 time: 0.274705 Aug 21 01:11:21.583390 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 594/1290] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:21 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:21.818840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:21.835230 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a9f418b-36fd-4c89-ad11-190a9a2647c6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.565250 Aug 21 01:11:21.852639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 697/1291] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:21 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:22.198520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4faf18-6966-40a5-b84e-f92cddd58982", "name": "network-vif-deleted", "tag": "d534adbc-f58f-46f7-81d0-9a20484c70a3"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:22.222222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.222736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.223159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.244603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] Creating event network-vif-deleted:d534adbc-f58f-46f7-81d0-9a20484c70a3 for instance 9a4faf18-6966-40a5-b84e-f92cddd58982 on n-h2-master-1 Aug 21 01:11:22.257542 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b5954c2b-85c6-4df7-b71b-e41a79d84f53 req-744f9fe8-0568-4e9b-8f11-6d4bde8d623c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065969 Aug 21 01:11:22.258157 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 595/1292] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:22.622709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:22.624272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 9a4faf18-6966-40a5-b84e-f92cddd58982] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:22.634469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.635372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.636199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.637990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.638608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.639240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.662863 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] HTTP exception thrown: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Request method failure captured: Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 HTTP/1.1 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYW8Tv01USgxttP9QsyVxLhxprYEAZMjVLMslKyREklY5FsVPvURIAptRqEnZigy4OGq-4W81zgHX2MohMmiCt_QfSVBTEzN4OBUGurR_CubI9E9jgH7IacSJPKq96pvYHwRXBnLUhB8cqITaoJ5UPgTPyMfGLY5Xhx3IMNF1jdwInE Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b094e07a54b4d908fb9fcb60b1c87bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}] Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 897d73e68cc44589ac64edfb23770a66 Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9a4faf18-6966-40a5-b84e-f92cddd58982'} Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:22.670381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. Aug 21 01:11:22.676089 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:22.679328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Returning 404 to user: Instance 9a4faf18-6966-40a5-b84e-f92cddd58982 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:22.680083 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a4dc408-ba95-41e0-9e78-14038511f833 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982" status: 404 len: 111 microversion: 2.1 time: 0.073999 Aug 21 01:11:22.680706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 698/1293] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:22 2022] GET /compute/v2.1/servers/9a4faf18-6966-40a5-b84e-f92cddd58982 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:22.690371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:22.690958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:22.704103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.704589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.705219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.706087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.706695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.711969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.781314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:22.837113 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:22.858228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:22.858780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:22.868784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.869303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.869739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.870463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.874971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.875497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.916387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b099f5c2-777e-483f-a35b-85ee4e49b071 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "DELETE /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 204 len: 0 microversion: 2.1 time: 0.230498 Aug 21 01:11:22.917612 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 596/1294] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:22 2022] DELETE /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:11:22.927418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:22.928574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:22.952844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.953845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.954502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:22.955412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:22.956066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:22.956691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:23.179092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:23.198024 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-710459a4-3c74-4fcd-818d-d276d2e88707 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.344072 Aug 21 01:11:23.199223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 699/1295] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:22 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:23.239361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:23.252133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5217c7eb-8a02-49c6-9559-1e1192288469 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1469 microversion: 2.1 time: 0.330346 Aug 21 01:11:23.253466 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 597/1296] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:22 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:23.677436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:23.678787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:23.685505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:23.686096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:23.686606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:23.687414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:23.687969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:23.688479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:23.718556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:23.814254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a6377fd-b488-4a96-8de1-038fc0b77d87 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 204 len: 0 microversion: 2.1 time: 0.140687 Aug 21 01:11:23.815372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 700/1297] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:23 2022] DELETE /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:11:23.823642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:23.824262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:23.836444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:23.837191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:23.837773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:23.838674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:23.839151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:23.839675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:24.026764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:24.035418 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e4d47d80-eb9b-46fc-93a6-be93805e2857 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1680 microversion: 2.1 time: 0.215945 Aug 21 01:11:24.051791 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 598/1298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:23 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:24.221706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:24.222994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:24.231103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:24.231692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:24.232182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:24.232926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:24.233381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:24.233798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:24.274917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:24.276640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:24.280936 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:24.286531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:24.287417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:24.287851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:24.288579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:24.289411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:24.289832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:24.477722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:24.491403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d7dbfc7-9f2d-47af-9b6a-634b61e862f9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1469 microversion: 2.1 time: 0.221376 Aug 21 01:11:24.494250 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 599/1299] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:24 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:24.527627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:24.536504 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0e9d69d-44de-4b27-a434-e33e1bee21b1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.320344 Aug 21 01:11:24.537359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 701/1300] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:24 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:25.058123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:25.059024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:25.066449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.067284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.067937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.068850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.069580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.070555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.410639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:25.422972 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6831d325-d957-4f53-83d9-d04f444d2775 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1680 microversion: 2.1 time: 0.368409 Aug 21 01:11:25.437372 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 600/1301] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:25 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1680 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:25.518089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:25.519448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:25.528981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.530266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.530996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.532035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.532652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.533258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.559431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:25.560702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:25.586936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.587538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.587991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.589225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:25.589734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:25.590162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:25.749715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:25.761579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-966de298-094c-48aa-bb0b-6ad9f4835817 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1469 microversion: 2.1 time: 0.249600 Aug 21 01:11:25.772610 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 702/1302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:25 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:25.959223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:25.968396 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21df259f-1031-4339-96fe-a563044c4344 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.414356 Aug 21 01:11:25.969176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 601/1303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:25 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:26.443564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:26.444281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:26.451186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:26.451955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:26.452658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:26.453208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:26.453748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:26.454301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:26.597294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:26.605986 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-975f5f48-14ad-4c80-bdb7-907b08d0dee7 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1680 microversion: 2.1 time: 0.165637 Aug 21 01:11:26.618547 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 703/1304] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:26 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:26.787173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:26.794799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:26.804614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:26.805424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:26.806234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:26.808059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:26.808758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:26.809438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:26.855709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fccf9d2c-4ccc-4d18-beca-ced0afded12c tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-213618053", "id": 2058848940, "os-flavor-access:is_public": "True"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:26.858956 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:26.858956 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:26.890126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fccf9d2c-4ccc-4d18-beca-ced0afded12c tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.211964 Aug 21 01:11:26.892883 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 602/1305] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:11:26 2022] POST /compute/v2.1/flavors => generated 470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:26.905524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c0c0c32-752b-46ca-b1bc-58abd394ebff tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:26.908210 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:26.908210 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:27.270283 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c0c0c32-752b-46ca-b1bc-58abd394ebff tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2058848940/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.368925 Aug 21 01:11:27.271540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 603/1306] 10.222.0.46 () {62 vars in 1265 bytes} [Sun Aug 21 01:11:26 2022] POST /compute/v2.1/flavors/2058848940/os-extra_specs => generated 62 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:27.282834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:27.288011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:27.297980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:27.298827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:27.299429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:27.300516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:27.301286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:27.301883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:27.535880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897d73e68cc44589ac64edfb23770a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b094e07a54b4d908fb9fcb60b1c87bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:27.542981 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:27.546641 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a4ba589-c4c1-41fb-a374-029a55e707db tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 200 len: 1469 microversion: 2.1 time: 0.765656 Aug 21 01:11:27.547569 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 704/1307] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:26 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 1469 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:27.567443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad2a8a-0292-465a-82f4-721071f3c1cf", "name": "network-vif-deleted", "tag": "414ff6ae-48a7-46f9-8bb6-6cebf60a0c09"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:27.589668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:27.590539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:27.591158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:27.595534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:27.606729 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] Creating event network-vif-deleted:414ff6ae-48a7-46f9-8bb6-6cebf60a0c09 for instance 39ad2a8a-0292-465a-82f4-721071f3c1cf on n-h1-master-1 Aug 21 01:11:27.610308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-03cb6364-522f-40d7-ad21-65f5e5b7dd30 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.336280 Aug 21 01:11:27.612942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 604/1308] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:27 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:27.623839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14b9b7d7-5176-49eb-be12-cd2c9a643d09 tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:27.626722 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e8b0e184-b93d-4650-9346-017de4301631 req-cb61daf0-f2d4-486d-a469-c3a1996610c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063803 Aug 21 01:11:27.627349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 705/1309] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:27.628281 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:27.628281 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:27.645769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:27.646895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:27.666619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:27.667124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:27.667566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:27.677089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:27.680001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:27.680501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:27.698119 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14b9b7d7-5176-49eb-be12-cd2c9a643d09 tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2058848940" status: 202 len: 0 microversion: 2.86 time: 0.081714 Aug 21 01:11:27.703421 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 605/1310] 10.222.0.46 () {60 vars in 1202 bytes} [Sun Aug 21 01:11:27 2022] DELETE /compute/v2.1/flavors/2058848940 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:27.722300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-210a75e8-c7ad-4807-bd43-176db1fc9c80 tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:27.757011 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-210a75e8-c7ad-4807-bd43-176db1fc9c80 tempest-FlavorMetadataValidation-392979355 tempest-FlavorMetadataValidation-392979355-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.050446 Aug 21 01:11:27.758358 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 606/1311] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:11:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:11:27.804287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:27.828975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a116eeab-f0c9-4781-a8bd-d86752bcd319 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1612 microversion: 2.1 time: 0.200237 Aug 21 01:11:27.832657 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 706/1312] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:27 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1612 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:28.575058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:28.575859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] [instance: 39ad2a8a-0292-465a-82f4-721071f3c1cf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:28.591653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.594849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.596817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.598323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.600541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.601293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.624551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] HTTP exception thrown: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. Aug 21 01:11:28.634137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:28.634766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Request method failure captured: Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf HTTP/1.1 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYW8Tv01USgxttP9QsyVxLhxprYEAZMjVLMslKyREklY5FsVPvURIAptRqEnZigy4OGq-4W81zgHX2MohMmiCt_QfSVBTEzN4OBUGurR_CubI9E9jgH7IacSJPKq96pvYHwRXBnLUhB8cqITaoJ5UPgTPyMfGLY5Xhx3IMNF1jdwInE Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b094e07a54b4d908fb9fcb60b1c87bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b094e07a54b4d908fb9fcb60b1c87bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b094e07a54b4d908fb9fcb60b1c87bf"}]}] Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1b094e07a54b4d908fb9fcb60b1c87bf Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminTestJSON-2057983 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 897d73e68cc44589ac64edfb23770a66 Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminTestJSON-2057983-project Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '39ad2a8a-0292-465a-82f4-721071f3c1cf'} Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:28.645750 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:28.654097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] Returning 404 to user: Instance 39ad2a8a-0292-465a-82f4-721071f3c1cf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:28.655633 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2097208d-14da-4190-b24c-2636a6e402b9 tempest-ServersAdminTestJSON-2057983 tempest-ServersAdminTestJSON-2057983-project] 10.222.0.46 "GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf" status: 404 len: 111 microversion: 2.1 time: 0.079412 Aug 21 01:11:28.655898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.657668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 607/1313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:28 2022] GET /compute/v2.1/servers/39ad2a8a-0292-465a-82f4-721071f3c1cf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:28.657783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.657783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.658361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.658968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.659408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.859962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:28.861000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:28.881167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.882347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.883225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.884306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:28.889433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:28.895357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:28.908484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:28.917142 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c44f347-e824-42d2-ac47-88c09c094751 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1541 microversion: 2.1 time: 0.289370 Aug 21 01:11:28.925694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 707/1314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:28 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1541 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:29.021237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9174038735de4d78b4ad527105d06624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '238f21f4c486416caa3eb44c58d2b452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:29.048903 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2aa2e154-b4e1-4f39-898a-d88d6a62c1d6 tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 200 len: 1325 microversion: 2.1 time: 0.195312 Aug 21 01:11:29.064379 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 608/1315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:28 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:29.645607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7fc13f-00b1-4abc-a3f4-108799eede61", "name": "network-vif-deleted", "tag": "5dac50bc-822d-432d-9f1a-32237d2110db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:29.671378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:29.672373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:29.673137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:29.702966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] Creating event network-vif-deleted:5dac50bc-822d-432d-9f1a-32237d2110db for instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 on n-h1-master-1 Aug 21 01:11:29.718357 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2122b324-0732-4d77-b948-c94a436864af req-d9b941fb-9193-45dd-9286-342615b18bb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076026 Aug 21 01:11:29.719552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 708/1316] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:29.949684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:29.951522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:29.959830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:29.960333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:29.961000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:29.962027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:29.962880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:29.963554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:30.075195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:30.076285 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] [instance: 9b7fc13f-00b1-4abc-a3f4-108799eede61] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:30.085284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:30.086472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:30.087340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:30.088512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:30.089197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:30.089830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:30.108276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] HTTP exception thrown: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Request method failure captured: Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 HTTP/1.1 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWhAX0W-D1fmEixQJ3dMb4x9l-xBXY1d4_iJJaf3HpWBHxJ0kbv873S9v41wkeo4jHChMD4v1TVaS_DIS61vSRM9oY7geLgXHzM2RjmpQcPH7DTK57h4cDPG-Zxp7OTuiUvNe0-TZpd9BFdr60NTuAZm_pb0DdcmhQZ-m6BenR_gpE Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 238f21f4c486416caa3eb44c58d2b452 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/238f21f4c486416caa3eb44c58d2b452"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_238f21f4c486416caa3eb44c58d2b452", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/238f21f4c486416caa3eb44c58d2b452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/238f21f4c486416caa3eb44c58d2b452"}]}] Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 238f21f4c486416caa3eb44c58d2b452 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2091872975 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesAdminNegativeTest-2091872975-project Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9174038735de4d78b4ad527105d06624 Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesAdminNegativeTest-2091872975-project Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9b7fc13f-00b1-4abc-a3f4-108799eede61'} Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:30.110260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Returning 404 to user: Instance 9b7fc13f-00b1-4abc-a3f4-108799eede61 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1333946b-d50a-455a-8fba-663b8a84647f tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61" status: 404 len: 111 microversion: 2.1 time: 0.043137 Aug 21 01:11:30.117436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 709/1317] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:30 2022] GET /compute/v2.1/servers/9b7fc13f-00b1-4abc-a3f4-108799eede61 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:11:30.123464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-422f0b66-2de9-4775-9169-f696303b829e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] Calling method '.version_select at 0x7fc3f9e01f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:30.144934 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-422f0b66-2de9-4775-9169-f696303b829e tempest-VolumesAdminNegativeTest-2091872975 tempest-VolumesAdminNegativeTest-2091872975-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-857815837" status: 202 len: 0 microversion: 2.1 time: 0.025396 Aug 21 01:11:30.145773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 710/1318] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-857815837 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:30.492901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:30.519578 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e56e6dba-d1e4-4ea6-9ba6-79b291809731 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1540 microversion: 2.1 time: 0.572678 Aug 21 01:11:30.524253 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 609/1319] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:29 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1540 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:31.568609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:31.574047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:31.594340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:31.594945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:31.595573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:31.598198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:31.598785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:31.599540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:32.039729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:32.067581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4756c8b-7dc4-4e6c-84e0-b8f70e6a7bbd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1540 microversion: 2.1 time: 0.525999 Aug 21 01:11:32.073681 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 711/1320] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:31 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1540 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:32.843258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16606e07-0949-4bb0-a83d-0531e2d19ba9 tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:32.853579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16606e07-0949-4bb0-a83d-0531e2d19ba9 tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.089345 Aug 21 01:11:32.854311 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 712/1321] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:11:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:32.866780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a06c7d1a-c971-42f2-b3dc-e65d1669358b tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] Calling method '.version_select at 0x7fc3fe97c9d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:32.869694 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:32.869694 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:32.883792 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a06c7d1a-c971-42f2-b3dc-e65d1669358b tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.327670 Aug 21 01:11:32.897801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5a61ea2-621d-48b1-b11c-75f42b9c4d1d tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] Action: 'update', calling method: .version_select at 0x7fc3f9da44c0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:32.902307 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:32.902307 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:11:32.902694 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 610/1322] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:11:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:33.093982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:33.094573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:33.102649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:33.103168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:33.103593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:33.104323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:33.104729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:33.105164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:33.228135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5a61ea2-621d-48b1-b11c-75f42b9c4d1d tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.334416 Aug 21 01:11:33.229245 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 713/1323] 10.222.0.46 () {60 vars in 1206 bytes} [Sun Aug 21 01:11:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:33.249126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f89901a5-d3c9-42f5-b99a-6acad2c5ecc7 tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] Calling method '.version_select at 0x7fc3fa03ec10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:33.254945 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:33.254945 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:11:33.288187 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f89901a5-d3c9-42f5-b99a-6acad2c5ecc7 tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.052165 Aug 21 01:11:33.288989 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 714/1324] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:11:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:33.301467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c8a3180a-c130-4cb1-9cd3-9ee6c8a73062 tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa03aa60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:33.346847 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=16,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:33.389036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:33.400544 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33b946c6-7164-4cd5-a728-0017f73c381a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1472 microversion: 2.1 time: 0.310312 Aug 21 01:11:33.401863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 611/1325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:33 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:33.432075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-unplugged", "status": "completed", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:33.469770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:33.470385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:33.470810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:33.479085 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c8a3180a-c130-4cb1-9cd3-9ee6c8a73062 tempest-QuotaClassesAdminTestJSON-1043006930 tempest-QuotaClassesAdminTestJSON-1043006930-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.181313 Aug 21 01:11:33.492798 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 715/1326] 10.222.0.46 () {60 vars in 1206 bytes} [Sun Aug 21 01:11:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:33.510709 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Creating event network-vif-unplugged:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:11:33.530791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:11:33.549978 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-536f2594-80b1-40f9-bea2-34f583543839 req-14a631d9-86db-4110-9b41-667d986eb7ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122364 Aug 21 01:11:33.554104 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 612/1327] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:11:33.848897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1025085412", "imageRef": "9ba7fff8-74ea-495c-9084-d4e735de665e", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:33.918796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:11:34.423807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:34.427446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:34.453220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.460560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.463605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.464525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.466580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.468556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.686152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:34.696469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c63f1f56-4b8a-4be6-b59c-c06e13eeca84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1469 microversion: 2.1 time: 0.277792 Aug 21 01:11:34.697090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 613/1328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:34 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:34.717245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:34.717534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:34.730256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.732757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.733456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.734798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.735338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.735863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.754643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] Request method failure captured: Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 143 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZEw8kVkbahKvA0Y2udFZiw3esj6-nCbaSk6oDZsBbUJX46ymvD4Ai7oa97K7V6xo70odHxRS_3GT1U_bo2k_FShGx-qAyyX2ZrEqSJyCcEdK0VgU8QlccuVRM77Ulgfcq4U33zxc6upWAiObXNeK88SMcHB89OH_kVSuGv0gCTDBM Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 3d87d5fedc284c0cad5a477016021b4b Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FlavorsV2NegativeTest-1090046655 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3d87d5fedc284c0cad5a477016021b4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3d87d5fedc284c0cad5a477016021b4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3d87d5fedc284c0cad5a477016021b4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3d87d5fedc284c0cad5a477016021b4b"}]}] Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FlavorsV2NegativeTest-1090046655 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 3d87d5fedc284c0cad5a477016021b4b Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1090046655 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FlavorsV2NegativeTest-1090046655-project Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9b7128cfcf1b41caa8c0ec7e6e00ae48 Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FlavorsV2NegativeTest-1090046655-project Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1025085412", "imageRef": "9ba7fff8-74ea-495c-9084-d4e735de665e", "flavorRef": "452"}} Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor's memory is too small for requested image. Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1025085412', 'imageRef': '9ba7fff8-74ea-495c-9084-d4e735de665e', 'flavorRef': '452'}}} Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:11:34.757420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1234809c-f8d4-4109-81ce-25e71f52240c tempest-FlavorsV2NegativeTest-1090046655 tempest-FlavorsV2NegativeTest-1090046655-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.914926 Aug 21 01:11:34.761685 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 716/1329] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:11:33 2022] POST /compute/v2.1/servers => generated 93 bytes in 917 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:34.822480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.822480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.824488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.825279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:34.827250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:34.828845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:34.890890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:34.906384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:35.131128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14ef2655-15db-4dfd-ab32-b3844f3f6974 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0/action" status: 202 len: 0 microversion: 2.1 time: 0.416642 Aug 21 01:11:35.136554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 614/1330] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:11:34 2022] POST /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:11:35.142537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:35.144216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:35.167366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:35.168159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:35.168811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:35.171809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:35.172584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:35.174816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:35.497317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:35.514682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3eb21789-a3be-4fac-8167-455537c0cc51 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1468 microversion: 2.1 time: 0.375122 Aug 21 01:11:35.515878 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 717/1331] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:35 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:36.539265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:36.540673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:36.549986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:36.550586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:36.551293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:36.552320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:36.553057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:36.553660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:36.894971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:36.902633 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:36.909053 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3b7a69f-a11c-424d-ae37-47179628a410 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1468 microversion: 2.1 time: 0.374847 Aug 21 01:11:36.910214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 615/1332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:36 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1468 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:37.820343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-plugged", "status": "completed", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:37.835773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:37.836254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:37.836672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:37.851874 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Creating event network-vif-plugged:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:11:37.861085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:11:37.869942 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0826d818-5c02-4ed8-847b-c030739db16e req-00013490-c549-463f-b688-14be25ab80c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053744 Aug 21 01:11:37.870905 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 718/1333] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:37.939527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:37.940309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:37.957735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:37.958242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:37.958741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:37.959498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:37.959949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:37.964512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:38.253488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:38.263425 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36e7e299-acd9-4ac3-b3e2-dd5deab094ec tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1468 microversion: 2.1 time: 0.330723 Aug 21 01:11:38.264459 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 616/1334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:37 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1468 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:38.978024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa573790>, body: {"quota_set": {"ram": "5120"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:39.088000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.088937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.089597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.090563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.091255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.091897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.295174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:39.297097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:39.305870 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f24ae0a-3cf1-4273-98ba-ad6872f6d4c3 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154" status: 200 len: 240 microversion: 2.36 time: 0.553546 Aug 21 01:11:39.310423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 719/1335] 10.222.0.46 () {62 vars in 1303 bytes} [Sun Aug 21 01:11:38 2022] PUT /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154 => generated 240 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:11:39.313018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.313758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.314410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.315336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.316021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.321230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.327486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Calling method '.version_select at 0x7fc3f9e26dc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:39.441424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.442242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.443849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.445369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.446103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.446874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.481521 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46f8ca1f-bbe1-4e3a-9a98-38f6557ce79a tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154/detail" status: 200 len: 672 microversion: 2.36 time: 0.163411 Aug 21 01:11:39.483355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 720/1336] 10.222.0.46 () {60 vars in 1304 bytes} [Sun Aug 21 01:11:39 2022] GET /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154/detail => generated 672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:11:39.704574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Action: 'update', calling method: .version_select at 0x7fc3f9e45160>, body: {"quota_set": {"ram": "2048"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:39.710971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:39.722939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84575a53-45da-4abd-bf37-4c464b237d06 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1468 microversion: 2.1 time: 0.432853 Aug 21 01:11:39.733919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 617/1337] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:39 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:39.816947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.817441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.818672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.819753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.820216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.820649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.879206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.879698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.880640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:39.881590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:39.882071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:39.882483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:40.059021 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0152d20-945a-4151-9c2f-2022e64660bb tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154?user_id=a90b682851024b02a55f679a153fe0cf" status: 200 len: 240 microversion: 2.36 time: 0.358323 Aug 21 01:11:40.060346 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 721/1338] 10.222.0.46 () {62 vars in 1384 bytes} [Sun Aug 21 01:11:39 2022] PUT /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154?user_id=a90b682851024b02a55f679a153fe0cf => generated 240 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:11:40.077925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e555316f-ac09-4364-8d69-34635b3d0e23 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] Calling method '.version_select at 0x7fc3fdca7a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:40.208987 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e555316f-ac09-4364-8d69-34635b3d0e23 tempest-QuotasAdminTestV236-1712227712 tempest-QuotasAdminTestV236-1712227712-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154?user_id=a90b682851024b02a55f679a153fe0cf" status: 200 len: 282 microversion: 2.36 time: 0.140567 Aug 21 01:11:40.218418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 618/1339] 10.222.0.46 () {60 vars in 1364 bytes} [Sun Aug 21 01:11:40 2022] GET /compute/v2.1/os-quota-sets/8ebac2ac1f644ae6997c721b5f6cb154?user_id=a90b682851024b02a55f679a153fe0cf => generated 282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:40.766750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:40.768265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:40.788397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:40.789561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:40.790740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:40.793186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:40.795513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:40.796655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:41.193784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:41.224973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-518c1166-4afa-4838-bb78-1a1677b2d273 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1534 microversion: 2.1 time: 0.470697 Aug 21 01:11:41.226945 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 722/1340] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:40 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1534 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:41.485067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8780cefe-7dfe-424e-8274-f2c58283f94e tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Action: 'create', calling method: .version_select at 0x7fc3fdd78f70>, body: {"keypair": {"name": "tempest-keypair-2115481243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8YIHNjwJ+5xCCE3jmyV5OTLFxO6jSgh/iDff03Eo7r98Eba/mRGwdBUh0/CfOI7h2QSB53mQrbi2GN/roUE4L9lVs5MLolRCqj8lho/0C4cCacBYOoLGmUpEQxeM2Gdw=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:41.577096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8780cefe-7dfe-424e-8274-f2c58283f94e tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for project 13b4ddb93fac43868ba8972d2f753e47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:41.597125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8780cefe-7dfe-424e-8274-f2c58283f94e tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for user d1fa5fee71024c328a90d1724a048c7e and project 13b4ddb93fac43868ba8972d2f753e47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:41.673965 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8780cefe-7dfe-424e-8274-f2c58283f94e tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.470370 Aug 21 01:11:41.675174 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 619/1341] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:11:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:42.249587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:42.250900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:42.282925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:42.283604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:42.283946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:42.284637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:42.285124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:42.285545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:42.661763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:42.686464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:42.690840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Searching by: {'deleted': False, 'project_id': '3e58a6cdaef14d36a9afbaf330135478'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:11:42.711825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:42.713910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:42.714635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:42.715335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:42.715668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:42.716076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:42.886833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:42.894706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:11:42.902191 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d5d127d-2d6f-4604-920f-f57b6fc90a49 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1534 microversion: 2.1 time: 0.657038 Aug 21 01:11:42.903039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 723/1342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:42 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1534 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:43.000601 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aeab3b06-c939-4250-8bc2-c4f8355cfcb5 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.374424 Aug 21 01:11:43.003154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 620/1343] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:11:42 2022] GET /compute/v2.1/servers => generated 344 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:43.018139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:43.028371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:43.029295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Searching by: {'deleted': False, 'project_id': '3e58a6cdaef14d36a9afbaf330135478'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:11:43.047076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.047561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.048009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:43.050980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.051533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.051940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:43.144909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:11:43.256104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:43.273119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.273605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.274042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:43.385136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-unplugged", "status": "completed", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:43.407426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.407935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.408373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:43.430587 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] Creating event network-vif-unplugged:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:11:43.450030 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cb85463b-26fb-4083-ba7b-d38d05192779 req-28155a79-a41a-4ad2-9640-e16107eed78a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068349 Aug 21 01:11:43.451011 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 621/1344] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:11:43.717952 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c443844-e0a8-4a3c-a285-8b11d2a10a0e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.704839 Aug 21 01:11:43.719047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 724/1345] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:11:43 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:43.756155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a86da02-0d49-45ca-944f-6c2ad189c8ce tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:43.767648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a86da02-0d49-45ca-944f-6c2ad189c8ce tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025836 Aug 21 01:11:43.775408 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 622/1346] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:11:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:43.927173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:43.927861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:43.938932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.943444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.945407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:43.946700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:43.949272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:43.950355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:44.086758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:44.088175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:44.108015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:44.110096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:44.116808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:44.117740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:44.118503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:44.119100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:44.214650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:11:44.682106 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:44.707004 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c6bd62d-e3d2-43ad-9e8d-84242df3e144 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "DELETE /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 204 len: 0 microversion: 2.1 time: 0.623873 Aug 21 01:11:44.710668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 623/1347] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:44 2022] DELETE /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:11:44.720641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:44.721479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:44.728777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:44.729359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:44.729852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:44.730664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:44.731175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:44.731648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:45.003786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:45.016146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7831023-9309-44d7-92f0-99aeb38a374a tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1527 microversion: 2.1 time: 1.094240 Aug 21 01:11:45.029524 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 725/1348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:43 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1527 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:45.041324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:45.041935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:45.063481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:45.064425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:45.065160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:45.066940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:45.068221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:45.069453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:45.562832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:45.574238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b146963-c856-4ac0-9cee-e6ddb0e46c3c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1527 microversion: 2.1 time: 0.537081 Aug 21 01:11:45.574833 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 726/1349] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:45 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1527 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:45.599265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73ebf6d1-61b2-4707-b083-c42ade628ba8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:45.609193 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:45.609193 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:11:45.625157 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-73ebf6d1-61b2-4707-b083-c42ade628ba8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] HTTP exception thrown: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73ebf6d1-61b2-4707-b083-c42ade628ba8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Request method failure captured: Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/flavors/a9c95d5d-c6be-415c-a386-b51f2a8d824c HTTP/1.1 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV7XvigMZlqyD0I6_WyHlxQhOvGiQcZYhwbo4L6vmA2Vk__Z5ZkuW5x6ZBi7pEbwn5N0s_TXkKpyAN-witkr-8VmaLgbj8_KhafN-gHcR6Gd4j6KYivV0hCxmuQQ1BuCWm5zzlLLNiT723MySaYbWT0uVAkSoxoWMLRywmW0F0Ui14 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c27f9d1ac44947208d478968f0ced360 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MigrationsAdminTest-1843213394 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c27f9d1ac44947208d478968f0ced360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c27f9d1ac44947208d478968f0ced360", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c27f9d1ac44947208d478968f0ced360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c27f9d1ac44947208d478968f0ced360"}]}] Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MigrationsAdminTest-1843213394 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c27f9d1ac44947208d478968f0ced360 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MigrationsAdminTest-1843213394 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MigrationsAdminTest-1843213394-project-admin Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b35f092e6bfa489c910de20007267a75 Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MigrationsAdminTest-1843213394-project-admin Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a9c95d5d-c6be-415c-a386-b51f2a8d824c'} Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:45.632300 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. Aug 21 01:11:45.637482 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:11:45.640360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73ebf6d1-61b2-4707-b083-c42ade628ba8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Returning 404 to user: Flavor a9c95d5d-c6be-415c-a386-b51f2a8d824c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:45.644622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73ebf6d1-61b2-4707-b083-c42ade628ba8 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/a9c95d5d-c6be-415c-a386-b51f2a8d824c" status: 404 len: 109 microversion: 2.1 time: 0.049287 Aug 21 01:11:45.645832 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 727/1350] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:11:45 2022] DELETE /compute/v2.1/flavors/a9c95d5d-c6be-415c-a386-b51f2a8d824c => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:45.897826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1282004508", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:46.023772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:46.039400 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0aea7211-a015-4bca-ab9a-613ae82ccf7e tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1607 microversion: 2.1 time: 1.324245 Aug 21 01:11:46.041527 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 624/1351] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:44 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1607 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:46.349739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2057411651", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9279f69d-c90e-4f45-acdd-658db8b54ab3"}], "security_groups": [{"name": "tempest-securitygroup--1717444106"}], "key_name": "tempest-keypair-2115481243", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:46.513155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:11:46.778508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] validate_networks() for [('9279f69d-c90e-4f45-acdd-658db8b54ab3', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:11:47.184442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:11:47.185439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:11:47.186144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:11:47.186994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:11:47.187762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:11:47.216373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:47.217807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:47.218273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:47.221154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:47.221644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:47.222083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:47.298243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:47.317560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Getting quotas for user 72250431a7f44bff83c1881ff733f2de and project f8905ebcf94b46da8aad6632c78b4881. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:47.360420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:11:47.369425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:11:47.484174 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cee30cdb-2141-423c-81cc-49c6ab251c4e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590334 Aug 21 01:11:47.491855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 728/1352] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:11:47.498910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:47.500019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:47.504024 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:UPDATE=9,nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:47.508745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:47.509559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:47.511060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:47.512341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:47.513059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:47.514253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:47.986043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:47.999962 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc1a3073-b7d1-434a-b0cb-73ea40c59606 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1607 microversion: 2.1 time: 0.503535 Aug 21 01:11:48.002691 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 729/1353] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:47 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1607 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:48.027545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87ffae22-8498-43fe-a196-2f0fcfb1ba96 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:48.033469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87ffae22-8498-43fe-a196-2f0fcfb1ba96 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:48.164566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-87ffae22-8498-43fe-a196-2f0fcfb1ba96 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:48.171999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87ffae22-8498-43fe-a196-2f0fcfb1ba96 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1213 microversion: 2.1 time: 0.166349 Aug 21 01:11:48.174398 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 730/1354] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:48 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:48.523089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for project 13b4ddb93fac43868ba8972d2f753e47. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:48.548861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for user d1fa5fee71024c328a90d1724a048c7e and project 13b4ddb93fac43868ba8972d2f753e47. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:48.608391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:11:48.608837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:11:48.609313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:11:48.616095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:11:48.617707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:11:48.672051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:48.672570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:48.676378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:48.680057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:48.681503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:48.684047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:48.736715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for project 13b4ddb93fac43868ba8972d2f753e47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:48.755712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Getting quotas for user d1fa5fee71024c328a90d1724a048c7e and project 13b4ddb93fac43868ba8972d2f753e47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:48.826420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:11:48.833399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:11:48.993388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45e65946-752a-4123-ac90-1704d2f4fbe1 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.647264 Aug 21 01:11:49.000111 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 625/1355] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:11:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:11:49.011233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2de63d11-55df-4269-93b5-06e942da1144 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:49.011855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2de63d11-55df-4269-93b5-06e942da1144 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:49.024623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:49.025360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:49.038576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:49.046776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:49.055029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:49.057130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:49.058664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:49.060171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:49.279999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2de63d11-55df-4269-93b5-06e942da1144 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:49.293078 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2de63d11-55df-4269-93b5-06e942da1144 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1270 microversion: 2.1 time: 0.286169 Aug 21 01:11:49.307173 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 731/1356] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:49 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:49.312407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:49.313228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:49.336981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:49.340949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:49.342628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:49.347741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:49.349973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:49.352276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:49.352939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:49.379254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45173927-f514-4e8d-8a63-574c75ff8854 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1540 microversion: 2.1 time: 0.357110 Aug 21 01:11:49.388677 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 626/1357] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:49 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:49.790949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:49.801535 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-079b9e06-6c40-4624-be06-40ce05b7f5d2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1209 microversion: 2.1 time: 0.505109 Aug 21 01:11:49.821223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 732/1358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:49 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1209 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:49.836991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-plugged", "status": "completed", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:49.872467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:49.875114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:49.877178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:49.980676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] Creating event network-vif-plugged:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:11:50.006909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4442057f-d41d-4acc-8acf-f49cf0a9c820 req-54b8f779-b2d8-4f91-b8f1-b023419044da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180567 Aug 21 01:11:50.010987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 733/1359] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:50.044996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970cdff0-7cdd-485c-b8d9-5ef7351b8990", "name": "network-vif-deleted", "tag": "f6b0b79c-66d3-486a-a132-508aae6a65b4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:50.106139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.108587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.109864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.181813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] Creating event network-vif-deleted:f6b0b79c-66d3-486a-a132-508aae6a65b4 for instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 on n-h1-master-1 Aug 21 01:11:50.186561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fdc90700>, body: {"quota_set": {"ram": "5120"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:50.205901 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-53569d04-1ce9-4d37-a224-949f348b2052 req-3b64a34f-f262-4e67-bfc3-57152666a88d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172017 Aug 21 01:11:50.206514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 734/1360] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:11:50.338082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:50.340378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:50.367184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.373061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.373515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.398128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.399373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.399831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.403321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.405458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.406195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.409281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.409986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.410676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.465945 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:50.591876 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67c7d939-efdd-497b-8f16-4bfda1e0c219 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156" status: 200 len: 148 microversion: 2.57 time: 1.043134 Aug 21 01:11:50.597126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 627/1361] 10.222.0.46 () {62 vars in 1303 bytes} [Sun Aug 21 01:11:49 2022] PUT /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156 => generated 148 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:11:50.606116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:50.612499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:50.625440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.626227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.628273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.629302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.630366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.632466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.681230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:50.695638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60a8974b-975f-4ebf-9c81-63fc369a1d3a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1274 microversion: 2.1 time: 0.377397 Aug 21 01:11:50.698658 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 735/1362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:50 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:50.710188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Calling method '.version_select at 0x7fc3fa86a8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:50.816621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:50.833727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc645af1-070a-4a70-85b6-737889fe20cc tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.232935 Aug 21 01:11:50.835460 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 628/1363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:50 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:50.848202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:50.853767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:50.863444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.874086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.876662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.876845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.877318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.877951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.878078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.878581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.879200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.881167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:50.883158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:50.887215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:50.949582 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9ce72a9-85fc-4917-8d07-a4d91eab47b5 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156/detail" status: 200 len: 463 microversion: 2.57 time: 0.249370 Aug 21 01:11:50.950226 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 736/1364] 10.222.0.46 () {60 vars in 1304 bytes} [Sun Aug 21 01:11:50 2022] GET /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156/detail => generated 463 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:51.017650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:51.035993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-172f1598-c59f-4249-b6dd-5c50757172aa tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1271 microversion: 2.1 time: 0.195774 Aug 21 01:11:51.049522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 629/1365] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:50 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:51.677115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0639ab6f-1d79-4154-bdd2-c4c5d1abfcd9 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Action: 'create', calling method: .version_select at 0x7fc3fa282c10>, body: {"keypair": {"name": "tempest-keypair-1070666573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKsKCE6lFY05i1S0ZtxSsaRnwizfX4cz4y3OIDuPrH6vHCz6jHw+9LEwNZx2yOljhYO+8Hw1PJLW9TLN0Le6MYlSpCssrPJ60e/behgDhiZks/ae3Fl7gxcVsEDTlXqXQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:51.719548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:51.720279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:51.724000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0639ab6f-1d79-4154-bdd2-c4c5d1abfcd9 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for project c5715eb5c1474f35bb87595ba83a23f6. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:51.735601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:51.736103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:51.736542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:51.739016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0639ab6f-1d79-4154-bdd2-c4c5d1abfcd9 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for user 57bbc3575a184139b26e3b0bdd221a91 and project c5715eb5c1474f35bb87595ba83a23f6. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:51.740174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:51.740832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:51.744142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:51.796599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0639ab6f-1d79-4154-bdd2-c4c5d1abfcd9 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.555279 Aug 21 01:11:51.797733 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 737/1366] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:11:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:51.838019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fa166af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:51.956383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:51.976971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51f3abcc-4087-4a72-8eb2-cc2152505b30 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1328 microversion: 2.1 time: 0.261610 Aug 21 01:11:51.983797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 630/1367] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:51 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:51.996688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:52.001874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:52.026247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.028232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.029462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.031781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.034222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.037788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.151358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.158985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.161708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.165067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.167288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.168683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.275595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.282713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.283172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.283991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.289732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.291021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.373609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:52.384744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22199320-33d8-4741-bfa8-c39b1a8c742d tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.399714 Aug 21 01:11:52.397998 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 631/1368] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:51 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:52.403390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:52.404942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:52.412469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.413007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.413438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.414149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:52.414693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:52.415105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:52.510987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63dc82db-df2c-4f50-82fc-57cf34d35dd3 tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156?user_id=e31b0dff7744496098059a769edc3278" status: 200 len: 148 microversion: 2.57 time: 0.677399 Aug 21 01:11:52.520888 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 738/1369] 10.222.0.46 () {62 vars in 1384 bytes} [Sun Aug 21 01:11:51 2022] PUT /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156?user_id=e31b0dff7744496098059a769edc3278 => generated 148 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:52.534036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3da2ce22-d79c-4138-9858-6cbcb316589e tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] Calling method '.version_select at 0x7fc3f9e904c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:52.712220 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3da2ce22-d79c-4138-9858-6cbcb316589e tempest-QuotasAdminTestV257-359457805 tempest-QuotasAdminTestV257-359457805-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156?user_id=e31b0dff7744496098059a769edc3278" status: 200 len: 190 microversion: 2.57 time: 0.184319 Aug 21 01:11:52.720715 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 739/1370] 10.222.0.46 () {60 vars in 1364 bytes} [Sun Aug 21 01:11:52 2022] GET /compute/v2.1/os-quota-sets/9e8babe9d4b3443daaf561d54ef01156?user_id=e31b0dff7744496098059a769edc3278 => generated 190 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:52.825286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:52.842917 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59023887-6ea5-4911-8db2-c5e3133b9ba5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.437400 Aug 21 01:11:52.847203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 632/1371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:52 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:53.014478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:53.015602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:53.029761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.034999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.036229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:53.038931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.039616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.040356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:53.305216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:53.314627 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1166aff3-a61a-4dd1-b8b6-7701ebb80e5c tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1328 microversion: 2.1 time: 0.313028 Aug 21 01:11:53.315450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 740/1372] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:52 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1328 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:53.407196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:53.407808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:53.426050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.426931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.427405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:53.428192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.430557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.431032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:53.863578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:53.864258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:53.873212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.873695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.874121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:53.889726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:53.890257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:53.890696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:54.206900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:54.219353 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-870c7d85-cd95-42bb-93bd-425b0805e5a9 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.816619 Aug 21 01:11:54.221669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 633/1373] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:53 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:54.337037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:54.337912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:54.346936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:54.349688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:54.350502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:54.351787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:54.353836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:54.355207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:54.512063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:54.521484 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-437126b8-389e-49fa-b46e-e6e6da2664f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1328 microversion: 2.1 time: 0.188550 Aug 21 01:11:54.527206 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 634/1374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:54 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:55.008498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:55.032103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d48fc327-a254-4aee-aa20-583b56c3efd6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 1.172122 Aug 21 01:11:55.032901 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 741/1375] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:53 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:11:55.245520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:55.246165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:55.253238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:55.254116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:55.255072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:55.256241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:55.256883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:55.262697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:55.321907 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:55.534458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:55.547566 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-264bb46c-94da-4a02-85ac-6c01153fd557 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.307708 Aug 21 01:11:55.547903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:55.549026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:55.565222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 635/1376] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:55 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:55.569566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:55.570302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:55.570945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:55.571825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:55.572447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:55.575194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:55.787897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:55.812082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:55.812577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:55.813032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:55.839579 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] Creating event network-changed:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:11:55.850958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b3176b95-062e-4cc3-9b15-482222f4e02d req-64e78b05-eb25-4504-b160-7fc6d561d306 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068706 Aug 21 01:11:55.853992 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 636/1377] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:11:56.044624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:56.055286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:56.056035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:56.063244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:56.064999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24b71fa2-8d83-4373-a9dc-45060a1314f8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.514893 Aug 21 01:11:56.076806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 742/1378] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:55 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:56.077190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:56.077190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:56.077190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:56.077190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:56.077190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:56.342189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-715762631", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fa8c25db-69fc-447f-98de-03cfa6211037"}], "security_groups": [{"name": "tempest-securitygroup--613133028"}], "key_name": "tempest-keypair-1070666573", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:56.535359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] validate_networks() for [('fa8c25db-69fc-447f-98de-03cfa6211037', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:11:56.929551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:56.946848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e8f76af-1043-48c2-b3b0-a6beda90d6b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.896881 Aug 21 01:11:56.947687 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 637/1379] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:56 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:56.952511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:56.957227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:56.968086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:56.974208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:56.975002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:56.975935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:56.976574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:56.977301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.111496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:57.143477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-585e8c1a-141a-4c6a-b586-49fd12c67d50 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.191979 Aug 21 01:11:57.159905 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 638/1380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:56 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:57.167711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:57.168853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:57.194544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.195208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.195790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.196861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.197583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.198166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.450534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:57.468719 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62115dd7-96cb-4751-ba05-645e951c3459 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.302397 Aug 21 01:11:57.472645 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 639/1381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:57 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:57.528405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for project c5715eb5c1474f35bb87595ba83a23f6. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:57.537563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for user 57bbc3575a184139b26e3b0bdd221a91 and project c5715eb5c1474f35bb87595ba83a23f6. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:57.556934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:11:57.557570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:11:57.558220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:11:57.558802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:11:57.559382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:11:57.570140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.570885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.571320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.572053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.572501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.572945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.593889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for project c5715eb5c1474f35bb87595ba83a23f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:11:57.602028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Getting quotas for user 57bbc3575a184139b26e3b0bdd221a91 and project c5715eb5c1474f35bb87595ba83a23f6. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:11:57.631579 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:57.642568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:11:57.646367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:11:57.742743 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-67a5ab11-500f-423a-aafd-d58c1569bcca tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.404873 Aug 21 01:11:57.743824 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 743/1382] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:11:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:11:57.754754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33e55281-c66a-417a-ad60-f59075ed7e98 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:57.755399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33e55281-c66a-417a-ad60-f59075ed7e98 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:57.832654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33e55281-c66a-417a-ad60-f59075ed7e98 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:57.840659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:57.841363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:57.847830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33e55281-c66a-417a-ad60-f59075ed7e98 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1277 microversion: 2.1 time: 0.097331 Aug 21 01:11:57.861158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 640/1383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:57 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:57.861250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.111616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987ec0ed-2e84-4741-808a-3666813311cd", "tag": "f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:11:58.132288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.137276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.138714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.151837 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] Creating event network-changed:f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee for instance 987ec0ed-2e84-4741-808a-3666813311cd on n-h1-master-1 Aug 21 01:11:58.171017 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-10b1fe1d-7ff5-4318-badd-ed9d0152b9ab req-e1d76005-3fb8-413b-9ef7-e48a308eee52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261025 Aug 21 01:11:58.172365 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 641/1384] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:11:58.179106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:58.180334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:58.188651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.189397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.189859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.190842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.191387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.192018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.263766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:11:58.303147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9546b5e-c038-4a43-bbf5-ce8cf5a677b6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 2345 microversion: 2.25 time: 0.472416 Aug 21 01:11:58.306780 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 744/1385] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:11:57 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 2345 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:11:58.322491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:58.325059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:58.341920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.342743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.351569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.354152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.358047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.361339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.398610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:58.434218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b72448d-e64b-4585-97ad-a1b4597ccd08 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.241565 Aug 21 01:11:58.434908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 642/1386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:58 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:58.454838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:58.458213 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:11:58.458213 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:11:58.459584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.460491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.461227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.462201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.462939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.463658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.502073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d05275c344461cb9bdef94c765de35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58a6cdaef14d36a9afbaf330135478', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:58.517372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d705e10d-0897-4f86-ab57-336cb157e6da tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 200 len: 1253 microversion: 2.1 time: 0.209149 Aug 21 01:11:58.521857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 745/1387] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:58 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 1253 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:58.538527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:58.545492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:58.551047 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:58.577202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.580035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eb632021-ce3e-4fd0-90d9-b23b440f7c35 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.129234 Aug 21 01:11:58.580670 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 643/1388] 10.222.0.46 () {60 vars in 1217 bytes} [Sun Aug 21 01:11:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:11:58.580845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.581352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.582163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.584924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.585423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.867656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:58.868913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:58.877215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.881851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.882977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.884923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:58.885620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:58.888801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:58.976902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:58.990549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e32aae9a-694a-46b7-8ac5-f1a4f9e7fe98 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.466299 Aug 21 01:11:58.992297 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 746/1389] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:58 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:59.279127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:59.288127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3193c4da-23a5-4365-8443-21375350860a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1281 microversion: 2.1 time: 0.424405 Aug 21 01:11:59.299469 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 644/1390] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:58 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:11:59.461185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:59.461862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:59.482227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:59.490491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:59.491189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:59.495415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:59.496039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:59.496373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:59.542651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:59.547819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] [instance: 970cdff0-7cdd-485c-b8d9-5ef7351b8990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:11:59.565855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:59.570161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:59.570924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:59.572164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:11:59.572545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:11:59.573004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:11:59.620019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] HTTP exception thrown: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Request method failure captured: Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 HTTP/1.1 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYXgwv_-uUxRJHHfGuY_jOZBUIEkAR1lABmKLAhprIF-qvHWWC0EWS5bDDsOuIi8GXQkdWqrXPvA4HZuTkg4goCxmAUXl88zoob6V5USh2Hq4lW7WeeGA37h_38yyzejZBD5jPZ3jnTRkfioojNQTErrCLifccAGt-XiWoQzSdAavPs Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 3e58a6cdaef14d36a9afbaf330135478 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestBootFromVolume-1714823827 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e58a6cdaef14d36a9afbaf330135478"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e58a6cdaef14d36a9afbaf330135478", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e58a6cdaef14d36a9afbaf330135478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e58a6cdaef14d36a9afbaf330135478"}]}] Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestBootFromVolume-1714823827 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 3e58a6cdaef14d36a9afbaf330135478 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1714823827 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestBootFromVolume-1714823827-project Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e8d05275c344461cb9bdef94c765de35 Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestBootFromVolume-1714823827-project Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '970cdff0-7cdd-485c-b8d9-5ef7351b8990'} Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:11:59.621757 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. Aug 21 01:11:59.626913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:11:59.632650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Returning 404 to user: Instance 970cdff0-7cdd-485c-b8d9-5ef7351b8990 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:11:59.633653 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4dbb88a8-ec81-4496-b65f-2461e62c76cb tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990" status: 404 len: 111 microversion: 2.1 time: 0.099120 Aug 21 01:11:59.634540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 645/1391] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:59 2022] GET /compute/v2.1/servers/970cdff0-7cdd-485c-b8d9-5ef7351b8990 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:11:59.642385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-85b7a50d-fefc-4d55-b0d0-0f54d22d2713 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] Calling method '.version_select at 0x7fc3fdefca60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:11:59.704331 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-85b7a50d-fefc-4d55-b0d0-0f54d22d2713 tempest-ServersTestBootFromVolume-1714823827 tempest-ServersTestBootFromVolume-1714823827-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178693014" status: 202 len: 0 microversion: 2.1 time: 0.065756 Aug 21 01:11:59.708137 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 646/1392] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178693014 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:11:59.939551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:11:59.971184 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-077d8ba0-6b55-4a64-8105-2b0cd2a99703 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.519511 Aug 21 01:11:59.976113 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 747/1393] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:11:59 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:00.012321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:00.013246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:00.039721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:00.048092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:00.048833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:00.049753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:00.050357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:00.050949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:00.315685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:00.316553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:00.337559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:00.338390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:00.338988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:00.339891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:00.340653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:00.341280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:00.686538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:00.700866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7b916d8-fbe2-4136-92e6-c6a26f35efaa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1337 microversion: 2.1 time: 0.388934 Aug 21 01:12:00.701477 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 748/1394] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:00 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1337 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:01.006156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:01.009679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:01.040116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.042553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.043028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:01.045486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.046174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.056262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:01.651626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:01.666150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c091005-55c8-4f3f-ba11-2eba38d69c0e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.675119 Aug 21 01:12:01.667109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 749/1395] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:00 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:01.672088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "309b2df2-bb50-4b9f-b7af-008e7c026698", "device": "/dev/xvdb"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:01.687177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:01.705767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.709385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.710520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:01.711888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.717403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.718605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:01.806230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:01.815465 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-506085b5-2652-45a4-a834-578570174d89 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 1.806965 Aug 21 01:12:01.830349 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 647/1396] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:00 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:01.848016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:01.849060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:01.869068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.870069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.870746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:01.871734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:01.872403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:01.873086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:02.153091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:02.168317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0e037d6d-1e06-4cab-8445-a8ef8f89fdfe tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1335 microversion: 2.1 time: 0.330044 Aug 21 01:12:02.171097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 648/1397] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:01 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1335 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:02.329204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52961725-df16-4eee-a886-78766001fdb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.660666 Aug 21 01:12:02.350635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 750/1398] 10.222.0.46 () {62 vars in 1364 bytes} [Sun Aug 21 01:12:01 2022] POST /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:12:02.689911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:02.691037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:02.705233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:02.709018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:02.709549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:02.715642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:02.716458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:02.717134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:02.844237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:02.845138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:02.859091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:02.865900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:02.866561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:02.867547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:02.868438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:02.869313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:03.324942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:03.334800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0338d36-b274-4498-a793-a9b5ea8b5e29 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.495849 Aug 21 01:12:03.340076 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 751/1399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:02 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:03.354377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:03.356215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:03.371677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:03.372343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:03.377232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:03.378868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:03.379519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:03.380115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:03.871830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:03.891654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:03.900039 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53eaa690-a2bd-48a0-afb1-dbe2ac2e0393 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 1.215167 Aug 21 01:12:03.912091 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 649/1400] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:02 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:03.914068 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba200591-afa5-488b-8f88-28695c0f8532 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.572355 Aug 21 01:12:03.914685 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 752/1401] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:03 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:03.922780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-plugged", "status": "completed", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:03.960021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:03.965342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:03.965814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.015683 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] Creating event network-vif-plugged:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:12:04.025423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ab22ec42-53b3-47f2-9704-1313f7475837 req-885d3177-27b3-47a7-836b-0e3cf3fe2118 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112154 Aug 21 01:12:04.027252 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 650/1402] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:04.361842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:04.364416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:04.373472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.374589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.375238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.376593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.377910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.378575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.924425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:04.924613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:04.926046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:04.937246 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-806af998-9782-477e-abc0-cf4f607038fc tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.579328 Aug 21 01:12:04.939503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.941124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 753/1403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:04 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:04.943820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.945637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.947734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.949068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.951184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.967033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:04.967957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:04.982908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.985575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.986217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:04.989043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:04.990184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:04.992164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:05.051132 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:05.311790 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:05.326664 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3b46f57-ee02-4eff-b59c-73304361eb6f tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.383985 Aug 21 01:12:05.330084 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 754/1404] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:04 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:05.344109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:05.357509 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0bd404d-a529-4aa1-ae48-5b895a630d83 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1313 microversion: 2.1 time: 0.435266 Aug 21 01:12:05.360272 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 651/1405] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:04 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:05.841197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12dabd6-7399-4cd0-a253-bd66898c7daf", "tag": "fdac7d31-989f-4109-a3f5-9c8a2c72824e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:05.862551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:05.864185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:05.864809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:05.904859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] Creating event network-changed:fdac7d31-989f-4109-a3f5-9c8a2c72824e for instance f12dabd6-7399-4cd0-a253-bd66898c7daf on n-h2-master-1 Aug 21 01:12:05.922340 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-52c469f6-29fc-44d0-9bdd-061c1c6a55ef req-cf2b1b92-57cc-4b5a-a230-7e970aa884dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085647 Aug 21 01:12:05.923707 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 755/1406] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:05.959740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:05.961195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:05.965576 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:05.978983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:05.981750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:05.982468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:05.985721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:05.986566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:05.987147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:06.355321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:06.356022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:06.368171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:06.368720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:06.369132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:06.369832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:06.370278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:06.370689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:06.536610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:06.557393 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-412cdb24-1f56-430b-a66e-9b78e83a2dd3 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.602529 Aug 21 01:12:06.563410 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 652/1407] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:05 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:06.580138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:06.581096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:06.616926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:06.617515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:06.618067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:06.618869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:06.619418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:06.621257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.057183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:07.080375 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c02d2ae0-194c-4f46-a10f-afe6fff10b4c tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.732704 Aug 21 01:12:07.081554 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 756/1408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:06 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:07.091606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:07.120290 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b5b3a22-88a2-4d54-b8e9-f3a5bbbb293e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1463 microversion: 2.1 time: 0.555435 Aug 21 01:12:07.124153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 653/1409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:06 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1463 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:07.150487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:07.151444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:07.173702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.176023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.177066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.182535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.184053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.184695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.387266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5382ed4c-8eab-4aa8-b364-076ed690386a tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] Calling method '.version_select at 0x7fc3fde4d430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:07.441318 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5382ed4c-8eab-4aa8-b364-076ed690386a tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] 10.222.0.46 "GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1" status: 200 len: 784 microversion: 2.1 time: 0.203104 Aug 21 01:12:07.446446 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 654/1410] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:12:07 2022] GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1 => generated 784 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:07.469858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9a2af0fe-3076-4936-b791-76dc4f22604e tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] Calling method '.version_select at 0x7fc3fdeb69d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:07.582059 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=22 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:07.584259 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9a2af0fe-3076-4936-b791-76dc4f22604e tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] 10.222.0.46 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.121264 Aug 21 01:12:07.585170 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 655/1411] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:12:07 2022] GET /compute/v2.1/images => generated 445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:07.590207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:07.591047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:07.598084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.598571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.599036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.599759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.600409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.601214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.802109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:07.814406 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcbed266-f788-4a29-b25d-280427813b31 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.228092 Aug 21 01:12:07.815193 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 656/1412] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:07 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:07.835018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b435aa2-8a22-49a6-868a-527c491fc2d1 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1614 microversion: 2.1 time: 0.685925 Aug 21 01:12:07.835896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 757/1413] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:07 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1614 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:07.836194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa6d7122-97ee-4dd3-aa33-51d776a06bd8 tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] Calling method '.version_select at 0x7fc3fdf15dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:07.847899 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=30 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:07.860645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:07.861244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:07.869057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.869543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.869972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.870674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:07.871319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:07.871897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:07.907727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa6d7122-97ee-4dd3-aa33-51d776a06bd8 tempest-ListImagesTestJSON-826914167 tempest-ListImagesTestJSON-826914167-project] 10.222.0.46 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.087251 Aug 21 01:12:07.916874 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 657/1414] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:12:07 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:07.936307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b35f092e6bfa489c910de20007267a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27f9d1ac44947208d478968f0ced360', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:07.937159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] flavor_id is None. Assuming migration. {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 21 01:12:07.937966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:12:08.109309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:08.110808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:08.122495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.125576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.127833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:08.133012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.134381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.135373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:08.180519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34d32993-9d64-4f8d-a0f7-0cc052a20bf7 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364/action" status: 202 len: 0 microversion: 2.1 time: 0.325619 Aug 21 01:12:08.184951 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 758/1415] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:12:07 2022] POST /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:12:08.190919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:08.192491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:08.200309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.201061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.201698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:08.202600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.203255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.203885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:08.492985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:08.511878 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05c2261d-b69e-47ae-83dd-21c47beb6e8b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.409456 Aug 21 01:12:08.513972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 658/1416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:08 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:08.820355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:08.832637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6d3b19f-4428-4645-b9da-7ab5edd62cef tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1472 microversion: 2.1 time: 0.645811 Aug 21 01:12:08.850587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 759/1417] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:08 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:08.854959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:08.860102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:08.865735 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=11 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:08.883886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.884373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.885221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:08.885532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:08.886009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:08.886424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:09.308714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:09.318984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c716765-b3bd-43d7-bebf-35b7fe623122 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.472067 Aug 21 01:12:09.329213 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 659/1418] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:08 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:09.534763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:09.535625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:09.547653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:09.555079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:09.555754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:09.556710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:09.559112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:09.559540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:09.857659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:09.858431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:09.879118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:09.879677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:09.880120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:09.881537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:09.882331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:09.882927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:09.914721 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:09.950417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:09.964648 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c776144-e59f-44cd-9d85-f8a1016b5561 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.431746 Aug 21 01:12:09.978870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 760/1419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:09 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:10.569063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5028ea06-b95f-4eb3-a4c3-74b3efbfd2ae tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Action: 'create', calling method: .version_select at 0x7fc3f9f18a60>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:10.834072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:10.844512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba353e9f-f770-48ed-9299-49074d9593a1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1472 microversion: 2.1 time: 0.990989 Aug 21 01:12:10.853635 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 660/1420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:09 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1472 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:10.870395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:10.872813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:10.891165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:10.897864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:10.898740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:10.902823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:10.903479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:10.909395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:12.186322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:12.199172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53d7cd90-d5a5-4b72-9bdd-f204fc124aa6 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 1.343605 Aug 21 01:12:12.212805 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 661/1421] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:10 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:12.482228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987ec0ed-2e84-4741-808a-3666813311cd", "name": "network-vif-plugged", "status": "completed", "tag": "f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:12.523885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:12.533626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:12.538595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:12.578852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] Creating event network-vif-plugged:f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee for instance 987ec0ed-2e84-4741-808a-3666813311cd on n-h1-master-1 Aug 21 01:12:12.599003 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d67dbafb-8309-4942-a10f-78972df4805f req-94621674-0f23-4ef5-b9f3-e8c6a29e88f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396748 Aug 21 01:12:12.603633 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 662/1422] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:12.633252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:12.634215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:12.651143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:12.651884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:12.652330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:12.654476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:12.655086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:12.655527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:13.271744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:13.310871 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce0d94d1-62dc-4507-a827-b9abad59c2c0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.690026 Aug 21 01:12:13.314281 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 663/1423] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:12 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:13.325835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:13.327615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:13.346077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:13.350329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:13.351525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:13.353602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:13.356468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:13.357747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:13.780929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:13.790012 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51e35edd-ae78-4b75-8b00-790d2d45ee32 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1472 microversion: 2.1 time: 0.473529 Aug 21 01:12:13.803952 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 664/1424] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:13 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:13.808433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5028ea06-b95f-4eb3-a4c3-74b3efbfd2ae tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.562603 Aug 21 01:12:13.809408 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 761/1425] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:12:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:12:13.818078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:13.818695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:13.822251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51bc3906-76d7-4a37-b4b3-5ead1a71cc9c tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fa265280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:13.832877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:13.833884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:13.834953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:13.836530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:13.837136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:13.838519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:14.015872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:14.030900 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e1fbf87-b0d6-422f-8af8-b30247088201 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1396 microversion: 2.1 time: 0.225418 Aug 21 01:12:14.041747 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 665/1426] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:13 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1396 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:14.152129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51bc3906-76d7-4a37-b4b3-5ead1a71cc9c tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/34937698-5ac1-49cb-ab0f-06954fd6027d" status: 200 len: 142 microversion: 2.1 time: 0.334012 Aug 21 01:12:14.160898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 762/1427] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:12:13 2022] GET /compute/v2.1/os-floating-ips/34937698-5ac1-49cb-ab0f-06954fd6027d => generated 142 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:12:14.166843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7407b06-fd95-4bff-85fd-da5dc690287b tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fdf02310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:14.335545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:14.336198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:14.350339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:14.350843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:14.351386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:14.352093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:14.352535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:14.352982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:14.463553 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7407b06-fd95-4bff-85fd-da5dc690287b tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.301533 Aug 21 01:12:14.465249 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 666/1428] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:12:14 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:14.477609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d13316be-2043-4081-8b7c-990faeead62b tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fdf7a670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:15.153289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:15.167405 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f62d600-26e3-4c02-bd1d-f31f2ba32205 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.834378 Aug 21 01:12:15.169858 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 763/1429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:14 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:15.179221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:15.180320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:15.190280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.192304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.193346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.194462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.195149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.196398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.514742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:15.538414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-500fc7a3-7359-4756-9b2d-c9d1bf10b5b8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.363793 Aug 21 01:12:15.554588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 764/1430] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:15 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:15.569365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:15.571341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:15.592906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.593654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.594347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.595769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.596446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.597967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.603477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d13316be-2043-4081-8b7c-990faeead62b tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/34937698-5ac1-49cb-ab0f-06954fd6027d" status: 202 len: 0 microversion: 2.1 time: 1.130420 Aug 21 01:12:15.605956 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 667/1431] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:12:14 2022] DELETE /compute/v2.1/os-floating-ips/34937698-5ac1-49cb-ab0f-06954fd6027d => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:12:15.617895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12dabd6-7399-4cd0-a253-bd66898c7daf", "name": "network-vif-plugged", "status": "completed", "tag": "fdac7d31-989f-4109-a3f5-9c8a2c72824e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:15.651334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.653537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.655383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.681798 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] Creating event network-vif-plugged:fdac7d31-989f-4109-a3f5-9c8a2c72824e for instance f12dabd6-7399-4cd0-a253-bd66898c7daf on n-h2-master-1 Aug 21 01:12:15.688991 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6b5bf5b6-8255-4158-b41e-2e1bd76fe2e2 req-db4783de-a89b-43e8-b8ea-22a651d601d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080984 Aug 21 01:12:15.690134 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 668/1432] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:15.697660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d490da7-1ca7-4d1c-986e-ccf0235569f1 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Action: 'create', calling method: .version_select at 0x7fc3fde03790>, body: {"pool": null} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:15.907028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:15.926101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8735f4e3-15f8-4f89-8161-18de62dc7889 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1578 microversion: 2.1 time: 0.364178 Aug 21 01:12:15.927799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 765/1433] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:15 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1578 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:15.951601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:15.952977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:15.962103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.963312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.964362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:15.965434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:15.966099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:15.966602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:16.189178 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8e2a5e3-376d-4644-a234-f833733502a7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243041 Aug 21 01:12:16.190820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 766/1434] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:12:15 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:12:16.203834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:16.204451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:16.243906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:16.244902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:16.247621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:16.248581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:16.251378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:16.251814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:16.648168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:16.671111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89e4f16e-5dbc-4218-a045-b0eb72a25067 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.478395 Aug 21 01:12:16.672195 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 767/1435] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:16 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:16.680382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:16.681807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:16.692132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:16.694391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:16.695077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:16.697813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:16.699382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:16.700158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:17.151569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:17.161936 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3e5cf32-1c66-4afb-8f64-2ca1a9e3364e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.488357 Aug 21 01:12:17.164644 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 768/1436] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:16 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:17.692178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:17.693176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:17.704309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:17.704807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:17.709466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:17.710433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:17.711054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:17.711671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.112059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:18.124361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-345738ff-fe2a-4048-aeaa-dd518211f56b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1402 microversion: 2.1 time: 0.436234 Aug 21 01:12:18.146156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 769/1437] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:17 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1402 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:18.203153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:18.207480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:18.241080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:18.242352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:18.247964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.249864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:18.251656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:18.253309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.719458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:18.734362 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f67b537-1433-4446-9be4-0a5b206c6df8 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1578 microversion: 2.1 time: 0.591223 Aug 21 01:12:18.741120 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 770/1438] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:18 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1578 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:18.746661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987ec0ed-2e84-4741-808a-3666813311cd", "tag": "f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:18.762592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:18.763328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:18.763910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.779479 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] Creating event network-changed:f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee for instance 987ec0ed-2e84-4741-808a-3666813311cd on n-h1-master-1 Aug 21 01:12:18.786557 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-72eff0b6-9669-4136-8d1d-b2e2dd681a73 req-8832bafc-be06-43e6-8922-5a18ab698b88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043478 Aug 21 01:12:18.787492 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 771/1439] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:18.794045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:18.794938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:18.802103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:18.802834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:18.803426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.804286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:18.804933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:18.805537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:18.912705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d490da7-1ca7-4d1c-986e-ccf0235569f1 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.221181 Aug 21 01:12:18.913865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 669/1440] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:12:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:18.926060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e18af75-1539-4b7c-ab9c-a893be629862 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fdefc670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:19.836854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:19.846584 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:19.859032 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfcb7aa7-c831-492f-98f3-6ae8c0679d84 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 1.069902 Aug 21 01:12:19.861648 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 772/1441] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:18 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:19.889776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:19.893726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:19.925359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:19.927465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:19.929695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:19.931791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:19.932554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:19.933262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.302833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:20.312582 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6b4d58f-097c-4c2a-9f63-3bb2f3ba97b7 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1589 microversion: 2.1 time: 0.431078 Aug 21 01:12:20.313212 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 773/1442] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:19 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1589 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:20.352973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:20.354979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:20.374586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.379268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.380109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.383756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.384549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.385382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.703025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4d3cf9d-3b89-4ab3-823a-e188c9a49743 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.370184 Aug 21 01:12:20.711973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 774/1443] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:12:20 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:20.723011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:20.723951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:20.741411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.743174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.744007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.747157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.748410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.749157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.837752 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e18af75-1539-4b7c-ab9c-a893be629862 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350" status: 202 len: 0 microversion: 2.1 time: 1.915777 Aug 21 01:12:20.838339 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 670/1444] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:12:18 2022] DELETE /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350 => generated 0 bytes in 1917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:12:20.846582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fdf02d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:20.956184 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40ceaf45-9a03-4409-9810-0ba09977d350 could not be found", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:20.957064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] HTTP exception thrown: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Request method failure captured: Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350 HTTP/1.1 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYZqGFp1ATY0X8ezXq5-Cxnpac-yO3_JZTVyGFU71nWbqlQpUxxxB-LvCKzMX749LmhqQ9-0uNayZemrjl5wRIMqHXH0DB8FWWj99meZLLSTTV0RLjKpv7PvHri1v6r1mIHZH29yJ5WXXsI23X3h6auEDbXyz7UUAtH2zaCykKDd0uw Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 5ef09c8f40204707a31a81da24b90085 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5ef09c8f40204707a31a81da24b90085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5ef09c8f40204707a31a81da24b90085", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5ef09c8f40204707a31a81da24b90085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5ef09c8f40204707a31a81da24b90085"}]}] Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 5ef09c8f40204707a31a81da24b90085 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsTestJSON-137123722-project Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 1cfe4a3f6ee24a2086e35af2dc30ffe0 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsTestJSON-137123722-project Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '40ceaf45-9a03-4409-9810-0ba09977d350'} Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40ceaf45-9a03-4409-9810-0ba09977d350 could not be found Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f023d5e5-ba18-43ee-a7e3-c6886a082791'] Aug 21 01:12:20.959829 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350. Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:20.964192 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:20.968422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Returning 404 to user: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:20.969508 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ef51729-71e6-4650-a2c5-52e0e8421295 tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350" status: 404 len: 111 microversion: 2.1 time: 0.126999 Aug 21 01:12:20.970160 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 671/1445] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:12:20 2022] GET /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:12:20.975567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:20.976435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:20.983728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.984282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.984805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:20.985657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:20.986337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:20.988734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:21.172316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:21.183161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10ae6177-1746-4374-bd66-a76d8e294488 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.210557 Aug 21 01:12:21.183773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 672/1446] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:20 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:21.202184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Calling method '.version_select at 0x7fc3fdf7a430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:21.252316 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40ceaf45-9a03-4409-9810-0ba09977d350 could not be found", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:21.254766 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] HTTP exception thrown: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Request method failure captured: Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350 HTTP/1.1 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYZqGFp1ATY0X8ezXq5-Cxnpac-yO3_JZTVyGFU71nWbqlQpUxxxB-LvCKzMX749LmhqQ9-0uNayZemrjl5wRIMqHXH0DB8FWWj99meZLLSTTV0RLjKpv7PvHri1v6r1mIHZH29yJ5WXXsI23X3h6auEDbXyz7UUAtH2zaCykKDd0uw Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 5ef09c8f40204707a31a81da24b90085 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5ef09c8f40204707a31a81da24b90085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5ef09c8f40204707a31a81da24b90085", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5ef09c8f40204707a31a81da24b90085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5ef09c8f40204707a31a81da24b90085"}]}] Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 5ef09c8f40204707a31a81da24b90085 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsTestJSON-137123722 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsTestJSON-137123722-project Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 1cfe4a3f6ee24a2086e35af2dc30ffe0 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsTestJSON-137123722-project Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '40ceaf45-9a03-4409-9810-0ba09977d350'} Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40ceaf45-9a03-4409-9810-0ba09977d350 could not be found Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4aa1d243-3163-4e2f-91c0-f7cf006ba9e6'] Aug 21 01:12:21.257986 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350. Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 Aug 21 01:12:21.263285 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:21.269603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] Returning 404 to user: Floating IP not found for ID 40ceaf45-9a03-4409-9810-0ba09977d350 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:21.270809 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9024ce1-4f61-4aca-9eb0-37bb1012fe7f tempest-FloatingIPsTestJSON-137123722 tempest-FloatingIPsTestJSON-137123722-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350" status: 404 len: 111 microversion: 2.1 time: 0.072665 Aug 21 01:12:21.271730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 673/1447] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:12:21 2022] DELETE /compute/v2.1/os-floating-ips/40ceaf45-9a03-4409-9810-0ba09977d350 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:21.359106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:12:21.378359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33621b89-e97d-4816-b6bb-c716a128fbd8 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 2423 microversion: 2.25 time: 0.664129 Aug 21 01:12:21.380597 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 775/1448] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:20 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 2423 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:21.414885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:21.419538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:21.428059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:21.428742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:21.429217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:21.429985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:21.430676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:21.431102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:21.459300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'flavor' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:12:21.477718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Going to try to live migrate instance to n-h1-master-1 {{(pid=122483) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:12:22.204171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:22.204793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:22.215288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:22.215785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:22.216226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:22.217552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:22.218233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:22.219263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:22.659997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:22.680299 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d54c5d0e-ec1a-405f-908a-53419948ae37 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.480301 Aug 21 01:12:22.680954 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 776/1449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:22 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:23.702769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:23.704106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:23.713288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:23.714064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:23.714669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:23.715571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:23.716178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:23.716750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:23.918388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc51df44-629e-47bc-842a-f13587aa6283 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/action" status: 202 len: 0 microversion: 2.25 time: 2.507324 Aug 21 01:12:23.923153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 674/1450] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:12:21 2022] POST /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/action => generated 0 bytes in 2510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:12:23.936822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:23.937456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:23.957598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:23.958665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:23.959619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:23.964349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:23.965085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:23.965808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:24.240698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:24.250450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73d95969-9cac-4362-aa39-124a5a4eddc3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.551479 Aug 21 01:12:24.267232 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 777/1451] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:23 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:24.272351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:24.281362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:24.290422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:24.290906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:24.291538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:24.293108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:24.297454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:24.298145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:24.578902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:24.600368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:24.608387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:24.610496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:24.611103 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d27fc17b-a242-47c2-9968-703bad606de0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.684370 Aug 21 01:12:24.613022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 675/1452] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:23 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:24.635515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0098138-53ea-41ef-8a6c-14f3a7cdb35a tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1589 microversion: 2.1 time: 0.366884 Aug 21 01:12:24.649391 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 778/1453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:24 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1589 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:24.870581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12dabd6-7399-4cd0-a253-bd66898c7daf", "tag": "fdac7d31-989f-4109-a3f5-9c8a2c72824e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:24.898633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:24.899414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:24.901280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:24.939083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] Creating event network-changed:fdac7d31-989f-4109-a3f5-9c8a2c72824e for instance f12dabd6-7399-4cd0-a253-bd66898c7daf on n-h2-master-1 Aug 21 01:12:24.957619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a8433213-9750-4d38-9fcf-09b84b190940 req-6a4c0bac-b807-4f29-a005-e2ef56db3c1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343092 Aug 21 01:12:24.967756 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 676/1454] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:25.082150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Calling method '.version_select at 0x7fc3fa03aaf0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:25.114135 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:25.115034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Neutron security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:12:25.115799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] HTTP exception thrown: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.115799 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Request method failure captured: Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/a74b3201-2215-4c37-9afa-6ebc01fe8b82 HTTP/1.1 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ4jVm2DzB8koa1HAvq0RlVT74wvorwuX4QoH_mQ1t2pTr8yLoG0YfKFgEcx_6MADjS5cdIImxUbQFDQ9dDL5QNzqUP1aN7alFpwDTa7saA4LwanfWBBKH0FrUTxT9mTMW-3ZV3SdtkHcOjaZLeYFPqsTG7qB2j4XZsBEakSQ32_d4 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c0caa335f1945d19fa908bb8eb4d5ef", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}] Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1f54a9dab8d0485a9f052a115d4810d7 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: exception: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a74b3201-2215-4c37-9afa-6ebc01fe8b82'} Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:25.118325 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] Aug 21 01:12:25.122276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.128927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Returning 404 to user: Security group a74b3201-2215-4c37-9afa-6ebc01fe8b82 does not exist Aug 21 01:12:25.128927 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-5a14e544-516f-4766-9736-20a17b4bb5d1'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:25.130169 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab62e268-620f-447a-b9e5-cd378613a78a tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/a74b3201-2215-4c37-9afa-6ebc01fe8b82" status: 404 len: 194 microversion: 2.1 time: 0.426023 Aug 21 01:12:25.130971 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 779/1455] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:12:24 2022] DELETE /compute/v2.1/os-security-groups/a74b3201-2215-4c37-9afa-6ebc01fe8b82 => generated 194 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:12:25.144896 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebbb14c6-614c-4a2d-9756-35765d13ff83 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008280 Aug 21 01:12:25.145452 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 677/1456] 10.222.0.46 () {58 vars in 1164 bytes} [Sun Aug 21 01:12:25 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 21 01:12:25.157913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d768c699-5b09-40b4-aa22-92ad07b03bb6 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Calling method '.version_select at 0x7fc3f9c66310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:25.273510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:25.274216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:25.282832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:25.283330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:25.288443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:25.289406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:25.289899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:25.290487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:25.511832 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d768c699-5b09-40b4-aa22-92ad07b03bb6 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.360686 Aug 21 01:12:25.512424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 780/1457] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:12:25 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:25.528598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Calling method '.version_select at 0x7fc3fa1a1c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:25.711775 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:25.712599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 21 01:12:25.712599 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Request method failure captured: Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/c53a7966-1a0e-4c59-afac-b6af5f1cfc53 HTTP/1.1 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ4jVm2DzB8koa1HAvq0RlVT74wvorwuX4QoH_mQ1t2pTr8yLoG0YfKFgEcx_6MADjS5cdIImxUbQFDQ9dDL5QNzqUP1aN7alFpwDTa7saA4LwanfWBBKH0FrUTxT9mTMW-3ZV3SdtkHcOjaZLeYFPqsTG7qB2j4XZsBEakSQ32_d4 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c0caa335f1945d19fa908bb8eb4d5ef", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}] Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1f54a9dab8d0485a9f052a115d4810d7 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: exception: Insufficient rights for removing default security group. Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c53a7966-1a0e-4c59-afac-b6af5f1cfc53'} Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:25.714498 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] Aug 21 01:12:25.719307 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:25.723746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 21 01:12:25.723746 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-c6701c52-809f-4829-a7ff-2f9ecc4ebed9'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:25.725096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aeef6017-8674-4fb6-a3e0-0e4e4ca012de tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/c53a7966-1a0e-4c59-afac-b6af5f1cfc53" status: 400 len: 182 microversion: 2.1 time: 0.202203 Aug 21 01:12:25.726335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 781/1458] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:12:25 2022] DELETE /compute/v2.1/os-security-groups/c53a7966-1a0e-4c59-afac-b6af5f1cfc53 => generated 182 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:12:25.732534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:25.734148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:25.744147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:25.746116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:25.746787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:25.747526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:25.747982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:25.748460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:26.041707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:26.051382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:26.054359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:26.055786 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2af43f02-cabb-4d9f-81a2-4850f0913801 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.328265 Aug 21 01:12:26.056502 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 782/1459] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:25 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:26.061500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Calling method '.version_select at 0x7fc3f9b8f940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:26.087802 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:26.089713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Neutron security group 5a109cf3-8703-4345-b983-6c743d71c944 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:12:26.090447 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] HTTP exception thrown: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.090447 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Request method failure captured: Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-security-groups/5a109cf3-8703-4345-b983-6c743d71c944 HTTP/1.1 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ4jVm2DzB8koa1HAvq0RlVT74wvorwuX4QoH_mQ1t2pTr8yLoG0YfKFgEcx_6MADjS5cdIImxUbQFDQ9dDL5QNzqUP1aN7alFpwDTa7saA4LwanfWBBKH0FrUTxT9mTMW-3ZV3SdtkHcOjaZLeYFPqsTG7qB2j4XZsBEakSQ32_d4 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c0caa335f1945d19fa908bb8eb4d5ef", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}] Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1f54a9dab8d0485a9f052a115d4810d7 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: exception: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5a109cf3-8703-4345-b983-6c743d71c944'} Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:26.092603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] Aug 21 01:12:26.096514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.101800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Returning 404 to user: Security group 5a109cf3-8703-4345-b983-6c743d71c944 does not exist Aug 21 01:12:26.101800 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-68e26bd9-7798-433e-b996-6039260e3f7e'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:26.103576 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a310a9b5-697d-4e91-a7d8-e968fdabd98b tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/5a109cf3-8703-4345-b983-6c743d71c944" status: 404 len: 194 microversion: 2.1 time: 0.045885 Aug 21 01:12:26.110733 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 783/1460] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:12:26 2022] GET /compute/v2.1/os-security-groups/5a109cf3-8703-4345-b983-6c743d71c944 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:26.116950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Action: 'update', calling method: .version_select at 0x7fc3f9e15280>, body: {"security_group": {"name": "tempest-sg-2140304683", "description": "tempest-description-161647206"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:26.177025 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:12:26.179015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Neutron security group e9169b46-cc8f-4397-b831-387a75703b91 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:12:26.179944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] HTTP exception thrown: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.179944 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Request method failure captured: Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-security-groups/e9169b46-cc8f-4397-b831-387a75703b91 HTTP/1.1 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 101 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ4jVm2DzB8koa1HAvq0RlVT74wvorwuX4QoH_mQ1t2pTr8yLoG0YfKFgEcx_6MADjS5cdIImxUbQFDQ9dDL5QNzqUP1aN7alFpwDTa7saA4LwanfWBBKH0FrUTxT9mTMW-3ZV3SdtkHcOjaZLeYFPqsTG7qB2j4XZsBEakSQ32_d4 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8c0caa335f1945d19fa908bb8eb4d5ef", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8c0caa335f1945d19fa908bb8eb4d5ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8c0caa335f1945d19fa908bb8eb4d5ef"}]}] Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8c0caa335f1945d19fa908bb8eb4d5ef Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1f54a9dab8d0485a9f052a115d4810d7 Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1961368406-project Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: {"security_group": {"name": "tempest-sg-2140304683", "description": "tempest-description-161647206"}} Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: exception: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e9169b46-cc8f-4397-b831-387a75703b91', 'body': {'security_group': {'name': 'tempest-sg-2140304683', 'description': 'tempest-description-161647206'}}} Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:12:26.182308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] Aug 21 01:12:26.186242 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:26.192548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] Returning 404 to user: Security group e9169b46-cc8f-4397-b831-387a75703b91 does not exist Aug 21 01:12:26.192548 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-804b8a1d-5a59-4453-8972-9003eea87519'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:26.193811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12a6b512-2971-4bea-80e1-00f38c5208c8 tempest-SecurityGroupsNegativeTestJSON-1961368406 tempest-SecurityGroupsNegativeTestJSON-1961368406-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/e9169b46-cc8f-4397-b831-387a75703b91" status: 404 len: 194 microversion: 2.1 time: 0.081645 Aug 21 01:12:26.204549 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 784/1461] 10.222.0.46 () {60 vars in 1290 bytes} [Sun Aug 21 01:12:26 2022] PUT /compute/v2.1/os-security-groups/e9169b46-cc8f-4397-b831-387a75703b91 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:26.369884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:26.390561 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ceba57cf-97ee-458a-a15d-9ebf97517dd4 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 1.122163 Aug 21 01:12:26.392674 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 678/1462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:25 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:27.081767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:27.082761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:27.091473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:27.093224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:27.093890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:27.094811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:27.095463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:27.096138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:27.412791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:27.413580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:27.436293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:27.437055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:27.437584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:27.438408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:27.438959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:27.439554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:27.519277 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:27.531683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:27.547800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:27.549229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f01b5698-3e21-4835-839c-e68bf3aa9598 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.474725 Aug 21 01:12:27.550219 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 785/1463] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:27 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:28.121910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:28.134993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a32c6db8-2254-4149-bbe3-94b8928f2a1f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.725893 Aug 21 01:12:28.153100 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 679/1464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:27 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:28.575386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:28.576299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:28.588142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:28.593557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:28.594127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:28.594895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:28.595361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:28.595780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:29.159184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:29.159813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:29.179450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:29.180197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:29.180846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:29.181743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:29.182351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:29.182936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:29.247175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:29.258113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:29.259930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:29.261480 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b94448f3-927d-4976-bf3d-89887d74e8ac tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.690101 Aug 21 01:12:29.276303 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 786/1465] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:28 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:29.516919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:29.525921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acf183bd-f8a6-4bcf-830e-5c82da3e5bf7 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.370574 Aug 21 01:12:29.545003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 680/1466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:29 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:30.288784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:30.289574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:30.310393 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=70 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:30.314651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:30.319029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:30.321290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:30.322182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:30.325805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:30.328034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:30.553089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:30.553711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:30.568561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:30.569081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:30.569513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:30.570493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:30.573030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:30.573488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:30.764369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:30.780992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:30.786474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:30.790037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4140ce1-795a-4bea-8629-d56f230883b6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.504686 Aug 21 01:12:30.791572 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 787/1467] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:30 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:30.891999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:30.905547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80b8b240-4177-41e8-97a9-c7e1f03ecb7e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.355199 Aug 21 01:12:30.908832 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 681/1468] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:30 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:31.818253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:31.819059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:31.833495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:31.834750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:31.835587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:31.836687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:31.837605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:31.838290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:31.931880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:31.933117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:31.943985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:31.944261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:31.954559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:31.956324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:31.956834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:31.957281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:32.229613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:32.249563 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-01f81b2e-825a-416f-822f-d431090a6ab5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.321447 Aug 21 01:12:32.250161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 682/1469] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:31 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:32.607244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:32.624729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:32.633164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:32.634441 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97cf5db8-b70b-4e84-a9ca-d82d0c570837 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.822000 Aug 21 01:12:32.639372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 788/1470] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:31 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:32.836810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-37557dba-afe3-4271-8e85-01c690108f4c tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Calling method '.version_select at 0x7fc3fde9b1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:32.874117 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-37557dba-afe3-4271-8e85-01c690108f4c tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-37557dba-afe3-4271-8e85-01c690108f4c tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/images/63760b0e-cf97-49c8-9ac0-42eb31e0fcd4/metadata/os_distro HTTP/1.1 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: action_args: {'image_id': '63760b0e-cf97-49c8-9ac0-42eb31e0fcd4', 'id': 'os_distro'} Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63760b0e-cf97-49c8-9ac0-42eb31e0fcd4 Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:32.876483 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63760b0e-cf97-49c8-9ac0-42eb31e0fcd4 could not be found. Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-37557dba-afe3-4271-8e85-01c690108f4c tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:32.881676 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-37557dba-afe3-4271-8e85-01c690108f4c tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "DELETE /compute/v2.1/images/63760b0e-cf97-49c8-9ac0-42eb31e0fcd4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.329839 Aug 21 01:12:32.885551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 683/1471] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:12:32 2022] DELETE /compute/v2.1/images/63760b0e-cf97-49c8-9ac0-42eb31e0fcd4/metadata/os_distro => generated 62 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:12:32.892603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13ddaeab-09dc-4cb1-aa23-f7a04f9859eb tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Calling method '.version_select at 0x7fc3fa5c3820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:32.940110 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-13ddaeab-09dc-4cb1-aa23-f7a04f9859eb tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13ddaeab-09dc-4cb1-aa23-f7a04f9859eb tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/images/58271f3e-5bc8-4947-8533-5bdcaaa53e7f/metadata/os_version HTTP/1.1 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: action_args: {'image_id': '58271f3e-5bc8-4947-8533-5bdcaaa53e7f', 'id': 'os_version'} Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58271f3e-5bc8-4947-8533-5bdcaaa53e7f Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:32.946712 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58271f3e-5bc8-4947-8533-5bdcaaa53e7f could not be found. Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:32.951558 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:32.959023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13ddaeab-09dc-4cb1-aa23-f7a04f9859eb tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:32.964570 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13ddaeab-09dc-4cb1-aa23-f7a04f9859eb tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "GET /compute/v2.1/images/58271f3e-5bc8-4947-8533-5bdcaaa53e7f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.076851 Aug 21 01:12:32.967187 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 789/1472] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:12:32 2022] GET /compute/v2.1/images/58271f3e-5bc8-4947-8533-5bdcaaa53e7f/metadata/os_version => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:12:32.980533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c58b2a1-f0a6-48f6-b5fd-3d12cf531ba5 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Calling method '.version_select at 0x7fc3fde75310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:33.015502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8c58b2a1-f0a6-48f6-b5fd-3d12cf531ba5 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c58b2a1-f0a6-48f6-b5fd-3d12cf531ba5 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/images/721a46bf-18e0-42d7-bec8-1b1690c1e9de/metadata HTTP/1.1 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: action_args: {'image_id': '721a46bf-18e0-42d7-bec8-1b1690c1e9de'} Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 721a46bf-18e0-42d7-bec8-1b1690c1e9de Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:33.018032 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 721a46bf-18e0-42d7-bec8-1b1690c1e9de could not be found. Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c58b2a1-f0a6-48f6-b5fd-3d12cf531ba5 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c58b2a1-f0a6-48f6-b5fd-3d12cf531ba5 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "GET /compute/v2.1/images/721a46bf-18e0-42d7-bec8-1b1690c1e9de/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045630 Aug 21 01:12:33.022839 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 684/1473] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:12:32 2022] GET /compute/v2.1/images/721a46bf-18e0-42d7-bec8-1b1690c1e9de/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:12:33.030807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-544842e2-817a-4c8f-8ad4-4a89839a42c8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Action: 'update_all', calling method: .version_select at 0x7fc403301160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:33.072065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-544842e2-817a-4c8f-8ad4-4a89839a42c8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-544842e2-817a-4c8f-8ad4-4a89839a42c8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/images/ce00f75c-b199-4ae5-a6e0-51f37260202b/metadata HTTP/1.1 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 57 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: action_args: {'image_id': 'ce00f75c-b199-4ae5-a6e0-51f37260202b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ce00f75c-b199-4ae5-a6e0-51f37260202b Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:33.074605 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce00f75c-b199-4ae5-a6e0-51f37260202b could not be found. Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-544842e2-817a-4c8f-8ad4-4a89839a42c8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:33.079091 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-544842e2-817a-4c8f-8ad4-4a89839a42c8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "PUT /compute/v2.1/images/ce00f75c-b199-4ae5-a6e0-51f37260202b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050006 Aug 21 01:12:33.087583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c497a19-87e0-4060-9745-8ad31efe2ce8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Action: 'update', calling method: .version_select at 0x7fc3fdefcee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:33.091790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 790/1474] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:12:33 2022] PUT /compute/v2.1/images/ce00f75c-b199-4ae5-a6e0-51f37260202b/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:12:33.120019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-3c497a19-87e0-4060-9745-8ad31efe2ce8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c497a19-87e0-4060-9745-8ad31efe2ce8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/images/a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864/metadata/os_distro HTTP/1.1 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 30 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: {"meta": {"os_distro": "alt"}} Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: action_args: {'image_id': 'a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864 Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:33.128067 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864 could not be found. Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.132155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c497a19-87e0-4060-9745-8ad31efe2ce8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:33.145213 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c497a19-87e0-4060-9745-8ad31efe2ce8 tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "PUT /compute/v2.1/images/a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062234 Aug 21 01:12:33.156362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94a59d39-ffbf-4c51-b584-0cb082d5d43d tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Action: 'create', calling method: .version_select at 0x7fc3fa1b9dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:33.161445 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 685/1475] 10.222.0.46 () {60 vars in 1310 bytes} [Sun Aug 21 01:12:33 2022] PUT /compute/v2.1/images/a56a7fcc-a3fd-41ac-9b42-c1d34cf4f864/metadata/os_distro => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:12:33.187997 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-94a59d39-ffbf-4c51-b584-0cb082d5d43d tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] HTTP exception thrown: Image not found. Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94a59d39-ffbf-4c51-b584-0cb082d5d43d tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Request method failure captured: Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/images/5a54670b-d30c-4c82-a593-df6c33680c00/metadata HTTP/1.1 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 57 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaAkBhFsdNDxABG5kOHAwhlQXv3RmDjEPsMycgEgLurOPJOp1CnXGaD0SP_knJfkFhIT6Hcy9JLCi0_KpfyH41YnZhbjVbF4Amns1lnLWJ3VjljmI4MMm2L0JLKhpDcStg8QIuEbDdsNZmJ7p2uKgfN-VO01M9JPEtTg5Zb9S8L7Bk Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83d569790af2403fb3d2e0025f021449", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83d569790af2403fb3d2e0025f021449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83d569790af2403fb3d2e0025f021449"}]}] Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 83d569790af2403fb3d2e0025f021449 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-349475334 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b5751bf986f7456cb5cee4644f5a3559 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-349475334-project Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: action_args: {'image_id': '5a54670b-d30c-4c82-a593-df6c33680c00', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5a54670b-d30c-4c82-a593-df6c33680c00 Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:12:33.190958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a54670b-d30c-4c82-a593-df6c33680c00 could not be found. Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:12:33.197988 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:12:33.210925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94a59d39-ffbf-4c51-b584-0cb082d5d43d tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:12:33.210925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94a59d39-ffbf-4c51-b584-0cb082d5d43d tempest-ImagesMetadataNegativeTestJSON-349475334 tempest-ImagesMetadataNegativeTestJSON-349475334-project] 10.222.0.46 "POST /compute/v2.1/images/5a54670b-d30c-4c82-a593-df6c33680c00/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047511 Aug 21 01:12:33.210925 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 791/1476] 10.222.0.46 () {60 vars in 1281 bytes} [Sun Aug 21 01:12:33 2022] POST /compute/v2.1/images/5a54670b-d30c-4c82-a593-df6c33680c00/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:12:33.272033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:33.272867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:33.285016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:33.287864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:33.289035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:33.291315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:33.293058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:33.293753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:33.635836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:33.672980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:33.673781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:33.685501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:33.686253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:33.688197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:33.692915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:33.693210 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b444412c-a359-4008-82e4-8087e6bbe70e tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.424171 Aug 21 01:12:33.693769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:33.694322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:33.696979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 686/1477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:33 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:34.164989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:34.175840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:34.183046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:34.184273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ece9eede-2d18-4c18-b808-23004302521b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.516104 Aug 21 01:12:34.184859 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 792/1478] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:33 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:34.718146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:34.718760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:34.735055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:34.735558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:34.735991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:34.736708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:34.737248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:34.737672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:34.758008 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:35.071217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:35.082468 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0601f70f-2c72-4b6d-b258-e1f388dd1825 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.366076 Aug 21 01:12:35.083429 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 687/1479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:34 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:35.209236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:35.209840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:35.220877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:35.221923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:35.222555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:35.223957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:35.224643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:35.225840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:36.107781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:36.109890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:36.119973 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=48 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:36.124195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:36.125416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:36.126172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:36.127504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:36.129819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:36.130690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:36.144885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:36.184810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:36.189855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:36.194349 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-274f0c41-eb65-4355-80bc-e31260f0275a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.990567 Aug 21 01:12:36.218663 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 793/1480] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:35 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:36.524295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:36.533562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68e42945-287c-4556-a9e9-139c4819f0b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1477 microversion: 2.1 time: 0.433028 Aug 21 01:12:36.534173 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 688/1481] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:36 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1477 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:37.196752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-unplugged", "status": "completed", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:37.221777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:37.222284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:37.222690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:37.222807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:37.223010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:37.238791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:37.239362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:37.240048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:37.241018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:37.241687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:37.242382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:37.252396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Creating event network-vif-unplugged:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h2-master-1 Aug 21 01:12:37.266765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] Instance 2c05f309-8dda-477c-8fca-742bb28b0364 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:12:37.314461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-892ec799-7297-4a13-98a9-5d2f3bb4d5ad req-4aa4a024-3e1f-4d2c-a9e7-49819e67ec1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123553 Aug 21 01:12:37.315887 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 794/1482] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:37.510118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:37.525178 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:37.528598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:37.533181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33292660-958e-4238-bf3b-9514e0580b9b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.315689 Aug 21 01:12:37.534613 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 689/1483] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:37 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:12:37.556089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:37.556964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:37.566237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:37.567211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:37.567810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:37.568674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:37.569346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:37.570020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:37.975493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:37.984281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c79ed5f8-02ef-4e76-8d1a-542939bd9fe9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1476 microversion: 2.1 time: 0.432819 Aug 21 01:12:37.990923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 795/1484] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:37 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:38.558554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:38.560000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:38.568613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:38.569141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:38.569566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:38.570277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:38.570727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:38.571147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:38.940255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:38.962726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:38.968332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:38.972641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6a716c0-207c-4af6-898a-1213018eaadd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.418901 Aug 21 01:12:38.976057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 690/1485] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:38 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:12:39.026866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:39.027500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:39.046184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:39.046858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:39.047357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:39.048104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:39.049766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:39.050418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:39.336236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:39.359916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:39.360553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:39.361194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:39.408656 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Creating event network-changed:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h2-master-1 Aug 21 01:12:39.421171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] Instance 2c05f309-8dda-477c-8fca-742bb28b0364 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:12:39.459722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8ed3f8f7-668b-4851-9b83-b1aa5d698a9b req-60985974-ba71-4d35-8959-d68cf46e3e65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127074 Aug 21 01:12:39.461395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:39.462207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 691/1486] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:39.491662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3fb70157-3c9f-4b2a-9e62-31958fc8516f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1474 microversion: 2.1 time: 0.481395 Aug 21 01:12:39.507421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 796/1487] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:39 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1474 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:40.001837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:40.003266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:40.028041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:40.028890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:40.029559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:40.030708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:40.031362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:40.031993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:40.535606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:40.536225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:40.555380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:40.556119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:40.557447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:40.558083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:40.562623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:40.564727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:41.026730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:41.041027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:41.050173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:41.051634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f93e706a-30ff-41ae-9cd3-9703011df0a2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 1.056545 Aug 21 01:12:41.056941 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 692/1488] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:39 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:41.102287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:41.103555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:41.114494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:41.115875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:41.118274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:41.121267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:41.121868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:41.122388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:41.515679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:41.518129 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:41.526244 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5f17a48-4ed8-4132-ad49-33e4554ffa9d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1474 microversion: 2.1 time: 0.994826 Aug 21 01:12:41.540168 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 797/1489] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:40 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1474 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:41.921484 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67082b68-5500-4a9c-8aca-25644e84396a tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1813 microversion: 2.1 time: 0.822602 Aug 21 01:12:41.927255 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 693/1490] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:41 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1813 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:41.945491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:41.948893 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:12:41.948893 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:12:41.950067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:41.950551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:41.950985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:41.951718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:41.952167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:41.952590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:42.084404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:42.095591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:42.099455 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-045a839f-97c2-492f-9c35-ddf4303f41e7 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.157874 Aug 21 01:12:42.119406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:42.119901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:42.120336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:42.128257 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 798/1491] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:12:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:42.167137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:42.167704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:42.172866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:42.547474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:42.548089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:42.557147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:42.559174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:42.559811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:42.562334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:42.563330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:42.565307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:42.661122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:42.681929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:42.687409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:42.693423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8c7c85b-63f3-4b95-b612-23a9a62c56af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.612002 Aug 21 01:12:42.713367 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 694/1492] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:42 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:42.887247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:42.910594 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7d3d2eb-d794-4f25-aa6c-c9d0954c2121 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1474 microversion: 2.1 time: 0.367253 Aug 21 01:12:42.940571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 799/1493] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:42 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:43.735347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:43.736106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:43.747128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:43.753648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:43.754498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:43.755484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:43.756155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:43.756844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:43.944300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:43.946758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:43.968279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:43.969279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:43.969950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:43.970915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:43.972069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:43.972751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:44.491096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:44.504897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:44.509303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:44.514308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a2f5ca7-f565-44a1-aa2f-8399a5946759 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.784721 Aug 21 01:12:44.537479 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 695/1494] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:43 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:44.800389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:44.821254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6149b3b-4826-4c28-abe2-875f48005a7b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1471 microversion: 2.1 time: 0.881397 Aug 21 01:12:44.822097 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 800/1495] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:43 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1471 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:44.844906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:44.846399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:44.859326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:44.866026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:44.874628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:44.875714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:44.876350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:44.877002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.189173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-121ece33-6fdc-4a21-9b78-79af3e540028 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "POST /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364/action" status: 202 len: 0 microversion: 2.1 time: 0.348705 Aug 21 01:12:45.199244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:45.200377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:45.207464 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 696/1496] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:12:44 2022] POST /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:12:45.215823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.217796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.221573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.222759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.223393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.224152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.265357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb15efe-a01d-4313-869e-bffdb91a3470", "device": "/dev/xvdb"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:45.270351 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:45.277474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.278839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.279460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.280435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.281149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.282035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.613105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:45.633747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-522fcbb9-46ee-41b8-bce6-fd31abe761e1 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.438733 Aug 21 01:12:45.634547 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 801/1497] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:45 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:45.645948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:45.646571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:45.672692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.673499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.674201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.675370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.680730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.681470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.781558 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32234ece-7599-41d0-97e7-171e45172dfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519595 Aug 21 01:12:45.784521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 697/1498] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:12:45 2022] POST /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:45.826963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "name": "network-vif-unplugged", "status": "completed", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:45.887463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:45.890881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:45.893726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:45.915558 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] Creating event network-vif-unplugged:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h2-master-1 Aug 21 01:12:45.933263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b323ba4e-1cf7-41c8-9bf8-cabc38135f7c req-2030ae03-deaa-4d99-ab9a-9bb6b15b6d44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125041 Aug 21 01:12:45.939024 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 698/1499] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:46.111743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:46.124549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:46.129097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:46.138327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2abe1307-8074-46e6-883b-399d9e11f0e5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.498432 Aug 21 01:12:46.139062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 802/1500] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:45 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:46.662419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:46.663729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:46.685399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:46.688673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:46.691318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:46.693137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:46.694482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:46.697542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:47.166091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:47.167339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:47.185064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:47.185562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:47.186001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:47.186717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:47.197611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:47.199239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:47.420654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:47.434647 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c6af568d-57a1-488a-a27a-43afd37521dd tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.779605 Aug 21 01:12:47.437180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 699/1501] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:46 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:47.515150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:47.527716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:47.529619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:47.531626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04c124ee-5b78-48ed-9c24-0311b060bfcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.369386 Aug 21 01:12:47.533520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 803/1502] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:47 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:47.722331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-347363722", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:47.808147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] validate_networks() for [('70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:12:48.468078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:48.469450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:48.487406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:48.489388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:48.492310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:48.493806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:48.496061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:48.497129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:48.882940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:48.910291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05d08c6d-bde8-4327-95be-c613ca972392 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.446239 Aug 21 01:12:48.911695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 804/1503] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:48 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:48.917918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:48.918839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:48.925647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:48.926624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:48.927306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:48.928405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:48.929097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:48.929718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.219759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:49.235566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:49.237322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:49.247058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-affa7a3c-fe68-489d-a4b3-935421d3cfb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.333606 Aug 21 01:12:49.249057 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 805/1504] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:48 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:49.265496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:49.305273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:49.305440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:49.306149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.342372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] Creating event network-changed:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h2-master-1 Aug 21 01:12:49.349746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f798d92e-bc76-4538-b0ce-45e4ea487682 req-04ef4b45-7008-4c25-8ac6-4fd004627e3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097619 Aug 21 01:12:49.351970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 806/1505] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:49.897794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:12:49.898833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:12:49.899565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:12:49.900182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:12:49.900761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:12:49.920410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:49.921352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:49.921981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.922866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:49.925497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:49.926557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.933505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:49.934884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:49.946361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:49.951415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:49.952315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.953336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:49.957034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:49.957734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:49.979119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:12:49.999100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for user 2a2ecc1a81574d7aa2679307a7985908 and project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:12:50.046768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:12:50.049321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:12:50.174817 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-380ba5e8-2fd6-4989-91da-c370fa3bf6e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713176 Aug 21 01:12:50.176592 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 700/1506] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:12:50.196261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d3dd327-aa4f-4f0b-885e-7af818da4334 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:50.197750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d3dd327-aa4f-4f0b-885e-7af818da4334 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:50.248403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:50.259207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b4a1b37-8670-4d06-9f6e-be688c2f593b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.331377 Aug 21 01:12:50.260576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 807/1507] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:49 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:50.271680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:50.275457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:50.297340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:50.305489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:50.306100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:50.307051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:50.307625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:50.308146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:50.333718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7d3dd327-aa4f-4f0b-885e-7af818da4334 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:50.349482 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d3dd327-aa4f-4f0b-885e-7af818da4334 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1207 microversion: 2.1 time: 0.160624 Aug 21 01:12:50.364366 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 701/1508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:50 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1207 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:50.638763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:50.663809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:50.668444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:50.670327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36c98d8f-d4d9-492b-93aa-db1d16fc0669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.402583 Aug 21 01:12:50.671772 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 808/1509] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:50 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:50.947519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-plugged", "status": "completed", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:50.970990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:50.973224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:50.976283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.010596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Creating event network-vif-plugged:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h2-master-1 Aug 21 01:12:51.020070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] Instance 2c05f309-8dda-477c-8fca-742bb28b0364 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:12:51.062537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-49d74c3f-db40-45ef-8b02-1aba69a4c084 req-b7aaccb1-3aec-487a-9235-4e7404c35a73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117732 Aug 21 01:12:51.064054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 702/1510] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:51.281363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:51.282639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:51.309767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.310694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.312475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.313631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.316127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.317708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.373088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:51.374039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:51.399046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.403783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.404463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.405106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.405572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.405991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.472696 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:51.635263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:51.644460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8e8e4f4-e45d-474a-9d0d-314a6c7c7e11 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.367130 Aug 21 01:12:51.647329 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 809/1511] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:51 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:51.695253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:51.695857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:51.712234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.712707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.721646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.724539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:51.726782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:51.728057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:51.773455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:51.781876 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d57cf6c1-24f3-425f-a569-a0b2c56fd76e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1203 microversion: 2.1 time: 0.414326 Aug 21 01:12:51.796153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 703/1512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:51 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1203 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:51.990182 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:52.050371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:52.060244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:52.074387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:52.078167 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-90198c94-acf7-4a14-bc3e-c367bbc966c6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.387327 Aug 21 01:12:52.079379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 810/1513] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:51 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:12:52.671697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:52.672706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:52.686758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:52.689566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:52.690288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:52.691478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:52.692053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:52.692598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:52.805637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:52.806258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:52.827185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:52.827677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:52.828103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:52.828864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:52.829310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:52.830020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:52.998937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:53.009136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd3ea0d3-8f0a-4d55-b180-15f9f000dd88 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1265 microversion: 2.1 time: 0.208064 Aug 21 01:12:53.014257 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 811/1514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:52 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:53.107793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:53.108717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:53.118682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:53.124034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:53.124480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:53.127117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:53.127963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:53.129126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:53.814234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:53.831364 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d00eb8f-811e-4124-a292-689f45e58b0d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 1.157161 Aug 21 01:12:53.834073 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 704/1515] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:52 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:53.850320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:53.874464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:53.875458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Searching by: {'deleted': False, 'project_id': '13b4ddb93fac43868ba8972d2f753e47'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:12:53.891461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:53.897628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:53.898360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:53.905899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:53.906995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:53.907667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:53.976495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:12:54.043907 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2cda30c9-929b-41da-b3a0-811c6fddcebd tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.208473 Aug 21 01:12:54.045393 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 705/1516] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:12:53 2022] GET /compute/v2.1/servers => generated 334 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:54.060183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:54.066440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:54.083246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.084271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.084990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.085964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.086647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.088096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.140034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.150449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.151941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.166365 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d767573d-6746-426a-97ea-750380a53a43 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 1.063692 Aug 21 01:12:54.170087 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 812/1517] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:53 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:12:54.175609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:54.189551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.194832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Searching by: {'deleted': False, 'project_id': '13b4ddb93fac43868ba8972d2f753e47'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:12:54.208587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.213156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.213836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.214801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.215706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.216301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.246369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.264413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f42b106d-6087-41dc-b748-da10dc9edc92 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1265 microversion: 2.1 time: 0.204652 Aug 21 01:12:54.265736 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 706/1518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:54 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:54.299380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:12:54.375061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:54.386637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.387000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.387432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.589582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-unplugged", "status": "completed", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:54.620501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.624059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.624652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.626605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46580aca-e271-41e0-a2f4-bb6ec4e1b765 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.454881 Aug 21 01:12:54.627282 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 813/1519] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:12:54 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:54.653671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ddd6e63-28b7-40f7-91fb-7c47d5e7d4a5 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:54.678452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ddd6e63-28b7-40f7-91fb-7c47d5e7d4a5 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029332 Aug 21 01:12:54.689985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 814/1520] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:12:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:54.695412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Creating event network-vif-unplugged:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:12:54.713983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] Instance 2c05f309-8dda-477c-8fca-742bb28b0364 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:12:54.753877 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d7490d72-c751-4190-af52-870cf9920160 req-8bd06880-5d02-4fa7-9ec8-d969a28b1671 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164591 Aug 21 01:12:54.756789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 707/1521] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:12:54.856789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:54.858607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:54.880549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.881311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.881748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.882670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:54.887821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:54.888468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:54.992562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:54.993335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:55.027273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.027776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.031225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.035851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.039622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.046428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.191360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:12:55.370952 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bb1a3fa-542c-482c-82c0-b53b30503167 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "DELETE /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 204 len: 0 microversion: 2.1 time: 0.388142 Aug 21 01:12:55.375177 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 708/1522] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:12:54 2022] DELETE /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:12:55.384365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:55.385098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:55.395212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.395717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.396153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.396979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.397851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.398282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.561846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:55.576506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-349b6ff2-c66b-4831-9bf0-9457f958eadc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.723441 Aug 21 01:12:55.593005 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 815/1523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:54 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:55.606623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:55.607244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:55.614593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.615631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.616562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.617486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.618098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.618807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.652317 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:55.843808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:55.867523 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-594517de-81b3-4d20-9f86-2f3ebf8fb00b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.273080 Aug 21 01:12:55.868905 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 816/1524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:55 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:55.886446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:55.887422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:55.895884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.896338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.897634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:55.901180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:55.901528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:55.901978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:56.035595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:56.060434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:56.062001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:56.068330 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa47f5ce-6ba1-411d-bd39-34eebe8b98da tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.694687 Aug 21 01:12:56.071511 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 709/1525] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:55 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:56.196116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:56.210355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd18c01a-500b-467b-9665-6c0f523d6cb7 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1703 microversion: 2.1 time: 0.339201 Aug 21 01:12:56.214652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 817/1526] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:55 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1703 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:56.602124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:56.603042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:56.623607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:56.624431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:56.625696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:56.626622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:56.627329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:56.627911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:56.888493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:56.892337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:56.911947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:56.912444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:56.913003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:56.913785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:56.914318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:56.914807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.279240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:57.287067 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adaf43d9-89a3-4d28-939f-30164f91d857 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.402427 Aug 21 01:12:57.287655 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 818/1527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:56 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:12:57.332108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:57.363141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:57.363141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:57.365088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.391922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Creating event network-changed:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:12:57.403534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] Instance 2c05f309-8dda-477c-8fca-742bb28b0364 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:12:57.442897 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8a6ffa68-4811-4121-a658-700bb49efd9f req-9740f988-7326-4938-955f-627641bc92c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136045 Aug 21 01:12:57.443895 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 819/1528] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:12:57.449843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:57.450659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:57.466173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:57.466660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:57.467091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.467805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:57.477121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:57.478051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.789211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:57.802967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:57.809926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:57.814431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed9db87d-ad3a-4f59-9410-1272d0ba9c97 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.369199 Aug 21 01:12:57.815023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 820/1529] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:57 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:57.831486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:57.832376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:57.844360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:57.844878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:57.845342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.846093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:57.846545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:57.846967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:57.968679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:57.996210 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6441baf5-d820-4d86-a1c3-28ec17b7e49d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 1.400084 Aug 21 01:12:58.011353 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 710/1530] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:56 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:58.021553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2079397574", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "f571a9bc-1442-458a-95ad-0fd0439cd9ac"}, {"uuid": "0fa182cb-5a96-412a-9df4-f78fbdef5974"}, {"uuid": "f571a9bc-1442-458a-95ad-0fd0439cd9ac"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:12:58.186068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] validate_networks() for [('f571a9bc-1442-458a-95ad-0fd0439cd9ac', None, None, None, None, None), ('0fa182cb-5a96-412a-9df4-f78fbdef5974', None, None, None, None, None), ('f571a9bc-1442-458a-95ad-0fd0439cd9ac', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:12:58.284921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:58.294990 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3f562b8-14f7-4a55-abd3-a8608849d0ce tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1703 microversion: 2.1 time: 0.467278 Aug 21 01:12:58.301865 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 821/1531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:57 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1703 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:58.333514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:58.334405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:58.353506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:58.354370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:58.354986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:58.355884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:58.356869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:58.363535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:58.746672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:58.758671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53be130d-370b-4ec1-b977-acd772752cc0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.430253 Aug 21 01:12:58.761013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 822/1532] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:58 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:58.838798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:58.839392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:58.846803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:58.847294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:58.847729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:58.848448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:58.848924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:58.849622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:59.110551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:59.140518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:59.144610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:59.145436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9e1bbbd-9de6-42ea-b621-e0edab923869 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.311543 Aug 21 01:12:59.146408 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 823/1533] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:12:58 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:12:59.151958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:59.154287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:59.170296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:59.172007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:59.173104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:59.175500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:59.177050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:59.177570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:59.553589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:59.584271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71fc987b-fd4f-4dd4-8df1-083c67ad0d80 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.436273 Aug 21 01:12:59.589614 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 824/1534] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:59 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:59.601928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:59.604980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:12:59.616530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:59.617384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:59.618063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:59.618988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:12:59.619807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:12:59.620464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:12:59.959952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:12:59.971283 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-992ed962-4d5a-4579-88a9-b1464acfbb11 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1703 microversion: 2.1 time: 0.378578 Aug 21 01:12:59.987786 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 825/1535] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:59 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1703 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:12:59.994475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:12:59.995420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:00.002687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.003584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.004252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:00.005066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.005552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.006195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:00.334372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:00.340789 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:00.348342 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a394f3d-d837-4ee7-90ce-1b64bfd9e1b4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.357780 Aug 21 01:13:00.361728 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 826/1536] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:12:59 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:00.365484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:00.366102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:00.378556 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=78 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:00.380976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.381442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.381870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:00.382579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.383021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.383436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:00.689994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:00.706393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:00.709383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:00.711553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6311713-585d-44c0-b89b-101c890e5734 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.356395 Aug 21 01:13:00.712390 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 827/1537] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:00 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:00.718515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:00.719650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:00.729756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.730533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.731317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:00.733615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:00.734302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:00.734902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.041045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:01.072662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab6f035f-8c4d-4472-bc84-53ea97b831ed tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.350279 Aug 21 01:13:01.073355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 828/1538] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:00 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:01.094006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67035c79-2bb6-40e8-874b-628c13c6c026", "tag": "45573363-c1b5-4900-8306-63badfb5ca3a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:01.146630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.152275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.153125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.197734 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] Creating event network-changed:45573363-c1b5-4900-8306-63badfb5ca3a for instance 67035c79-2bb6-40e8-874b-628c13c6c026 on n-h1-master-1 Aug 21 01:13:01.209568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8f3aa4fb-e09c-438d-9eaa-00bd1f8702e9 req-fdfa2ee8-a9a1-4795-a925-e13d79b1a5e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128356 Aug 21 01:13:01.212603 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 829/1539] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:01.227269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:01.227967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:01.245475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.246035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.246477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.247209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.247655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.249634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.834525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:01.855931 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d51e4ae0-7d24-4de6-893a-c40a07ff211b tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1703 microversion: 2.1 time: 0.640216 Aug 21 01:13:01.859008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 830/1540] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:01 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1703 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:01.872606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987ec0ed-2e84-4741-808a-3666813311cd", "name": "network-vif-unplugged", "status": "completed", "tag": "f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:01.900474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.902008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.902643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.931796 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] Creating event network-vif-unplugged:f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee for instance 987ec0ed-2e84-4741-808a-3666813311cd on n-h1-master-1 Aug 21 01:13:01.939369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1b5bbc6e-e4ae-4f42-a5da-0b23c83cee83 req-feb4c6c4-5a35-4870-9d53-2328d252ab5d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078739 Aug 21 01:13:01.939993 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 831/1541] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:01.948847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:01.949904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:01.957720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.958518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.959155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:01.960054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:01.960715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:01.965684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:02.371480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:02.387927 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a31e73b-22f0-4a59-ab88-8cb3491e97e5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.445509 Aug 21 01:13:02.390906 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 832/1542] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:01 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:02.401431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:02.403935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:02.418567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:02.419063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:02.419497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:02.420205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:02.425352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:02.425810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:02.769924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:02.789152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:02.794005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:02.796907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15394a2f-e13f-4e26-b152-647e995d6ead tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.399748 Aug 21 01:13:02.798994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 833/1543] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:02 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:02.805526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:02.806725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:02.828520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:02.829640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:02.830480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:02.835018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:02.837062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:02.837873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:02.869738 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:03.287179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:03.333325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-20053c02-9428-46d2-ab2f-c7b02df467d8 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1470 microversion: 2.1 time: 0.527200 Aug 21 01:13:03.350565 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 834/1544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:02 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:03.362464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:03.363091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:03.370234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.371830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.372422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.373314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.374064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.374675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.493798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:03.505732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f0baf52-f4f8-4089-badf-b2613a6af8fa tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1635 microversion: 2.1 time: 0.153958 Aug 21 01:13:03.509260 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 835/1545] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:03 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1635 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:03.522549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:03.523831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:03.539089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.541437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.543323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.544218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.546368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.546915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.801337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4dfc622f-2905-43c7-a691-7a9318d0000d tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1859 microversion: 2.1 time: 0.287255 Aug 21 01:13:03.803180 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 836/1546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:03 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1859 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:03.809475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:03.810511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:03.818765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.819303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.819728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.820962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:03.820962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:03.821430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:03.942027 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:04.045393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:04.059895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84e583e0-865d-4134-a037-96fec2bf6a23 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.254088 Aug 21 01:13:04.060505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 837/1547] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:03 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:04.074271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:04.078173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:04.086393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:04.086877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:04.087307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:04.088082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:04.088801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:04.089233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:04.147640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lazy-loading 'flavor' on Instance uuid 39804aef-6cc7-4646-b04c-68554a76c011 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:13:04.163284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Going to try to live migrate instance to n-h1-master-1 {{(pid=122482) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:13:04.257949 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:04.369331 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:05.052725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:05.053302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:05.053756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:05.054232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:05.054710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:05.075795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.077956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.078670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.079656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.080203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.081664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.110667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Getting quotas for project 26ee54d7a3e84461b4e5aff422e87f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:05.117031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Getting quotas for user 83fa03ac4589405e911fda3211620529 and project 26ee54d7a3e84461b4e5aff422e87f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:05.135216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:13:05.138015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:13:05.224513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c4a3348-5377-4470-a476-37b17765e8eb tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.211466 Aug 21 01:13:05.225209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 711/1548] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 7213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:13:05.242242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:05.243049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:05.259981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.264647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.265362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.266310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.267218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.267817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.458218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5af78578-056a-4092-a820-de79ae1262b0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/action" status: 202 len: 0 microversion: 2.1 time: 1.396560 Aug 21 01:13:05.458843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 838/1549] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:13:04 2022] POST /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/action => generated 0 bytes in 1398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:13:05.464079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:05.464946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:05.482269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.482976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.483643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.488498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.489748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.490485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.684128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:05.693919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1c36935-cd7b-4bb3-8e97-42f09074ebba tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1463 microversion: 2.1 time: 0.233376 Aug 21 01:13:05.708988 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 839/1550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:05 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1463 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:05.713592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:05.714210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:05.738789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.739613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.740588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.741932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.742629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.743297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.813859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:05.832883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:05.839812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:05.841407 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b59605a8-a372-42fb-a26d-fc18cea90693 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.612524 Aug 21 01:13:05.844756 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 712/1551] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:05 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:05.855320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:05.856676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:05.870783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.878544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.879491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.880496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:05.883704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:05.889216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:05.892703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1fa5fee71024c328a90d1724a048c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4ddb93fac43868ba8972d2f753e47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:05.911239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dca70622-de95-4504-97e8-ae05efdc20df tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 200 len: 1635 microversion: 2.1 time: 0.205802 Aug 21 01:13:05.911846 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 840/1552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:05 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 1635 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:05.916909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4e3e609-6c8a-4660-9a9c-73081b5284ff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:05.917079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4e3e609-6c8a-4660-9a9c-73081b5284ff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.042275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c4e3e609-6c8a-4660-9a9c-73081b5284ff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:06.050449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4e3e609-6c8a-4660-9a9c-73081b5284ff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1213 microversion: 2.1 time: 0.137485 Aug 21 01:13:06.064743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 841/1553] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:05 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:06.073147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987ec0ed-2e84-4741-808a-3666813311cd", "name": "network-vif-deleted", "tag": "f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:06.087764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.089101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.089718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.102707 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] Creating event network-vif-deleted:f1b410fc-720a-48b2-9fcf-9f7a6d39c9ee for instance 987ec0ed-2e84-4741-808a-3666813311cd on n-h1-master-1 Aug 21 01:13:06.109147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f9782419-114f-47c7-8daf-b9a6713b7af7 req-eff08a70-0c5b-4b17-8858-c1cca9425665 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041868 Aug 21 01:13:06.111102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 842/1554] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:06.119324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:06.121693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.126876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:06.130444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.131945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.132625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.134056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.135126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.136457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.142424 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-331c28d2-1f95-405d-ac64-8686914a3a9c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.295959 Aug 21 01:13:06.143132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 713/1555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:05 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:06.151793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:06.152694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.166093 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:06.168844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.169086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.170349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.171225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.171837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.172417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.456874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:06.468523 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89bbd00b-7e67-4ea4-9c6c-269b1b18cc1e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.355588 Aug 21 01:13:06.471806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 843/1556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:06 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:06.621040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-plugged", "status": "completed", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:06.663689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.667347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.686462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.693882 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29309c62-ae51-4ce8-a428-dea390346a25 tempest-MigrationsAdminTest-1843213394 tempest-MigrationsAdminTest-1843213394-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1614 microversion: 2.1 time: 0.546045 Aug 21 01:13:06.701821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] Creating event network-vif-plugged:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:13:06.709439 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 714/1557] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:06 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1614 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:06.711062 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7175085b-b04b-46d2-89db-40d4e702ba39 req-91da6215-3e69-438b-b5dc-cb9235419ab7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095231 Aug 21 01:13:06.711677 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 844/1558] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:06.726844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:06.727451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.733653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.734135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.734569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.735266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.735793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.736212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.764074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:06.876503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:06.877691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.883952 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9566a7e1-02b4-44e1-9b20-d8a67faf43f3 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 204 len: 0 microversion: 2.1 time: 0.161656 Aug 21 01:13:06.887143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 715/1559] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:06 2022] DELETE /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:06.890208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.893584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.895156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.898878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.899651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.900552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.901759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:06.903708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:06.929787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.930280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.930711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:06.931425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:06.931867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:06.932280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.194956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.211959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.214176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.216866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-255cab24-6ace-4447-99fc-c97d50c38a83 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.345305 Aug 21 01:13:07.238057 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 845/1560] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:06 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:07.245398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:07.246278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] [instance: 987ec0ed-2e84-4741-808a-3666813311cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:07.255427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.256209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.257675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.258735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.264106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.265587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.276947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.286123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] HTTP exception thrown: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. Aug 21 01:13:07.286504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0104223-2ade-4dd4-8323-b40e5b08a57d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1469 microversion: 2.1 time: 0.394651 Aug 21 01:13:07.287706 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 716/1561] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:06 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Request method failure captured: Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd HTTP/1.1 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZMQ_5r_K0EQO4yX4rDJT690wdoaW2tjv_JgQ-Fi2gGZwotM6XmK8emuElkvKTvku8lbmN3U1-AmF9Z6eEvPloCIKWa4dWeQLCllJQsPD7cWQngJUjhXN2rBBqIo61xNuDbH_xxTLq2C6ZIZuYR-CdWkLALyy7Ql7yNSx5K5ZjbDhg Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 13b4ddb93fac43868ba8972d2f753e47 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-997638853 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/13b4ddb93fac43868ba8972d2f753e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_13b4ddb93fac43868ba8972d2f753e47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/13b4ddb93fac43868ba8972d2f753e47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/13b4ddb93fac43868ba8972d2f753e47"}]}] Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-997638853 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 13b4ddb93fac43868ba8972d2f753e47 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-997638853 Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-997638853-project Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d1fa5fee71024c328a90d1724a048c7e Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-997638853-project Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '987ec0ed-2e84-4741-808a-3666813311cd'} Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:07.288403 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Returning 404 to user: Instance 987ec0ed-2e84-4741-808a-3666813311cd could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0cfc4b1a-e484-43d6-b852-c64694144e67 tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd" status: 404 len: 111 microversion: 2.1 time: 0.050542 Aug 21 01:13:07.293451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 846/1562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:07 2022] GET /compute/v2.1/servers/987ec0ed-2e84-4741-808a-3666813311cd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:07.295997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:07.296611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:07.301009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:07.301849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:07.303360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.303857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.304445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.305245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.306340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.306780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.310050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.310811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.311438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.312140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.312599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.313110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.339769 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:07.433335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.443681 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-74002186-3fc0-4e33-b915-471170c8ce9d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1271 microversion: 2.1 time: 0.147812 Aug 21 01:13:07.444997 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 717/1563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:07 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:07.451960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a17de28-fccd-4002-915d-3141f600581a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] Calling method '.version_select at 0x7fc3fe17b5e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:07.486428 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a17de28-fccd-4002-915d-3141f600581a tempest-ServersTestJSON-997638853 tempest-ServersTestJSON-997638853-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115481243" status: 202 len: 0 microversion: 2.1 time: 0.039301 Aug 21 01:13:07.487289 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 718/1564] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:13:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115481243 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:13:07.493508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:07.494117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:07.506696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.508032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.509765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.510695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:07.511280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:07.511854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:07.532865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.544022 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-658e3fb3-5b85-4c24-81a9-75cb7c3f4b47 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.251948 Aug 21 01:13:07.544799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 847/1565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:07 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:07.804406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:07.817343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6148d2e-bb4d-4680-bef2-216ef476fab4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.327277 Aug 21 01:13:07.831826 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 719/1566] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:07 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:08.246392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:08.247521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:08.269161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.270181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.271451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.272587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.277963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.279394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.307562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:08.308174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:08.324364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.324864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.325475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.326470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.327090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.327535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.551259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:08.573565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:08.579532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:08.583050 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e743d0c3-88bc-4be7-b0a7-03cddafac28e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.339690 Aug 21 01:13:08.584235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 848/1567] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:08 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:08.597982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:08.598813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:08.605875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.606755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.607355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.608250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.608903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.609489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.899240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:08.916292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3cf6d88a-7461-42f2-b076-f77c763ad598 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1313 microversion: 2.1 time: 0.330594 Aug 21 01:13:08.917500 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 849/1568] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:08 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:08.923287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:08.926432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:08.933802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.934652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.935273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:08.936198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:08.937667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:08.938920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.200792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:09.213473 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3af9eca-85c7-47fd-93cf-5813d00f9f44 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.294006 Aug 21 01:13:09.214474 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 850/1569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:08 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:09.220640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:09.221875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:09.230546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.231090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.231591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.232365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.233481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.233960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.502393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:09.517320 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67ce3acf-7719-457f-8c09-75466f56409b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1469 microversion: 2.1 time: 1.213334 Aug 21 01:13:09.531049 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 720/1570] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:08 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1469 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:09.537919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:09.548678 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e74b0d48-8ab4-496e-abe8-f8696138a76a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.332698 Aug 21 01:13:09.551952 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 851/1571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:09 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:09.613023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:09.613023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:09.627182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.628019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.628784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.629732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.630342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.631005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.940116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:09.941309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:09.957409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.958041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.958728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.959475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:09.960110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:09.960718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:09.965510 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:10.160223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:10.177708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:10.179720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:10.181746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f9202c9-a321-44cd-b1b2-bdf531a190e8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1814 microversion: 2.25 time: 0.575946 Aug 21 01:13:10.185266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 721/1572] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:09 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1814 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:10.240937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:10.242586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:10.263534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.264012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.264437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.269738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.270248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.271207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.368197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:10.377169 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c2435e4-a133-4f19-a802-b4db05b53fa8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1313 microversion: 2.1 time: 0.441530 Aug 21 01:13:10.382517 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 852/1573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:09 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:10.399305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67035c79-2bb6-40e8-874b-628c13c6c026", "name": "network-vif-plugged", "status": "completed", "tag": "45573363-c1b5-4900-8306-63badfb5ca3a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:10.414543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.415196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.415789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.475149 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] Creating event network-vif-plugged:45573363-c1b5-4900-8306-63badfb5ca3a for instance 67035c79-2bb6-40e8-874b-628c13c6c026 on n-h1-master-1 Aug 21 01:13:10.483209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bf0fcbda-2c70-423b-b1dd-b31a7fa2b59d req-fe1d33e3-8d37-41ea-8811-f5bf2d6f4879 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099072 Aug 21 01:13:10.484189 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 853/1574] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:10.548486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:10.550572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:10.577630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.578267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.584225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.589571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.590211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.594469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.934432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:10.950737 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6342f2a1-c8f7-4883-910d-e49a524a0da3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.715426 Aug 21 01:13:10.951805 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 722/1575] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:10 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:10.962382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:10.963283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:10.979805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.983010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.984154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:10.986282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:10.987102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:10.987706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.203485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.217605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4764fdbc-a4c5-49e6-8417-b2f5ab8d0b93 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 200 len: 1427 microversion: 2.1 time: 0.678818 Aug 21 01:13:11.230582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 854/1576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:10 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 1427 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:11.238407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.241399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c05f309-8dda-477c-8fca-742bb28b0364", "name": "network-vif-deleted", "tag": "1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:11.252659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.253398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.253908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.269693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] Creating event network-vif-deleted:1a9eb8ad-c08c-475b-b11e-b99dd4d4d5d0 for instance 2c05f309-8dda-477c-8fca-742bb28b0364 on n-h1-master-1 Aug 21 01:13:11.278584 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-dbe7e5d7-64ad-400a-8558-e110364e1dff req-877f95ed-6eaf-46f6-aeac-58caf759ef71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046306 Aug 21 01:13:11.279744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 855/1577] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:11.285061 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-061c9240-2d93-4c31-8af6-b5896da0fa73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.329573 Aug 21 01:13:11.287311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:11.288187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:11.294904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.295557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.296157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.297053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.297651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.298256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.301346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 723/1578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:10 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:11.402687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:11.403625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:11.411247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.412021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.412672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.413892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.414572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.415316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.551068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.561896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.567964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.569560 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0f162c8-8a5f-451e-be8a-fb0c9151a3fe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1804 microversion: 2.25 time: 0.287604 Aug 21 01:13:11.571186 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 856/1579] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:11 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1804 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:11.598203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6331ce69-2419-49c1-b2aa-6fbef019458d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '.version_select at 0x7fc3fa265af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:11.603656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6331ce69-2419-49c1-b2aa-6fbef019458d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.604148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6331ce69-2419-49c1-b2aa-6fbef019458d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.604581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6331ce69-2419-49c1-b2aa-6fbef019458d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.622805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6331ce69-2419-49c1-b2aa-6fbef019458d tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 4047 microversion: 2.25 time: 0.028300 Aug 21 01:13:11.630875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 857/1580] 10.222.0.46 () {60 vars in 1184 bytes} [Sun Aug 21 01:13:11 2022] GET /compute/v2.1/os-migrations => generated 4047 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:11.645795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:11.647977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:11.658609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.659376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.661042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.662144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.663032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.663592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.746789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:11.764233 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4093f6fb-f3af-48ec-9887-18c1bab0aa56 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1334 microversion: 2.1 time: 0.364534 Aug 21 01:13:11.785546 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 724/1581] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:11 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1334 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:11.973059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:11.973756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:11.986431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.991337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.993856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:11.995116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:11.995753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:11.996342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.026384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:13:12.061941 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7fe1d73-87e5-4a3c-8bee-5a3cecb8027a tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 2423 microversion: 2.25 time: 0.421165 Aug 21 01:13:12.063521 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 858/1582] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:11 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 2423 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:13:12.089546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.090359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.103464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.108141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.109295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.110871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.113709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.114481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.414608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:13:12.447794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fbae4bf-3005-4bcc-8574-49cf966b6396 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 2423 microversion: 2.25 time: 0.361600 Aug 21 01:13:12.449156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 859/1583] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:12 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 2423 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:13:12.477090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.479540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 2c05f309-8dda-477c-8fca-742bb28b0364] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.502911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.504124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.504758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.505800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.506422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.507384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.545319 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] HTTP exception thrown: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Request method failure captured: Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 HTTP/1.1 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV6QtiC87sgxUKh2KVwYd8WHxABA4ODL3IAQ06AXgZeNsWamkhYC-8h3-9bwZqSSeJ7MWiygDjZScjJB9-gBZ-9DBX5Ab8ezPRFxXDwwIGjh76WqI-_V8gNbfy1PBNa4fYr6inStpUAbTQkoCRNkpFQEuIIDTbvGJnzWCDwz6AWcEw Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8905ebcf94b46da8aad6632c78b4881", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}] Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 72250431a7f44bff83c1881ff733f2de Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2c05f309-8dda-477c-8fca-742bb28b0364'} Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:12.547250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. Aug 21 01:13:12.552596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:12.554381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Returning 404 to user: Instance 2c05f309-8dda-477c-8fca-742bb28b0364 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:12.555455 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e5e6298-5b21-4023-a2b4-e1b9815f04c9 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364" status: 404 len: 111 microversion: 2.1 time: 0.105204 Aug 21 01:13:12.556241 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 860/1584] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:12 2022] GET /compute/v2.1/servers/2c05f309-8dda-477c-8fca-742bb28b0364 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:12.561717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.563197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.570890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.571885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.571885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.572499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.572973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.573579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.598449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:12.612734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19d0dc20-10bf-444b-9cf6-00308523b150 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1307 microversion: 2.1 time: 0.643107 Aug 21 01:13:12.629554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 725/1585] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:11 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1307 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:12.642256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.643065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.657156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.660179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.660986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.661949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.662685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.664202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.714610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:12.841216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9993ea93-e6a9-4314-9a0a-21baa9ec6ea6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 204 len: 0 microversion: 2.1 time: 0.209770 Aug 21 01:13:12.842639 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 726/1586] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:12 2022] DELETE /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:12.852236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.855100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.868125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.874254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.874874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.875714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.876587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.877262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.882409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:12.893037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbb8da75-ff6e-4476-a85b-e646c88f3c92 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.335499 Aug 21 01:13:12.897863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 861/1587] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:12 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:12.907828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:12.909233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:12.924524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.926282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.926887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:12.928992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:12.930666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:12.933986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.118967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lazy-loading 'services' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:13:13.250880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:13.263196 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-720d21f5-0f10-462d-a808-b07fdaf4b0ce tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.361970 Aug 21 01:13:13.263892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 862/1588] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:12 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:13.314901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1dcb2f2-2417-44c7-893b-8949edaab2af tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments/309b2df2-bb50-4b9f-b7af-008e7c026698" status: 202 len: 0 microversion: 2.25 time: 0.467516 Aug 21 01:13:13.322210 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 727/1589] 10.222.0.46 () {60 vars in 1457 bytes} [Sun Aug 21 01:13:12 2022] DELETE /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments/309b2df2-bb50-4b9f-b7af-008e7c026698 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:13.331373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:13.335392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:13.354187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.355678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.357015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.357928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.359119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.359766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.473864 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81c145d4-c465-4dc4-b317-5f6e2291cef9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149716 Aug 21 01:13:13.474814 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 728/1590] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:13 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:13.520126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:13.520973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:13.530545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.531807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.532541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.534159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.535560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.536177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.638636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:13.643793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:13.652337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.653162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.654888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.656418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.657439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.659565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.836122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:13.864757 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98e0708e-e6d5-4e29-b8bc-ed43145df58d tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1533 microversion: 2.1 time: 0.598137 Aug 21 01:13:13.865638 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 863/1591] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:13 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1533 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:13.928940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:13.929877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:13.951065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.951539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.951996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:13.952726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:13.953221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:13.957315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.062924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:14.071536 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0f406a70-2ff5-4bce-878b-53c382589b02 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1486 microversion: 2.1 time: 0.438150 Aug 21 01:13:14.072113 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 729/1592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:13 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1486 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:14.094463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:14.095808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:14.106659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.108363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.110707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.113961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.114895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.115664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.247484 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-44a523ec-dd9a-46ce-a923-2d62f75c237e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026/action" status: 202 len: 0 microversion: 2.1 time: 0.156579 Aug 21 01:13:14.248815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 730/1593] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:13:14 2022] POST /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:13:14.259722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:14.260966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:14.270793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.271669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.273780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.275293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.276144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.277031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.288618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:14.300610 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d250866d-40e0-4b28-96bb-bc7f63872b80 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.382090 Aug 21 01:13:14.302643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 864/1594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:13 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:14.329262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:14.330333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:14.346698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.348248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.348889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.349927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.350542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.351149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.732606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:14.750849 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-91bef3a6-b905-45ea-8124-f218c41da24c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.444339 Aug 21 01:13:14.752403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 865/1595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:14 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:14.765972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "tag": "f24ebbe3-ef99-40cf-bd14-678300bf9917"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:14.795553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.801372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.804197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.841012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] Creating event network-changed:f24ebbe3-ef99-40cf-bd14-678300bf9917 for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:14.852124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0d0de1c1-0211-4770-a686-c1904494c33a req-53c8514e-d308-4b2a-91da-740dd6bdf239 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096250 Aug 21 01:13:14.853052 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 866/1596] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:14.867147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:14.874065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:14.899323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.903268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.904007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:14.905262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:14.908161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:14.911370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.005721 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-952651fa-79c4-4130-8c4a-e50919a0605c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150349 Aug 21 01:13:15.008391 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 867/1597] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:14 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:15.016960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:15.018982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:15.031277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.033252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.036475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.037816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.038818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.039501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.095905 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:15.128620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:15.128620 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:15.129951 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:15.147379 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-626d36b7-e6a1-42d0-885b-392d17a63b3c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1491 microversion: 2.1 time: 0.893544 Aug 21 01:13:15.148177 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 731/1598] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:14 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1491 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:15.323369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:15.323984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:15.340168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.343945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:15.345602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.346370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.350524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.351369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.352111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.357628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de45d933-fbac-4e3c-9f05-0a86a66d718f tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1533 microversion: 2.1 time: 0.348069 Aug 21 01:13:15.358235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 868/1599] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:15 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1533 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:15.776436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:15.777364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:15.796516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.797042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.797495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:15.798543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:15.799072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:15.799496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.047444 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:16.124431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:16.134433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02d2c712-2956-474a-b409-a2c6261f2dec tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.361722 Aug 21 01:13:16.135506 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 869/1600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:15 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:16.140633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:16.143388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:16.150171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.150892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.151564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.152447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.153080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.153660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.219748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b26b762-ca52-420d-b431-4e2d08d68bd3 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082866 Aug 21 01:13:16.227153 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 870/1601] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:16 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:16.231957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:16.232562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:16.252952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.253376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.257098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.258155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.258775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.259384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.297741 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:16.561355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:16.575641 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c33864af-cdeb-48b1-bb4b-27c2b221977d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 200 len: 1471 microversion: 2.1 time: 0.347358 Aug 21 01:13:16.589661 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 871/1602] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:16 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:16.609188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:16.610142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:16.616885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.617601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.619901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.620871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.621585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.622177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.790674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:16.800943 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1235da83-bb61-4a85-9eb2-a8777cbc54f4 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 1.481583 Aug 21 01:13:16.805657 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 732/1603] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:15 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:16.810869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-541719645"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:16.818458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:16.831717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.832273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.832761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.833575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:16.834082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:16.841176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:16.908444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:16.919566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a373a978-e0f4-4e4f-9d0a-c28c2ac0c58c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1533 microversion: 2.1 time: 0.328182 Aug 21 01:13:16.921147 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 872/1604] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:16 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1533 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:17.163230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:17.164616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:17.180598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.182417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.184330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.187330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.188419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.191797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.261188 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-96b3bd58-399e-42d6-abac-c70466719a5a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026/action" status: 202 len: 0 microversion: 2.1 time: 0.453622 Aug 21 01:13:17.275481 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 733/1605] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:13:16 2022] POST /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:13:17.289969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:17.292488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:17.309317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.312709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.313454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.314437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.316110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.316646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.394045 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22d93383-0b44-4bd3-9515-0550f0e1096b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114441 Aug 21 01:13:17.395086 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 734/1606] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:17 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:17.400326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1ad6130-dfad-402f-b37e-50b77eb8b9da tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fe16fca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:17.473132 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1ad6130-dfad-402f-b37e-50b77eb8b9da tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 0.075613 Aug 21 01:13:17.475732 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 735/1607] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:17 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:17.488154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d03e4-c5f6-4e92-a078-a6da2e4ec2d0", "name": "network-vif-deleted", "tag": "196a0773-91f5-4960-be9d-4a4dc3897649"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:17.511701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.512103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.513642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.546555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] Creating event network-vif-deleted:196a0773-91f5-4960-be9d-4a4dc3897649 for instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 on n-h1-master-1 Aug 21 01:13:17.561081 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c1a9a6b2-4149-4c98-8f17-4331dc3188e2 req-e1047d9d-98dc-4cd5-b688-f3a2b12214db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078254 Aug 21 01:13:17.561866 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 736/1608] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:17.829709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:17.832472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:17.833209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:17.840925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ad1cf68-cb5f-4811-bc7a-39be566fa6ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.683636 Aug 21 01:13:17.851088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.851945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.852599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.853552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.854243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.854891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.856676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 873/1609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:17 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:17.946710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:17.947579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:17.955739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.956542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.958898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:17.959904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:17.972718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:17.974049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:18.033325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:18.034214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:18.034898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:18.035742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lazy-loading 'fault' on Instance uuid 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:13:18.111455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:18.124659 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73d3d922-60dc-4d24-b59a-aebd6cefeecc tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 200 len: 1368 microversion: 2.1 time: 0.182321 Aug 21 01:13:18.126061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 874/1610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:17 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:18.180043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:18.197086 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-247ee71c-42dc-4b6d-92fb-5adb315e53c8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.370053 Aug 21 01:13:18.201464 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 737/1611] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:17 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:18.488669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bcb24bd-2a26-48e4-85f1-1fd5b3e45d19 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fdf02a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:18.600333 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bcb24bd-2a26-48e4-85f1-1fd5b3e45d19 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 0.116494 Aug 21 01:13:18.603841 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 738/1612] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:18 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:18.762205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:18.765649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:18.767908 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:18.776235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:18.777275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:18.778005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:18.778921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:18.779572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:18.780214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:18.819862 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b7a4e303-5751-4759-8d1d-d3a82ec14924 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.417560 Aug 21 01:13:18.820922 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 875/1613] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:18 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:18.863796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:18.865578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:18.886956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:18.887765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:18.888410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:18.889456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:18.892241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:18.892913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.146162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:19.147038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:19.154137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.154903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.155550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.156615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.160831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.161265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.183717 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] HTTP exception thrown: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Request method failure captured: Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 HTTP/1.1 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV6QtiC87sgxUKh2KVwYd8WHxABA4ODL3IAQ06AXgZeNsWamkhYC-8h3-9bwZqSSeJ7MWiygDjZScjJB9-gBZ-9DBX5Ab8ezPRFxXDwwIGjh76WqI-_V8gNbfy1PBNa4fYr6inStpUAbTQkoCRNkpFQEuIIDTbvGJnzWCDwz6AWcEw Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8905ebcf94b46da8aad6632c78b4881", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}] Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 72250431a7f44bff83c1881ff733f2de Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '103d03e4-c5f6-4e92-a078-a6da2e4ec2d0'} Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:19.185555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. Aug 21 01:13:19.190877 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:19.193340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Returning 404 to user: Instance 103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:19.194371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c7f2880-15f1-43ce-8ae7-074471af47b2 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0" status: 404 len: 111 microversion: 2.1 time: 0.052204 Aug 21 01:13:19.194949 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 876/1614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:19 2022] GET /compute/v2.1/servers/103d03e4-c5f6-4e92-a078-a6da2e4ec2d0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:13:19.210228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-547cb35c-ac29-460e-a69a-96a82e1f5742 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '.version_select at 0x7fc403283700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:19.234088 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-547cb35c-ac29-460e-a69a-96a82e1f5742 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301436823" status: 202 len: 0 microversion: 2.1 time: 0.027434 Aug 21 01:13:19.235567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 877/1615] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301436823 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:13:19.242132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:19.247492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:19.257814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.258270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.258700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.269575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.270103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.270545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.319134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:19.365924 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7eb16632-4099-456d-945e-3237cd6c8a9a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.507099 Aug 21 01:13:19.381147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 739/1616] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:18 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:19.586768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:19.595768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d448d4b-4941-4d20-948f-999772c201a0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.358988 Aug 21 01:13:19.596355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 878/1617] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:19 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:19.616930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a982e3a4-9dd5-4929-a395-9b76cd086597 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fe32f4c0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:19.640534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "tag": "7fa54a5a-8cc2-4b47-8bb6-432ba742c57c"}, {"name": "network-changed", "server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "tag": "5c2ee999-3559-491a-91b3-f3a046342b7f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:19.668063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.669411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.670143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.690870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a982e3a4-9dd5-4929-a395-9b76cd086597 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 0.076267 Aug 21 01:13:19.692043 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 740/1618] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:19 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:19.704848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Creating event network-changed:7fa54a5a-8cc2-4b47-8bb6-432ba742c57c for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:19.705684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] Creating event network-changed:5c2ee999-3559-491a-91b3-f3a046342b7f for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:19.711740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c926b277-70b1-4c8c-a825-483978436017 req-055408ec-1202-4f5f-bbd8-0a5f97680ac8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076159 Aug 21 01:13:19.713648 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 879/1619] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:19.834412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:19.837273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:19.849106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.850599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.851762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.852744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:19.854546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:19.855218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:19.899511 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a10150b0-7bf5-4bc5-82a9-9d4609ecbf8f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070221 Aug 21 01:13:19.900212 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 741/1620] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:19 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:13:20.358222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:20.359600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:20.378050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.379356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.389983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:20.390695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:20.396859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:20.401734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.404530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.405146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:20.413101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.415985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.419169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:20.425080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.429538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.431257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:20.501952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:20.654218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ee0e3af-fea1-4813-8cd8-e9f2fca32aa6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 204 len: 0 microversion: 2.1 time: 0.302537 Aug 21 01:13:20.656555 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 880/1621] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:20 2022] DELETE /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:20.678267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:20.684179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:20.698509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.699000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.699429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:20.701254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:20.701254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:20.701254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:21.131952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:21.154462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9b8f5b9-0dd0-43b1-9831-c3fa45a7389d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.495544 Aug 21 01:13:21.155234 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 881/1622] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:20 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:21.160680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:21.161501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:21.172241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:21.173376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:21.177435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:21.178439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:21.179067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:21.179656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:21.255786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:21.263880 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5923009-20f2-4139-98a9-f4778bba21c4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.880567 Aug 21 01:13:21.279701 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 742/1623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:20 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:13:21.285662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-179b7093-6e0d-4c06-ba8c-0f8d6c9ad8ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fdcc81f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:21.388971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-179b7093-6e0d-4c06-ba8c-0f8d6c9ad8ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 0.118920 Aug 21 01:13:21.390418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 743/1624] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:21 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:21.406356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:21.409601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:21.418563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:21.420562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:21.422080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:21.423099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:21.423734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:21.424334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:21.481543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9ae724e-bab4-44e3-b0aa-a7beb426bce8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.088305 Aug 21 01:13:21.483961 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 744/1625] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:13:21 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:21.716222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:21.742554 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-337cb300-8081-40b1-bc7f-51317bce212c tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1468 microversion: 2.1 time: 0.585796 Aug 21 01:13:21.745651 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 882/1626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:21 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1468 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:22.180855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:22.182160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:22.215690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:22.219114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:22.220151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:22.221220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:22.232058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:22.236488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:22.291227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:22.294092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:22.323398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:22.326419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:22.331395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:22.334787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:22.337185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:22.338904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:22.995970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:23.006423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14b8b751-f726-434e-98c6-58317e1b196e tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.722254 Aug 21 01:13:23.021497 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 883/1627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:22 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:23.036726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b11fb77-4b29-4292-ae7a-6baa70d1e9b1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4032c31f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:23.158299 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b11fb77-4b29-4292-ae7a-6baa70d1e9b1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 0.135323 Aug 21 01:13:23.158877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 884/1628] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:23 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:23.174992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:23.175663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:23.185478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:23.194385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:23.194881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:23.195657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:23.196111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:23.196893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:23.689647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:23.721131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9522f25-69fb-4f10-9d17-140c67e3b817 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 1.530660 Aug 21 01:13:23.724638 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 745/1629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:22 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:24.000397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:24.036950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:24.039404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:24.073716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53a41b6f-5639-4df3-a536-1a09d8b6ac52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1468 microversion: 2.1 time: 0.913439 Aug 21 01:13:24.074328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 885/1630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:23 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1468 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:24.084496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:24.088432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:24.089203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:24.092927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:24.095999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:24.097741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:24.172493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26414807-5d19-4885-ad6f-f3d7ce699902 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc40326b550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:25.821167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:25.855698 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5232050f-ea42-4b17-946a-3e6717beed43 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 1.807187 Aug 21 01:13:25.859918 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 746/1631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:24 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:25.878634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:25.913123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:25.928689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:25.929134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:25.929561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:25.930253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:25.930693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:25.931101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:26.689531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:26.713284 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4dbd1fd-e09d-4e8f-b88a-9021f0532142 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.851753 Aug 21 01:13:26.718885 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 747/1632] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:25 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:26.734000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:26.745749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:26.759155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:26.766179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:26.767105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:26.768096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:26.768782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:26.769514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:26.964225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:26.973172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-382394c2-25e0-4054-9ee7-4baf2e26e5e6 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1426 microversion: 2.1 time: 0.243063 Aug 21 01:13:26.980080 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 748/1633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:26 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1426 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:26.986234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67035c79-2bb6-40e8-874b-628c13c6c026", "name": "network-vif-plugged", "status": "completed", "tag": "45573363-c1b5-4900-8306-63badfb5ca3a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:27.017348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.018210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.021400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:27.051824 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] Creating event network-vif-plugged:45573363-c1b5-4900-8306-63badfb5ca3a for instance 67035c79-2bb6-40e8-874b-628c13c6c026 on n-h1-master-1 Aug 21 01:13:27.069707 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bb8317eb-4659-443e-8cfb-26d80d895642 req-6f6fc9fe-23f7-4590-8774-4af76cb4f889 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087810 Aug 21 01:13:27.070618 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 749/1634] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:27.082527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f59bd8-c68d-48f9-af56-fc29eb3b33d7", "name": "network-vif-deleted", "tag": "fee75ae5-febf-4af2-9b96-7d067a854aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:27.116129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.117677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.118349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:27.149317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] Creating event network-vif-deleted:fee75ae5-febf-4af2-9b96-7d067a854aa4 for instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 on n-h2-master-1 Aug 21 01:13:27.167639 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-07c6d744-2514-4680-bca5-4579df38cf5f req-88458261-ec8e-460c-8ec8-717ade7e9887 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087551 Aug 21 01:13:27.168751 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 750/1635] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:27.177933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:27.178883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:27.193086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.194829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.195528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:27.197647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.201221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.202212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:27.767771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:27.790127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1ff7de4-a40f-4db6-a676-20f87c7c5d88 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.619724 Aug 21 01:13:27.796340 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 751/1636] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:27 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:27.804455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:27.806859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:27.827877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.832333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.833729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:27.835360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:27.838493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:27.839884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:28.655170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:28.676458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2b6bdb5e-0f5f-488d-9571-f28f82ffdd00 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.877951 Aug 21 01:13:28.699131 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 752/1637] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:27 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:28.712233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:28.714296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:28.744840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:28.745586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:28.746170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:28.747315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:28.749323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:28.754681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:28.769415 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:29.308719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:29.329986 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0afc99cf-3914-4e94-9d5e-cafe151beb52 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 200 len: 1426 microversion: 2.1 time: 0.628857 Aug 21 01:13:29.331866 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 753/1638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:28 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 1426 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:29.355865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:29.357505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:29.388279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:29.389301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:29.389978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:29.398996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:29.400446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:29.401140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:30.048612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:30.074419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65bc13eb-a30d-4b67-9e23-bd2d5b6d3aab tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.738994 Aug 21 01:13:30.076816 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 754/1639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:29 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:30.091887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae070c9d-a73e-4d21-84f4-60e7c280e383 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Action: 'create', calling method: .version_select at 0x7fc3fe3719d0>, body: {"keypair": {"name": "tempest-keypair-1147848782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNO8VRxW5cHks0NL/jOxAFIn2ReZ3uSSA4q1aBxn2d37eyyreEqH27Gl1Vz8mMjyr2MOfSWvaNPH3rDcrPk971IvRdDXbGwd6qby8FasYd9u6VHOlCogpWKq58+kngAKA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:30.164279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ae070c9d-a73e-4d21-84f4-60e7c280e383 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Getting quotas for project 503c042abb9448a393e983403fa0c1fe. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:30.175131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ae070c9d-a73e-4d21-84f4-60e7c280e383 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Getting quotas for user 25d98f9b858449a0af6ed328aa334600 and project 503c042abb9448a393e983403fa0c1fe. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:30.235539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae070c9d-a73e-4d21-84f4-60e7c280e383 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.157386 Aug 21 01:13:30.237109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 755/1640] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:13:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:13:30.245401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:30.246223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:30.270818 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:30.274669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:30.278188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:30.284128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:30.291191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:30.294194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:30.294894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.169364 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:31.290715 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0691f322-adea-4302-afb1-17408b4d0f2e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.998272 Aug 21 01:13:31.336673 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 756/1641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:30 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:31.359988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:31.368465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: 32f59bd8-c68d-48f9-af56-fc29eb3b33d7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:31.395631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.399512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.401055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.402748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.408982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.411002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.448021 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] HTTP exception thrown: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Request method failure captured: Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 HTTP/1.1 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV6QtiC87sgxUKh2KVwYd8WHxABA4ODL3IAQ06AXgZeNsWamkhYC-8h3-9bwZqSSeJ7MWiygDjZScjJB9-gBZ-9DBX5Ab8ezPRFxXDwwIGjh76WqI-_V8gNbfy1PBNa4fYr6inStpUAbTQkoCRNkpFQEuIIDTbvGJnzWCDwz6AWcEw Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8905ebcf94b46da8aad6632c78b4881", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}] Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 72250431a7f44bff83c1881ff733f2de Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '32f59bd8-c68d-48f9-af56-fc29eb3b33d7'} Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:31.453895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. Aug 21 01:13:31.459749 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:31.464820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Returning 404 to user: Instance 32f59bd8-c68d-48f9-af56-fc29eb3b33d7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:31.466066 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-342750d6-420e-47e9-9d33-e3ed5dab4e15 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7" status: 404 len: 111 microversion: 2.1 time: 0.127867 Aug 21 01:13:31.469871 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 757/1642] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:31 2022] GET /compute/v2.1/servers/32f59bd8-c68d-48f9-af56-fc29eb3b33d7 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:31.477708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:31.478563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:31.488564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.496782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.497567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.501688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.504699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.505299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.840404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:31.858501 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f45f3dd-2f75-49fc-a18d-5fb78f03a1bc tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.387213 Aug 21 01:13:31.865029 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 758/1643] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:31 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:31.877979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:31.879974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:31.897843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.898624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.900508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:31.909988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:31.910608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:31.911053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:32.021757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:32.292082 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f0d4479b-060f-42d7-a5cc-ae39719da6b5 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 204 len: 0 microversion: 2.1 time: 0.425349 Aug 21 01:13:32.293159 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 759/1644] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:31 2022] DELETE /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:32.302698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:32.304939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:32.319457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:32.319952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:32.321985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:32.323901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:32.324491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:32.325788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:33.185594 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:33.285561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72250431a7f44bff83c1881ff733f2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8905ebcf94b46da8aad6632c78b4881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:33.301828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5bf020b3-7516-4dae-913a-06746d85378b tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 200 len: 1468 microversion: 2.1 time: 1.004095 Aug 21 01:13:33.303234 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 760/1645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:32 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 1468 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:33.307955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:33.310232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:33.332477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:33.333271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:33.333886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:33.334779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:33.335377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:33.335946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:33.993606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:34.009566 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2936658a-d2a2-49c8-bd18-81d3924b5752 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.702515 Aug 21 01:13:34.012928 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 761/1646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:33 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:34.018270 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:34.041426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:34.049936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:34.081931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:34.095238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:34.096817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:34.101904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:34.104952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:34.108597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:34.814889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:34.829121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f55222d-e28a-46d9-b8ab-116547bdb002 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.812199 Aug 21 01:13:34.831059 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 762/1647] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:34 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:34.838202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1163329364", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "069b24fd-dfc6-4342-bc4b-dedbd78ab8f3"}, {"port": "14001b66-77c6-45a0-9adf-7941e57f220d", "tag": "port-1"}, {"port": "af9fedc1-ee77-4233-9405-39aa90621b2a", "tag": "port-2"}, {"uuid": "8afcb550-6093-44bc-ba2e-ca82f9768f70", "tag": "net-1"}, {"uuid": "8afcb550-6093-44bc-ba2e-ca82f9768f70"}, {"uuid": "676cec28-6e0c-4390-bb48-248ab0fca316", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "676cec28-6e0c-4390-bb48-248ab0fca316", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "34dfa3d8-d7fb-4cf9-ab58-193aba31f26a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "00f9c665-116b-42af-b502-57efd8eab56a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8676fdb9-3667-4414-aab2-46d30be67654", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--417724815"}], "key_name": "tempest-keypair-1147848782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:40.185175 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:41.938621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26414807-5d19-4885-ad6f-f3d7ce699902 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1411 microversion: 2.1 time: 17.769936 Aug 21 01:13:41.939514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 886/1648] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:24 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1411 bytes in 17772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:41.949571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:41.953528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] [instance: ffa39429-ef5c-4236-a3f3-7054ce8a3a2e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:41.972693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:41.973513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:41.974111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:41.975003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:41.975628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:41.976214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:41.994556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] HTTP exception thrown: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Request method failure captured: Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e HTTP/1.1 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV6QtiC87sgxUKh2KVwYd8WHxABA4ODL3IAQ06AXgZeNsWamkhYC-8h3-9bwZqSSeJ7MWiygDjZScjJB9-gBZ-9DBX5Ab8ezPRFxXDwwIGjh76WqI-_V8gNbfy1PBNa4fYr6inStpUAbTQkoCRNkpFQEuIIDTbvGJnzWCDwz6AWcEw Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8905ebcf94b46da8aad6632c78b4881", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8905ebcf94b46da8aad6632c78b4881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8905ebcf94b46da8aad6632c78b4881"}]}] Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f8905ebcf94b46da8aad6632c78b4881 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MigrationsAdminTest-1301511324 Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 72250431a7f44bff83c1881ff733f2de Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MigrationsAdminTest-1301511324-project Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ffa39429-ef5c-4236-a3f3-7054ce8a3a2e'} Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:41.996652 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. Aug 21 01:13:42.002749 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:42.005137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] Returning 404 to user: Instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:42.006056 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8dab9e0-c0b6-49cd-b451-ea988c8c3316 tempest-MigrationsAdminTest-1301511324 tempest-MigrationsAdminTest-1301511324-project] 10.222.0.46 "GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e" status: 404 len: 111 microversion: 2.1 time: 0.065428 Aug 21 01:13:42.006615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 887/1649] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:41 2022] GET /compute/v2.1/servers/ffa39429-ef5c-4236-a3f3-7054ce8a3a2e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:42.023254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:42.025544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:42.041937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:42.044976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:42.047268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:42.048504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:42.049198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:42.050171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:42.090630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] validate_networks() for [('069b24fd-dfc6-4342-bc4b-dedbd78ab8f3', None, None, None, None, None), (None, None, '14001b66-77c6-45a0-9adf-7941e57f220d', None, None, None), (None, None, 'af9fedc1-ee77-4233-9405-39aa90621b2a', None, None, None), ('8afcb550-6093-44bc-ba2e-ca82f9768f70', None, None, None, None, None), ('8afcb550-6093-44bc-ba2e-ca82f9768f70', None, None, None, None, None), ('676cec28-6e0c-4390-bb48-248ab0fca316', '10.2.2.100', None, None, None, None), ('676cec28-6e0c-4390-bb48-248ab0fca316', '10.2.2.200', None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:42.259763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:42.293791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-659ee4b1-f6e0-4c46-8518-14ac09393f72 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.285903 Aug 21 01:13:42.294367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 888/1650] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:42 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:42.659011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-913110137", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "d69e053f-6b1d-418b-8812-81a4b6dbd84b"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:42.737922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] validate_networks() for [('d69e053f-6b1d-418b-8812-81a4b6dbd84b', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:43.427666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:43.429299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:43.429827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:43.430245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:43.430655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:43.443692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.444176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.444691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.445717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.446108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.446536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.466659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Getting quotas for project 6548e216312e4326a0efba388107207b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:43.473266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Getting quotas for user a04086173676446ab71da619f5826f97 and project 6548e216312e4326a0efba388107207b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:43.487822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:13:43.490360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:13:43.543919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c68e3b54-aaba-463d-a614-dd21e5e322fe tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244174 Aug 21 01:13:43.544947 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 889/1651] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:13:43.550670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:43.551577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:43.559198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.559918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.560742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.562158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.562838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.563458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.784311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:43.792926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42ee68d0-60f1-437e-a4b2-028630f1b16c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.246691 Aug 21 01:13:43.793495 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 890/1652] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:43 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:43.798652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa39429-ef5c-4236-a3f3-7054ce8a3a2e", "name": "network-vif-deleted", "tag": "8a49dd55-d62c-4c16-9e63-1eb758b681dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:43.809071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.809551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.809985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.822509 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] Creating event network-vif-deleted:8a49dd55-d62c-4c16-9e63-1eb758b681dd for instance ffa39429-ef5c-4236-a3f3-7054ce8a3a2e on n-h2-master-1 Aug 21 01:13:43.828036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8b0c8eca-6b46-4b55-87c9-79568b6d1477 req-98534f2a-1a32-4f9a-bff9-e3ada4019458 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033078 Aug 21 01:13:43.829390 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 891/1653] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:43.834536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-plugged", "status": "completed", "tag": "f24ebbe3-ef99-40cf-bd14-678300bf9917"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:43.845633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.846355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.846979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.861110 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] Creating event network-vif-plugged:f24ebbe3-ef99-40cf-bd14-678300bf9917 for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:43.866621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d5060820-d075-4c28-b3d5-2a31322a9ae0 req-aaec76dd-ed9b-45bb-98fd-69033691b803 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Aug 21 01:13:43.867240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 892/1654] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:43.874157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:43.879874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:43.880920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Searching by: {'deleted': False, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:13:43.887176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.887891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.888522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.889438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:43.890072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:43.891023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:43.995267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:13:44.064692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c109f2dd-9837-4dc5-81ab-47b400d803bb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.195852 Aug 21 01:13:44.067150 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 893/1655] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:13:43 2022] GET /compute/v2.1/servers => generated 339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:44.081122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15b3d6ba-4fd3-4b2e-845e-5294decc3263 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa2c0ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.147851 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15b3d6ba-4fd3-4b2e-845e-5294decc3263 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1420 microversion: 2.1 time: 0.079091 Aug 21 01:13:44.148840 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 894/1656] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:44.160301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.163162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:44.179907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.179907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.180255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.180723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.181203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.181629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.414442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:44.424519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c291f45b-fdbb-4c52-a119-9573da75dae0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.274397 Aug 21 01:13:44.425236 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 895/1657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:44.444377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.445482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:44.455310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.456714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.458145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.459858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.460330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.460982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.556918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:44.566867 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49225074-11d8-45ca-a1c7-80442c11781c tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1212 microversion: 2.1 time: 0.139878 Aug 21 01:13:44.576889 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 896/1658] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:44.576889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.581571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:44.582716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Searching by: {'deleted': False, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:13:44.588360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.589082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.589739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.590642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.591181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.591477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.623877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:13:44.677366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:44.684159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.684815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.685253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.824868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7360f82-e36a-43e1-9b2b-b2711869ef39 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.255800 Aug 21 01:13:44.825467 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 897/1659] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:44.827038 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:44.844536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1c71bd5-1038-45f0-b4ef-78661d7ed3c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc40322c8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.899886 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1c71bd5-1038-45f0-b4ef-78661d7ed3c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 200 len: 1420 microversion: 2.1 time: 0.071463 Aug 21 01:13:44.912603 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 898/1660] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:44.923389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:44.924061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:44.947474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.948258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.949255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:44.951038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:44.953775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:44.957615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:45.200427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:45.213753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-354684dc-2247-4a3d-b6a6-978f39b67fff tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.300119 Aug 21 01:13:45.227801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 899/1661] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:44 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:45.239624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffa35ffb-2461-433c-a98b-7644574819aa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:45.268247 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffa35ffb-2461-433c-a98b-7644574819aa tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032053 Aug 21 01:13:45.269231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 900/1662] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:13:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:45.277733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60831d7f-7356-4093-8e44-de12f41b7ba4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4032359d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:46.271566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60831d7f-7356-4093-8e44-de12f41b7ba4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 204 len: 0 microversion: 2.1 time: 1.001045 Aug 21 01:13:46.272438 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 901/1663] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:45 2022] DELETE /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:46.277157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:46.277755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:46.293010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.293812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.294407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.295309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.299283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.307220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.407551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:46.408645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:46.409217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:46.409620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:46.410024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:46.440727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.441358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.441801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.442580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.445302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.445959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.465799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Getting quotas for project 503c042abb9448a393e983403fa0c1fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:46.471371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Getting quotas for user 25d98f9b858449a0af6ed328aa334600 and project 503c042abb9448a393e983403fa0c1fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:46.518307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:46.531859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a811a5c-7a3c-4b30-ba13-0940ce614080 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.258267 Aug 21 01:13:46.533486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 902/1664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:46 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:46.539569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:46.540399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:46.563311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.564130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.564747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.565573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.566202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.566783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.732432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:13:46.735812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='34dfa3d8-d7fb-4cf9-ab58-193aba31f26a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='00f9c665-116b-42af-b502-57efd8eab56a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8676fdb9-3667-4414-aab2-46d30be67654',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:13:46.892462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:46.921039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30c7195a-2a73-48ea-999f-6df6c65ff612 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.385044 Aug 21 01:13:46.923170 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 903/1665] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:46 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:46.932066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:46.932849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:46.950646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.954402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.954856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:46.955740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:46.956463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:46.959387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.003784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:47.144251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ccaf7672-0e86-4fdd-a03a-6d0cde965eb8 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 204 len: 0 microversion: 2.1 time: 0.218457 Aug 21 01:13:47.144886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 904/1666] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:46 2022] DELETE /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:47.329670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64dcfccf-71ab-4462-83e0-786b3963668a tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Calling method '.version_select at 0x7fc40326b3a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:47.366993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c1bbfa5-9454-4f67-bb44-092b8df78f75 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 12.533301 Aug 21 01:13:47.375690 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 763/1667] 10.222.0.46 () {62 vars in 1189 bytes} [Sun Aug 21 01:13:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 12544 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:13:47.388720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "name": "network-vif-unplugged", "status": "completed", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}, {"name": "network-changed", "server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:47.416161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.423050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.423768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.452824 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Creating event network-vif-unplugged:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h2-master-1 Aug 21 01:13:47.453602 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] Creating event network-changed:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h2-master-1 Aug 21 01:13:47.465390 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-aa334e31-d7b5-4fed-9ad0-006e5a56cd3f req-74b9fec9-781e-49d4-acaa-4e086d973829 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.087992 Aug 21 01:13:47.469477 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 764/1668] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:47.482852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-plugged", "status": "completed", "tag": "5c2ee999-3559-491a-91b3-f3a046342b7f"}, {"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-plugged", "status": "completed", "tag": "7fa54a5a-8cc2-4b47-8bb6-432ba742c57c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:47.520492 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64dcfccf-71ab-4462-83e0-786b3963668a tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 371 microversion: 2.1 time: 0.370146 Aug 21 01:13:47.521158 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 905/1669] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:13:47 2022] GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:47.527359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.540374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.540812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.542074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:47.542842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:47.568623 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Creating event network-vif-plugged:5c2ee999-3559-491a-91b3-f3a046342b7f for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:47.569156 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] Creating event network-vif-plugged:7fa54a5a-8cc2-4b47-8bb6-432ba742c57c for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:13:47.570560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.571615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.572108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.572860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.573448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.573872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.600249 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5f2dc983-b213-45c2-9d6d-c08b06da5cb3 req-61cea26d-e05d-4b47-8bab-bb04d2c26bb6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129070 Aug 21 01:13:47.606977 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 765/1670] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:47.620334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:47.622081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:47.639395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.641752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.642459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.643982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.646195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.646908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.710778 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:47.857418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:47.872356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b9daa95-6581-4cb2-aa07-b809bd309e1d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 0.348528 Aug 21 01:13:47.884806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 906/1671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:47 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:47.884806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:47.884806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:47.892045 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a29f231-d699-417a-90b2-8a8d78f17b10 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 204 len: 0 microversion: 2.1 time: 0.280167 Aug 21 01:13:47.892983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 766/1672] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:47 2022] DELETE /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:47.908839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:47.908839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:47.909181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.909181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.909181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.910384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:47.910850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:47.913210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:47.983109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:47.991494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:47.993701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:47.995198 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5c29b7b5-0a43-43bb-ae7a-8ccf026cbebd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1286 microversion: 2.32 time: 0.101027 Aug 21 01:13:47.996239 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 767/1673] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:47 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:48.014914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe5741f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:48.148817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.148817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.149258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.149680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.150128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.150552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.254611 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f8a2b4be-31bc-4179-b13b-13b77d8240b3 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 328 microversion: 2.1 time: 0.256790 Aug 21 01:13:48.264907 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 768/1674] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:47 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 328 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:48.264907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:48.264907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:48.280482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.281055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.281504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.285564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.286182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.287516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.299355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:48.310207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-928e593a-8ad9-45ac-8f7b-ea7228c9dcb0 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1712 microversion: 2.1 time: 0.434692 Aug 21 01:13:48.313933 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 907/1675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:47 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1712 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:48.339501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:48.341427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:48.362435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.366636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.368411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.369559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:48.371220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:48.375875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:48.420831 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:48.584721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:48.593120 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a33c6819-f79b-4d24-9f3a-c3c609d44895 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.276649 Aug 21 01:13:48.594383 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 908/1676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:48 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:48.599230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-522677086", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:48.631766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:48.652396 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d9f3c9ad-c896-4366-b54f-241b2f861101 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.395756 Aug 21 01:13:48.653162 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 769/1677] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:48 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:48.674056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] validate_networks() for [('70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:48.724487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-661800337", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:48.793877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:49.132596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:49.133072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:49.133956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:49.133956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:49.135501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:49.148220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.149012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.149232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.149955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.150635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.151102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.173306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:49.192570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for user f8cd2a7facca4461a9802262a222a164 and project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:49.232869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.utils [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] cores quota exceeded for f7365174bf8e492a870365b0a2b3c63c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122483) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 21 01:13:49.234585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Request method failure captured: Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 144 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYbIuXXzeSi8RkkYkS_LLmhJK-sFrUFNHgSsRf7-qAQhfjVD_prmT0Rn6JysktgeuYGDOUODbMzAPHaLnfAd5YiSBHcT7XdAFSsGbKNfMfg9LBUAhWGTt0TetcjnFRhAebO2d4GSvhmOwSgEAVva-kG_O0M_u8DEoHjjNpTZjAfIcgg Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7365174bf8e492a870365b0a2b3c63c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}] Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f8cd2a7facca4461a9802262a222a164 Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-661800337", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-661800337', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452'}}} Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:13:49.241475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 21 01:13:49.248401 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:49.269603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:49.271946 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bb5ead35-a739-4f39-8993-b9bee22179a7 tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.617051 Aug 21 01:13:49.278024 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 770/1678] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:13:48 2022] POST /compute/v2.1/servers => generated 111 bytes in 621 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:49.287755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:49.292572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:49.315755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.318970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.321070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.323299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.324120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.324898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.526298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:49.526861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:49.528943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:49.529776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:49.530757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:49.560531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.561164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.561679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.563189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.567358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.568200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.602939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:49.612926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for user 2a2ecc1a81574d7aa2679307a7985908 and project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:49.645494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:13:49.653785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:13:49.737395 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2ec91ce-5be5-41de-b3a5-fa23d35416c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141356 Aug 21 01:13:49.738622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 909/1679] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:13:49.747949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:49.749035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:49.759397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.760344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.761196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:49.762136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:49.762870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:49.763461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.420182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:50.448646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:50.451483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:50.455539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f0933bd-f17f-44a6-9514-ca65ffa35c3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1576 microversion: 2.32 time: 0.715264 Aug 21 01:13:50.456730 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 910/1680] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:49 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1576 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:50.461512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc403240040>, body: {"quota_set": {"cores": 20}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:50.589062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:50.592034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.592633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.601670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.603001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33ca874f-1836-44c1-91bd-93df257a6259 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1355 microversion: 2.1 time: 1.327109 Aug 21 01:13:50.605502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.607115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.608364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.617849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 771/1681] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:49 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1355 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:50.623870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:50.626425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:50.643187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.643944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.644577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.645580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.646195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.646781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.730816 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e6ee3e6-8aeb-4b09-a477-e832487bc387 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 329 microversion: 2.1 time: 0.272755 Aug 21 01:13:50.732194 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 911/1682] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:50 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 329 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:50.737484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d12f44b-a525-4cf2-bb09-622e01196700", "tag": "74670a8c-c8de-4803-99d3-dbd307c38538"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:50.749361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.749845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.751146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.766791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] Creating event network-changed:74670a8c-c8de-4803-99d3-dbd307c38538 for instance 6d12f44b-a525-4cf2-bb09-622e01196700 on n-h1-master-1 Aug 21 01:13:50.773398 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3e613dba-e5da-4b8b-8264-020d3617150e req-c08892f3-1b1b-48e4-acfd-b5fb3379db1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039443 Aug 21 01:13:50.774986 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 912/1683] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:50.781897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:50.782596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:50.786414 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:50.794106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.794596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.795423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.796194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.797074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.797074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.944679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:50.954529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06e827bf-c1af-4b8a-a0b8-8d22413df4a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.178258 Aug 21 01:13:50.955434 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 913/1684] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:50 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:50.961165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67035c79-2bb6-40e8-874b-628c13c6c026", "name": "network-vif-unplugged", "status": "completed", "tag": "45573363-c1b5-4900-8306-63badfb5ca3a"}, {"server_uuid": "f12dabd6-7399-4cd0-a253-bd66898c7daf", "name": "network-vif-unplugged", "status": "completed", "tag": "fdac7d31-989f-4109-a3f5-9c8a2c72824e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:50.973359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:50.973825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:50.974240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:50.990070 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Creating event network-vif-unplugged:45573363-c1b5-4900-8306-63badfb5ca3a for instance 67035c79-2bb6-40e8-874b-628c13c6c026 on n-h1-master-1 Aug 21 01:13:50.990919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] Creating event network-vif-unplugged:fdac7d31-989f-4109-a3f5-9c8a2c72824e for instance f12dabd6-7399-4cd0-a253-bd66898c7daf on n-h2-master-1 Aug 21 01:13:51.002509 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-cef6392a-6849-4034-80c6-20da2929db37 req-4029fa27-4e16-41fe-92ea-4991503e77a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.045535 Aug 21 01:13:51.003370 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 914/1685] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:51.009618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:51.010028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:51.018650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.019299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.019546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.020535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.020824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.021268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.227214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.238060 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a57dcd99-2c74-411b-abe8-a6e910f994ba tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.233226 Aug 21 01:13:51.240243 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 915/1686] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:51 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:51.243518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:51.244232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:51.253524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.254036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.254462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.255158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.256029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.256450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.321846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.330692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ce6f25e-b0b0-4b6d-b2e6-eb355ac3013e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1265 microversion: 2.1 time: 0.090955 Aug 21 01:13:51.343927 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 916/1687] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:51 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:51.343927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3c06a7a-799c-4938-b4cb-32f1f2472095 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Calling method '.version_select at 0x7fc403247af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:51.415704 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3c06a7a-799c-4938-b4cb-32f1f2472095 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 371 microversion: 2.1 time: 0.083260 Aug 21 01:13:51.416290 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 917/1688] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:13:51 2022] GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:51.427941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc403177a60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:51.500904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.501631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.502226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.503147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.503599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.504020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.558069 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-532c9659-1cef-42bc-8931-781bea717b92 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 328 microversion: 2.1 time: 0.134322 Aug 21 01:13:51.558709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 918/1689] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:51 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 328 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:51.577649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:51.578652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:51.585561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.586278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.588281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.589190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.589826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.590423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.680358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.690833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.692477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.693641 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e66299ba-3dab-4ca3-b8ab-ba42a440a20c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1594 microversion: 2.32 time: 0.123423 Aug 21 01:13:51.694193 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 919/1690] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:51 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1594 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:51.698884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-778984853", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:51.724186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:51.740927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d75f667a-e267-4c17-8766-d5feb1b49618 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1712 microversion: 2.1 time: 1.121059 Aug 21 01:13:51.753364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 772/1691] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:50 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1712 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:51.759615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:51.760424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:51.768139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:51.771035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.772419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.773129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.774260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:51.775381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:51.776067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:51.985514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:51.985929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:51.986428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:51.986829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:51.987261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:52.004441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.005434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.005589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.006282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.006734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.007158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.027914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:52.034951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for user f8cd2a7facca4461a9802262a222a164 and project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:52.049388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.utils [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] instances quota exceeded for f7365174bf8e492a870365b0a2b3c63c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122482) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 21 01:13:52.050335 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Request method failure captured: Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 144 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbIuXXzeSi8RkkYkS_LLmhJK-sFrUFNHgSsRf7-qAQhfjVD_prmT0Rn6JysktgeuYGDOUODbMzAPHaLnfAd5YiSBHcT7XdAFSsGbKNfMfg9LBUAhWGTt0TetcjnFRhAebO2d4GSvhmOwSgEAVva-kG_O0M_u8DEoHjjNpTZjAfIcgg Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7365174bf8e492a870365b0a2b3c63c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}] Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f8cd2a7facca4461a9802262a222a164 Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-778984853", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-778984853', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452'}}} Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:13:52.053998 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9fb103b-de1a-4d56-ad86-9f4be8c59b3c tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.360109 Aug 21 01:13:52.059078 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 920/1692] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:13:51 2022] POST /compute/v2.1/servers => generated 119 bytes in 361 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:52.069823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-192627060", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "733da70d-73b5-4a16-a93a-dec288bd5761"}], "block_device_mapping_v2": [{"uuid": "ab91ac6c-70ad-4b90-a574-c82d6fc86ba6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:52.141985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] validate_networks() for [('733da70d-73b5-4a16-a93a-dec288bd5761', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:52.338218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:52.355361 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12a816c0-8243-431f-94ff-7c4980b92257 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1806 microversion: 2.1 time: 0.600131 Aug 21 01:13:52.359775 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 773/1693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:51 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1806 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:52.366762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:52.367953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:52.377613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.378624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.379247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.380347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.381583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.382202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.589932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:52.590381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:52.590823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:52.591565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:52.591980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:52.601848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.602608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.603034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.603761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.604208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.604629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.624735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:52.631002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Getting quotas for user 547522b0b07f472a91ec83f15a36bb90 and project ce70f9ff025c4666be942f9399ae72dc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:52.697744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:13:52.700910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab91ac6c-70ad-4b90-a574-c82d6fc86ba6',volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:13:52.853545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef838c66-0f69-4bd9-9e85-43e1e5271b34 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.796344 Aug 21 01:13:52.861758 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 921/1694] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:13:52.866616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc4031d3670>, body: {"quota_set": {"instances": 10}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:52.957376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.957768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.958235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:52.959000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:52.959439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:52.959850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.040461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34a29eab-badb-401c-aac3-e937900c9167 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 329 microversion: 2.1 time: 0.184463 Aug 21 01:13:53.042299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 922/1695] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:52 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 329 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:53.049511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.050263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.075801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.076293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.076731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.077821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.078300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.078723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.257173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.270168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3545cbed-9104-40b7-8b8e-3f47e9fbd65c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.224267 Aug 21 01:13:53.270786 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 923/1696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:53.275491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.276103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.288536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.289056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.289490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.290622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.291073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.291497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.385343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.396002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c170954b-f1c6-4b82-83c7-32c06e55ecd5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1265 microversion: 2.1 time: 0.123863 Aug 21 01:13:53.408819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 924/1697] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:53.413965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.414640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.422128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.422616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.423043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.423749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.424196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.424816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.462374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0318d420-0866-4a18-b693-f0c9c1077269 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a/ips" status: 200 len: 219 microversion: 2.1 time: 0.063836 Aug 21 01:13:53.463849 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 925/1698] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a/ips => generated 219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:53.469654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.470968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.477620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.478727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.479468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.481027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.481680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.482169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.566109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.576976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.579195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.580581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec0901ab-b053-44dd-9987-712f94425608 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1594 microversion: 2.32 time: 0.115775 Aug 21 01:13:53.581710 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 926/1699] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1594 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:53.586861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.587657 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.604077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.605511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.606203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.607125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.607744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.608435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.684740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.694092 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2e00ecc-79b9-4d68-ab65-2d64af8b5390 tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1645 microversion: 2.1 time: 0.111092 Aug 21 01:13:53.695351 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 927/1700] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:53.713333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:53.714218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:53.720403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.720927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.721363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.722065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:53.728328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:53.729251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:53.882661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.904240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.909711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:53.911108 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4c963fb-9025-4a8d-9063-5d8a3a72c87a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1176 microversion: 2.25 time: 0.215276 Aug 21 01:13:53.911418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 928/1701] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1176 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:53.915734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-03278a2e-0cf2-4439-a756-95f355ab0d8c tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Calling method '.version_select at 0x7fc4031d3040>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:54.013546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:54.015920 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-03278a2e-0cf2-4439-a756-95f355ab0d8c tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 371 microversion: 2.1 time: 0.103267 Aug 21 01:13:54.023210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 929/1702] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:13:53 2022] GET /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:54.025364 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7fb60a6e-f569-4526-8cef-b7a72690f285 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 1.663947 Aug 21 01:13:54.027047 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 774/1703] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:52 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:54.028618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:54.029234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:54.033949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67035c79-2bb6-40e8-874b-628c13c6c026", "name": "network-vif-deleted", "tag": "45573363-c1b5-4900-8306-63badfb5ca3a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:54.046558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.046728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.047114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.047266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.047673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.048029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.049334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.049795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.050953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.065624 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] Creating event network-vif-deleted:45573363-c1b5-4900-8306-63badfb5ca3a for instance 67035c79-2bb6-40e8-874b-628c13c6c026 on n-h1-master-1 Aug 21 01:13:54.073200 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-95c1b0bb-9567-4f10-9522-6b4a970a1260 req-11eda857-d3bd-4700-bd01-d69448c4ddf8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043690 Aug 21 01:13:54.075286 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 775/1704] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:54.085365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc3fe7985e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:54.090201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:13:54.252252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.253895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.254426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.256487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.258630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.258630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.286408 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c0b29bf-9a77-4e99-a6c3-b2bd109dafdf tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 204 len: 0 microversion: 2.1 time: 0.261951 Aug 21 01:13:54.291913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 930/1705] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:13:54 2022] DELETE /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:13:54.306075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:54.310056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:54.329560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.330079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.330569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.331314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.331768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.332189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.362415 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:54.379130 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:54.404343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67f1a7f3-b0bf-4d3d-85da-2edc1be8eb54 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 325 microversion: 2.1 time: 0.326858 Aug 21 01:13:54.405734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 776/1706] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:54 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:54.415630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:54.416604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:54.441435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.441926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.442370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.443134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.443598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.443979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.663485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:54.691363 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e0bff59-f60a-42af-bc49-cd2407dbb526 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1718 microversion: 2.1 time: 0.394603 Aug 21 01:13:54.692314 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 931/1707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:54 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1718 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:54.699267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:54.699882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:54.711609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.712388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.713012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.713878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:54.714925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:54.715511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:54.832099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:54.841000 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-585e0d3d-40b5-4b32-8cc7-2b6c240ab1f3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1265 microversion: 2.1 time: 0.147433 Aug 21 01:13:54.853373 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 932/1708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:54 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:54.863155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1319550964", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:54.875626 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:54.985425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:13:55.202286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.211578 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0f5316cc-df07-4174-94b1-97601af4aec8 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1812 microversion: 2.1 time: 0.804199 Aug 21 01:13:55.215780 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 777/1709] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:54 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1812 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:55.225029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:55.228165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:55.243929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.246385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.246995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.250354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.251023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.251637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.267775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:13:55.268211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:13:55.268690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:13:55.269150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:13:55.269633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:13:55.282312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.283079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.283515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.284299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.284757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.285215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.308502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:13:55.315480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Getting quotas for user f8cd2a7facca4461a9802262a222a164 and project f7365174bf8e492a870365b0a2b3c63c. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:13:55.339918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.utils [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] ram quota exceeded for f7365174bf8e492a870365b0a2b3c63c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122482) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 21 01:13:55.340807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Request method failure captured: Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 145 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbIuXXzeSi8RkkYkS_LLmhJK-sFrUFNHgSsRf7-qAQhfjVD_prmT0Rn6JysktgeuYGDOUODbMzAPHaLnfAd5YiSBHcT7XdAFSsGbKNfMfg9LBUAhWGTt0TetcjnFRhAebO2d4GSvhmOwSgEAVva-kG_O0M_u8DEoHjjNpTZjAfIcgg Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7365174bf8e492a870365b0a2b3c63c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}] Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f8cd2a7facca4461a9802262a222a164 Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1319550964", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1319550964', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452'}}} Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:13:55.344125 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c713e30-99e7-42a2-887e-f2e28673246a tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.491411 Aug 21 01:13:55.349336 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 933/1710] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:13:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:55.353047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:55.353047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:55.360054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.362257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.362257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.362257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.362739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.363241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.441823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbc3575a184139b26e3b0bdd221a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5715eb5c1474f35bb87595ba83a23f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.456988 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d034f06-10b8-4389-bbd2-aef0d13598fd tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 200 len: 1645 microversion: 2.1 time: 0.109250 Aug 21 01:13:55.457830 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 934/1711] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:55 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 1645 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:55.471208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:55.471208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:55.476908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.478329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.479210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.480532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.481037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.481533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.572451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.583650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.585445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.586866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d3c16ea-1f6d-4c4f-91b3-fe827641dfb1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1240 microversion: 2.25 time: 0.124964 Aug 21 01:13:55.587594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 935/1712] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:55 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:55.623748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:55.631280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:55.651546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.652932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.653541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.656789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:55.657607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:55.661181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:55.909532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:55.921218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6bb1d1ae-6524-45b0-a00b-86b0cca7ce42 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.331029 Aug 21 01:13:55.922298 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 936/1713] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:55 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:55.926933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Action: 'update', calling method: .version_select at 0x7fc4030bcee0>, body: {"quota_set": {"ram": 51200}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:56.013035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.013830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.014419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.015668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.016396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.017002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.096799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3654e435-6d88-48c2-b8b9-dced458d1f74 tempest-QuotasAdminNegativeTest-403701786 tempest-QuotasAdminNegativeTest-403701786-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 200 len: 329 microversion: 2.1 time: 0.173044 Aug 21 01:13:56.099084 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 937/1714] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:55 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:56.105890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:56.105890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:56.113190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.113190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.113555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.114871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.115869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.116614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.342685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.352735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3568236-b32f-4a65-8e54-d310baf54d0f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1708 microversion: 2.1 time: 0.252603 Aug 21 01:13:56.354535 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 938/1715] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:56 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1708 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:56.361018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:56.361633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:56.369166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.369744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.370244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.371023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.371549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.372155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.633988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.649926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c30c4d0-49cd-4cea-99bc-507c98c30c1b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.294206 Aug 21 01:13:56.651032 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 939/1716] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:56 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:56.671096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba1227fc-2912-46ea-abff-3dd9d764511d tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Action: 'update', calling method: .version_select at 0x7fc403128790>, body: {"quota_set": {"ram": 0}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:56.685201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba1227fc-2912-46ea-abff-3dd9d764511d tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f8cd2a7facca4461a9802262a222a164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7365174bf8e492a870365b0a2b3c63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba1227fc-2912-46ea-abff-3dd9d764511d tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Request method failure captured: Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c HTTP/1.1 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 25 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbIuXXzeSi8RkkYkS_LLmhJK-sFrUFNHgSsRf7-qAQhfjVD_prmT0Rn6JysktgeuYGDOUODbMzAPHaLnfAd5YiSBHcT7XdAFSsGbKNfMfg9LBUAhWGTt0TetcjnFRhAebO2d4GSvhmOwSgEAVva-kG_O0M_u8DEoHjjNpTZjAfIcgg Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7365174bf8e492a870365b0a2b3c63c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7365174bf8e492a870365b0a2b3c63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7365174bf8e492a870365b0a2b3c63c"}]}] Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f7365174bf8e492a870365b0a2b3c63c Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-920055276 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f8cd2a7facca4461a9802262a222a164 Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-QuotasAdminNegativeTest-920055276-project Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: {"quota_set": {"ram": 0}} Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f7365174bf8e492a870365b0a2b3c63c', 'body': {'quota_set': {'ram': 0}}} Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:13:56.688970 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 21 01:13:56.698845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.701661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba1227fc-2912-46ea-abff-3dd9d764511d tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:56.702968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba1227fc-2912-46ea-abff-3dd9d764511d tempest-QuotasAdminNegativeTest-920055276 tempest-QuotasAdminNegativeTest-920055276-project] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c" status: 403 len: 116 microversion: 2.1 time: 0.049758 Aug 21 01:13:56.708129 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 940/1717] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:13:56 2022] PUT /compute/v2.1/os-quota-sets/f7365174bf8e492a870365b0a2b3c63c => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:56.727106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:56.727723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:56.747379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.751053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.752177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.753044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.753529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.755907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.777999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.799796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.805960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:56.807207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce291426-5878-4c85-b4c5-04cba617ec3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1661 microversion: 2.32 time: 1.590258 Aug 21 01:13:56.821466 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 778/1718] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:55 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1661 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:56.830634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62a9167a-a272-40c6-a5a6-9b9ac1903d02 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '.version_select at 0x7fc3fde4db80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:56.844359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a9167a-a272-40c6-a5a6-9b9ac1903d02 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.844925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a9167a-a272-40c6-a5a6-9b9ac1903d02 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.845370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a9167a-a272-40c6-a5a6-9b9ac1903d02 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.885708 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62a9167a-a272-40c6-a5a6-9b9ac1903d02 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.069405 Aug 21 01:13:56.890747 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 779/1719] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:13:56 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:56.903317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:56.904427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] [instance: f12dabd6-7399-4cd0-a253-bd66898c7daf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:56.917700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.922753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.923433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.925126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:56.926344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:56.929106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:56.963731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] HTTP exception thrown: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Request method failure captured: Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf HTTP/1.1 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYZXRe8FbJKHx7VGHr-O_YoQQBraHrdAv8TnKvYld-MvTyU1FsR9T2ZpKvdqNzeXAjmqgrqWAd2HA-zkCNIK7zebMv_MjIeeb3czgFoykWzbzawoI4nQBoACUhd8N6olZTtek41R-CWiZDNTEx51jvjuuCdcjuYBZKYJ71UHy_pCPaQ Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c5715eb5c1474f35bb87595ba83a23f6 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestManualDisk-588946300 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c5715eb5c1474f35bb87595ba83a23f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c5715eb5c1474f35bb87595ba83a23f6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c5715eb5c1474f35bb87595ba83a23f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c5715eb5c1474f35bb87595ba83a23f6"}]}] Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestManualDisk-588946300 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c5715eb5c1474f35bb87595ba83a23f6 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestManualDisk-588946300 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestManualDisk-588946300-project Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 57bbc3575a184139b26e3b0bdd221a91 Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestManualDisk-588946300-project Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f12dabd6-7399-4cd0-a253-bd66898c7daf'} Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:13:56.965469 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Returning 404 to user: Instance f12dabd6-7399-4cd0-a253-bd66898c7daf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbb1f641-7d4a-441b-9324-116d706645eb tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf" status: 404 len: 111 microversion: 2.1 time: 0.074428 Aug 21 01:13:56.978332 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 780/1720] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:56 2022] GET /compute/v2.1/servers/f12dabd6-7399-4cd0-a253-bd66898c7daf => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:13:56.981341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12dabd6-7399-4cd0-a253-bd66898c7daf", "name": "network-vif-deleted", "tag": "fdac7d31-989f-4109-a3f5-9c8a2c72824e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:57.014788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.018323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.018995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.049102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] Creating event network-vif-deleted:fdac7d31-989f-4109-a3f5-9c8a2c72824e for instance f12dabd6-7399-4cd0-a253-bd66898c7daf on n-h2-master-1 Aug 21 01:13:57.060970 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c4a41957-6dbd-4f7d-999f-4da36fa19aea req-b67b8ea6-72f4-4200-9a53-6b2660773689 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086411 Aug 21 01:13:57.062127 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 781/1721] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:57.071528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.077431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:57.092172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.096063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.096607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.097449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.099370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.099877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.129463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:57.144526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-243b13b8-521a-456c-bc14-640236e4deb1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1812 microversion: 2.1 time: 0.438583 Aug 21 01:13:57.145439 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 941/1722] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:56 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1812 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:57.154764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d12f44b-a525-4cf2-bb09-622e01196700", "name": "network-vif-plugged", "status": "completed", "tag": "74670a8c-c8de-4803-99d3-dbd307c38538"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:57.179278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.181305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.181861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.203168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] Creating event network-vif-plugged:74670a8c-c8de-4803-99d3-dbd307c38538 for instance 6d12f44b-a525-4cf2-bb09-622e01196700 on n-h1-master-1 Aug 21 01:13:57.212192 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9547741c-dbaf-4cf8-b0fd-564f76ffbeb0 req-0d6ec110-2f91-45cf-9ba6-181ae3f98013 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065229 Aug 21 01:13:57.214441 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 942/1723] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:13:57.221956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.222815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:57.229671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.230279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.231094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.232039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.233306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.233978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.430149 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f630912-bbb4-483f-8b1e-42ef710f8c82 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1859 microversion: 2.1 time: 0.214040 Aug 21 01:13:57.431373 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 943/1724] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:57 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1859 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:57.437971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.439412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:57.447450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.448297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.449159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.450956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.451758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.452614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.537781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:57.546739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:57.553634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:57.555050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45ce32cf-844d-400b-8c98-6e2b693d706f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1250 microversion: 2.25 time: 0.488571 Aug 21 01:13:57.558114 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 782/1725] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:57 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1250 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:57.573766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a60e021-a1fc-49fb-ba6b-d26ab96ce74b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] Calling method '.version_select at 0x7fc3fde4dc10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.600271 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a60e021-a1fc-49fb-ba6b-d26ab96ce74b tempest-ServersTestManualDisk-588946300 tempest-ServersTestManualDisk-588946300-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070666573" status: 202 len: 0 microversion: 2.1 time: 0.030051 Aug 21 01:13:57.601597 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 783/1726] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070666573 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:13:57.606760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.607778 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:57.614801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.615542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.616218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.617167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.617819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.618392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.743077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:57.757609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d34e539a-8530-4925-8820-df3ff7dd93c8 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.324924 Aug 21 01:13:57.758213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 944/1727] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:57 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:57.776176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:57.777109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:57.786751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.787345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.787983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:57.788752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:57.789370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:57.789892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.074314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.089300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-510ab0d5-34ba-4593-9a1c-2a2c2947fa86 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.319088 Aug 21 01:13:58.092573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 945/1728] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:57 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:58.101816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:58.102423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:58.116208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.116759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.117312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.118410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.118925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.119466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.580744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2d3eb8c-ae94-47ed-9298-1157edc56626 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1859 microversion: 2.1 time: 0.971429 Aug 21 01:13:58.598214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 784/1729] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:57 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1859 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:58.605171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:58.606174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:58.619286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.620561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.621462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.621999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.627200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.627792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.628934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.637106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.639380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.641922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f12e25a-ee0d-44d9-8c74-5fa65fc770cd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1661 microversion: 2.32 time: 0.546512 Aug 21 01:13:58.647411 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 946/1730] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:58 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1661 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:58.652986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:58.656331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:58.672462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.673284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.673943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.674996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.675698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.682704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.845292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.857866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.862702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:58.864174 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72ea6b67-81cd-4ba8-9e1b-718dd9901e35 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1250 microversion: 2.25 time: 0.215337 Aug 21 01:13:58.867717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 947/1731] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:58 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1250 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:13:58.885492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:58.886722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:58.895858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.898064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.902056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:58.917538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:58.918689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:58.919335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:59.274525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:59.300585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-200669d5-6352-499f-abdb-089ad889c0c7 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1316 microversion: 2.1 time: 0.429466 Aug 21 01:13:59.304508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 948/1732] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:58 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:59.323590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:13:59.325546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:13:59.338272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:59.350289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:59.351484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:59.354397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:59.362883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:59.373620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:59.913820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:59.924865 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf761919-997f-418e-9aee-f8909014bd8c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.616701 Aug 21 01:13:59.925457 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 949/1733] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:59 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:59.945192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-unplugged", "status": "completed", "tag": "f24ebbe3-ef99-40cf-bd14-678300bf9917"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:13:59.953368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:13:59.967776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:13:59.968257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:13:59.968691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:13:59.969230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e15776bb-19fc-4c6e-b77b-826d56960809 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1812 microversion: 2.1 time: 1.367077 Aug 21 01:13:59.969848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 785/1734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:13:58 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1812 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:13:59.999675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:00.000329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:00.022910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] Creating event network-vif-unplugged:f24ebbe3-ef99-40cf-bd14-678300bf9917 for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:14:00.045236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a399a501-57e3-423e-b751-b74a1ddfa258 req-6fcac7af-7fb5-4b63-9884-3be0b819e6a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101601 Aug 21 01:14:00.047695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.048746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.049158 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 950/1735] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:00.049381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.050218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.051038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.051742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.078439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-deleted", "tag": "5c2ee999-3559-491a-91b3-f3a046342b7f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:00.091978 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:00.146180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.147680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.150082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.180344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] Creating event network-vif-deleted:5c2ee999-3559-491a-91b3-f3a046342b7f for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:14:00.189451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8f597915-bbac-4880-b623-2cbc1260802a req-e02f0712-7445-45f4-9e37-f8a6387e9eb9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135419 Aug 21 01:14:00.191141 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 951/1736] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:00.201105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:00.202181 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:00.214222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.215505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.216132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.217302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.218271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.218863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.228882 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:00.406223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:00.423615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:00.426460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:00.427898 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02c7f1da-aa29-4c37-9f94-6a598a1e72f5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1250 microversion: 2.25 time: 0.235148 Aug 21 01:14:00.429156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 952/1737] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:00 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1250 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:00.446836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:00.447512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:00.455048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.455841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.456567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.457691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.458312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.458897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.933420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:00.947707 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6789b4e3-95b5-4a30-94ab-5bbf077f3eaa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1505 microversion: 2.1 time: 0.516924 Aug 21 01:14:00.948316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 953/1738] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:00 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:00.965689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:00.966645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:00.982813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.983717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.984310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:00.985229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:00.985972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:00.986599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.078660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.094430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.099720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.103725 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38bc94ba-e0e7-44f1-9418-5442df0256f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1707 microversion: 2.32 time: 1.132895 Aug 21 01:14:01.107213 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 786/1739] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:13:59 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1707 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:01.112882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:01.121873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:01.140598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.141692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.142919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.147042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.147762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.148683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.224816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.226220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16eb8357-d883-41a5-b530-c6d7134efbfa tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/os-instance-actions/req-c68e3b54-aaba-463d-a614-dd21e5e322fe" status: 200 len: 313 microversion: 2.1 time: 0.117741 Aug 21 01:14:01.235693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 787/1740] 10.222.0.46 () {58 vars in 1419 bytes} [Sun Aug 21 01:14:01 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/os-instance-actions/req-c68e3b54-aaba-463d-a614-dd21e5e322fe => generated 313 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:01.241472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:01.242309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:01.260159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.262291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.262997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.269705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.271239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.271898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.411423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.420807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c0e704f-a9b0-4688-9ca9-78018111d37b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.471006 Aug 21 01:14:01.421489 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 954/1741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:00 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:01.449215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:01.451558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:01.475330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.477249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.477705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.478449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.482358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.484284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.656457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c356a93-8b95-45ee-9fa4-39f9f47cbd4b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "POST /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/action" status: 202 len: 0 microversion: 2.1 time: 0.224642 Aug 21 01:14:01.662470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 955/1742] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:14:01 2022] POST /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:14:01.682008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:01.683734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:01.714751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.715983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.717059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.719532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.721258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.723580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.741074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.765592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4fa4e818-d683-45d9-9b24-c2894a573f39 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1677 microversion: 2.1 time: 0.526358 Aug 21 01:14:01.769088 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 788/1743] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:01 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1677 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:01.778534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:01.779278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:01.790664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.793510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.794366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.797338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:01.799698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:01.806707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:01.936307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.953492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.956669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:01.958635 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b776a3a0-ee34-44ac-84ac-a25da850c773 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1250 microversion: 2.25 time: 0.293973 Aug 21 01:14:01.959764 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 956/1744] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:01 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1250 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:02.066367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-unplugged", "status": "completed", "tag": "7fa54a5a-8cc2-4b47-8bb6-432ba742c57c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:02.078532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.080355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.082282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:02.101391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] Creating event network-vif-unplugged:7fa54a5a-8cc2-4b47-8bb6-432ba742c57c for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:14:02.110369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-46d649a2-3ad7-42af-b0be-d92523034b4d req-0bb19ea3-e1c7-4c51-8bc7-d73fee7958d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049643 Aug 21 01:14:02.112700 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 957/1745] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:14:02.134515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:02.136033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:02.149651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.150494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.151166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:02.152091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.154154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.156125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:02.747684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:02.762390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:02.774206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:02.776152 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d7f8df5-dfa3-4901-ad90-ed09137eb7dd tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1707 microversion: 2.32 time: 0.649150 Aug 21 01:14:02.780609 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 958/1746] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:02 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1707 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:02.791282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c1e5ba-78de-4638-b4a6-4a73f0b85fd4", "tag": "bed23fe5-5be4-494f-b81e-fbd127d722e7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:02.828695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.830335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.834513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:02.848917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] Creating event network-changed:bed23fe5-5be4-494f-b81e-fbd127d722e7 for instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 on n-h1-master-1 Aug 21 01:14:02.867244 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c45aee8c-12a5-4343-9a65-dcb9cf49d521 req-c5a3b64b-22d1-4117-9bf7-06fdde6c4218 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079667 Aug 21 01:14:02.872449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 959/1747] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:02.880054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:02.888971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:02.905995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.906803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.907416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:02.908634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:02.910708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:02.911321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:03.322444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:03.334376 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c8e34eb-8657-4cf0-b094-edb9a0a9e6e0 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1507 microversion: 2.1 time: 1.563833 Aug 21 01:14:03.353610 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 789/1748] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:01 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1507 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:03.376512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:03.379507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:03.391937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:03.395930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:03.397658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:03.399155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:03.399835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:03.401740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:03.691348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:03.702258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d6d2120-e304-4981-9d3e-47e079a12d7b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.827814 Aug 21 01:14:03.713190 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 960/1749] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:02 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:03.721762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:03.722746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:03.730663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:03.731444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:03.732098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:03.733218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:03.734036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:03.734674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:03.978239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:03.988832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:03.990807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:03.995272 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a608f0b-8708-431d-8bf3-7fc3dd0b55b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1292 microversion: 2.25 time: 0.280538 Aug 21 01:14:03.997399 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 961/1750] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:03 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:04.198160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:04.202528 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:14:04.202528 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:14:04.205278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.205774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.206219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.212851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.213321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.213763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.262562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:04.276165 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c7f15807-98d6-43ed-8ebc-0676de6780ae tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1656 microversion: 2.1 time: 0.903224 Aug 21 01:14:04.277954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 790/1751] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:03 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1656 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:04.278657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e627714-57e8-43c2-bbbe-cb5faa244b82 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.275391 Aug 21 01:14:04.286639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 962/1752] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:14:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:04.291504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:04.292344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:04.292907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:04.296598 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:14:04.296598 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:14:04.297940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.298433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.301212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.301920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.302550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.303536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.303968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.304359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.304973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.305104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.305741 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:04.306397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.306856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.336583 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=25 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:04.385149 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=30 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:04.398597 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e240adb6-6a5d-4d85-b8dc-226f4293cb26 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.110495 Aug 21 01:14:04.406572 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 963/1753] 10.222.0.46 () {58 vars in 1172 bytes} [Sun Aug 21 01:14:04 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:14:04.416909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:04.417841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:04.425069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.425837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.427226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:04.428174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:04.429108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:04.429724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.027779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:05.038513 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-418f8352-b1d2-49be-894b-0a530c316a1b tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1507 microversion: 2.1 time: 0.630170 Aug 21 01:14:05.041974 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 964/1754] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:04 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:05.048686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:05.052910 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:14:05.052910 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:14:05.054693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.057527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.069247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.072749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.073563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.074366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.111262 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-132208a3-6c44-41e0-939e-4f3b4f822978 tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067786 Aug 21 01:14:05.112593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 965/1755] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:14:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:05.123512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:05.124127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:05.143471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.144042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.144470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.147292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.147996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.148167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.378914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:05.390780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:05.393638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:05.398257 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea192771-34e3-41ee-9468-8fbd60b422c7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1753 microversion: 2.32 time: 1.118831 Aug 21 01:14:05.399729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 791/1756] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:04 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1753 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:05.406376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-deleted", "tag": "7fa54a5a-8cc2-4b47-8bb6-432ba742c57c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:05.419437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.420317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.421038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.435211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] Creating event network-vif-deleted:7fa54a5a-8cc2-4b47-8bb6-432ba742c57c for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:14:05.442801 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-99da04ec-fdb8-49e9-abc5-095a442ae3a5 req-6beb4f41-bec4-4e5a-8fa0-ddd7270f5dbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041326 Aug 21 01:14:05.445762 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 792/1757] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:05.453450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:05.454625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:05.463161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.463933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.464949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.466250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.467298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.468013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.526573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:05.537220 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-109816ae-f969-44f4-87a2-0d2403c4e83f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.422827 Aug 21 01:14:05.538323 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 966/1758] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:05 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:05.546731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:05.572460 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:14:05.572460 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:14:05.574280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.575002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.575765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.577645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.578994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.579823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.628463 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-168ad409-05d1-4cf6-a784-d22336230f5d tempest-ServicesAdminTestJSON-2104196197 tempest-ServicesAdminTestJSON-2104196197-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.088433 Aug 21 01:14:05.629124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 967/1759] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:14:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:05.645826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:05.646002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:05.658042 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:05.660299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.661065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.662189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.662386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:05.663044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:05.663495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:05.994977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:06.025393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:06.028111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:06.030685 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f305831-f084-49fd-bb94-32b29e7c127b tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1292 microversion: 2.25 time: 0.582726 Aug 21 01:14:06.037018 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 793/1760] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:05 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1292 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:06.063586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:06.064608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:06.068280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:06.086792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.087748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.087949 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f168b653-1b29-40ab-ad6b-10ac956062f1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 200 len: 1497 microversion: 2.1 time: 0.455432 Aug 21 01:14:06.088606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.089627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.090299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.090959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.092199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 968/1761] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:05 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:06.425816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:06.426483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:06.429530 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=70 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:06.445760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.446228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.446664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.447380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.447827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.448244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.845075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:06.852966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7540f17e-e102-417d-9a66-3440913ffc0f tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1507 microversion: 2.1 time: 0.794093 Aug 21 01:14:06.853550 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 794/1762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:06 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1507 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:06.868615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:06.873271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:06.885853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.891826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.892518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.893396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:06.893826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:06.894172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:06.944328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.007286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.023085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.026393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a4d69b7-83b9-454b-b305-315d84d4a3d2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1753 microversion: 2.32 time: 0.601350 Aug 21 01:14:07.027822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 969/1763] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:06 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1753 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:07.064337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:07.065180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:07.086365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.088423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.090213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.091627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.093696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.095760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.385292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.396642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.398554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.400077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65cb36e3-f4e9-49f2-ac7e-b21080d82b27 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1292 microversion: 2.25 time: 0.342012 Aug 21 01:14:07.418851 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 970/1764] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:07 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:07.427294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:07.428216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:07.439806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.440682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.441487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.442339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.442940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.443512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.464877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a HTTP/1.1 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '29d80535-fd61-410a-8cf4-0a40b599241a'} Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:07.466704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:14:07.472268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:07.474269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:07.476021 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66c29e7e-239e-40ff-bccc-208ced38a2af tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 404 len: 111 microversion: 2.1 time: 0.055908 Aug 21 01:14:07.476604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 971/1765] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:07 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:14:07.542958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d80535-fd61-410a-8cf4-0a40b599241a", "name": "network-vif-deleted", "tag": "f24ebbe3-ef99-40cf-bd14-678300bf9917"}, {"name": "network-changed", "server_uuid": "ab51f922-b064-4405-aa06-a4dc9b115412", "tag": "99bcb505-6f74-41df-93c7-c5323751ecfc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:07.573594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.573808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.577699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.616282 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Creating event network-vif-deleted:f24ebbe3-ef99-40cf-bd14-678300bf9917 for instance 29d80535-fd61-410a-8cf4-0a40b599241a on n-h2-master-1 Aug 21 01:14:07.618480 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] Creating event network-changed:99bcb505-6f74-41df-93c7-c5323751ecfc for instance ab51f922-b064-4405-aa06-a4dc9b115412 on n-h2-master-1 Aug 21 01:14:07.639864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-373eb4bd-8f5f-48fa-909a-5ad1afe86883 req-9b0845f2-0cb4-4a78-a0fb-d37755311b64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099661 Aug 21 01:14:07.643765 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 972/1766] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:14:07.787392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:07.806443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c72bd3b8-9a4a-4313-9c44-47f5adea7f74 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.951816 Aug 21 01:14:07.807028 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 795/1767] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:06 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:07.875152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:07.876590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:07.890724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.897048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.897901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.900346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:07.902419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:07.903703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:07.972046 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:08.054287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:08.054885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:08.074674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.075436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.076019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.077001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.077617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.078198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.274981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:08.299531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5468f177-8ae7-4274-a92a-4007ec86ee79 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1505 microversion: 2.1 time: 0.428884 Aug 21 01:14:08.303109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 973/1768] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:07 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:08.330658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '.version_select at 0x7fc403177d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:08.331443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:08.338904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.339611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.340232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.341853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.342804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.343520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.394860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b5fb4e0-2104-418e-ab4b-b6080731c738 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.072918 Aug 21 01:14:08.401436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 974/1769] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:14:08 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700/os-instance-actions => generated 611 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:08.417742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:08.419768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:08.444502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.445328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.446313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.447808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.448467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.449087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.532531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:14:08.725631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15b0d49f-4319-46fd-af86-83a276ab4ad6 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 204 len: 0 microversion: 2.1 time: 0.317847 Aug 21 01:14:08.729242 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 975/1770] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:14:08 2022] DELETE /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:14:08.748629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:08.753806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:08.766683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.768206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.768875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:08.769775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:08.770378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:08.770956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.131858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.143964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.157344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.158741 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4980b25d-6201-48d0-9d41-1cd5d902337f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1292 microversion: 2.25 time: 0.423736 Aug 21 01:14:09.173206 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 976/1771] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:08 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:09.179347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:09.183745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:09.201556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.202307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.202894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.207291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.208001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.208608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.524730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.539321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-82d22c62-5625-4d47-a2bc-3748502660e5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1511 microversion: 2.1 time: 0.362258 Aug 21 01:14:09.552796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 977/1772] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:09 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:09.558940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:09.559716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:09.569381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.570924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.571362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.572070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.572509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.576311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.817165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.827660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.831454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.840161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1faaad62-d114-4257-a449-826f8816b6b6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1799 microversion: 2.32 time: 1.789638 Aug 21 01:14:09.843044 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 796/1773] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:08 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1799 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:09.852640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:09.854981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:09.867419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.868088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.872152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.872957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:09.873885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:09.874329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:09.876848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:09.890204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a7b02ad-c9ec-414f-9161-fc8b7e9422c9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.348311 Aug 21 01:14:09.902054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 978/1774] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:09 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:09.996446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lazy-loading 'services' on Instance uuid 39804aef-6cc7-4646-b04c-68554a76c011 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:14:10.088968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c203036a-cf76-4b4e-95ab-547beffef548 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments/fbb15efe-a01d-4313-869e-bffdb91a3470" status: 202 len: 0 microversion: 2.1 time: 0.244245 Aug 21 01:14:10.090495 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 797/1775] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:14:09 2022] DELETE /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments/fbb15efe-a01d-4313-869e-bffdb91a3470 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:14:10.101218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:10.104343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:10.113393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.115041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.115653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.117174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.117973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.118591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.185400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:10.186532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:10.205036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.206031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.206923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.207735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.208890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80b76bb9-66f4-45cc-bf97-ff7c0a0eb3c7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113352 Aug 21 01:14:10.209453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.210557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.211830 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 979/1776] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:10 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:10.610923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-246ae31c-4714-41fa-b705-e278567a348e tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-299289378", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:10.617027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-246ae31c-4714-41fa-b705-e278567a348e tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] HTTP exception thrown: min_count must be <= max_count Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-246ae31c-4714-41fa-b705-e278567a348e tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Request method failure captured: Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 183 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbiNyOKQDQaifoMrn3d4bkVi3McL2Cr1m0zHIUN3lfBdgLaOsOVFiB2R0w42fjGOS3zSx9USDChgg1FXJ1Ffx3yYJeKiYZPi6UU94JWF5XbSf0fjdW7iqzWu_siCMtUPgmwaCzpDZClftC1cJtsYK0FS-lOM01jnihcDph1d-nd5DM Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04f0bc3a7db948e0bc3232eba00ef81a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}] Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 40d2c5c649824015bb405c77264d877a Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-299289378", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: exception: min_count must be <= max_count Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-299289378', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 21 01:14:10.618879 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.633399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-246ae31c-4714-41fa-b705-e278567a348e tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Returning 400 to user: min_count must be <= max_count {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:10.634486 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-246ae31c-4714-41fa-b705-e278567a348e tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.210890 Aug 21 01:14:10.635809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 980/1777] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:10 2022] POST /compute/v2.1/servers => generated 74 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 21 01:14:10.654689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:10.658868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:10.679319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.683564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.685381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.689488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:10.691590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:10.694728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:10.902300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:10.912796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:10.914321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:10.921741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fae91e65-0b6b-4ba5-b38a-00eb6bfb1fa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.735470 Aug 21 01:14:10.922459 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 798/1778] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:10 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:10.933622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d79cfad6-b417-40b3-9956-7c870ce58b38 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1033686850", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "max_count": 0}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d79cfad6-b417-40b3-9956-7c870ce58b38 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Request method failure captured: Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 168 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYbiNyOKQDQaifoMrn3d4bkVi3McL2Cr1m0zHIUN3lfBdgLaOsOVFiB2R0w42fjGOS3zSx9USDChgg1FXJ1Ffx3yYJeKiYZPi6UU94JWF5XbSf0fjdW7iqzWu_siCMtUPgmwaCzpDZClftC1cJtsYK0FS-lOM01jnihcDph1d-nd5DM Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04f0bc3a7db948e0bc3232eba00ef81a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}] Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 40d2c5c649824015bb405c77264d877a Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1033686850", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "max_count": 0}} Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1033686850', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'max_count': 0}}} Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 0 Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:14:10.940449 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:10.946255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:14:10.956519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d79cfad6-b417-40b3-9956-7c870ce58b38 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:10.957702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d79cfad6-b417-40b3-9956-7c870ce58b38 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034276 Aug 21 01:14:10.958802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 799/1779] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:10 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:14:10.973743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c1e5ba-78de-4638-b4a6-4a73f0b85fd4", "name": "network-vif-plugged", "status": "completed", "tag": "bed23fe5-5be4-494f-b81e-fbd127d722e7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:11.000093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.000284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.000554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.022745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:11.024307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] Creating event network-vif-plugged:bed23fe5-5be4-494f-b81e-fbd127d722e7 for instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 on n-h1-master-1 Aug 21 01:14:11.035930 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b944a559-2230-4448-afbe-a3a7f459f664 req-1f21ad4c-2f53-4f09-a21b-c45cefe0ffbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075735 Aug 21 01:14:11.037236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-771ed103-5df2-4784-915a-b3af7493aaf3 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1511 microversion: 2.1 time: 0.398826 Aug 21 01:14:11.039926 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 800/1780] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:11.045411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:11.046438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:11.053342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.054077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.054686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.055111 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 981/1781] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:10 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:11.055827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.056440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.057058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.065426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:11.066631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:11.081253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.082768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.084274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.085382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.086399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.087130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.259644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:11.267552 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a171a95-8249-4a26-937e-847c3cc51906 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.211211 Aug 21 01:14:11.280797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 982/1782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:11 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:11.284080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05bf3af6-b082-4995-acc7-f928ae250beb tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-208647699", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "max_count": 2.5}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05bf3af6-b082-4995-acc7-f928ae250beb tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Request method failure captured: Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 169 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbiNyOKQDQaifoMrn3d4bkVi3McL2Cr1m0zHIUN3lfBdgLaOsOVFiB2R0w42fjGOS3zSx9USDChgg1FXJ1Ffx3yYJeKiYZPi6UU94JWF5XbSf0fjdW7iqzWu_siCMtUPgmwaCzpDZClftC1cJtsYK0FS-lOM01jnihcDph1d-nd5DM Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04f0bc3a7db948e0bc3232eba00ef81a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}] Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 40d2c5c649824015bb405c77264d877a Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-208647699", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "max_count": 2.5}} Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-208647699', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'max_count': 2.5}}} Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 2.5 Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:14:11.289432 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.294982 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.296266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05bf3af6-b082-4995-acc7-f928ae250beb tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:11.305400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05bf3af6-b082-4995-acc7-f928ae250beb tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025295 Aug 21 01:14:11.312182 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 983/1783] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:14:11.316095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:11.318863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:11.327438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.328256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.328819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.329808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.330369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.330888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.367187 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-32e19ac8-b52b-47cb-bf48-37b49153d72e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057941 Aug 21 01:14:11.367997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 984/1784] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:11 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:11.473251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1642ee50-0274-4383-a930-998a4f1fd8e4 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2024514767", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 0}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1642ee50-0274-4383-a930-998a4f1fd8e4 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Request method failure captured: Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 168 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbiNyOKQDQaifoMrn3d4bkVi3McL2Cr1m0zHIUN3lfBdgLaOsOVFiB2R0w42fjGOS3zSx9USDChgg1FXJ1Ffx3yYJeKiYZPi6UU94JWF5XbSf0fjdW7iqzWu_siCMtUPgmwaCzpDZClftC1cJtsYK0FS-lOM01jnihcDph1d-nd5DM Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04f0bc3a7db948e0bc3232eba00ef81a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}] Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 40d2c5c649824015bb405c77264d877a Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2024514767", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 0}} Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2024514767', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'min_count': 0}}} Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 0 Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:14:11.478574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.484730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1642ee50-0274-4383-a930-998a4f1fd8e4 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:11.486861 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1642ee50-0274-4383-a930-998a4f1fd8e4 tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018280 Aug 21 01:14:11.488524 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 985/1785] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:14:11.579007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97a6a0ef-adb4-471c-8ae0-ef5c96bc717f tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2111482334", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 2.5}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97a6a0ef-adb4-471c-8ae0-ef5c96bc717f tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Request method failure captured: Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 170 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYbiNyOKQDQaifoMrn3d4bkVi3McL2Cr1m0zHIUN3lfBdgLaOsOVFiB2R0w42fjGOS3zSx9USDChgg1FXJ1Ffx3yYJeKiYZPi6UU94JWF5XbSf0fjdW7iqzWu_siCMtUPgmwaCzpDZClftC1cJtsYK0FS-lOM01jnihcDph1d-nd5DM Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_04f0bc3a7db948e0bc3232eba00ef81a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/04f0bc3a7db948e0bc3232eba00ef81a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/04f0bc3a7db948e0bc3232eba00ef81a"}]}] Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 04f0bc3a7db948e0bc3232eba00ef81a Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-196134328 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 40d2c5c649824015bb405c77264d877a Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-196134328-project Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2111482334", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 2.5}} Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2111482334', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'min_count': 2.5}}} Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 2.5 Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:14:11.587104 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97a6a0ef-adb4-471c-8ae0-ef5c96bc717f tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97a6a0ef-adb4-471c-8ae0-ef5c96bc717f tempest-MultipleCreateNegativeTestJSON-196134328 tempest-MultipleCreateNegativeTestJSON-196134328-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015250 Aug 21 01:14:11.598613 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 986/1786] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:14:11.793070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:11.807377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:11.813396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:11.819419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa6d55b5-04c4-4abd-a42a-b7a9c6b16d1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1799 microversion: 2.32 time: 0.776249 Aug 21 01:14:11.820908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 801/1787] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:11 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1799 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:11.950760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:11.952479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:11.982672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.983354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.983927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:11.984671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:11.985156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:11.985585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:12.059889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:12.060696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:12.070723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:12.077117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:12.078789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:12.083716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:12.084474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:12.085165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:12.488801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:12.500321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:12.506810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:12.509910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee7443ff-fa53-485f-92ad-689fb17ae2b0 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.565016 Aug 21 01:14:12.513991 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 987/1788] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:11 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:12.541506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:12.547120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:12.559926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:12.563697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:12.565025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:12.567278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:12.570658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:12.571328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.061612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04086173676446ab71da619f5826f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6548e216312e4326a0efba388107207b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.074408 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87339689-fa4b-437b-855a-c6c4b04980f5 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 200 len: 1511 microversion: 2.1 time: 1.018603 Aug 21 01:14:13.087931 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 802/1789] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:12 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 1511 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:13.088714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:13.092984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:13.111341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.115131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.116949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.117992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.118461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.118888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.124807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.141077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6594fba-5394-4cb8-bd8b-c105e0e89ea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1307 microversion: 2.1 time: 0.619472 Aug 21 01:14:13.143195 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 988/1790] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:12 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1307 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:13.152962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:13.156837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:13.201022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.201723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.202249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.206971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.207744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.208423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.227859 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b6ae714-5e12-49b8-8b23-2ca696cc06a9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144730 Aug 21 01:14:13.240823 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 803/1791] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:13 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:13.251388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d12f44b-a525-4cf2-bb09-622e01196700", "name": "network-vif-deleted", "tag": "74670a8c-c8de-4803-99d3-dbd307c38538"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:13.278129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.279281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.280417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.303714 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] Creating event network-vif-deleted:74670a8c-c8de-4803-99d3-dbd307c38538 for instance 6d12f44b-a525-4cf2-bb09-622e01196700 on n-h1-master-1 Aug 21 01:14:13.322081 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-fb671d8f-8600-46e4-a49a-be0ad7d6fe95 req-ea8b9dca-a1cc-4928-bd13-cba3508c92f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077315 Aug 21 01:14:13.323326 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 804/1792] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:13.541216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:13.542995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:13.551638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.552397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.553044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.554850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:13.555527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:13.556118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:13.587909 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:13.716056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.730930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.732433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.736123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46848b9e-2f1f-4656-b8bc-94a9708a3f08 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1845 microversion: 2.32 time: 0.591623 Aug 21 01:14:13.742305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 989/1793] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:13 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1845 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:13.894021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.903933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.909110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:13.914989 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-52d5e1a9-249c-47d5-860e-2936f697f9ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.379222 Aug 21 01:14:13.915585 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 805/1794] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:13 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:14:14.097116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:14.097963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] [instance: 6d12f44b-a525-4cf2-bb09-622e01196700] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:14.109386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.113491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.114442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.116242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.118151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.119201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.164893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] HTTP exception thrown: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. Aug 21 01:14:14.166479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Request method failure captured: Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 HTTP/1.1 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYa_X38GvD0H18DhjD5XOACJ65B0e_lxzTXOA1A0kRpU2wwL3naHho4lf1gkXElh4BMNVNiZ6OiMp0tJNjUWjpgB3Ks8o35yksX_8Xwq8m6sTnU9w7tUcY2guhmJ89fcavMIiOaQfIY2BYl4U6pd0-zszsVxbtYZKmklGrTIjn6f86A Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6548e216312e4326a0efba388107207b Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-InstanceActionsTestJSON-934625644 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6548e216312e4326a0efba388107207b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6548e216312e4326a0efba388107207b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6548e216312e4326a0efba388107207b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6548e216312e4326a0efba388107207b"}]}] Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-InstanceActionsTestJSON-934625644 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6548e216312e4326a0efba388107207b Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-InstanceActionsTestJSON-934625644 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-InstanceActionsTestJSON-934625644-project Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a04086173676446ab71da619f5826f97 Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-InstanceActionsTestJSON-934625644-project Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6d12f44b-a525-4cf2-bb09-622e01196700'} Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:14:14.166885 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. Aug 21 01:14:14.171686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:14:14.172200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:14.172291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] Returning 404 to user: Instance 6d12f44b-a525-4cf2-bb09-622e01196700 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:14:14.172291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6743bc41-98b5-4d33-b501-bf12ca9a98a2 tempest-InstanceActionsTestJSON-934625644 tempest-InstanceActionsTestJSON-934625644-project] 10.222.0.46 "GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700" status: 404 len: 111 microversion: 2.1 time: 0.076465 Aug 21 01:14:14.173421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 990/1795] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:14 2022] GET /compute/v2.1/servers/6d12f44b-a525-4cf2-bb09-622e01196700 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:14:14.183680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.185519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.188310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.189124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.189595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.191141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.253435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:14.266071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:14.286939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.289753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.290402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.292901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.293547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.295597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.393862 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfec4426-a9c5-4789-a6a9-6ce9881a8903 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149972 Aug 21 01:14:14.398234 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 991/1796] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:14 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:14.760388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:14.761034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:14.768759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.770013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.770628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:14.771497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:14.772281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:14.773255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.017644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.034498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-658e7e99-77a9-40a0-92cf-1329ca9f49aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1487 microversion: 2.1 time: 0.872116 Aug 21 01:14:15.037030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 806/1797] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:14 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1487 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:14:15.054668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:15.057263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:15.075172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.077549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.078321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.080141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.082485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.084254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.366132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.369710 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:15.388802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.390842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.392197 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-07cf8a39-4452-45c5-98dd-fa7cc167b49a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1845 microversion: 2.32 time: 0.636511 Aug 21 01:14:15.413704 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 992/1798] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:14 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1845 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:14:15.425258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:15.441890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.442378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.442810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.515270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:14:15.587738 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:15.602850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46df402b-13b9-4c24-b08f-43dd0023bff2 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.187612 Aug 21 01:14:15.606361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 993/1799] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:14:15 2022] POST /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:14:15.608682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:15.610994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:15.628680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.629199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.629625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.630322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.630954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.631565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.670368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64e77d7a-818d-4fe7-914f-bb1f5719ef50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065413 Aug 21 01:14:15.671663 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 994/1800] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:15 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:15.674468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.677943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "8c042ceb-0474-43e0-9d18-f60ab556f200"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:15.693852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.695903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.697064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.702270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.712014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:15.712984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] Creating event network-changed:8c042ceb-0474-43e0-9d18-f60ab556f200 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:15.713497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3309a1e-9ec7-4287-9ff0-664b09dbf669 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.674162 Aug 21 01:14:15.714051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 807/1801] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:15 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:15.735753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5dd1aa15-21ff-4612-84cb-29e648f97632 req-ba34eb24-a5b8-4b36-acae-6ed80c3575ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062395 Aug 21 01:14:15.736661 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 995/1802] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:15.737870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:15.740915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:15.753241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.753724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.754190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:15.754909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:15.755422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:15.755844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.428125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:16.429639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:16.456859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.457655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.458326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.459535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.460334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.460997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.604103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:16.616443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b4b5e83-f4ec-4539-a563-1fe32909f801 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.887825 Aug 21 01:14:16.617454 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 808/1803] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:15 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:16.686979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:16.690198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:16.708006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.708552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.709021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.709757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.710543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.710655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.819785 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-818c19c6-53c1-4ee0-9b41-770f7d67773e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138847 Aug 21 01:14:16.821008 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 809/1804] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:16 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:14:16.826603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:16.827682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:16.834380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.835125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.836109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:16.837123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:16.837777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:16.838398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:17.148803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.164045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.166086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.168057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-109c5505-baf1-4014-b663-5d8100558789 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1845 microversion: 2.32 time: 0.744148 Aug 21 01:14:17.174588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 996/1805] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:16 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1845 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:17.638029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:17.639144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:17.661311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:17.661807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:17.662245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:17.662961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:17.663407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:17.663824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:17.760609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.776384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.777747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:17.778893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d57e2ad3-aa32-42fd-a469-eebf71eadbc7 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.956659 Aug 21 01:14:17.779513 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 810/1806] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:16 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:17.832682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:17.835124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:17.848154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:17.848961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:17.849556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:17.853691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:17.854410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:17.855010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:17.911616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-06fdd2d5-72d1-4dfe-9fe4-a5695770d6e2 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083474 Aug 21 01:14:17.912853 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 811/1807] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:17 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:18.199791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:18.200549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:18.214478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:18.215258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:18.219221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:18.223519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:18.224610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:18.227421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:18.283326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:18.302008 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3111f2e9-6078-4e18-9157-9089a9681657 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.667632 Aug 21 01:14:18.328941 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 997/1808] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:17 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:18.804547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:18.806394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:18.828592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:18.832559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:18.833200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:18.834051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:18.834614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:18.835537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.207957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:19.222115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:19.224238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:19.229580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6abda28-7cc8-4b1a-b358-276cb1798413 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.430308 Aug 21 01:14:19.245249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 998/1809] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:18 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:19.253429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "14001b66-77c6-45a0-9adf-7941e57f220d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:19.277556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:19.278033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:19.278459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.302916 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] Creating event network-changed:14001b66-77c6-45a0-9adf-7941e57f220d for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:19.316781 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-081dc49c-8663-4ba8-a944-5f5c1f7b6935 req-1701e492-0092-4d68-b36b-9010e6935e15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080876 Aug 21 01:14:19.320407 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 999/1810] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:19.330550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:19.332936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:19.351937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:19.352422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:19.352882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.353598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:19.354045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:19.354460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.438231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f1cac94-4b72-45d5-8cbf-a3c25b70f72d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116328 Aug 21 01:14:19.441423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1000/1811] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:14:19 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:14:19.455652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:19.456513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:19.466962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:19.472923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:19.473861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.476486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:19.477149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:19.479688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:19.835788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:19.850229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9198374-694d-41f1-92cf-0eece8a7fc26 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.401088 Aug 21 01:14:19.850898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1001/1812] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:19 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:20.141797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1136716761", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "25a2e2f5-db1d-4f1b-b401-385b2fd6fde5"}, {"uuid": "edbf7695-e39a-4e82-9de6-158540e80d26"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:20.225185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] validate_networks() for [('25a2e2f5-db1d-4f1b-b401-385b2fd6fde5', None, None, None, None, None), ('edbf7695-e39a-4e82-9de6-158540e80d26', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:14:20.895556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:20.927838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:20.929394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:20.938403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8d9af933-6bfd-43fb-b320-5ebd80c0f191 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1866 microversion: 2.32 time: 2.742551 Aug 21 01:14:20.960935 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 812/1813] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:18 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1866 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:20.992274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:21.003403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:21.059795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:21.060561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:21.061188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:21.072525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:21.073090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:21.073514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:21.728303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:21.745286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:21.746793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:21.753773 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7631a04d-7aef-44da-b440-dfe2a5d25de5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 0.776483 Aug 21 01:14:21.756413 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 813/1814] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:20 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:21.778197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:21.784123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:21.804363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:21.805248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:21.809431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:21.811670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:21.815051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:21.815994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:22.886393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:22.912674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a42ff63-ba56-4287-85a8-f6bd091c979c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 1.146813 Aug 21 01:14:22.914667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 814/1815] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:21 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:22.929599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:22.933390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:22.949170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:22.949924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:22.950468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:22.952006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:22.957448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:22.958230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:23.516760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:14:23.517343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:14:23.517955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:14:23.518671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:14:23.519336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:14:23.553877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:23.556793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:23.557376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:23.558176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:23.565374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:23.565853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:23.652738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Getting quotas for project 26ee54d7a3e84461b4e5aff422e87f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:14:23.684410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Getting quotas for user 83fa03ac4589405e911fda3211620529 and project 26ee54d7a3e84461b4e5aff422e87f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:14:23.748946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:14:23.756031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:14:23.766137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:23.785119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:23.800108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:23.801038 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec76583b-516c-42e0-abe9-1142308b643c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1887 microversion: 2.32 time: 0.884901 Aug 21 01:14:23.802419 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 815/1816] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:22 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1887 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:23.825912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:23.831120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:23.852254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:23.853359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:23.861494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:23.867548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:23.868052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:23.869562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:23.942923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4a60a64-9ec3-43d5-871a-bfcfae86476f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.804962 Aug 21 01:14:23.955363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1002/1817] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:14:23.967326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "af9fedc1-ee77-4233-9405-39aa90621b2a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:24.012427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:24.013362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:24.014248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:24.032449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] Creating event network-changed:af9fedc1-ee77-4233-9405-39aa90621b2a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:24.043763 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a6a88b1f-7d38-457f-8017-33b1705ce42e req-b73dcaa5-662b-4418-bf02-ab5e9f2f4490 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086751 Aug 21 01:14:24.045795 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1003/1818] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:24.059530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:24.067005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:24.093874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:24.094797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:24.095481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:24.096313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:24.096909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:24.097571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:24.938862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:24.951221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87c900b1-fac6-4159-94a9-300593f05c6c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.895890 Aug 21 01:14:24.956256 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1004/1819] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:24 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:24.974396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62980687-2d6f-403e-934d-4babc5caf0c5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:24.979066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62980687-2d6f-403e-934d-4babc5caf0c5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:25.076703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:25.095299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:25.102724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:25.115680 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2faba7a0-5d05-4398-85a8-fd3692ea6f1d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 1.305554 Aug 21 01:14:25.117952 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 816/1820] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:23 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:25.137944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:25.138743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:25.157171 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=82,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:25.168685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:25.169731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:25.176475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:25.177447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:25.178027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:25.178720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:25.223760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-62980687-2d6f-403e-934d-4babc5caf0c5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:25.238331 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62980687-2d6f-403e-934d-4babc5caf0c5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1213 microversion: 2.1 time: 0.280792 Aug 21 01:14:25.241702 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1005/1821] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:24 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1213 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:25.602491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab51f922-b064-4405-aa06-a4dc9b115412", "name": "network-vif-plugged", "status": "completed", "tag": "99bcb505-6f74-41df-93c7-c5323751ecfc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:25.632576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:25.633089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:25.633509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:25.669750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] Creating event network-vif-plugged:99bcb505-6f74-41df-93c7-c5323751ecfc for instance ab51f922-b064-4405-aa06-a4dc9b115412 on n-h2-master-1 Aug 21 01:14:25.678120 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ce6f4061-9daf-4369-9e6c-9b4b1a801b7f req-f129155f-f0bd-4fbe-830c-f504d9ceb907 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078137 Aug 21 01:14:25.679652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1006/1822] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:25.989726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:25.993512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:26.029662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:26.033266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:26.036097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:26.039101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:26.040916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:26.043420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:26.632132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:26.644075 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43a51959-56a9-4c5f-b879-bac9b3fb91f8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.671734 Aug 21 01:14:26.644994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1007/1823] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:25 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:26.660488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:26.666625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:26.684055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:26.686926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:26.687816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:26.690247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:26.690836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:26.692623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:27.709133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:27.726614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:27.735982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:27.737410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd3e21a4-f5d9-4c6c-9f51-e442959f529f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1887 microversion: 2.32 time: 2.617374 Aug 21 01:14:27.753283 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 817/1824] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:25 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1887 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:27.775797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:27.776343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:27.791448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:27.791448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:27.791664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:27.792231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:27.797003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:27.797693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:28.196523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:28.206921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb38f97b-07fc-4f73-bfbf-a55f19c433ba tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1271 microversion: 2.1 time: 0.461401 Aug 21 01:14:28.212863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 818/1825] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:27 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1271 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:28.243464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:28.244076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:28.263878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:28.265490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:28.269629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:28.271268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:28.274518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:28.275197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:28.287861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:28.306647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:28.317310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:28.318713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edbd853c-189b-499b-a4ad-4ac9628e526c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1280 microversion: 2.25 time: 1.672548 Aug 21 01:14:28.321087 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1008/1826] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:26 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1280 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:28.761471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:28.762736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:28.770280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:28.771443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:28.772066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:28.773141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:28.774745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:28.775719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.071883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:29.080683 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81572db9-c1a2-403d-94cb-61d0358626e7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.853384 Aug 21 01:14:29.081310 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 819/1827] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:28 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:29.107547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "67a9430a-b35b-4d92-91c6-42f46492d842"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:29.143817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:29.144312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:29.144743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.194053 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] Creating event network-changed:67a9430a-b35b-4d92-91c6-42f46492d842 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:29.208260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-661166c5-c270-4fae-8865-e3141fe8a354 req-3a2803aa-e503-4ee7-a5c3-5895133e13b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105380 Aug 21 01:14:29.210180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 820/1828] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:29.240396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:29.241398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:29.273564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:29.274050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:29.274485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.283277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:29.283775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:29.284214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.478506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:29.513338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:29.515391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:29.518502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08f6ca53-e4d2-4ada-80f7-78fa6f77147f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1887 microversion: 2.32 time: 0.761188 Aug 21 01:14:29.519713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1009/1829] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:28 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1887 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:29.539445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:29.540160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:29.557546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:29.558714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:29.560809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.564999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:29.567350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:29.571757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:29.578365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:29.590947 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09c28b49-a68f-4a8f-a34a-add4ce6032b4 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1271 microversion: 2.1 time: 0.358463 Aug 21 01:14:29.592654 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 821/1830] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:29 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:30.102682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:30.113166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:30.122084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:30.123971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:30.125588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:30.128955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:30.130491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:30.131150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:30.168324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:30.188537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:30.204816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:30.206114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b765403b-5f25-4c9d-9bf5-d65b10dd70e1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1477 microversion: 2.25 time: 0.679564 Aug 21 01:14:30.213185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1010/1831] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:29 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1477 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:30.735917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:30.736699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:30.741322 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:30.752234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:30.753434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:30.754375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:30.755352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:30.756052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:30.757436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:30.998748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:31.003033 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:31.034080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-89cc8414-eb94-40f3-b325-163f196f43aa tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.935720 Aug 21 01:14:31.034689 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 822/1832] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:30 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:14:31.172493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid ab51f922-b064-4405-aa06-a4dc9b115412 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:14:31.194746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1340013445", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "391fa7c1-09e8-4581-8a97-ce32dc76b623"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:31.239036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-039d5958-f107-491f-b37c-a43c146b204e tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1969 microversion: 2.25 time: 1.005477 Aug 21 01:14:31.264400 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1011/1833] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:30 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1969 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:14:31.264400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:31.268362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:31.285803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:31.286416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:31.288408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:31.289546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:31.292605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:31.293304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:31.328692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] validate_networks() for [('391fa7c1-09e8-4581-8a97-ce32dc76b623', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:14:31.351353 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:31.839185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:31.860611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:31.862132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:31.871116 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2070f1c0-dd09-44e3-9a3f-fc88d1a0f572 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.619227 Aug 21 01:14:31.876522 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1012/1834] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:31 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:31.888457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:31.889452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:31.907193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:31.907689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:31.909131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:31.910321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:31.912420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:31.915706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:32.599485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:32.619346 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71195bea-3c8a-4109-a5e0-045a3c35895c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1313 microversion: 2.1 time: 0.735703 Aug 21 01:14:32.622676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1013/1835] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:31 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:32.644932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:32.649129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:32.685358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:32.686261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:32.687910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:32.690191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:32.693261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:32.693995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.132210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid ab51f922-b064-4405-aa06-a4dc9b115412 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:14:33.170033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc2351f2-8620-4244-b3fa-9e69b8227969 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1969 microversion: 2.25 time: 0.545887 Aug 21 01:14:33.171233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1014/1836] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:32 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1969 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:33.177388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:33.178473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:33.188094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:33.189667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:33.191320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.193148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:33.194906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:33.195782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.600905 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:33.828572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:14:33.829125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:14:33.829477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:14:33.829888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:14:33.830295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:14:33.882649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:33.884480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:33.885855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.888194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:33.889994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:33.892519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.928199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:33.947357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Getting quotas for project 30b2a95273e6417babc48661728340bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:14:33.959532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8cae0ce2-b5b3-4554-ba44-381c13c0f1f7 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.784024 Aug 21 01:14:33.961547 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1015/1837] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:33 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:33.962148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Getting quotas for user b3d2e0ca31ba428d9391b4fa5c91bf4e and project 30b2a95273e6417babc48661728340bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:14:33.974358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:33.975322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:33.985903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:33.988055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:33.989170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:33.995680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:14:34.002739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:14:34.011905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.020442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.024654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.117065 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29923ac2-94a6-41a4-886f-2307107e4509 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.081137 Aug 21 01:14:34.121069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 823/1838] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:14:34.128524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:34.131980 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:14:34.131980 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:14:34.135839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.136929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.137568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.138696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.139373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.140335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.233836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4650ddcb-d6a3-45fc-96c7-38d0c16cf8ff tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.110950 Aug 21 01:14:34.235124 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 824/1839] 10.222.0.46 () {60 vars in 1217 bytes} [Sun Aug 21 01:14:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:14:34.244217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "09ee1a66-22fc-4784-bfd8-33aa4d4f401b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:34.255404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.256196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.257122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.273411 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] Creating event network-changed:09ee1a66-22fc-4784-bfd8-33aa4d4f401b for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:34.288575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-19402e9d-c04b-413f-b6f5-5c02d3fc648b req-8bbb14f6-1e6b-4a1e-99d7-1f69f5748433 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050931 Aug 21 01:14:34.289506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 825/1840] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:34.308154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:34.311042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:34.341109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.342630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.343781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.346758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:34.347261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:34.347646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:34.726745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:34.745322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:34.757959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:34.761916 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98769ad0-6535-4c0f-ae58-436e6d46ef3a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.797399 Aug 21 01:14:34.763361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1016/1841] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:33 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:34.787533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bee26273-6aa1-41d9-928e-a151801da893 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:34.789915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bee26273-6aa1-41d9-928e-a151801da893 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:34.952847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bee26273-6aa1-41d9-928e-a151801da893 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:34.969701 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bee26273-6aa1-41d9-928e-a151801da893 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1224 microversion: 2.1 time: 0.201960 Aug 21 01:14:34.973280 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1017/1842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:34 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1224 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:34.994451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:35.000690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:35.016115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:35.016797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:35.018932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:35.021937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:35.022836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:35.023453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:35.069327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'flavor' on Instance uuid ab51f922-b064-4405-aa06-a4dc9b115412 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:14:35.125265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Going to try to live migrate instance to n-h1-master-1 {{(pid=122482) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:14:36.042688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:36.057410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b93ce1b3-63dc-43c9-bbc7-4296895f6325 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1313 microversion: 2.1 time: 1.765812 Aug 21 01:14:36.059102 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 826/1843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:34 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1313 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:36.383237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-909421967", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "9748ae6e-2d4e-41d2-be21-e0943739bcf2"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:36.507818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] validate_networks() for [('9748ae6e-2d4e-41d2-be21-e0943739bcf2', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:14:37.609442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1e1545b-b0c5-4f57-aded-6e31c98932a6 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412/action" status: 202 len: 0 microversion: 2.25 time: 2.632866 Aug 21 01:14:37.610430 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1018/1844] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:14:34 2022] POST /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412/action => generated 0 bytes in 2636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:14:37.625238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:37.627070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:37.652973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:37.655667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:37.657248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:37.660879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:37.661781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:37.663095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:38.281332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:38.295503 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3a74458-1a82-4d87-a076-f2a30addfe12 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.683537 Aug 21 01:14:38.297587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1019/1845] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:37 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:38.304207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:38.304850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:38.319867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:38.321392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:38.325125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:38.326212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:38.329259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:38.332331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.179957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:39.192540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:39.194207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:39.195473 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76d4f432-3409-4de9-9d8d-5c7c2da781d9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.896929 Aug 21 01:14:39.210134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1020/1846] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:38 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:39.221588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:39.222653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:39.232317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.233010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.233512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.234333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.234855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.235961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.432479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:39.446071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-855cd4a6-488a-4be9-96ce-dcfc3f9340ea tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1282 microversion: 2.1 time: 0.234504 Aug 21 01:14:39.447003 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1021/1847] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:39 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:39.465739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:39.467457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:39.476662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.477621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.478232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.479312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.479947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.480857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.490297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:14:39.490879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:14:39.491544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:14:39.492117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:14:39.492660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:14:39.536160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.537006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.537680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.538749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.539374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.540066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.579449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Getting quotas for project e6740efa787346ddaa3b0f22d2c3ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:14:39.585627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Getting quotas for user 6d1bf9f58c8b4cd285bd369a6689c4e8 and project e6740efa787346ddaa3b0f22d2c3ffa0. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:14:39.608589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:14:39.613853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:14:39.726738 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-699ed199-1d67-47b1-b077-750867592ce6 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.666242 Aug 21 01:14:39.729049 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 827/1848] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:14:39.747257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:39.750542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:39.768246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.771141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.771802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.772720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.774420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.775700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.835613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:39.852209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-001afb42-6f28-4933-9e0e-b5bdf350090a tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.402977 Aug 21 01:14:39.854413 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1022/1849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:39 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:39.885398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "2b34f8d9-a956-4cd7-88dc-cd02dd48506a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:39.907916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.908856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.909495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.929672 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] Creating event network-changed:2b34f8d9-a956-4cd7-88dc-cd02dd48506a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:39.941316 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-60a0f79a-6516-4f5a-968f-288a28273d1e req-c9230c68-fefa-4333-bc03-a05d92c53c31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060694 Aug 21 01:14:39.943367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1023/1850] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:39.951957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:39.953018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:39.961889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.962479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.963414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:39.964393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:39.967161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:39.968179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:40.291048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:40.302243 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dee88f68-4ac1-45ae-9738-e8cf1741493f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1497 microversion: 2.1 time: 0.357167 Aug 21 01:14:40.320248 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1024/1851] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:39 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:40.320248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a4c7c4d-a47c-4c1e-8ec1-f757ff990119 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:40.320248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a4c7c4d-a47c-4c1e-8ec1-f757ff990119 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:40.435082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:40.457009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:40.463606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:40.465543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6e33f70e-e441-4498-ba18-404e13a43f71 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.734264 Aug 21 01:14:40.469457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 828/1852] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:39 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:40.486142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7a4c7c4d-a47c-4c1e-8ec1-f757ff990119 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:40.487203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:40.488369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:40.503419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:40.504361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:40.504960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:40.505888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:40.506632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:40.507162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:40.511229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a4c7c4d-a47c-4c1e-8ec1-f757ff990119 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1224 microversion: 2.1 time: 0.202422 Aug 21 01:14:40.512034 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1025/1853] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:40 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:40.536034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:40.537740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:40.561310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:40.563636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:40.564988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:40.565738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:40.568593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:40.569721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:41.195377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:41.217851 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b346d346-9a16-47d2-850b-31e50aebbf7b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.699157 Aug 21 01:14:41.218863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1026/1854] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:40 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:41.239558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:41.240914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:41.254000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:41.258065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:41.258822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:41.261488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:41.263223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:41.264404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:41.694400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:41.715240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-445bcf09-876b-4133-8abb-318132db9aa1 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.491660 Aug 21 01:14:41.717442 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1027/1855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:41 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:41.753645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:41.754784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:41.768312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:41.775023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:41.775903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:41.788839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:41.789968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:41.790661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.563186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:42.575332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:42.584099 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7e832fa-6fbe-46cb-8dc9-218c8808ebb1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 200 len: 1474 microversion: 2.1 time: 0.863129 Aug 21 01:14:42.585553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:42.587269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:42.588134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1028/1856] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:41 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 1474 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:42.595348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae7e9d0a-fe72-4279-ba15-463ce54c16a4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 2.117641 Aug 21 01:14:42.598502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 829/1857] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:40 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:42.604549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:42.605476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:42.612413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:42.613064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:42.614943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.616203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.625541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.630489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.630986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.631955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.641214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.641884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.642329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.646951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.647434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.650705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.679457 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:42.818609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:42.831152 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8b0ca32-849b-4215-a5e9-c71d6bc45a12 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1282 microversion: 2.1 time: 0.231131 Aug 21 01:14:42.832112 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 830/1858] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:42 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:42.838642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:42.839760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:42.854837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.860282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.862388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:42.863946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:42.868878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:42.869498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:43.139249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:43.157660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:43.159422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:43.163858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4e5e9a65-95a1-4a51-bdf1-e68336d6ab1c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.567170 Aug 21 01:14:43.187834 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1029/1859] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:42 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:43.193477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1505226341"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:43.205579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:43.238652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:43.245508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:43.247509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:43.252658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:43.253292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:43.257415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:43.773916 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-122b30be-52e9-4a15-a717-ed45b15ffcf8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.572603 Aug 21 01:14:43.776105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1030/1860] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:14:43 2022] POST /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:14:43.792806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:43.793979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:43.803050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:43.804902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:43.806676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:43.808208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:43.808952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:43.809962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.294520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:44.304997 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-484a9b85-a4cb-412a-875c-15fa8da09087 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.526510 Aug 21 01:14:44.305600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1031/1861] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:43 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:44.314025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:44.316662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:44.336747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.337262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.342363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.342754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.346421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.347145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.685565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:44.701954 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-887f2845-fb4b-47c2-8588-dbd8a2181c37 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 1.863457 Aug 21 01:14:44.712804 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 831/1862] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:42 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:44.712804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce7f57e2-863b-4161-93ba-ed78d76eecae tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fe371670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:44.779789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce7f57e2-863b-4161-93ba-ed78d76eecae tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.075472 Aug 21 01:14:44.780733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 832/1863] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:44 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:44.800214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:44.800887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:44.816658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.817236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.817758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.819961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.820556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.821013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.862312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:44.878521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:44.879947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:44.887311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2935f819-ac65-497a-89b4-626b7bd35e16 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.579392 Aug 21 01:14:44.887925 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1032/1864] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:44 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:44.903699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:44.906662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:44.937668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.938416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.939062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:44.939979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:44.940614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:44.941363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:45.201795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:45.219746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97512bde-95b4-41e1-a4df-7c73d582840a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1282 microversion: 2.1 time: 0.433735 Aug 21 01:14:45.234824 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 833/1865] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:44 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1282 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:45.234824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "tag": "56c4b3b3-b468-476d-8e36-22167cb76389"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:45.243540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:45.244392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:45.246346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:45.263796 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] Creating event network-changed:56c4b3b3-b468-476d-8e36-22167cb76389 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:14:45.271627 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-26ddc585-4fb3-4196-aa63-eb376d620d66 req-9ee74141-ad73-4640-9c6d-e021168c3cda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046855 Aug 21 01:14:45.274560 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 834/1866] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:45.301133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:45.323765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:45.325487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:45.326725 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7cf1adb-828f-46c9-b7bb-82c7888ccd14 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.426888 Aug 21 01:14:45.330696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:45.331834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:45.340528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1033/1867] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:44 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:45.346388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:45.348286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:45.350119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:45.352650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:45.355360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:45.357696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:45.726451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:45.727077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:45.741427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:45.741938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:45.744564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:45.746007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:45.746659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:45.749287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:46.086027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:46.102134 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28190fa0-8606-4637-8745-d7f207c659be tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.376815 Aug 21 01:14:46.103122 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1034/1868] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:45 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:14:46.116561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f2d750b-3917-4d43-956c-bb4f503d19c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9550040>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:46.211078 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f2d750b-3917-4d43-956c-bb4f503d19c3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.106446 Aug 21 01:14:46.212138 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1035/1869] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:46 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:46.220428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:46.222616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:46.253429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:46.255025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:46.260865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:46.262127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:46.262887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:46.263714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:46.679755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:46.709064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:46.712804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:46.723833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c97be0bc-37fb-45a4-92a1-454877d55b87 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.509813 Aug 21 01:14:46.739529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1036/1870] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:46 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:46.744547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:46.755787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:46.772094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:46.773162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:46.774847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:46.777181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:46.779272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:46.779991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.017666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:47.034047 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb2617d8-9b73-40f2-9708-0baabfaec848 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1282 microversion: 2.1 time: 0.291768 Aug 21 01:14:47.050990 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1037/1871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:46 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:47.051137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:47.061421 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c4d0350-55a2-43fa-ab64-0202b80e6570 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 1.737530 Aug 21 01:14:47.062455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 835/1872] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:45 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:47.072095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:47.074947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:47.105776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:47.106380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:47.108908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.112456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:47.113182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:47.113898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.124576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:47.152312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:47.187712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:47.190069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:47.191993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.196200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:47.196726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:47.204202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.481833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:47.496751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:47.498890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:47.501682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da45aca1-c5af-4c4c-8dd6-df6af008fff9 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.445478 Aug 21 01:14:47.508858 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1038/1873] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:47 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:47.533705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8da5ed95-476d-44f3-9ac0-dfa83c031d5d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031770d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:47.636252 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8da5ed95-476d-44f3-9ac0-dfa83c031d5d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.119859 Aug 21 01:14:47.647981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1039/1874] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:47 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:47.664317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "ed52380b-6a18-402a-9e3c-afd08577e340"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:47.697048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:47.699972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:47.700476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:47.732807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] Creating event network-changed:ed52380b-6a18-402a-9e3c-afd08577e340 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:14:47.740406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-605726a5-8850-4a12-995b-025f927da654 req-f7ffb0d9-cc0f-4bc2-b475-3ce3f538ee5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089750 Aug 21 01:14:47.741973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1040/1875] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:47.927788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2099208250", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "e85ca8e5-8d15-4aa8-98b0-ccaef53cf7a9"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:48.073261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] validate_networks() for [('e85ca8e5-8d15-4aa8-98b0-ccaef53cf7a9', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:14:49.081607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:49.103748 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cfd7cad1-0d3c-405b-b58f-df4ab1b87700 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 1.984215 Aug 21 01:14:49.104744 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 836/1876] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:47 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:49.115797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:49.122196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:49.139014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.140171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.141160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.142200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.143867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.144642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.549648 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:49.601963 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:49.793463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:49.813764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:49.815323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:49.816568 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2aeb2486-17a7-4427-bb05-1d91b6b53e1c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.708459 Aug 21 01:14:49.830144 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 837/1877] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:49 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:49.841638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:49.842850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:49.859414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.860360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.861758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.865822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.866818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.867561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.869878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:14:49.870427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:14:49.870862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:14:49.871430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:14:49.871948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:14:49.894703 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=13 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:49.906572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.907533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.909123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.910379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:49.912344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:49.914270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:49.979013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Getting quotas for project c1471f0184d741a0a97be9a7ff45fb65. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:14:49.988030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Getting quotas for user 263bda79fe484f1698ed7994566c5116 and project c1471f0184d741a0a97be9a7ff45fb65. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:14:50.010970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:14:50.014336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:14:50.106039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-026a8593-97fb-4e29-8e7e-6adc754b20db tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.361706 Aug 21 01:14:50.118222 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1041/1878] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:14:50.126311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:50.127472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:50.141691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:50.143009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:50.144233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:50.145233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:50.145884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:50.146482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:50.582428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:50.603394 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a4fca18-1fc4-4baa-8f7f-22f82b4bfe25 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.478271 Aug 21 01:14:50.604307 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1042/1879] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:50 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:50.646066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:50.646812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:50.668668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:50.673024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:50.673492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:50.679093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:50.679755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:50.682902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:51.084298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:51.103803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:51.114945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:51.119111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40d7c9a5-86dd-4d35-b119-fb52b7f89b54 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.498270 Aug 21 01:14:51.120703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1043/1880] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:50 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:51.136675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d8bb1a4-1fd6-463b-9796-00b1d26a5603 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc403195820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:51.255684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d8bb1a4-1fd6-463b-9796-00b1d26a5603 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.130861 Aug 21 01:14:51.257299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1044/1881] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:51 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:51.272882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dce49cab-3d3e-4771-b20f-1482bc60b3ff tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:51.273527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dce49cab-3d3e-4771-b20f-1482bc60b3ff tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:51.348842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dce49cab-3d3e-4771-b20f-1482bc60b3ff tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:51.358578 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dce49cab-3d3e-4771-b20f-1482bc60b3ff tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1225 microversion: 2.1 time: 0.099326 Aug 21 01:14:51.360014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1045/1882] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:51 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:51.377425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:51.378030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:51.388523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:51.389614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:51.390266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:51.391153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:51.391761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:51.392439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:51.691475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:51.713402 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e626692c-e241-4d71-a827-78e27318cf1a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.351901 Aug 21 01:14:51.729143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1046/1883] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:51 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:51.732130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c1e5ba-78de-4638-b4a6-4a73f0b85fd4", "name": "network-vif-plugged", "status": "completed", "tag": "bed23fe5-5be4-494f-b81e-fbd127d722e7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:51.791197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:51.794298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:51.795430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:51.874476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] Creating event network-vif-plugged:bed23fe5-5be4-494f-b81e-fbd127d722e7 for instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 on n-h1-master-1 Aug 21 01:14:51.921067 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ef58b0d9-6782-494c-b6d4-f84b01e12277 req-f20c73c5-9d18-441d-a608-cd1fd9523988 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190612 Aug 21 01:14:51.926482 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1047/1884] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:51.952057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:51.988395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:51.989231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:51.989703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:52.017840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] Creating event network-changed:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:14:52.052475 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9ed47744-8524-4d58-8ecf-5a8ed6fd4ceb req-bebdb7b8-25d0-4e8b-aeb3-37619931f882 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120537 Aug 21 01:14:52.059497 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1048/1885] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:52.097217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:52.100714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:52.125943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:52.126914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:52.129521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:52.131259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:52.133331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:52.135284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:52.713238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:52.722828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6610e9b-932c-4427-9be8-fe367593fa9a tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 2.890934 Aug 21 01:14:52.727203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 838/1886] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:49 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 2896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:52.740039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:52.741067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:52.757778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:52.758828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:52.759703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:52.764154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:52.765001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:52.765694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:53.114504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.140701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.145406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.151130 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e32c31d5-45ba-48c1-b429-58687f13240d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.080274 Aug 21 01:14:53.153438 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1049/1887] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:52 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:53.180478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:53.181124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:53.203728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:53.204288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:53.206891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:53.208412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:53.211076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:53.211542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:53.568082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.589811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.593533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.596442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c53e693d-cc5a-4d7b-9027-1b6a6463eee8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.427317 Aug 21 01:14:53.599974 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1050/1888] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:53 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:53.615498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-546689e7-87c2-4de4-9849-5afa848293a8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a1ca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:53.788031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-546689e7-87c2-4de4-9849-5afa848293a8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.186766 Aug 21 01:14:53.788624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1051/1889] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:53 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:53.810646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:53.811480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:53.830969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:53.831416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:53.832507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:53.833415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:53.833993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:53.834515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:53.881426 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:53.981714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:53.996345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f30a1ad1-876c-4c1b-9cbe-e0fe2a68f78f tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1283 microversion: 2.1 time: 0.196413 Aug 21 01:14:54.023496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1052/1890] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:53 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1283 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:54.034087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:54.034566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:54.053373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.054641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.055035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.055882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.056547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.057022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.276550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:54.286573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f20f7527-9e73-4bdd-a060-8cfffff38a02 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.261416 Aug 21 01:14:54.301861 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1053/1891] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:54 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:54.313803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:54.314437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:54.323730 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:54.330471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.330966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.331399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.332118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.332564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.333021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.479682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:54.496440 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a546a5f8-931a-4c81-97f9-b6884ae74aa5 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 1.767771 Aug 21 01:14:54.523051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 839/1892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:52 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:54.532727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:54.533845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:54.553186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.554941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.566026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.567257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.567979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.568661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.596498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:54.615526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be61e7ab-562a-42bd-8238-d5272cfaf40c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.312428 Aug 21 01:14:54.616365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1054/1893] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:54 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:54.626607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "tag": "d2b21e3b-cad1-4ee9-a2af-d659d647f6c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:54.657003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.657484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.657912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.695644 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] Creating event network-changed:d2b21e3b-cad1-4ee9-a2af-d659d647f6c6 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:14:54.707957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-688bf5c3-a214-4773-b6f4-5bbf73430274 req-73e4fded-dc50-45be-b883-754328442f2e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090262 Aug 21 01:14:54.708536 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1055/1894] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:54.725356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:54.726061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:54.739964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.740233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.740549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:54.741436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:54.741896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:54.742319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:55.117960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.138123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.141542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.144169 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-82144eb2-062b-4790-a0c1-da90efe48417 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.434283 Aug 21 01:14:55.160622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1056/1895] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:54 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:55.174173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb6d8c19-5d95-4dde-b9e6-5d2805c785c1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a10d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:55.269659 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb6d8c19-5d95-4dde-b9e6-5d2805c785c1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.100521 Aug 21 01:14:55.282117 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1057/1896] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:55 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:55.298577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-851732883", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "89ad451d-4568-43da-b498-e71b39d2698e"}], "block_device_mapping_v2": [{"uuid": "6490560d-fe31-4a30-afc8-4bc51972e42d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:55.331419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.369769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.377545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.385030 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5802c8d-fd9b-4f9d-af7a-6d2ccfeeae27 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.858238 Aug 21 01:14:55.414375 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 840/1897] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:54 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:55.459807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:55.467904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:55.479593 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:55.502814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:55.504794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:55.506303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:55.511215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:55.518048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:55.518547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:55.606099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] validate_networks() for [('89ad451d-4568-43da-b498-e71b39d2698e', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:14:55.959990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:55.968623 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c34451ef-6f71-4e37-b873-3021d64cd8f7 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1283 microversion: 2.1 time: 0.551183 Aug 21 01:14:55.971149 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 841/1898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:55 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1283 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:55.981676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:55.984120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:55.996139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.001219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.001892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.002820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.003440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.005767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.231868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:14:56.232628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:14:56.233402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:14:56.234946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:14:56.235433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:14:56.253719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.254215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.254653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.256061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.256530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.257016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.292475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:14:56.309182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Getting quotas for user b0bd3eeeb578465a8f5e5eaa3b3fdc85 and project 6073ae2e8036492faa2a4f7a26489134. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:14:56.440978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:14:56.443481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6490560d-fe31-4a30-afc8-4bc51972e42d',volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:14:56.668858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0be85ff-de62-46b9-8764-3934598d2bff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384601 Aug 21 01:14:56.680958 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1058/1899] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:14:56.680958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:56.687464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:56.697213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.698493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.698493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.706271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.706924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.707891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.744283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:56.763561 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f9b90bd-afbc-488e-bb85-9034b5daf92e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.785494 Aug 21 01:14:56.776792 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 842/1900] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:55 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:56.794042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:56.794691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:56.805212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.805987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.806119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.806806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.807248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.807657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.925355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:56.939632 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-109331f9-b2dc-4112-a22c-0d2026e0f869 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.260147 Aug 21 01:14:56.942850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1059/1901] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:56 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:56.970785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:56.973582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:56.983640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.984054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.984489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:56.985296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:56.985818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:56.986406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.206296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.216577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.218796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.220007 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bf3bee8-109b-400e-a324-c765a86bcbcc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.259547 Aug 21 01:14:57.221173 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1060/1902] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:56 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:57.226518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3e2a558-c2ef-46b0-ac9a-d140a2a03713 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a1af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:57.285640 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3e2a558-c2ef-46b0-ac9a-d140a2a03713 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.063248 Aug 21 01:14:57.287234 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1061/1903] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:57 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:57.292855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:57.294238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:57.303135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.303629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.304062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.305005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.305456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.306046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.485064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.488549 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:14:57.501877 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8785ce4-02c1-4664-9a3f-0b78360ce100 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.717159 Aug 21 01:14:57.502600 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 843/1904] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:56 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:57.512676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e984e1f8-11c7-428e-98ed-ed49c8d2fc23 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:57.513384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e984e1f8-11c7-428e-98ed-ed49c8d2fc23 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:57.688528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.707179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.709364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.711941 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80ae4450-6ae7-4d8d-a819-c591a25d91e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.422353 Aug 21 01:14:57.713195 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1062/1905] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:57 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:57.718986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92753fe-d3cb-44da-a832-c747be857329", "tag": "d4c5b3e3-42b5-416a-8a26-f10a956b0618"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:14:57.729470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.730212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.730904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.744441 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] Creating event network-changed:d4c5b3e3-42b5-416a-8a26-f10a956b0618 for instance e92753fe-d3cb-44da-a832-c747be857329 on n-h2-master-1 Aug 21 01:14:57.750479 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-cebad230-397e-40d8-9f1e-e135465d9c3b req-ba050992-54a9-4eb5-a9ce-68d5f63b0020 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035766 Aug 21 01:14:57.754068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1063/1906] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:14:57.766486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:57.767129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:57.774979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.776164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.776607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.777381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.777843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.779196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.888730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:57.902425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95fb884b-fbe7-4289-a732-162e20e10ba5 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1283 microversion: 2.1 time: 0.144754 Aug 21 01:14:57.903299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1064/1907] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:57 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:57.938047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:57.939000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:57.948127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.948814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.949331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:57.950230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:57.950964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:57.951394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.194921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:58.196782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e984e1f8-11c7-428e-98ed-ed49c8d2fc23 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:58.207752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7779635-9da5-416d-9174-922804ef8f6b tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.279556 Aug 21 01:14:58.210392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e984e1f8-11c7-428e-98ed-ed49c8d2fc23 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1052 microversion: 2.1 time: 0.704894 Aug 21 01:14:58.211228 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1065/1908] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:57 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:58.212221 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 844/1909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:57 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1052 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:58.234446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:58.238169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:58.253109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:58.254205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:58.255602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.256103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.256539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.257344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.257732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.258154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.267355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.268464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.269471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.270494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.272528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.273957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.611421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:58.626712 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3211645-a8a8-4112-9402-dba405bb6f4c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.414274 Aug 21 01:14:58.641967 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1066/1910] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:58 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:58.652215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4fb90f2-d04a-444f-af52-4f9ad103360f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a1f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:58.742792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4fb90f2-d04a-444f-af52-4f9ad103360f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.099317 Aug 21 01:14:58.744603 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1067/1911] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:14:58 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:58.752498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:58.753740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:58.763541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.764643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.765526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:58.766491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:58.767570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:58.768525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.036248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.038742 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b03f948-fdd4-448d-8b42-6337f5adc8bc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.292159 Aug 21 01:14:59.039811 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1068/1912] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:58 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:59.045821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:59.046760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:59.054596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.055253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.056136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.057112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.057828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.058452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.249512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.259567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.261099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.262284 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81cdc746-5b81-41ec-8e88-e991b04e420f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 1.018791 Aug 21 01:14:59.262852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 845/1913] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:58 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:14:59.282114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:59.282740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:59.318673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.319261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.319709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.320475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.320943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.321591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.548251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.572056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.580438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.584143 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d195388-3fe5-40a2-9b0e-17e18eda0e3f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.542801 Aug 21 01:14:59.585060 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1069/1914] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:14:59 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:14:59.590409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:59.591389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:59.598990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.599760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.600379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.601603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.602253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.602853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.948646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:14:59.964578 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d723803e-1adc-411f-be54-ce4b8b434f92 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.378222 Aug 21 01:14:59.978157 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1070/1915] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:59 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:14:59.978157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:14:59.978157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:14:59.978157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.978677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.978954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.979623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:14:59.981613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:14:59.981613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:14:59.995952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:00.013585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3b8a22f-869e-478d-9452-4bf51a56746a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.749555 Aug 21 01:15:00.015150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 846/1916] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:59 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:00.019939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:00.020521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:00.034293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.034909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.035341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.036246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.036697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.037147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.080924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:00.094715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbf6d537-b9e4-4a25-b01d-f318bbdd9fcf tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1168 microversion: 2.1 time: 0.128355 Aug 21 01:15:00.104858 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1071/1917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:14:59 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1168 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:00.104858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14cd6331-28ca-4075-9561-9570c74d0280 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a13a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:00.187505 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14cd6331-28ca-4075-9561-9570c74d0280 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.089926 Aug 21 01:15:00.197370 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1072/1918] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:00 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:00.205728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:00.209458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:00.231560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.234252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.234834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.235649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.236180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.236786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.658625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:00.674172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebae366e-a0ff-4412-bf96-1d1ce4160360 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.474637 Aug 21 01:15:00.677750 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1073/1919] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:00 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:00.696172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:00.698902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:00.714957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.716118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.718130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.719357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.720220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.720990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.907104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:00.917757 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09d5bfec-9322-46a4-a5fc-845b8391dc50 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.901237 Aug 21 01:15:00.918364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 847/1920] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:00 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:00.925971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:00.933849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:00.957636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.959544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.965430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:00.966511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:00.967135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:00.967828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.040322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:01.055704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:01.062872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:01.064844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f17b6395-e402-4af0-8bcb-092e4bf1bbbe tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.385679 Aug 21 01:15:01.096345 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1074/1921] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:00 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:01.106195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "name": "network-vif-plugged", "status": "completed", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:01.127408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.128388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.130374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.155777 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:01.160251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] Creating event network-vif-plugged:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:15:01.168352 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-eae0fbdd-efe8-4b99-98c9-b6cf6fe60f87 req-5ecacbfb-8b35-4795-bc97-2a3deaba30c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068286 Aug 21 01:15:01.170668 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1075/1922] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:01.184506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:01.189590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:01.209738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.210669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.211447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.213123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.221625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.224167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.495799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:01.516082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-381b4410-6f74-4f73-8390-58e95ae39a84 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 0.340381 Aug 21 01:15:01.519308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1076/1923] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:01 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:01.547804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:01.551052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:01.588849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.589628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.593021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.594579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.598741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.601421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.934307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:01.949136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa8737c7-c5a7-4692-8fac-c902e30c7709 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.426799 Aug 21 01:15:01.950562 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1077/1924] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:01 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:01.957795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:01.959063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:01.966975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.968275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.969362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:01.970327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:01.971000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:01.971673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.094090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:02.110798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-930a7717-ee33-4191-92fe-f549a30b303e tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1168 microversion: 2.1 time: 0.154351 Aug 21 01:15:02.127879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1078/1925] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:01 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1168 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:02.137256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f24bc804-3d48-4b99-9b62-f55ebf5e9a2c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f94c7670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:02.212619 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f24bc804-3d48-4b99-9b62-f55ebf5e9a2c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.082058 Aug 21 01:15:02.214389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1079/1926] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:02 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:02.222379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:02.223494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:02.233319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.234258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.235660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.237262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.240415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.241998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.500878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:02.513788 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43071f01-3c2d-42a1-b931-38d98ec80705 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.293354 Aug 21 01:15:02.517417 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1080/1927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:02 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:02.526937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:02.527558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:02.544136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.544711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.545320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.546044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.546492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.547125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.920632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:02.930227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f641f72b-42c6-409a-ba27-6cf535a32d2c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.411698 Aug 21 01:15:02.944642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1081/1928] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:02 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:02.948631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:02.949287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:02.970419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.971363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.972099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.973120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:02.974015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:02.974691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:02.988620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.010951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.012624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.014334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e224ecef-16c2-4e7c-a26d-b407a545e3d0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 2.092239 Aug 21 01:15:03.015899 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 848/1929] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:00 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:03.028002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:03.028616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:03.053448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:03.054267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:03.054973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:03.055930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:03.056617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:03.057300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:03.651355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.680531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.682514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:03.684173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26170a6c-5ffc-4d9b-b2f9-010e10266c2a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.746895 Aug 21 01:15:03.701890 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1082/1930] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:02 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:03.708411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:03.709557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:03.729389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:03.733327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:03.735214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:03.736318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:03.739807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:03.746466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:03.990870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:04.002609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ca17714-b123-417b-b6fc-4e4e0f54d15e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.299092 Aug 21 01:15:04.003930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1083/1931] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:03 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:04.009484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:04.010216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:04.021396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.021885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.022307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.023020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.023461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.023874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.185537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:04.200696 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7192dad0-0305-4a9b-bfd7-5112a69faa20 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1324 microversion: 2.1 time: 1.180057 Aug 21 01:15:04.202666 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 849/1932] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:03 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1324 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:04.222455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4cb79d22-774c-4b7e-ab3d-85d749b92702 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fda4e430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:04.300654 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4cb79d22-774c-4b7e-ab3d-85d749b92702 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.095465 Aug 21 01:15:04.302316 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 850/1933] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:04 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:04.308180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:04.309942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:04.317141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:04.320815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.321738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.322401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.323440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.324063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.324793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.327874 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83b93b27-0734-4445-9289-4d7bcc9dcc73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1210 microversion: 2.1 time: 0.322020 Aug 21 01:15:04.330776 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1084/1934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:04 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1210 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:04.357747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:04.358442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:04.391132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.393404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.393848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.394575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.395025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.396191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.619167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:04.629038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1fb752d4-7c4c-4629-b82b-de6b93fb0ad6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.293447 Aug 21 01:15:04.641526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1085/1935] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:04 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:04.641526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:04.641526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:04.658724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.659796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.659796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:04.660537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:04.661472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:04.662100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.021985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.050526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.053908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.057111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b1fc53b-28fe-4440-934f-72a760c52129 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.426496 Aug 21 01:15:05.058641 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1086/1936] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:04 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:05.068190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:05.073712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:05.094035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.095217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.096230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.097307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.099527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.100314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.427975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.444585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.449945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.452347 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95bc21c0-4684-4b26-b00d-825dab5f9410 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.391746 Aug 21 01:15:05.466330 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1087/1937] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:05 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:05.486294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:05.489922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:05.500569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.501452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.502219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.503241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.504123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.504967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.719108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:05.730973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b415e5a-38f3-4444-8751-933e34d0c8ee tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.255820 Aug 21 01:15:05.731825 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1088/1938] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:05 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:05.736985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:05.737896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:05.745252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.746139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.746753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.747659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:05.748367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:05.749238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:05.989101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:06.008506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25883723-1804-47b3-94f0-edc228382eef tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1519 microversion: 2.1 time: 0.275114 Aug 21 01:15:06.009995 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1089/1939] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:05 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:06.015472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1846ca93-8c0a-49ef-ae3a-525df33e69ec tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc403240af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:06.016363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:06.074372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e34df823-a716-4aab-960b-a42ed24de280 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 1.770449 Aug 21 01:15:06.074976 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 851/1940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:04 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:06.090274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:06.091144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:06.121091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:06.121575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:06.122064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:06.122766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:06.123215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:06.123776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:06.131129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1846ca93-8c0a-49ef-ae3a-525df33e69ec tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.115168 Aug 21 01:15:06.137649 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1090/1941] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:06 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:06.156483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:06.157373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:06.187763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:06.188875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:06.189266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:06.193304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:06.196153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:06.196646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:06.275682 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:06.323752 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=13 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:06.487080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:06.514125 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6d71519-ef75-4acc-9727-5602d107587f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.373460 Aug 21 01:15:06.531880 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1091/1942] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:06 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:06.538218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d5d1333-4b3c-496b-a8da-6ae914a6d757 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'create', calling method: .version_select at 0x7fc3f95e4b80>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:07.774968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:07.798876 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1fc865f-5332-4c42-9e73-8abac2484c74 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1210 microversion: 2.1 time: 1.721241 Aug 21 01:15:07.803559 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 852/1943] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:06 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1210 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:07.814122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27812ad0-e7cf-4e98-95b8-a26baefe8609", "tag": "420d84b3-eb41-4dd7-bff2-18ef5a8e927c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:07.859370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:07.860704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:07.870306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:07.900670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] Creating event network-changed:420d84b3-eb41-4dd7-bff2-18ef5a8e927c for instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 on n-h1-master-1 Aug 21 01:15:07.911621 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a664c226-6f6e-4a88-9352-b0c6510cf04a req-76056892-fb81-4c2d-8a5e-43ba638d0a49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106525 Aug 21 01:15:07.913722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 853/1944] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:07.924432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:07.925844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:07.944495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:07.945572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:07.946248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:07.947168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:07.947829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:07.949297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:08.204063 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:08.496318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d5d1333-4b3c-496b-a8da-6ae914a6d757 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.963039 Aug 21 01:15:08.510931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1092/1945] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:15:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:08.519114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:08.523104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:08.532797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:08.533309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:08.533739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:08.534438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:08.534881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:08.535298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:08.726534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.737354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.739200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.740633 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7ed241b-6607-4ef1-8b2c-86eacf020540 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.227665 Aug 21 01:15:08.741749 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1093/1946] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:08 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:08.747068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:08.747985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:08.761481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:08.762335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:08.762959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:08.763908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:08.764524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:08.765378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:08.923298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.939424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.941948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:08.944301 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d5f52b4b-014f-4307-be61-e9d8e0fea05d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.027764 Aug 21 01:15:08.971001 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 854/1947] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:07 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:08.996316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:08.999202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:09.010015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.010841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.011544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.012498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.013176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.018984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.029684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:09.040720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa875804-8a6d-4726-a038-f7b9c794104a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.297519 Aug 21 01:15:09.041813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1094/1948] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:08 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:09.048217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e7ab0dd-a1b9-4081-aabc-90b932921f1d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc40311f3a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:09.106689 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e7ab0dd-a1b9-4081-aabc-90b932921f1d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.063791 Aug 21 01:15:09.108044 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1095/1949] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:09 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:09.114834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:09.115455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:09.122899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.123391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.123914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.124882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.125343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.125777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.154380 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:09.252911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:09.263723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae356e50-811b-4ea3-96ba-7b2e9f328810 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.290972 Aug 21 01:15:09.265317 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 855/1950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:08 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:09.272826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92753fe-d3cb-44da-a832-c747be857329", "name": "network-vif-plugged", "status": "completed", "tag": "d4c5b3e3-42b5-416a-8a26-f10a956b0618"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:09.288002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.288984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.290503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.307702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] Creating event network-vif-plugged:d4c5b3e3-42b5-416a-8a26-f10a956b0618 for instance e92753fe-d3cb-44da-a832-c747be857329 on n-h2-master-1 Aug 21 01:15:09.314601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:09.323339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-938d2937-64e6-4ad9-be14-3e0b878853b9 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.213453 Aug 21 01:15:09.324089 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6829b479-5ff0-47c0-8b8c-a70fdca780ea req-5bbd8854-595f-4fef-bc44-13f4c047f0db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055452 Aug 21 01:15:09.325382 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 856/1951] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:09.333330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-155633718", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "391fa7c1-09e8-4581-8a97-ce32dc76b623"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:09.337650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1096/1952] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:09 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:09.346975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:09.347928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:09.354621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.355451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.356230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.357717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.359025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.359865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.412713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] validate_networks() for [('391fa7c1-09e8-4581-8a97-ce32dc76b623', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:15:09.592952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:09.604314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b838cdf-75ee-4bca-900b-45b9fb09e9db tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.265388 Aug 21 01:15:09.619756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1097/1953] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:09 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:09.766613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:09.767230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:09.786023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.786543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.787059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:09.796530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:09.796991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:09.797432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.060904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.079687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.082982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.082982 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8997e5b-43b2-4b69-a2da-68611488b6ea tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.321503 Aug 21 01:15:10.097514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1098/1954] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:09 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:10.108991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.109395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:10.118381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.118861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.119347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.120087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.120626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.121104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.209589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:15:10.210067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:15:10.210506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:15:10.210912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:15:10.211295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:15:10.226746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.227287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.227729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.229414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.229875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.230432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.253507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Getting quotas for project 30b2a95273e6417babc48661728340bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:15:10.262335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Getting quotas for user b3d2e0ca31ba428d9391b4fa5c91bf4e and project 30b2a95273e6417babc48661728340bf. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:15:10.277299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:15:10.293989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:15:10.359796 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b8c0aeb-c7e6-4e3c-a5b1-135dbb56dc29 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031748 Aug 21 01:15:10.360499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 857/1955] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:15:10.365510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.366495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:10.374593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.375374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.375809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.376706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.377184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.377786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.391008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.401609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.407013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.408543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b67d3bf5-d92c-49c7-a235-1d544583498a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.309755 Aug 21 01:15:10.418156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1099/1956] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:10.430848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9bdcbee-702d-4542-8acb-c6020a940570 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031e2160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.521715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9bdcbee-702d-4542-8acb-c6020a940570 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1412 microversion: 2.1 time: 0.100232 Aug 21 01:15:10.523931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1100/1957] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:10.534567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab51f922-b064-4405-aa06-a4dc9b115412", "name": "network-vif-unplugged", "status": "completed", "tag": "99bcb505-6f74-41df-93c7-c5323751ecfc"}, {"name": "network-changed", "server_uuid": "ab51f922-b064-4405-aa06-a4dc9b115412", "tag": "99bcb505-6f74-41df-93c7-c5323751ecfc"}, {"name": "network-changed", "server_uuid": "d64161bf-6b32-4616-b029-f7d2d76ad8a6", "tag": "dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:10.566414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.567263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.567915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.596027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Creating event network-vif-unplugged:99bcb505-6f74-41df-93c7-c5323751ecfc for instance ab51f922-b064-4405-aa06-a4dc9b115412 on n-h2-master-1 Aug 21 01:15:10.597172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Creating event network-changed:99bcb505-6f74-41df-93c7-c5323751ecfc for instance ab51f922-b064-4405-aa06-a4dc9b115412 on n-h2-master-1 Aug 21 01:15:10.597859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] Creating event network-changed:dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee for instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 on n-h2-master-1 Aug 21 01:15:10.605071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-93edd85d-0154-4543-b260-41a7eeb34623 req-d0b6c54b-ffd0-414a-85c9-c245b6e71947 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.079484 Aug 21 01:15:10.606404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1101/1958] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:10.614534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.615646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:10.628474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.629235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.629919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.630907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.631599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.632408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.687949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.700668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-624f4606-03cf-47f0-b8d1-de33f5eaecc4 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.338796 Aug 21 01:15:10.712942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 858/1959] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:10.731753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.738169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:10.753043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.753523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.753955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.754766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:10.755842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:10.756585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:10.879169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.898904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bbf6390-a83c-4edd-a220-28de655b31f9 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.290165 Aug 21 01:15:10.899382 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1102/1960] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:10.904247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17cba1a6-1ee9-48ed-a18f-d825af5b01b8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:10.905770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17cba1a6-1ee9-48ed-a18f-d825af5b01b8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:10.990332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17cba1a6-1ee9-48ed-a18f-d825af5b01b8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:10.998857 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17cba1a6-1ee9-48ed-a18f-d825af5b01b8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1223 microversion: 2.1 time: 0.097972 Aug 21 01:15:11.013192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1103/1961] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:11.019891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.020513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:11.034166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.034733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.035220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.035890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.036387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.036844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.264679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.274460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bc5fc03-aeee-45cd-9c09-d66397f1f4ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.259125 Aug 21 01:15:11.285870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1104/1962] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:11.285870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.285870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:11.287323 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:11.289586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.290440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.291106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.292010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.292641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.293284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.541314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.566160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.568658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.573252 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-856a3f19-4827-45e9-9cff-6968ca5a5639 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.294812 Aug 21 01:15:11.575464 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1105/1963] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:11.581464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "name": "network-vif-plugged", "status": "completed", "tag": "56c4b3b3-b468-476d-8e36-22167cb76389"}, {"server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "name": "network-vif-plugged", "status": "completed", "tag": "d2b21e3b-cad1-4ee9-a2af-d659d647f6c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:11.596287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.597834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.598954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.614101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Creating event network-vif-plugged:56c4b3b3-b468-476d-8e36-22167cb76389 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:15:11.615019 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] Creating event network-vif-plugged:d2b21e3b-cad1-4ee9-a2af-d659d647f6c6 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:15:11.620808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f2448693-440a-40be-8426-3f23604a5beb req-92b7380f-d8e5-4640-b368-4c451eef64e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043800 Aug 21 01:15:11.625229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1106/1964] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:11.631851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.633034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:11.640207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.641780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.642452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.643974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.644674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.645343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.672447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.686370 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0034d79a-eaab-4732-932c-ebac623c999f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.970355 Aug 21 01:15:11.700018 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 859/1965] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:10 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:11.706512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf120529-f536-4b73-b65c-c572c8659d80 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fe355af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.771227 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf120529-f536-4b73-b65c-c572c8659d80 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1421 microversion: 2.1 time: 0.069546 Aug 21 01:15:11.771819 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 860/1966] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1421 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:11.782988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.783916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:11.790426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.790939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.791373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.792074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.792535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.793004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.889440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.900032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.901655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.902862 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36d03343-0493-491a-a7aa-acdcff6e2615 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.276295 Aug 21 01:15:11.903402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1107/1967] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:11.908101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66ffebd0-75a6-4a27-be07-e8b316b68f2a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a1e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.956073 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66ffebd0-75a6-4a27-be07-e8b316b68f2a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 200 len: 1421 microversion: 2.1 time: 0.051386 Aug 21 01:15:11.956732 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1108/1968] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 1421 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:11.961357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:11.962027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:11.969901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.970385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.970811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.971502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:11.971945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:11.972378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:11.991096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:11.999781 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4efc14ba-a28d-4dac-a48d-589fd3475d8c tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.225376 Aug 21 01:15:12.000326 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 861/1969] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:12.004800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a8c96e3-57c0-44c9-a215-8fbf696ae637 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fea14040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.110343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.118220 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f61f23cd-2fe0-41a0-aaa2-e53bca3e5721 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.160424 Aug 21 01:15:12.118791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1109/1970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:11 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:12.123363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.124117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.137636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.138459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.139249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.140163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.141223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.141717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.233209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.243868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1aa35da5-85ab-4ce8-ba3e-3ab070fa3cc4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1275 microversion: 2.1 time: 0.123915 Aug 21 01:15:12.244665 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1110/1971] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:12 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:12.301663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.302532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.309497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.310324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.311442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.312202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.312997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.313424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.470121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.478363 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e17882af-ab30-4f19-a4d4-83dcb798dbfc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.184108 Aug 21 01:15:12.478943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1111/1972] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:12 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:12.506035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4a8c96e3-57c0-44c9-a215-8fbf696ae637 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 204 len: 0 microversion: 2.1 time: 0.504593 Aug 21 01:15:12.506611 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 862/1973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:12 2022] DELETE /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:15:12.514982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.515553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.521579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.522047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.522468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.523144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.523583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.523993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.552275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:12.601810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.602533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.610293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.610932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.611439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.612243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.612692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.613187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.630818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7ee655fa-3788-4c46-a46f-24dad94707bf tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 204 len: 0 microversion: 2.1 time: 0.119504 Aug 21 01:15:12.631470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1112/1974] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:12 2022] DELETE /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:15:12.707954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.708647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.714840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.715500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.716077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.716903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.717484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.718036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.765154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.773519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.774989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.776131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b13a1fce-7548-4840-a2fc-e1d3cff77384 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.178371 Aug 21 01:15:12.776666 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 863/1975] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:12 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:12.782112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1530539149", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:12.843004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] validate_networks() for [('70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:15:12.871751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:12.880482 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04601019-ec08-4124-ac87-ae4ac46710de tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.176627 Aug 21 01:15:12.894039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1113/1976] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:12 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:12.931757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:12.932375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:12.939811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.940294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.940729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:12.941459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:12.941907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:12.942358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.130259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.144378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.146130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.147337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2361b19-78a9-4b9a-ad47-5a8f26913da9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.219729 Aug 21 01:15:13.147903 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1114/1977] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:12 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:13.152911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.153776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.160567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.161096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.161531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.162232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.162840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.163257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.292345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:15:13.292759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:15:13.293238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:15:13.293638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:15:13.294039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:15:13.303657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.304122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.304753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.305673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.306633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.307213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.311131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.315134 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:13.321002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27547820-c0e7-483b-a3e4-577c3d9d0ed6 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.171876 Aug 21 01:15:13.332928 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1115/1978] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:13.333221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:15:13.333221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for user 2a2ecc1a81574d7aa2679307a7985908 and project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:15:13.337002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.337607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.346164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.346657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.347015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:15:13.347133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.347795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.348246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.348672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.349789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:15:13.402874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14367be1-0b4c-43c1-b31a-d03dbebb163e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624787 Aug 21 01:15:13.403615 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 864/1979] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:15:13.410005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.410627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.418006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.418486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.418920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.419737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.420195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.420860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.487861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.497252 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef85ed60-3e60-4765-bb09-5b3ce10e6b1c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1275 microversion: 2.1 time: 0.092235 Aug 21 01:15:13.498197 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 865/1980] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:13.502994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e5c5f4f-c789-4cae-a900-035eebecb5fe tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.503598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e5c5f4f-c789-4cae-a900-035eebecb5fe tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.518173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.529936 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69057e70-c923-466b-bf44-eac9e608d1cd tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1324 microversion: 2.1 time: 0.206529 Aug 21 01:15:13.531725 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1116/1981] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:13.539615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.541554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.549123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.549608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.550054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.550722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.551210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.551700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.583728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e5c5f4f-c789-4cae-a900-035eebecb5fe tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.592161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e5c5f4f-c789-4cae-a900-035eebecb5fe tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1208 microversion: 2.1 time: 0.092891 Aug 21 01:15:13.593337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 866/1982] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:13.701166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.709272 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77deca81-dea8-478e-9c9f-ad5c7746db19 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.176040 Aug 21 01:15:13.709903 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1117/1983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:13.799874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.800476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.807696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.808238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.808676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.809423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.809870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.810366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.900677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:13.901420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:13.907877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.908448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.908980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.909751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:13.910273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:13.910760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:13.958414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.967018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.968509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:13.969693 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3bb1f03-0a7f-4a23-99e0-bf8c3de93c4d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.173957 Aug 21 01:15:13.970283 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 867/1984] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:14.065234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.073728 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-203d7bfa-930d-4b07-b28a-bd69da19a961 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1334 microversion: 2.1 time: 0.177032 Aug 21 01:15:14.074274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1118/1985] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:13 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:14.171968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.172601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.179152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.179630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.180069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.180749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.181234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.181648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.185861 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:14.343203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.343871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.349938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.350604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.351041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.351730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.352311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.352959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.383362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.393444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.395171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.396929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97b973ec-bfc1-47c8-bd9c-15b23b9621c9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.229083 Aug 21 01:15:14.402264 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 868/1986] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:14.487544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.499628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1373380d-b33d-45fa-832e-af5af2fdd326 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.160840 Aug 21 01:15:14.500210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1119/1987] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:14.522558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.523547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.531779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.532187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.532608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.533325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.533763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.534175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.552164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.553149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.562753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.563439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.564760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.565645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.566704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.567443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.668985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.682196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da8b4707-a812-489c-8ff4-2f2026c065a8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1275 microversion: 2.1 time: 0.165286 Aug 21 01:15:14.682778 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 869/1988] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:14.688013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.688613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.694548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.695193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.695756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.696454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.696932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.697356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.770504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.782012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:14.784283 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e761c643-fa98-47d2-b615-b3256bb2b54e tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1520 microversion: 2.1 time: 0.236594 Aug 21 01:15:14.790286 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-620242c7-ca70-4c88-af87-d6abfdfa38ba tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1212 microversion: 2.1 time: 0.106316 Aug 21 01:15:14.790503 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1120/1989] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:14.791161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 870/1990] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1212 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:14.795496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.796141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.816464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.816982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.817412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.818440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.818546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.821410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.824722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.825277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.849078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.849574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.850012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.850727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.851171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.851590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.908790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] HTTP exception thrown: Instance is not a member of specified network Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Request method failure captured: Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329/ips/invalid HTTP/1.1 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYb67n1bhtK0l6L_SdzSmr6cXM6BW0419khUGrVP89sfu4AskGThgPUAHEJ3532Srr-fE1ug34ldYWGPm2TJHOsqctA-bsiXQtWn1aV2Iz3G7wOyMwzl_6WvqDZ-F3N-nXmuPGS47XzCWI33Fg0OiECkxs7PCxD9B5BbgwGLrsF5oDc Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e6740efa787346ddaa3b0f22d2c3ffa0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}] Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 6d1bf9f58c8b4cd285bd369a6689c4e8 Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: exception: Instance is not a member of specified network Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'e92753fe-d3cb-44da-a832-c747be857329', 'id': 'invalid'} Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 21 01:15:14.910437 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.913070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:14.919220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d84c1f18-6317-4256-a223-ffd7e204f7d8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.094419 Aug 21 01:15:14.925447 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 871/1991] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329/ips/invalid => generated 91 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:15:14.931739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.941502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Failed to fetch instance by id 999 {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:15:14.942207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] HTTP exception thrown: Instance 999 could not be found. Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Request method failure captured: Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYb67n1bhtK0l6L_SdzSmr6cXM6BW0419khUGrVP89sfu4AskGThgPUAHEJ3532Srr-fE1ug34ldYWGPm2TJHOsqctA-bsiXQtWn1aV2Iz3G7wOyMwzl_6WvqDZ-F3N-nXmuPGS47XzCWI33Fg0OiECkxs7PCxD9B5BbgwGLrsF5oDc Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e6740efa787346ddaa3b0f22d2c3ffa0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}] Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 6d1bf9f58c8b4cd285bd369a6689c4e8 Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 999 could not be found. Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '999'} Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 21 01:15:14.944170 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:14.950175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:14.957387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e76aa9f-a193-4a03-b9ce-69d6dc3388dc tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.029896 Aug 21 01:15:14.958208 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 872/1992] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:15:14.968516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:14.969095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:14.976084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.976668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.977358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:14.978064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:14.978518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:14.978937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.046884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:15.079615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.088932 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37774a64-7bbd-431c-969e-c2ef11d2d3aa tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.297216 Aug 21 01:15:15.112398 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1121/1993] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:14 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:15.118170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.125412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.138215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.138987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.139568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.140358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.140929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.141768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.206684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94111308-9da4-4a30-9dad-7ea51c0fb93c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 204 len: 0 microversion: 2.1 time: 0.242792 Aug 21 01:15:15.210174 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 873/1994] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:14 2022] DELETE /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:15:15.224310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.225041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.237894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.238759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.239518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.240680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.241167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.241593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.315729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.326753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.328508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.329924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3ee8952-d7bc-4d50-89cc-a0b150930145 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.216048 Aug 21 01:15:15.340789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1122/1995] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:15.340789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.340789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.351221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.351221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.351499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.352249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.352963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.353462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.615312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.634022 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3cb5535-57f4-4b35-8053-3a1878101207 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1526 microversion: 2.1 time: 0.302153 Aug 21 01:15:15.634611 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1123/1996] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:15.642042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27812ad0-e7cf-4e98-95b8-a26baefe8609", "name": "network-vif-plugged", "status": "completed", "tag": "420d84b3-eb41-4dd7-bff2-18ef5a8e927c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:15.661913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.662604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.663029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.676587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] Creating event network-vif-plugged:420d84b3-eb41-4dd7-bff2-18ef5a8e927c for instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 on n-h1-master-1 Aug 21 01:15:15.682583 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-286ac571-ff26-46ff-9384-56f2981c97b3 req-46e37ec2-8aa2-48eb-889d-2cfe7639892f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046620 Aug 21 01:15:15.684967 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1124/1997] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:15.693989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.695163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.714752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.715606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.716402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.717444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.718135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.718686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.791281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.806086 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-829e6373-c5c3-4a1a-92fc-33d54a555b2f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1669 microversion: 2.1 time: 0.597013 Aug 21 01:15:15.806938 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 874/1998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1669 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:15.817736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.818603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.833519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.834650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.835388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.836324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.836934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.837483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.953697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.964316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.965854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:15.967566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08a38c9e-cc84-473c-8977-3b6772fe67c4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.280209 Aug 21 01:15:15.968151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1125/1999] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:15.979352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:15.980402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:15.989052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.989632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.990127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:15.990932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:15.991466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:15.992498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.077678 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.086924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46d8fba5-3c2f-484c-b027-6b8b545adb15 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1283 microversion: 2.1 time: 0.112093 Aug 21 01:15:16.100178 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1126/2000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:16.100178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.100178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.100513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.101372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.101372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.101911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.102352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.102766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.186201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.196313 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a8a1343-addc-4153-9f54-c901938d1d1f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1266 microversion: 2.1 time: 0.106924 Aug 21 01:15:16.208576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1127/2001] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:16.208576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.208576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.211237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.211872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.215119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.215249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.215388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.215388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.216261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.226470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-471226a6-5be3-421c-b629-4f50d089ff3d tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.418280 Aug 21 01:15:16.227286 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 875/2002] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:15 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:16.231552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.232153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.240147 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:16.251736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.253529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c38a38f2-7b41-44a1-b110-85e6d17c7ace tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9/ips" status: 200 len: 179 microversion: 2.1 time: 0.054111 Aug 21 01:15:16.254141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.254976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.256508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.258129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.259361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.261107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1128/2003] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9/ips => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:16.266537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.267037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.275536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.276019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.276621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.277395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.277851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.278267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.309293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:16.405094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8e0cf5c-8d0a-4f38-a7ab-af3e6e8351ea tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 204 len: 0 microversion: 2.1 time: 0.141955 Aug 21 01:15:16.408862 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1129/2004] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:16 2022] DELETE /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:15:16.414393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.415090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.421573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.422191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.422622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.423321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.423760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.424171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.592906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.598228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.603235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.605792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.607847 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ff0e359-4279-49b2-8c12-8158a5e256fb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.197543 Aug 21 01:15:16.620815 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1130/2005] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:16.621003 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63bdbd92-b47c-45eb-b7c2-a145a2f16094 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.381126 Aug 21 01:15:16.621003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 876/2006] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:16.624980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.629057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.637398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c1e5ba-78de-4638-b4a6-4a73f0b85fd4", "name": "network-vif-deleted", "tag": "bed23fe5-5be4-494f-b81e-fbd127d722e7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:16.647331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.649312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.649933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.650496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.651383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.656364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.659456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.663031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.664201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.667868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] Creating event network-vif-deleted:bed23fe5-5be4-494f-b81e-fbd127d722e7 for instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 on n-h1-master-1 Aug 21 01:15:16.675481 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b21a0ccb-23d0-4651-85d6-f364254f2bcb req-736d7e01-54b2-4db6-acfb-4d1424f93e5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060392 Aug 21 01:15:16.676449 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 877/2007] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:16.681820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.684806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:16.701996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.702498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.702939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.703623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:16.706474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:16.706910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:16.858106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:16.862326 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:16.871836 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-838c116b-1ca4-49b2-afc5-66525d5b807d tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1675 microversion: 2.1 time: 0.260231 Aug 21 01:15:16.876368 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1131/2008] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:16.993239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:16.994650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.006491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.007021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.007462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.008199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.008658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.009115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.029064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.040277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23cff2f8-8184-441a-9dcc-2f66cb3a688c tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1526 microversion: 2.1 time: 0.361824 Aug 21 01:15:17.042016 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 878/2009] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1526 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:17.107862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.108333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.115606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.116415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.116859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.118760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.119382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.123254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.237827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.239946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.249210 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0ba590d-76af-4800-970a-c105523bb6a7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1293 microversion: 2.1 time: 0.145167 Aug 21 01:15:17.250061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 879/2010] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:17.254336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.254907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.255517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.255815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.257007 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98f49727-1abe-43cd-85e5-b2c4140d4449 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.267988 Aug 21 01:15:17.257706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1132/2011] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:16 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:17.267600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.268205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.277521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.277632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.278052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.278149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.278479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.278588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.279416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.279518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.279669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.279753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.280236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.280330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.501229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.509195 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe9c5ee7-c4f8-4ee0-95bd-fccd5bab59d3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.257922 Aug 21 01:15:17.509771 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 880/2012] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:17.531167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.539560 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4900bdd8-c1a4-45df-a678-4e70ca601b5b tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1325 microversion: 2.1 time: 0.275755 Aug 21 01:15:17.540140 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1133/2013] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:17.640118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.640969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.646593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.647380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.647874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.648305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.648404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.649051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.649507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.649997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.656043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.656732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.657381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.659148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.659846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.660568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.894725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.905400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.907969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:17.909626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a58bd98-07aa-4b07-86ec-2bea554a3dde tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.267913 Aug 21 01:15:17.910240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1134/2014] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:17.914897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c1e5ba-78de-4638-b4a6-4a73f0b85fd4", "name": "network-vif-unplugged", "status": "completed", "tag": "bed23fe5-5be4-494f-b81e-fbd127d722e7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:17.925109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.925870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.926394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.939901 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] Creating event network-vif-unplugged:bed23fe5-5be4-494f-b81e-fbd127d722e7 for instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 on n-h1-master-1 Aug 21 01:15:17.945207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f11515af-c00a-4e6d-8789-35a59d787093 req-e828eb66-5ebd-407b-81d3-9ee74a5e5a73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033618 Aug 21 01:15:17.946080 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1135/2015] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:17.951676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:17.952598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:17.959278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.960033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.960541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:17.961340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:17.961861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:17.962451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.406374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:18.417100 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3abfcf1a-a0cb-4383-871e-32c8f906f35c tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.781873 Aug 21 01:15:18.419510 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 881/2016] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:18.439527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:18.440683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:18.452942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.453667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.454252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.456603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.458451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.459099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.590834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:18.599094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6956cf5e-8546-479a-b359-d0320edabd57 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1675 microversion: 2.1 time: 0.651647 Aug 21 01:15:18.599927 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1136/2017] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:17 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1675 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:18.604662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:18.605502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:18.613378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.614102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.614682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.619099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.619581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.620061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.882800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:18.893192 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb3ce6c8-c086-4b12-b0c4-b55b4768f158 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.292003 Aug 21 01:15:18.894181 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1137/2018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:18 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:18.900598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:18.901695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:18.913530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.914493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.915134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:18.916070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:18.917008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:18.917801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.200487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.212438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.214910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.216487 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-384e08a8-4c25-43c2-be53-598fe35e9c6a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.320332 Aug 21 01:15:19.228789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1138/2019] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:18 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:19.228789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:19.228789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:19.237592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.238209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.238771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.239583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.240286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.241296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.309617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.341468 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8fd6075-0197-46f4-bae4-6274de264d90 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1526 microversion: 2.1 time: 0.908602 Aug 21 01:15:19.346408 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 882/2020] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:18 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1526 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:19.354533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:19.355585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:19.367450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.368147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.368621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.371865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.372343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.373043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.455398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.465336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a56ea99-4360-4f9a-a391-db9dab19ea15 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.246687 Aug 21 01:15:19.466615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1139/2021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:19 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:19.472331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:19.473591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:19.481007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.482051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.483587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.484761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.485383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.486170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.774987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.786603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.788977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.790444 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4eb10eb-4e05-401e-bee8-07d5eb76011a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.322710 Aug 21 01:15:19.791509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1140/2022] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:19 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:19.797059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:19.797955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:19.806561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.807250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.807818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.808673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.809288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.810177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.901109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:19.917487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a0cda83-eef9-4e5c-82a6-606497c76c61 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1521 microversion: 2.1 time: 0.569464 Aug 21 01:15:19.918838 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 883/2023] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:19 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:19.924021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:19.939294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.939690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.940110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.953802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] Creating event network-changed:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:15:19.960538 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5cc00c77-bda5-4b5b-91bb-2688764265ff req-98bf60ee-9275-4758-a016-f630790cc2fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039667 Aug 21 01:15:19.961778 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 884/2024] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:19.968678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:19.969699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:19.977572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.978303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.978887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.980711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:19.981303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:19.981734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:19.986036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.001431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0d93ae0-2b8a-42c4-8e0a-a5f39f7fc78f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.208299 Aug 21 01:15:20.003001 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1141/2025] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:19 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:20.029667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.031859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.058456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.059363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.060016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.061106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.062180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.063434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.216268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.226489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2951174-6666-46b0-a982-618eb1f2270d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.221983 Aug 21 01:15:20.227071 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1142/2026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:20.231676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.232210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.238445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.238845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.239272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.239970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.240415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.240861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.277784 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] HTTP exception thrown: Action 999 not found Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Request method failure captured: Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609/os-instance-actions/999 HTTP/1.1 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYcHDHnOhHQdHY28vzg64VrUmE38In1Z7VCfgX76AQCXuJsTYQ4kG3nJZREh_nfTVdOmjEH0JL_OBw8bEWXrf1b7p1wj5Qaf0yz3cCicBzUkcrQ2pddsWEZm8C-1jT8YEccgvkFGkst91G1s0R00AqsRQeaxFjbk6BBiu3CR-ino0Dg Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1471f0184d741a0a97be9a7ff45fb65", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}] Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 263bda79fe484f1698ed7994566c5116 Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: exception: Action 999 not found Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': '27812ad0-e7cf-4e98-95b8-a26baefe8609', 'id': '999'} Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 21 01:15:20.279590 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.282304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Returning 404 to user: Action 999 not found {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:20.282304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-611d512e-f041-4808-80ab-35ea3b95d8f2 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.052999 Aug 21 01:15:20.282304 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1143/2027] 10.222.0.46 () {58 vars in 1308 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609/os-instance-actions/999 => generated 66 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:15:20.287889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92753fe-d3cb-44da-a832-c747be857329", "name": "network-vif-deleted", "tag": "d4c5b3e3-42b5-416a-8a26-f10a956b0618"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:20.298874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.299355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.299782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.314325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] Creating event network-vif-deleted:d4c5b3e3-42b5-416a-8a26-f10a956b0618 for instance e92753fe-d3cb-44da-a832-c747be857329 on n-h2-master-1 Aug 21 01:15:20.323769 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-50ca1add-798b-40c4-8c7c-4e96fcb70f37 req-f8b4c7b4-c7be-476f-b1fc-37b71ed5917a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036713 Aug 21 01:15:20.324447 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1144/2028] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:20.329885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.330589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.337180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.337674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.338111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.338845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.339269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.339646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.405722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.410886 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.418287 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb2b5f13-edcc-4b51-bc94-4081ef176457 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1675 microversion: 2.1 time: 0.455142 Aug 21 01:15:20.419494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 885/2029] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:19 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1675 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:20.433275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '.version_select at 0x7fc3fd9870d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.434154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.441222 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] HTTP exception thrown: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Request method failure captured: Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/6cc47baa-a9b3-44a3-8b8e-d14ac978eddf/os-instance-actions HTTP/1.1 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYcHDHnOhHQdHY28vzg64VrUmE38In1Z7VCfgX76AQCXuJsTYQ4kG3nJZREh_nfTVdOmjEH0JL_OBw8bEWXrf1b7p1wj5Qaf0yz3cCicBzUkcrQ2pddsWEZm8C-1jT8YEccgvkFGkst91G1s0R00AqsRQeaxFjbk6BBiu3CR-ino0Dg Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1471f0184d741a0a97be9a7ff45fb65", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}] Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 263bda79fe484f1698ed7994566c5116 Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '6cc47baa-a9b3-44a3-8b8e-d14ac978eddf'} Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:20.443661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. Aug 21 01:15:20.446583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:20.449508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Returning 404 to user: Instance 6cc47baa-a9b3-44a3-8b8e-d14ac978eddf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:20.450663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0038703b-77c8-4359-91b2-7c40eec6fd73 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/6cc47baa-a9b3-44a3-8b8e-d14ac978eddf/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029873 Aug 21 01:15:20.456499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 886/2030] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/6cc47baa-a9b3-44a3-8b8e-d14ac978eddf/os-instance-actions => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:20.463227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.464681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.472963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.473686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.474318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.475373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.476049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.476659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.566154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.576116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.577767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.578948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5325c343-39c2-4752-bcf9-254e55a252ba tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.253329 Aug 21 01:15:20.579415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d1bf9f58c8b4cd285bd369a6689c4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6740efa787346ddaa3b0f22d2c3ffa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.585440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1145/2031] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:20.590431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.590872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.595953 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72814505-982b-4817-beb7-fec391d808c8 tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 200 len: 1484 microversion: 2.1 time: 0.138066 Aug 21 01:15:20.596495 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 887/2032] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 1484 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:20.601337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.601798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.601928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.602562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.603176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.603974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.604815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.605516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.608914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.609715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.610332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.612099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.612099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.612099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.637293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:20.723134 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-691c7529-b04e-47c4-b9fe-fbbba180f282 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 204 len: 0 microversion: 2.1 time: 0.136045 Aug 21 01:15:20.723847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1146/2033] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:20 2022] DELETE /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:15:20.734050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.734739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.737998 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.742811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.743293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.743785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.744400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.744880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.745298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.907612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.916300 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-663efe7f-b30e-44e0-899f-f0880392f3e3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.318630 Aug 21 01:15:20.917667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 888/2034] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:20.923334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:20.925011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:20.932441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.933016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.934199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.935233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:20.936176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:20.936690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:20.949559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:20.959973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d5d080b-9b03-4dd3-b89c-be46acbcbf17 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1527 microversion: 2.1 time: 0.230299 Aug 21 01:15:20.961896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1147/2035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:21.024082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.024892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.027356 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:21.034332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.034332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.034902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.035815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.036459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.037104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.041996 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:21.196022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.204893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50fd80bd-0042-4e1e-847a-fc46589267b7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.184697 Aug 21 01:15:21.205809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1148/2036] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:21.206049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.215068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.216677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.217906 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8359c20c-fd87-41e9-8865-8269dd8240ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.298993 Aug 21 01:15:21.218464 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 889/2037] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:20 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:21.247499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.248614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.256183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.256758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.257257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.257986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.258498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.259284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.440199 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.441176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.446637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.448508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.449067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.449502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.450202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.450709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.451210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.456864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72e3c41b-8740-46a3-b93d-ab3edad1ae4c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.213150 Aug 21 01:15:21.457636 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1149/2038] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:21.520209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fa03ac4589405e911fda3211620529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ee54d7a3e84461b4e5aff422e87f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.538793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9dd04ea-d09f-491e-9205-3c3b1e95065f tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 200 len: 1612 microversion: 2.1 time: 0.102505 Aug 21 01:15:21.540120 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 890/2039] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 1612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:21.603962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.604578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.611373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.611888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.612347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.613251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.613709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.614136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.616390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.617040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] [instance: e92753fe-d3cb-44da-a832-c747be857329] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.624292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.624754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.625253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.625957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.626409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.626829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.643948 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] HTTP exception thrown: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Request method failure captured: Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 HTTP/1.1 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYb67n1bhtK0l6L_SdzSmr6cXM6BW0419khUGrVP89sfu4AskGThgPUAHEJ3532Srr-fE1ug34ldYWGPm2TJHOsqctA-bsiXQtWn1aV2Iz3G7wOyMwzl_6WvqDZ-F3N-nXmuPGS47XzCWI33Fg0OiECkxs7PCxD9B5BbgwGLrsF5oDc Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e6740efa787346ddaa3b0f22d2c3ffa0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e6740efa787346ddaa3b0f22d2c3ffa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e6740efa787346ddaa3b0f22d2c3ffa0"}]}] Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: e6740efa787346ddaa3b0f22d2c3ffa0 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1318891714 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 6d1bf9f58c8b4cd285bd369a6689c4e8 Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1318891714-project Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e92753fe-d3cb-44da-a832-c747be857329'} Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:21.645497 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] Returning 404 to user: Instance e92753fe-d3cb-44da-a832-c747be857329 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e018d3b-e617-45cb-939d-24414d01512d tempest-ServerAddressesNegativeTestJSON-1318891714 tempest-ServerAddressesNegativeTestJSON-1318891714-project] 10.222.0.46 "GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329" status: 404 len: 111 microversion: 2.1 time: 0.034367 Aug 21 01:15:21.648926 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 891/2040] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/e92753fe-d3cb-44da-a832-c747be857329 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:21.808732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.824095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.825772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:21.827690 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50cda75f-09cf-4128-bf12-e80e92ae11d7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.228274 Aug 21 01:15:21.828337 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1150/2041] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:21.939939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.940646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.947826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.948303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.948734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.949460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.949934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.950349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.984347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:21.985262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:21.992424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.993229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.993670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:21.994395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:21.995003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:21.995436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.171221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.181173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-667ba151-f667-4e96-9ca6-4c21926be63e tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1527 microversion: 2.1 time: 0.201557 Aug 21 01:15:22.185338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1151/2042] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1527 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:22.228820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:22.229447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:22.237836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.238047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.238406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.239449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.239623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.240013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.407158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.415813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54bf539b-188c-4820-8928-1697005dac78 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.191108 Aug 21 01:15:22.416656 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1152/2043] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:22 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:22.421383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:22.422214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:22.428132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.428615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.429079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.429767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.430210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.431619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.586486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.597076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.598646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.599904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1cf33d36-67d3-4ab8-95e6-8b25a6325287 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.182489 Aug 21 01:15:22.600570 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1153/2044] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:22 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:22.605479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "name": "network-vif-deleted", "tag": "56c4b3b3-b468-476d-8e36-22167cb76389"}, {"name": "network-changed", "server_uuid": "91d93aaa-bbc5-4845-b568-c783ac5d7db8", "tag": "ca3e1fd8-049f-4314-b371-5b74979def42"}, {"server_uuid": "f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9", "name": "network-vif-deleted", "tag": "d2b21e3b-cad1-4ee9-a2af-d659d647f6c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:22.616956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.617361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.617819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.626897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:22.631782 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Creating event network-vif-deleted:56c4b3b3-b468-476d-8e36-22167cb76389 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:15:22.632295 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Creating event network-changed:ca3e1fd8-049f-4314-b371-5b74979def42 for instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 on n-h1-master-1 Aug 21 01:15:22.632963 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] Creating event network-vif-deleted:d2b21e3b-cad1-4ee9-a2af-d659d647f6c6 for instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 on n-h1-master-1 Aug 21 01:15:22.635322 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f207e34d-a271-4c43-ac52-191a2fc83426 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.699768 Aug 21 01:15:22.635864 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 892/2045] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:21 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:22.640982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:22.642264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:22.647268 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f77087a8-18aa-413d-a182-e9e7dc7a0575 req-74379cd7-5472-4839-a541-315aca3ca0ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.044440 Aug 21 01:15:22.648229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1154/2046] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:22.651578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.654606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.655346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.656014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:22.656495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.656734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:22.657680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.658326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.663245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.664103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.664526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.665646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.666104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.666527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.683266 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 HTTP/1.1 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9'} Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:22.685133 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5375a51e-7849-4eb2-bbf7-11402a87a73c tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 404 len: 111 microversion: 2.1 time: 0.037924 Aug 21 01:15:22.688748 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1155/2047] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:22 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:22.851165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:22.851826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:22.861132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.861624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.862051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:22.862752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:22.863204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:22.863625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.147428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.182880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.186383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.188529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c373cb55-470d-4dc8-b64d-34a6d3d8c11b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.341561 Aug 21 01:15:23.197213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.200615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1156/2048] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:22 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:23.203813 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b862fdf-3de0-414e-90e8-a476a18b70c2 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.566550 Aug 21 01:15:23.204412 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 893/2049] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:22 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:23.212519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:23.215794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:23.225040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.225789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.227858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.228745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.229542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.230216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.433588 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:23.439422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:23.440245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:23.447580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.448405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.449065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.449990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.450656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.451318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.479283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.490139 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49b83b16-2620-46aa-9017-595bfd6eab6a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1527 microversion: 2.1 time: 0.287339 Aug 21 01:15:23.496305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1157/2050] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:23 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1527 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:23.588678 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=14 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:23.625482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:23.628091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:23.637469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.638893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.639433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.640156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.640721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.641580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.893461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.905635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.907310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.909168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ea51159-c9da-43e9-9c36-9bbf53a926fc tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.288446 Aug 21 01:15:23.910639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1158/2051] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:23 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:23.917459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:23.918228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:23.925621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.926096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.926524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.927213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:23.927804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:23.928355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:23.972635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:23.983412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04d3972c-8d86-4c53-89f6-fb6bc2a79f57 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.550137 Aug 21 01:15:23.992870 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 894/2052] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:23 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:24.145413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:24.156284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63fd2c9b-7499-43fb-8eed-a0ebdfa69500 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.244382 Aug 21 01:15:24.157561 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1159/2053] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:23 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:24.215385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:24.215996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:24.222774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.223591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.224223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.225212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.225616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:24.226125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.226230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:24.226839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.236631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.237292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.239096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.239363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.239823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.240322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.408490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:24.421376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4309d356-1afa-42f7-83ec-499f3e52637a tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.201234 Aug 21 01:15:24.422835 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1160/2054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:24 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:24.438398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64161bf-6b32-4616-b029-f7d2d76ad8a6", "name": "network-vif-plugged", "status": "completed", "tag": "dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:24.449352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.449808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.450242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.465845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] Creating event network-vif-plugged:dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee for instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 on n-h2-master-1 Aug 21 01:15:24.470749 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9207de78-4b9c-4df3-b25f-334750320046 req-cdbe3891-2092-4f24-820a-b5873165183d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Aug 21 01:15:24.471388 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1161/2055] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:24.517562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:24.518724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:24.525411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.525894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.526317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.527083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.527521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.527938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.598670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '263bda79fe484f1698ed7994566c5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1471f0184d741a0a97be9a7ff45fb65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:24.607495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-897ad985-ed99-467b-be60-d19c3629cf51 tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 200 len: 1485 microversion: 2.1 time: 0.095050 Aug 21 01:15:24.608054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1162/2056] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:24 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 1485 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:15:24.686694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27812ad0-e7cf-4e98-95b8-a26baefe8609", "name": "network-vif-deleted", "tag": "420d84b3-eb41-4dd7-bff2-18ef5a8e927c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:24.696733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.697302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.697681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.709546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] Creating event network-vif-deleted:420d84b3-eb41-4dd7-bff2-18ef5a8e927c for instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 on n-h1-master-1 Aug 21 01:15:24.714733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f69cb77a-5fa2-4eb8-bbcd-12b577da3894 req-c42864ca-c153-466e-a5aa-5121c94b30ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Aug 21 01:15:24.715684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1163/2057] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:24.932943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:24.933828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:24.941881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.942373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.942811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:24.943518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:24.943972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:24.944395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.030280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.045109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.047517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.049871 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad2e5d23-6879-44b8-ae7c-7b3438b4bb66 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.837994 Aug 21 01:15:25.052226 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 895/2058] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:24 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:25.058334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:25.059229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:25.067583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.068327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.068750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.069915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.075313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.076003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.131723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.148868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.151373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.153040 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff1b96ae-9aff-4567-adc2-3ca85ab25cb8 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1487 microversion: 2.25 time: 0.225225 Aug 21 01:15:25.157852 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1164/2059] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:24 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1487 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:25.180002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:25.180534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:25.189960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.192383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.192885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.193840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.194280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.201319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.410624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.422297 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b00f5cd-1a9f-46c4-89df-b413bb004615 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.246756 Aug 21 01:15:25.423004 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1165/2060] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:25 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:25.439591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.446317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:25.450510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:25.460218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97754956-a73c-4922-9d40-202217ad7b79 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.406617 Aug 21 01:15:25.461346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 896/2061] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:25 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:25.470982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.471856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.472854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.474709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.475437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.477669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.631613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:25.637662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] [instance: 27812ad0-e7cf-4e98-95b8-a26baefe8609] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:25.647763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.649579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.650528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.651662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:25.652700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:25.653343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:25.674213 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] HTTP exception thrown: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Request method failure captured: Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 HTTP/1.1 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYcHDHnOhHQdHY28vzg64VrUmE38In1Z7VCfgX76AQCXuJsTYQ4kG3nJZREh_nfTVdOmjEH0JL_OBw8bEWXrf1b7p1wj5Qaf0yz3cCicBzUkcrQ2pddsWEZm8C-1jT8YEccgvkFGkst91G1s0R00AqsRQeaxFjbk6BBiu3CR-ino0Dg Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1471f0184d741a0a97be9a7ff45fb65", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1471f0184d741a0a97be9a7ff45fb65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1471f0184d741a0a97be9a7ff45fb65"}]}] Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c1471f0184d741a0a97be9a7ff45fb65 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-879963333 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 263bda79fe484f1698ed7994566c5116 Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-879963333-project Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '27812ad0-e7cf-4e98-95b8-a26baefe8609'} Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:25.676456 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. Aug 21 01:15:25.679636 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:25.682485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] Returning 404 to user: Instance 27812ad0-e7cf-4e98-95b8-a26baefe8609 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:25.683612 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1bf53a8-b5e3-451c-ac73-9c0e4c4f232a tempest-InstanceActionsNegativeTestJSON-879963333 tempest-InstanceActionsNegativeTestJSON-879963333-project] 10.222.0.46 "GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609" status: 404 len: 111 microversion: 2.1 time: 0.058791 Aug 21 01:15:25.684938 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 897/2062] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:25 2022] GET /compute/v2.1/servers/27812ad0-e7cf-4e98-95b8-a26baefe8609 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:15:25.691742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:25.702931 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72b1088f-bf29-40e7-85dd-15b3b674165e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.260363 Aug 21 01:15:25.706390 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1166/2063] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:25 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:26.076190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:26.077208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:26.084628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.085452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.085885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.086700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.087128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.087694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.177588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:26.178940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:26.204467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.205467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.212661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.214038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.214824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.215476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.247717 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:26.602589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.613176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.614833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.616026 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83ddbbf5-9b31-4129-bbf0-dc6a9fd51f61 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1477 microversion: 2.25 time: 0.442518 Aug 21 01:15:26.616593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1167/2064] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:26 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1477 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:26.621599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:26.622212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:26.629199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.629685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.630323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.631232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.631849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.632461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.866262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.898426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.902587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.904373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:26.905868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-96155df0-ad8a-412e-b75c-0e4829a5cbde tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.834790 Aug 21 01:15:26.908030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 898/2065] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:26 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:26.915911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "name": "network-vif-plugged", "status": "completed", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:26.929772 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-784123ec-b2a4-41b3-a2d6-8cf9bd7e3277 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.311672 Aug 21 01:15:26.930666 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1168/2066] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:26 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:26.935776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:26.936336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:26.942824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.943438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.943604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.943917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.944246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.944351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.945050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.945494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.945908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.961165 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] Creating event network-vif-plugged:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:15:26.967791 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f523f5c7-c17f-4699-8623-d38426592c88 req-03d20a81-10e3-43ea-9892-04334e53d59f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054312 Aug 21 01:15:26.968721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 899/2067] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:26.977327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81dd6b65-bd73-4c6f-a62b-b89697a366be tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '.version_select at 0x7fc3fd987dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:26.981090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81dd6b65-bd73-4c6f-a62b-b89697a366be tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:26.981572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81dd6b65-bd73-4c6f-a62b-b89697a366be tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:26.982145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81dd6b65-bd73-4c6f-a62b-b89697a366be tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:26.998674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81dd6b65-bd73-4c6f-a62b-b89697a366be tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.028198 Aug 21 01:15:27.000034 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 900/2068] 10.222.0.46 () {60 vars in 1184 bytes} [Sun Aug 21 01:15:26 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:27.016216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.017735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.024977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.025600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.026019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.026952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.027615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.028232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.251617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:27.261190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8723bcef-3eff-4cce-a8b6-df95e45674da tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1198 microversion: 2.1 time: 0.329262 Aug 21 01:15:27.262426 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1169/2069] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:26 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1198 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:27.268641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.269773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.278116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.279033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.279774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.280718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.281409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.282028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.562003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] Lazy-loading 'services' on Instance uuid ab51f922-b064-4405-aa06-a4dc9b115412 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:15:27.583541 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6eec8dc-97b2-4472-af80-5127f922e662 tempest-LiveAutoBlockMigrationV225Test-1797863593 tempest-LiveAutoBlockMigrationV225Test-1797863593-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1969 microversion: 2.25 time: 0.319802 Aug 21 01:15:27.584918 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1170/2070] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:27 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:27.597035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.598191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.611493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.611823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.612224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.612980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.613591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.614008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.628905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 HTTP/1.1 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9'} Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:27.630751 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6a6fe42-3d00-435c-ba7e-14f509d385b6 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 404 len: 111 microversion: 2.1 time: 0.045643 Aug 21 01:15:27.633780 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1171/2071] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:27 2022] DELETE /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:27.639004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.648619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.666176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.666956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.667567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.670026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.670993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.671745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.705311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:27.798403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:27.824013 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbac6ef7-a4f9-4d01-8889-970de58de438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.817251 Aug 21 01:15:27.826887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 901/2072] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:27 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:27.839736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.841702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.856871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.861130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.863274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.865744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.867396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.867941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.900524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9234e026-4fc9-496b-80e5-ac37ccef9bc1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 204 len: 0 microversion: 2.25 time: 0.266217 Aug 21 01:15:27.901411 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1172/2073] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:15:27 2022] DELETE /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:15:27.923941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.924758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.929818 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 HTTP/1.1 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9'} Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:27.930808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:27.934053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:27.934453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff21c5d7-fb71-49ac-9cd2-c48c3a4177ad tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9" status: 404 len: 111 microversion: 2.1 time: 0.106004 Aug 21 01:15:27.938600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.938850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.939294 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 902/2074] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:27 2022] GET /compute/v2.1/servers/f8d5e97c-e85f-49c2-ba63-139cf7d4a2f9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:27.939440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.940286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.940790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.941302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.947875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:27.948719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:27.956523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.957240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.957856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:27.958712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:27.960347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:27.961281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.231025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.254140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.255838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.257163 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2e588a4-bf75-4361-a806-a8a1097e4448 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.315625 Aug 21 01:15:28.271741 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 903/2075] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:27 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:28.271741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:28.271741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:28.276086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.276638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.280271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.281104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.281570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.282100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.322007 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a HTTP/1.1 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '29d80535-fd61-410a-8cf4-0a40b599241a'} Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:28.325059 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e2ae028-6c44-47f7-8025-6e75dfade240 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 404 len: 111 microversion: 2.1 time: 0.067373 Aug 21 01:15:28.328935 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 904/2076] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:15:28 2022] DELETE /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:28.337202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:28.337769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:28.353673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.354176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.354593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.355297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.355767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.356161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.439778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.460106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.464586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.472512 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-687f8991-45da-48ef-b25d-40a4b08c671c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1483 microversion: 2.25 time: 0.560271 Aug 21 01:15:28.487319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1173/2077] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:27 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1483 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:28.500051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:28.501599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:28.513725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.514584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.515163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.516047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.516632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.518337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.799728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.810681 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad092ced-5559-42f1-8500-3cd5a6e34e65 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1381 microversion: 2.1 time: 0.316963 Aug 21 01:15:28.812345 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1174/2078] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:28 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1381 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:28.817707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:28.818474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] [instance: 29d80535-fd61-410a-8cf4-0a40b599241a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:28.825764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.826699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.827265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.829372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.830357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.830933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.855018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] HTTP exception thrown: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Request method failure captured: Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a HTTP/1.1 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaTiUSPN9lGC8PB9fn-MsWV-WXmM07ZKS6TUg2MV4WLA5Of_V4Se3pcITwzsWJKuIS7TguX69iUdTvnBBlmw3wHKWFXkA7Q6FwSH2UNgEyKNl1hTjTupip3qFXWj6UH50iTBJTOi3OOSSktHelN0yYF28GPyElC3Ygy1lRUSBdfb4M Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_26ee54d7a3e84461b4e5aff422e87f5a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/26ee54d7a3e84461b4e5aff422e87f5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/26ee54d7a3e84461b4e5aff422e87f5a"}]}] Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 26ee54d7a3e84461b4e5aff422e87f5a Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestMultiNic-473715801 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 83fa03ac4589405e911fda3211620529 Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestMultiNic-473715801-project Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '29d80535-fd61-410a-8cf4-0a40b599241a'} Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:28.857020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. Aug 21 01:15:28.860984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:28.864033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] Returning 404 to user: Instance 29d80535-fd61-410a-8cf4-0a40b599241a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:28.865120 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c5b960b-1b6c-4d67-9500-95affc100da2 tempest-ServersTestMultiNic-473715801 tempest-ServersTestMultiNic-473715801-project] 10.222.0.46 "GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a" status: 404 len: 111 microversion: 2.1 time: 0.051261 Aug 21 01:15:28.867369 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1175/2079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:28 2022] GET /compute/v2.1/servers/29d80535-fd61-410a-8cf4-0a40b599241a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:28.906125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:28.926880 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb83372d-2909-4d70-a171-5d9182b42f45 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.595477 Aug 21 01:15:28.943016 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 905/2080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:28 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:28.960409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:28.961089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:28.987580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.989383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.990931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:28.993340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:28.996310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:28.996994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.109756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:29.110611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:29.121949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.148092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.149116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.154191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.155373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.156063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.397512 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-efec03f7-7e0c-44b1-bd94-b654f0012059 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1532 microversion: 2.1 time: 0.526438 Aug 21 01:15:29.412907 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1176/2081] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:28 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1532 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:29.429565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:29.438916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:29.450300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.454161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.455033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.459111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.460853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.467420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.492077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:29.507203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-98a9302c-1930-4a56-8a18-9f3d4c68797e tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1323 microversion: 2.1 time: 0.560554 Aug 21 01:15:29.510368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 906/2082] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:28 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:29.522934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:29.527692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:29.540286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.541050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.541487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.551462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.552008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.552544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.614110 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:29.839475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:29.863296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:29.869259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:29.873840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3a16b43-0315-4719-b327-db2c0fef981d tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.448227 Aug 21 01:15:29.877213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1177/2083] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:29 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:29.884924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:29.903085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:29.922542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.923343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.924010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:29.924991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:29.925682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:29.926299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.282700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:30.323713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-741ccc1c-65e0-407d-ba70-99e0e45b0421 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1532 microversion: 2.1 time: 0.811513 Aug 21 01:15:30.324279 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 907/2084] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:29 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1532 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:30.337016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:30.337016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:30.337016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec0d7c39-0765-454d-95a6-4cf5097e059e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1483 microversion: 2.25 time: 0.454437 Aug 21 01:15:30.337016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1178/2085] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:29 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1483 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:30.338408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d93aaa-bbc5-4845-b568-c783ac5d7db8", "name": "network-vif-plugged", "status": "completed", "tag": "ca3e1fd8-049f-4314-b371-5b74979def42"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:30.344281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:30.344928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:30.354055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.354541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.354973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.355945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.356224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.356795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.372349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.373162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.373901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.394016 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] Creating event network-vif-plugged:ca3e1fd8-049f-4314-b371-5b74979def42 for instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 on n-h1-master-1 Aug 21 01:15:30.422207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5fa6afcd-3d42-4fd2-ae84-2edcc6d1da39 req-cb8df22d-64ea-4183-b951-6bc021e19ba0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088902 Aug 21 01:15:30.422979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 908/2086] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:30.429205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:30.431858 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:15:30.431858 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:15:30.435999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.456008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.456411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.457837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.458475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.459561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.511365 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f819f4d4-10aa-4608-9f1f-583f7c6d26fc tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086377 Aug 21 01:15:30.512352 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 909/2087] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:15:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:30.524262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:30.527438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:30.539807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.540492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.541096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.541972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.542572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.543656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.571799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lazy-loading 'flavor' on Instance uuid d64161bf-6b32-4616-b029-f7d2d76ad8a6 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:15:30.593864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Going to try to live migrate instance to n-h1-master-1 {{(pid=122483) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:15:30.779095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:30.801276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa1d0f11-3cb2-48ee-8c54-336882d1adcb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1308 microversion: 2.1 time: 0.465939 Aug 21 01:15:30.805077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1179/2088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:30 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:30.816396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:30.829141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:30.842304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.842795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.843428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:30.844146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:30.844588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:30.845421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:31.379438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:31.391002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46154c00-06eb-4647-be71-58e8849922a1 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 200 len: 1519 microversion: 2.1 time: 0.581248 Aug 21 01:15:31.391588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1180/2089] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:30 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 1519 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:31.424923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:31.425561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:31.448878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:31.450691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:31.453618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:31.454482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:31.456314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:31.458052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:31.853182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:31.866644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:31.872321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:31.873932 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f368462-85f0-482e-b954-74a106293ead tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.463760 Aug 21 01:15:31.875712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1181/2090] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:31 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:31.893247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab51f922-b064-4405-aa06-a4dc9b115412", "name": "network-vif-deleted", "tag": "99bcb505-6f74-41df-93c7-c5323751ecfc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:31.927987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:31.928598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:31.929157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:31.943589 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] Creating event network-vif-deleted:99bcb505-6f74-41df-93c7-c5323751ecfc for instance ab51f922-b064-4405-aa06-a4dc9b115412 on n-h1-master-1 Aug 21 01:15:31.950081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1c2061e5-8bb8-4071-b0d8-92a4854dc2a0 req-a257f2c7-9a8a-45b6-adb6-eab28437c395 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070141 Aug 21 01:15:31.951554 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1182/2091] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:31.958482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:31.959422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:31.982392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:31.985421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:31.987434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:31.989609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:31.990410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:31.993076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:32.251276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:32.262627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:32.267354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:32.273448 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89e64cf6-8af6-450a-b123-571a6c519240 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1265 microversion: 2.25 time: 0.315870 Aug 21 01:15:32.274390 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1183/2092] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:31 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:32.290791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: .version_select at 0x7fc400c665e0>, body: {"addFloatingIp": {"address": "172.35.1.124"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:32.294304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:32.310957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:32.311624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:32.312171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:32.313329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:32.317793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:32.318350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:32.381791 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:32.471261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:15:32.473722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquired lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:15:34.460944 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad70863c-8121-4d11-864d-49ebd6f763e0 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6/action" status: 202 len: 0 microversion: 2.1 time: 3.940336 Aug 21 01:15:34.462644 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 910/2093] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:30 2022] POST /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6/action => generated 0 bytes in 3943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:15:34.479360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:34.480021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:34.529348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:34.536680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:34.539092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:34.540363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:34.543916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:34.544608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:35.239267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:35.265391 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7fb37ec-aec9-43c3-9143-91017c09f5e8 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1487 microversion: 2.1 time: 0.792660 Aug 21 01:15:35.266364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 911/2094] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:34 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1487 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:35.271286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:35.271973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:35.288055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:35.288606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:35.289066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:35.289774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:35.290208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:35.290941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:35.731263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Building network info cache for instance {{(pid=122482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:15:36.013915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.028113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.030170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.035909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64e655ee-0e35-4090-83e7-e780cc250d20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.768520 Aug 21 01:15:36.036576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 912/2095] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:35 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:36.049327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:36.050147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:36.068438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.068946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.069375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.070411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.070521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.070903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.229480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.247627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.253151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.257278 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bdd67b17-f724-47d5-b74d-1b377e94592c tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1265 microversion: 2.25 time: 0.219154 Aug 21 01:15:36.265906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 913/2096] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:36 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:36.280970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:36.281586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:36.289397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.289872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.291893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.296563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.297420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.299406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.761929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Updating instance_info_cache with network_info: [{"id": "f2705b5b-7c12-46c6-8392-b100046efd4e", "address": "fa:16:3e:8d:6c:a5", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2705b5b-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:15:36.785003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Releasing lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:15:36.786756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb93c77e-438d-4e58-847f-24286d2c204c tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action" status: 202 len: 0 microversion: 2.1 time: 4.500743 Aug 21 01:15:36.788362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1184/2097] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:32 2022] POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action => generated 0 bytes in 4503 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:15:36.803681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:36.809983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:36.820217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:36.825053 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32efc442-4297-49c4-ab2a-9abe1fe1b164 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.553092 Aug 21 01:15:36.825949 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 914/2098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:36 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:36.832095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.832883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.833529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.834417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.840116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.840566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.853371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:36.903130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lazy-loading 'flavor' on Instance uuid 91d93aaa-bbc5-4845-b568-c783ac5d7db8 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:15:36.914670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:36.916874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:36.917867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:36.999713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] Creating event network-changed:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:15:37.013094 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-340193cc-1908-4952-abcb-b5f6d8d4b3f8 req-9670650b-02ae-4708-84ab-bc5410575cd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185139 Aug 21 01:15:37.015661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 915/2099] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:37.040531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: .version_select at 0x7fc400bf5040>, body: {"addFloatingIp": {"address": "172.35.1.124"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:37.047211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:37.067798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.078806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.079904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:37.084326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.085629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.087268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:37.090257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d24322ec-2fe7-412e-820e-76f4b8ffa9b6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8/action" status: 202 len: 0 microversion: 2.1 time: 0.297623 Aug 21 01:15:37.110059 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1185/2100] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:36 2022] POST /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:15:37.128689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:37.129800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:37.148269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.150317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.150947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:37.153027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.156170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.156825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:37.287081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:15:37.288347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquired lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:15:37.520036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:37.530163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:37.532131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:37.533362 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bc93f15f-f899-45b8-b872-b842c523b69f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.419279 Aug 21 01:15:37.534346 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1186/2101] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:37 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:37.539460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:37.540165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:37.546846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.547323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.547917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:37.548789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:37.549390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:37.549961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.153801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:38.171821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac5e9243-b1df-45b6-a118-568715669354 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1495 microversion: 2.1 time: 0.636348 Aug 21 01:15:38.175578 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1187/2102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:37 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1495 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:38.190567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:38.196447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:38.218545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.219438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.224902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.226171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.229699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.230492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.383490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:38.411796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:38.422610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:38.426301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-497abd82-b9af-4268-bf8f-d2f019d9f16a tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 200 len: 1265 microversion: 2.25 time: 0.248922 Aug 21 01:15:38.433819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1188/2103] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:38 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:38.455012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:38.456128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:38.481876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.488649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.490650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.493972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.495822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.496372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.875860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:38.888023 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fa9c0a2-31b9-44d9-b485-a043d90ffd6b tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.451767 Aug 21 01:15:38.906142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1189/2104] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:38 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:38.918392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:38.919271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:38.934142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.934651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.936231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:38.938409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:38.940481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:38.941029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.454377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:39.473738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:39.475954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:39.477177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7ca8f02f-5782-4e0d-a12c-620b053b3ff7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.571302 Aug 21 01:15:39.478027 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1190/2105] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:38 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:39.499629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:39.500254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:39.507034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.507546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.508022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.508711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.509196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.509619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.797358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:39.809137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-918d4e51-c2ed-4002-994d-6706ba0eff7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 200 len: 1478 microversion: 2.1 time: 0.314582 Aug 21 01:15:39.813646 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1191/2106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:39 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 1478 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:39.818994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:39.819818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: ab51f922-b064-4405-aa06-a4dc9b115412] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:39.829665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.837299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.844108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.845248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.846556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.848040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.883247 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] HTTP exception thrown: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Request method failure captured: Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 HTTP/1.1 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV1H2NTuDlkV7NlVhwIT9HoMW5iVYujsrlWERD7dVtoKA3I4DWARz8FwoLm-Z1I0x105H6T5hwL4Gl77BoDwS0KcAGO0kJoT6F07OJ7VqQNWwi6oayObCKOItRtkXBVuH82WSn8OzSYBqA5GoTzPn61FuZdaaQptRqdl2BvOQusbyQ Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.25 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ce70f9ff025c4666be942f9399ae72dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}] Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 547522b0b07f472a91ec83f15a36bb90 Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ab51f922-b064-4405-aa06-a4dc9b115412'} Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. Aug 21 01:15:39.885738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. Aug 21 01:15:39.889831 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:15:39.892151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Returning 404 to user: Instance ab51f922-b064-4405-aa06-a4dc9b115412 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:39.894897 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a359a5b2-6933-4556-982d-a58c527f3dc6 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412" status: 404 len: 111 microversion: 2.25 time: 0.079730 Aug 21 01:15:39.896188 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1192/2107] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:39 2022] GET /compute/v2.1/servers/ab51f922-b064-4405-aa06-a4dc9b115412 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:15:39.903726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1315300735"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:39.907552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:39.918970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.920021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.920937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:39.922336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:39.923271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:39.924124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:40.279915 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ccec15b7-35d8-4fdb-80fd-3fc4a91eb467 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8/action" status: 202 len: 0 microversion: 2.1 time: 0.381873 Aug 21 01:15:40.290662 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1193/2108] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:39 2022] POST /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:15:40.310396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:40.324928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:40.332885 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:40.348523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:40.349304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:40.351577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:40.352694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:40.353645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:40.354447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:40.471471 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:40.643309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:40.655911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-91287240-e4e2-4fa8-8ab7-f5f5b50ebb16 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.361747 Aug 21 01:15:40.656886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1194/2109] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:40 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:40.673064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a56b7b53-6603-4f0c-8baf-1966925baea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa5c3b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:40.767148 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a56b7b53-6603-4f0c-8baf-1966925baea3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.108720 Aug 21 01:15:40.767833 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1195/2110] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:40 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:40.781582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:40.782328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:40.789344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:40.789992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:40.790549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:40.791433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:40.792016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:40.792500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:41.211065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:41.234526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:41.236234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:41.242052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3db8015-8328-4406-a848-e6cc33af69f9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.464942 Aug 21 01:15:41.243994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1196/2111] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:40 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:41.686876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:41.689705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:41.709386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:41.709925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:41.710370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:41.714358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:41.716141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:41.717776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:42.011396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:42.023407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09632ebb-5235-45da-9a79-350037c524d9 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.344660 Aug 21 01:15:42.026033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1197/2112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:41 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:42.032465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8f05cc0-c177-472e-af4f-40cb1ec1c375 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa573790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:42.110859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8f05cc0-c177-472e-af4f-40cb1ec1c375 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.083460 Aug 21 01:15:42.111882 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1198/2113] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:42 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:42.270387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:42.271375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:42.281082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:42.281820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:42.282398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:42.283247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:42.294303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:42.297146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:42.675321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:42.677877 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:42.688294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:42.696626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:42.698116 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b64037e-d8e6-4599-ad4b-c2a011d53951 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.431670 Aug 21 01:15:42.700587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1199/2114] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:42 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:42.737814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "67a9430a-b35b-4d92-91c6-42f46492d842"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:42.758763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:42.759983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:42.760480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:42.799143 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] Creating event network-vif-plugged:67a9430a-b35b-4d92-91c6-42f46492d842 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:42.807536 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-67da5bb4-2956-43ef-9fd3-691d9ee4bc47 req-24a0f9a1-1928-44b3-a7b6-f90349b727c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073461 Aug 21 01:15:42.810142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1200/2115] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:15:43.049646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:43.050579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:43.070883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:43.077830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:43.082689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:43.083477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:43.083965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:43.084396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:43.289087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:43.304344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a1207c2-0ec1-4028-8fcf-68003f5fa7dd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.259374 Aug 21 01:15:43.305278 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1201/2116] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:43 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:43.314048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fe48105-3194-4f78-a37e-8d90fbb22e91 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa1668b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:43.410885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fe48105-3194-4f78-a37e-8d90fbb22e91 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.103509 Aug 21 01:15:43.417819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1202/2117] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:43 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:43.729369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:43.730284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:43.743396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:43.748187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:43.748803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:43.749570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:43.750048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:43.756418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:44.210726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:44.231376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:44.245247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:44.259125 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb878398-303b-4a59-9a88-132591fb732b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.529944 Aug 21 01:15:44.259933 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1203/2118] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:43 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:44.424832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:44.425793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:44.433205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:44.437442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:44.438484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:44.439459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:44.445569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:44.446385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:44.751944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:44.768963 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b74e0cc8-eb56-41d1-bc59-44421380a6d0 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.348056 Aug 21 01:15:44.769961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1204/2119] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:44 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:44.778192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee2197ba-7b51-4613-afb7-7f71e99d221c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4032c3e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:44.877901 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee2197ba-7b51-4613-afb7-7f71e99d221c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.106832 Aug 21 01:15:44.878816 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1205/2120] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:44 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:44.916280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "09ee1a66-22fc-4784-bfd8-33aa4d4f401b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:44.941678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:44.945167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:44.947652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:44.980319 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] Creating event network-vif-plugged:09ee1a66-22fc-4784-bfd8-33aa4d4f401b for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:44.995407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-30b71de0-0015-494a-9dc2-ca86feabd1d3 req-2efebe53-ef52-4875-93b5-9f8d50dd347b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084748 Aug 21 01:15:44.998210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1206/2121] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:45.286222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:45.287603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:45.308308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:45.309210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:45.309826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:45.312563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:45.316254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:45.316841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:45.671066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:45.695225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:45.706140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:45.707719 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a3db0a9-c777-46ca-8fda-e75e9a2bb6f3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.426285 Aug 21 01:15:45.726564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1207/2122] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:45 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:45.790187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:45.791521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:45.806826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:45.807586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:45.808177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:45.809174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:45.809771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:45.810334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:46.179707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:46.196145 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d2454b3-48b3-48c4-8488-88b5e40c7b29 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.406084 Aug 21 01:15:46.200963 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1208/2123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:45 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:46.220696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b997d4c4-ccb5-4192-b51c-9fc3dcbab165 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa1eb790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:46.324724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b997d4c4-ccb5-4192-b51c-9fc3dcbab165 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.121448 Aug 21 01:15:46.325353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1209/2124] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:46 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:46.737452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:46.738647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:46.756187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:46.756718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:46.757222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:46.757968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:46.758421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:46.758846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:47.063760 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=83 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:47.174429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:47.189698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:47.194004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:47.197437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4cc4202-39eb-4067-8ffa-f0bba22e699c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 0.465675 Aug 21 01:15:47.198024 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1210/2125] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:46 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:47.205262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "2b34f8d9-a956-4cd7-88dc-cd02dd48506a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:47.235125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:47.235608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:47.236035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:47.268570 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] Creating event network-vif-plugged:2b34f8d9-a956-4cd7-88dc-cd02dd48506a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:47.274492 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:47.284642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-92831af5-8bb0-421d-aa95-bd3ad9386b2f req-1ed23185-6854-491d-aa94-3e8755d1090b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082934 Aug 21 01:15:47.290936 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1211/2126] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:47.300354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:47.301102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:47.321404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:47.321928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:47.333390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:47.334694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:47.335454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:47.336041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:47.564221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.neutron [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] re-assign floating IP 172.35.1.124 from instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 Aug 21 01:15:47.667427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:15:48.799618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:48.810430 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7adb332f-05f3-4fe7-8c44-e11a94adfb63 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 1.518159 Aug 21 01:15:48.816865 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1212/2127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:47 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:48.827951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:48.872524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:48.873447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:48.877087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:48.909258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] Creating event network-changed:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:15:48.924743 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6039e8de-421d-4fb2-940e-043db1d1e30a req-08272055-b45f-4c1e-a52c-f8c84da015f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106402 Aug 21 01:15:48.925939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1213/2128] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:48.933093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae540572-05a7-4193-b805-7c7299fa6783 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9ef41f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:49.028099 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae540572-05a7-4193-b805-7c7299fa6783 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.100586 Aug 21 01:15:49.029790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1214/2129] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:48 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:49.041732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:49.045210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:49.059131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:49.062707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:49.063935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:49.068960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:49.069905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:49.077303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:50.126131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Updating instance_info_cache with network_info: [{"id": "f2705b5b-7c12-46c6-8392-b100046efd4e", "address": "fa:16:3e:8d:6c:a5", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2705b5b-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:15:50.171996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:15:50.718933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:50.741404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:50.748625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:50.750222 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5b81ec9-2d59-4f99-93bf-1e62daa4e9fc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.718668 Aug 21 01:15:50.750928 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1215/2130] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:49 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:50.802870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:50.803936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:50.827478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:50.828068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:50.828506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:50.829245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:50.836938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:50.837491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:51.251892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:51.261990 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a517588-2bac-406d-952d-7981d8ba91bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.510027 Aug 21 01:15:51.266471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1216/2131] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:50 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:51.280249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-07eb5c83-4fc6-4946-a47c-63c9b6a22b72 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9e90550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:51.381785 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-07eb5c83-4fc6-4946-a47c-63c9b6a22b72 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.110127 Aug 21 01:15:51.382479 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1217/2132] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:51 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:51.411264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "8c042ceb-0474-43e0-9d18-f60ab556f200"}, {"server_uuid": "91d93aaa-bbc5-4845-b568-c783ac5d7db8", "name": "network-vif-plugged", "status": "completed", "tag": "ca3e1fd8-049f-4314-b371-5b74979def42"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:51.461209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:51.472318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:51.475175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:51.535275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Creating event network-vif-plugged:8c042ceb-0474-43e0-9d18-f60ab556f200 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:51.536473 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] Creating event network-vif-plugged:ca3e1fd8-049f-4314-b371-5b74979def42 for instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 on n-h1-master-1 Aug 21 01:15:51.566845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b555eabd-3873-4835-9bee-5f0c9efe47a4 req-4020eaef-0bda-421c-a96d-eb5eb7a57c04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.182018 Aug 21 01:15:51.581618 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1218/2133] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:51.597070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:51.624697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:51.626049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:51.627735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:51.661555 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] Creating event network-changed:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:15:51.687481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-470e6e35-e6f6-49d1-9cb9-a7eb5e1ae553 req-3931ce2a-a0e0-4c03-9d09-93cb07aa9200 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104157 Aug 21 01:15:51.694086 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1219/2134] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:51.778022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:51.781630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:51.801141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:51.805791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:51.810131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:51.812067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:51.812759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:51.814349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.139545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Updating instance_info_cache with network_info: [{"id": "fd42da64-950d-468e-9a9c-1b85f72c2526", "address": "fa:16:3e:08:1c:a7", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd42da64-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:15:53.164157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Releasing lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:15:53.166410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2f73b093-8d43-408c-960f-4fa77cda58a4 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7/action" status: 202 len: 0 microversion: 2.1 time: 16.142567 Aug 21 01:15:53.167167 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 916/2135] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:37 2022] POST /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7/action => generated 0 bytes in 16150 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:15:53.185299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:53.191890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:53.212453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:53.217964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.223740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.224754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.227229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.228053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.229474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.242656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:53.251021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:53.253478 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d10ceb3e-3d2d-40e2-91bc-f1ddc81ed756 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.480259 Aug 21 01:15:53.280498 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1220/2136] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:51 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:15:53.291531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab0f4587-3231-4bf2-8e38-dbdcbebebd4b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9df9dc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:53.411895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab0f4587-3231-4bf2-8e38-dbdcbebebd4b tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.129379 Aug 21 01:15:53.421159 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1221/2137] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:53 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:53.433081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:53.435180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:53.445838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.446618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.447316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.448967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.449583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.450340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.494448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:15:53.609393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:53.619473 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a92a0b3-0794-42ea-9151-7554eb521d9a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.449330 Aug 21 01:15:53.625356 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 917/2138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:53 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:53.651361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: .version_select at 0x7fc400c67430>, body: {"removeFloatingIp": {"address": "172.35.1.124"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:53.760752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63d6ffb7-e48d-4faa-bad3-b87407f7aaa5 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 204 len: 0 microversion: 2.25 time: 0.336481 Aug 21 01:15:53.762938 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1222/2139] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:15:53 2022] DELETE /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:15:53.785537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "af9fedc1-ee77-4233-9405-39aa90621b2a"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "ed52380b-6a18-402a-9e3c-afd08577e340"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:53.815208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.816044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.816741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.856579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Creating event network-vif-plugged:af9fedc1-ee77-4233-9405-39aa90621b2a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:53.860146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] Creating event network-vif-plugged:ed52380b-6a18-402a-9e3c-afd08577e340 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:53.878472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-99a4a355-dc7c-4637-a6b5-b68e6baa4e33 req-76bdb87c-a8a4-44d7-95f7-6664ff9dec90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102172 Aug 21 01:15:53.879717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1223/2140] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:53.896150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:53.899755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:53.912621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.913307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.913856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:53.914613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:53.915063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:53.915687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:54.344050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:54.354583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:54.355364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:54.355951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:54.359441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:54.362621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:54.365059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:55.925999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:55.941413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:55.943956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:55.950464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c010562-50ae-4217-9072-9dabfd396c20 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1732 microversion: 2.25 time: 2.067328 Aug 21 01:15:55.952970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1224/2141] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:53 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1732 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:55.968900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:55.974496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:55.993278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:55.996900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:55.997716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:56.000023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:56.001985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:56.005905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:56.067615 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:56.318596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] HTTP exception thrown: Floating IP 172.35.1.124 is not associated with instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508. Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Request method failure captured: Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action HTTP/1.1 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 49 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYb2KdfCQPGwCo1_Lt4Ai2CgKg38qFRJtcBJQJIrGJdOud5sNDR8dPM6HXTOuKOD731z2lfXsDpbgQh454OUvdyKmJ1PiMfEn1R6aIsKVL5t4HM9NtU7CQ7d0gZiMU64RtELOHO-q6ksFPMelo_VluVdmHNEcwc842WRuGYnBvRjKiE Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30b2a95273e6417babc48661728340bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30b2a95273e6417babc48661728340bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}] Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b3d2e0ca31ba428d9391b4fa5c91bf4e Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: {"removeFloatingIp": {"address": "172.35.1.124"}} Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP 172.35.1.124 is not associated with instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508. Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ba1ea8ca-9643-4259-b2ca-e3b8e1592508', 'body': {'removeFloatingIp': {'address': '172.35.1.124'}}} Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.1.124 is not associated with instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508. Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.1.124 is not associated with instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508. Aug 21 01:15:56.329262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:15:56.332525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Returning 409 to user: Floating IP 172.35.1.124 is not associated with instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:15:56.332525 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bff079e8-ca98-4c2c-8a07-892cce905813 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action" status: 409 len: 146 microversion: 2.1 time: 2.700548 Aug 21 01:15:56.333515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 918/2142] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:53 2022] POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action => generated 146 bytes in 2703 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:15:56.355857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dc50877-61f0-4853-96be-a79343551912 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fd982160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:56.590512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dc50877-61f0-4853-96be-a79343551912 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.253627 Aug 21 01:15:56.597521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 919/2143] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:56 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:56.631510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:56.635553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:56.677617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:56.678478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:56.679138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:56.680077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:56.680733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:56.681393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:57.241189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:57.258963 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-741bfae3-acef-4104-a945-d394ba44ea50 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.658779 Aug 21 01:15:57.273541 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 920/2144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:56 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:57.277980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.124"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:57.538310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:57.549248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:57.549974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:57.550647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:57.553276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:57.557848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:57.559051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:57.681565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:57.702467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:57.708939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:57.721996 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06b29099-f5bc-44db-adcc-08dc914d15cf tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.762873 Aug 21 01:15:57.742025 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1225/2145] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:55 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:57.753990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-plugged", "status": "completed", "tag": "14001b66-77c6-45a0-9adf-7941e57f220d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:15:57.782341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:57.782828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:57.783254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:57.815958 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] Creating event network-vif-plugged:14001b66-77c6-45a0-9adf-7941e57f220d for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:15:57.835729 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-677f4ce1-23bf-4690-a7d8-e406ca15d54c req-a56cc2cc-71ab-41fd-93de-6a14f9151036 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089472 Aug 21 01:15:57.837894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1226/2146] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:15:57.852922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:57.853984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:57.873122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:57.889165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:57.889827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:57.897650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:57.898171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:57.898682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:58.425857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:58.455006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:58.456758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:58.462623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea60778d-f616-4b02-abe8-1832c075d5f2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1664 microversion: 2.25 time: 0.623464 Aug 21 01:15:58.473932 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1227/2147] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:57 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1664 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:15:58.480806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-622b891d-d9e5-41d3-aa2b-08406f28ff97 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9df9dc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:58.583782 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-622b891d-d9e5-41d3-aa2b-08406f28ff97 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.108332 Aug 21 01:15:58.584407 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1228/2148] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:58 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:58.623388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:58.628754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:58.676639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:58.678093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:58.678981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:58.681530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:58.682188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:58.683833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:58.883881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:15:58.884804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquired lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:15:59.410421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:15:59.426686 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-679a94c5-9450-4782-9f01-195488d7f3ff tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.840324 Aug 21 01:15:59.444884 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1229/2149] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:15:58 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:15:59.452237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:15:59.455332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:15:59.473946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:59.476429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:59.477113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:15:59.477988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:15:59.478588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:15:59.479171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:00.540718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:00.565190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:00.574689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:00.579245 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74943e84-f1c4-4f15-a78d-99237ddbdd55 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1875 microversion: 2.32 time: 1.128382 Aug 21 01:16:00.584104 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1230/2150] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:15:59 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1875 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:00.642607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:00.644397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:00.698933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:00.700218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:00.704863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:00.707989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:00.709329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:00.710761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:00.875868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:00.879801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:00.881531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:00.884178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lazy-loading 'fault' on Instance uuid 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:01.152972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:01.180322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:01.191230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:01.195707 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e719ebff-e9b1-43e0-9656-71ea76543b99 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 200 len: 1376 microversion: 2.25 time: 0.582928 Aug 21 01:16:01.208005 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1231/2151] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:00 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 1376 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:01.215866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3cf1009-2245-424e-bba8-f905cebe8e3e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fa166e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:01.310474 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3cf1009-2245-424e-bba8-f905cebe8e3e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.110386 Aug 21 01:16:01.312107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1232/2152] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:01 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:01.324077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f41cfc5-9582-43bc-b90a-c0ffa3eff884", "name": "network-vif-deleted", "tag": "0025f3a1-2ee2-4a92-b0c3-f61ae35e19db"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:01.373146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:01.376816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:01.378366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:01.412714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] Creating event network-vif-deleted:0025f3a1-2ee2-4a92-b0c3-f61ae35e19db for instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 on n-h1-master-1 Aug 21 01:16:01.430133 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-af1705f3-f680-4e30-85ee-fe7f48051b05 req-158c25af-422c-4a86-9edb-58f42567fa2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113170 Aug 21 01:16:01.432269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1233/2153] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:01.446814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:01.449504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:01.466090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:01.469169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:01.472362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:01.473660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:01.475310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:01.477821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:02.407832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:16:02.455869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:02.464803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-622d9ac3-7369-47bd-a494-c93b08d21ef6 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 1.031017 Aug 21 01:16:02.469093 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1234/2154] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:01 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:02.656251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1021653086", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "57c4f653-05f8-441c-a28f-d1591f6a1114"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:02.800686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] validate_networks() for [('57c4f653-05f8-441c-a28f-d1591f6a1114', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:03.869397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:03.870071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:03.870884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:03.871539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:03.872114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:03.913355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:03.925976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:03.927117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:03.927959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:03.928437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:03.928901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:03.983045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Updating instance_info_cache with network_info: [{"id": "fd42da64-950d-468e-9a9c-1b85f72c2526", "address": "fa:16:3e:08:1c:a7", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd42da64-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:16:04.002249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Releasing lock "refresh_cache-67065fbe-c43d-408a-923a-5100ad19aec7" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:16:04.003390 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4143278-349e-448a-9440-1357d8fdff91 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7/action" status: 202 len: 0 microversion: 2.1 time: 6.742284 Aug 21 01:16:04.004230 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 921/2155] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:15:57 2022] POST /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7/action => generated 0 bytes in 6744 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:16:04.009197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:04.010014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:04.025502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.026264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.026849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.027717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.029057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.029613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.106348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Getting quotas for project aa16ca726eda42c2ab2983a6b22e73c1. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:04.124379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Getting quotas for user 7913dc06b5764a5f88399c5a9407feec and project aa16ca726eda42c2ab2983a6b22e73c1. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:04.157778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:04.161656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:04.294706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9dd38341-aa3f-4363-ac6c-217a7acbb740 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824205 Aug 21 01:16:04.295851 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1235/2156] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:16:04.319956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:04.320579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 0f41cfc5-9582-43bc-b90a-c0ffa3eff884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:04.367835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.371307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.372991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.374248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.375793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.377467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.418757 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] HTTP exception thrown: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Request method failure captured: Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 HTTP/1.1 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV1H2NTuDlkV7NlVhwIT9HoMW5iVYujsrlWERD7dVtoKA3I4DWARz8FwoLm-Z1I0x105H6T5hwL4Gl77BoDwS0KcAGO0kJoT6F07OJ7VqQNWwi6oayObCKOItRtkXBVuH82WSn8OzSYBqA5GoTzPn61FuZdaaQptRqdl2BvOQusbyQ Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.25 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ce70f9ff025c4666be942f9399ae72dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}] Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 547522b0b07f472a91ec83f15a36bb90 Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0f41cfc5-9582-43bc-b90a-c0ffa3eff884'} Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. Aug 21 01:16:04.428166 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Returning 404 to user: Instance 0f41cfc5-9582-43bc-b90a-c0ffa3eff884 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:04.431514 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11282502-99ea-4ec4-ba75-262b52f39cd1 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884" status: 404 len: 111 microversion: 2.25 time: 0.134377 Aug 21 01:16:04.433582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1236/2157] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:04 2022] GET /compute/v2.1/servers/0f41cfc5-9582-43bc-b90a-c0ffa3eff884 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:16:04.441801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5604354-28a1-4391-8dc0-49e284f44c7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9dcc040>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:04.497077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:04.507585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:04.509156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:04.510487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-453bfca9-7ae5-4264-8eae-523b21c878da tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2825 microversion: 2.32 time: 0.505078 Aug 21 01:16:04.511070 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 922/2158] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:04 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2825 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:04.530468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5604354-28a1-4391-8dc0-49e284f44c7f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.093947 Aug 21 01:16:04.549790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1237/2159] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:04 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:04.557811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:04.560340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:04.587552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.590422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.591488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.592975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.595386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.596196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:04.691355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1099801923", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:04.852251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] validate_networks() for [('9ebbddb4-9d42-4559-aced-caebe39ccd22', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:04.910476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:04.923844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8622d633-1f6d-4418-801b-173c630185e1 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.371091 Aug 21 01:16:04.931097 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1238/2160] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:04 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:04.952703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64161bf-6b32-4616-b029-f7d2d76ad8a6", "name": "network-vif-unplugged", "status": "completed", "tag": "dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee"}, {"name": "network-changed", "server_uuid": "d64161bf-6b32-4616-b029-f7d2d76ad8a6", "tag": "dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee"}, {"name": "network-changed", "server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:04.992414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:04.993379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:04.994501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.029089 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Creating event network-vif-unplugged:dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee for instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 on n-h2-master-1 Aug 21 01:16:05.033153 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Creating event network-changed:dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee for instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 on n-h2-master-1 Aug 21 01:16:05.035130 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] Creating event network-changed:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:16:05.047185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0a50fb02-255d-45f8-8989-903fb72c6c09 req-4bb064ba-cccb-4c9f-b289-5ba172f77ac3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.113950 Aug 21 01:16:05.048093 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1239/2161] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:05.057477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:05.058756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:05.071226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.071998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.073241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.076050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.076846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.077745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.124737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:05.301146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a477624-bbd6-4f36-8d37-5f3ad8e12c00 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 204 len: 0 microversion: 2.1 time: 0.247119 Aug 21 01:16:05.306488 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1240/2162] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:05 2022] DELETE /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:05.369997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:05.375238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:05.400277 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:05.408102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.408733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.409206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.412705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.414441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.416206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.574805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:05.591276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2715632e-646b-4d0c-b670-b26a78eee6d3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1220 microversion: 2.1 time: 0.271107 Aug 21 01:16:05.591924 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1241/2163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:05 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:05.598439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf676515-b754-433b-8458-04122c04977d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '.version_select at 0x7fc3f9dccb80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:05.631914 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf676515-b754-433b-8458-04122c04977d tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748135276" status: 204 len: 0 microversion: 2.25 time: 0.038680 Aug 21 01:16:05.633580 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1242/2164] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748135276 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:16:05.643763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:05.644268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:05.645753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:05.646258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:05.646961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:05.647664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:05.649239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:05.656077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.656579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.657046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.658101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.658569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.658993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.679344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.682622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.684269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.688067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:05.698514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:05.699183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:05.757947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Getting quotas for project 7461e4a0b7124b3bbbb6396de9b59656. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:05.778294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Getting quotas for user 22a8b93432dd4d699a28a8db26bc3c98 and project 7461e4a0b7124b3bbbb6396de9b59656. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:05.796884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:05.799438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:05.895393 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87934bce-48b3-4dbe-aabf-ce05b6709d79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.381892 Aug 21 01:16:05.904523 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 923/2165] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:16:06.080635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-079ac85c-abf2-44b5-9fa7-5e834541d342 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: .version_select at 0x7fc3fd9c64c0>, body: {"keypair": {"name": "tempest-keypair-2061475518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGIVCC2f11A3ULuDyWwwmTKJzoT5+PPf7X3S6+eoqNzSQpSU3ePYHK+xJQuqWaXfJ+rmOKEnJ7gNVcvfSNkASctDTgahXXYCk6Am31Reac++mYeTpJ9y2f/rATCzj5jpQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:06.105429 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4400be83-192f-4423-ac5a-6e5bbeb14e20 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.470644 Aug 21 01:16:06.106462 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1243/2166] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:16:05 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270/os-interface => generated 1828 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:06.113238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.124"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:06.159669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:06.179504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:06.181613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:06.182083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:06.185772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-079ac85c-abf2-44b5-9fa7-5e834541d342 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:06.186249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:06.187110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:06.189446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:06.209370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-079ac85c-abf2-44b5-9fa7-5e834541d342 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:06.292206 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-079ac85c-abf2-44b5-9fa7-5e834541d342 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.386258 Aug 21 01:16:06.293962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:16:06.295995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquired lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:16:06.296416 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 924/2167] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:16:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:06.307468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f941c3e9-d3b6-4094-9ff2-012f931da4d0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fd982b80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:06.401323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f941c3e9-d3b6-4094-9ff2-012f931da4d0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.101665 Aug 21 01:16:06.406885 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 925/2168] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:06 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:06.424315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3253862-2812-40ab-a95c-4983ebf42bd8 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:06.428913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3253862-2812-40ab-a95c-4983ebf42bd8 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:07.880746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a3253862-2812-40ab-a95c-4983ebf42bd8 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:07.899294 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3253862-2812-40ab-a95c-4983ebf42bd8 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1214 microversion: 2.1 time: 1.489401 Aug 21 01:16:07.905216 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 926/2169] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:06 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1214 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:07.926104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:07.930387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:07.946568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:07.947348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:07.954856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:07.957150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:07.961175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:07.962029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:09.318429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:09.336216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-74d1fc55-8211-4bd8-af6b-fed97f68e798 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 1.427955 Aug 21 01:16:09.337934 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 927/2170] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:07 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:09.354305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:09.355210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:09.369975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:09.370461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:09.378850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:09.380124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:09.382420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:09.382931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:09.694259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:09.713856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-18ab663b-396f-49f1-9cb7-d72beb22ddc8 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1274 microversion: 2.1 time: 0.373678 Aug 21 01:16:09.717760 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 928/2171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:09 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:09.733352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0645ca6e-94f4-4ea2-bcd5-f87218f269a4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fd886280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:09.869354 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0645ca6e-94f4-4ea2-bcd5-f87218f269a4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.150072 Aug 21 01:16:09.874745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 929/2172] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:09 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:09.926788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:09.929387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:09.963974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:09.964459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:09.964917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:09.974755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:09.976158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:09.976926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:10.759210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:10.779779 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec6be25c-5dcb-4955-935a-8c307df1645a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1272 microversion: 2.1 time: 0.883024 Aug 21 01:16:10.784165 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 930/2173] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:09 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1272 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:10.808599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:10.809843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:10.833401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:10.835982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:10.838838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:10.843973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:10.846658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:10.847266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:12.184448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Building network info cache for instance {{(pid=122482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:16:13.554001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:13.571915 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42dcba31-3291-431f-b000-8a6049ad7a25 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 2.785858 Aug 21 01:16:13.574823 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 931/2174] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:10 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:13.583473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:13.595445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:13.615906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:13.616940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:13.617678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:13.618672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:13.619671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:13.620404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:13.960641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:13.987810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-266db516-9a34-4061-ae98-ebd07e6baf56 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1274 microversion: 2.1 time: 0.403900 Aug 21 01:16:13.990946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 932/2175] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:13 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1274 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:14.004599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b39acfd-bc20-4663-a3e8-7ddc37121fa9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fe298160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:14.037411 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:14.127293 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b39acfd-bc20-4663-a3e8-7ddc37121fa9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1438 microversion: 2.1 time: 0.134869 Aug 21 01:16:14.129730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 933/2176] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:13 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:14.142493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "name": "network-vif-unplugged", "status": "completed", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:14.148139 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:14.210190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:14.213500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:14.214979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:14.275466 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] Creating event network-vif-unplugged:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:16:14.293957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2319e7af-9599-4466-9d75-ec3e912541af req-dcec5cc9-2796-4f9e-abf6-89576a1053e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161590 Aug 21 01:16:14.297879 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 934/2177] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:14.317925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:14.318901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:14.343339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:14.350431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:14.353377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:14.355190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:14.357722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:14.358666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:15.211380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Updating instance_info_cache with network_info: [{"id": "f2705b5b-7c12-46c6-8392-b100046efd4e", "address": "fa:16:3e:8d:6c:a5", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2705b5b-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:16:15.228625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Releasing lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:16:15.229662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-447c0554-7db9-40b8-a836-92197d3adcca tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action" status: 202 len: 0 microversion: 2.1 time: 9.121389 Aug 21 01:16:15.230824 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1244/2178] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:16:06 2022] POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action => generated 0 bytes in 9124 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:16:15.240142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:15.278979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:15.281678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:15.282142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:15.319320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] Creating event network-changed:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:16:15.340700 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1ad83321-9cc9-44c2-9bb5-3de53ec663b3 req-2a3ae281-3aa4-4cbf-b4ed-ce5be363c7e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108347 Aug 21 01:16:15.346268 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1245/2179] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:15.356086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:15.364600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:15.382936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:15.383823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:15.384473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:15.388583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:15.389227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:15.389834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:15.479966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:15.599867 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:15.724851 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:15.907396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa30a6b6-e9eb-476e-8e41-66b8db15d190 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 204 len: 0 microversion: 2.25 time: 0.557367 Aug 21 01:16:15.909274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1246/2180] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:16:15 2022] DELETE /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:16:15.925093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "tag": "8c042ceb-0474-43e0-9d18-f60ab556f200"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:15.951064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:15.951545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:15.957433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:15.983992 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] Creating event network-changed:8c042ceb-0474-43e0-9d18-f60ab556f200 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:16:15.990935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-82b2703c-9d12-4960-9529-34214ec87418 req-e28acb65-d354-4fdb-847a-638f5ffc1810 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078586 Aug 21 01:16:15.992144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1247/2181] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:15.999193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:16.005311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:16.009561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:16.017547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86d15648-09aa-45a2-b60d-1b46bd90ed1f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 1.714659 Aug 21 01:16:16.036491 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 935/2182] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:14 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:16.041604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:16.043634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:16.045304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:16.047313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:16.047795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:16.048215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:16.048662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:16.049710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:16.061584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:16.062076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:16.067069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:16.067894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:16.068529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:16.070067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:16.354970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:16.364979 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d0f482c-199e-4369-956c-11b70dcee9bc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1391 microversion: 2.1 time: 0.371433 Aug 21 01:16:16.367868 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1248/2183] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:15 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1391 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:16.377735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66453ab8-cfef-4ace-8631-78459e95bb6f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9d90b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:16.469023 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66453ab8-cfef-4ace-8631-78459e95bb6f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1447 microversion: 2.1 time: 0.099020 Aug 21 01:16:16.481351 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1249/2184] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:16 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:16.487441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f009218d-1376-43c0-81f4-00e5eca0e5f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '.version_select at 0x7fc3f9d909d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:17.151442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f009218d-1376-43c0-81f4-00e5eca0e5f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/5b6c8f20-9c0d-46a9-b927-da10cc0bc110" status: 200 len: 184 microversion: 2.1 time: 0.667731 Aug 21 01:16:17.152682 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1250/2185] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:16:16 2022] GET /compute/v2.1/os-floating-ips/5b6c8f20-9c0d-46a9-b927-da10cc0bc110 => generated 184 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:17.157604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:17.158550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:17.167701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.168189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.168570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.169518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.170562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.171539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.386244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:17.396743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:17.398691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:17.399923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e34de62-8e04-4afd-b783-a6cef3e874cb tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1550 microversion: 2.25 time: 0.246074 Aug 21 01:16:17.412902 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1251/2186] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:17 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1550 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:17.412902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2af0577-84bd-41c9-9560-b470527ae0df tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4031a1af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:17.446363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:17.448595 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:17.458640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bdf57b13-cf93-47d2-859f-cf193dcf48dc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 1.420850 Aug 21 01:16:17.459577 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 936/2187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:16 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:17.465282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:17.466246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:17.469380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2af0577-84bd-41c9-9560-b470527ae0df tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 200 len: 1447 microversion: 2.1 time: 0.067130 Aug 21 01:16:17.469958 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:17.470987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1252/2188] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:17 2022] GET /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 1447 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:17.477299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Action: 'action', calling method: .version_select at 0x7fc400c66c10>, body: {"removeFloatingIp": {"address": "172.35.1.124"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:17.477841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.478397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.478961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.479708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.480246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.480661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.696738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:17.705603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.706175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.706677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.707452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:17.707980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:17.708871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:17.890230 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:17.919432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:16:17.919829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquired lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:16:18.201168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:18.212264 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fcd4f090-8969-4f84-9f7f-5d0cf9c1e27c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.751211 Aug 21 01:16:18.213483 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 937/2189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:17 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:18.220187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:18.221054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:18.236347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:18.237036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:18.238048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:18.238787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:18.240008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:18.240417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:18.624732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Building network info cache for instance {{(pid=122482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:16:18.790330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:18.808056 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e94b875-11db-4f50-ace1-4d10456d2e43 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1381 microversion: 2.1 time: 0.592757 Aug 21 01:16:18.809832 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 938/2190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:18 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1381 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:18.818415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f50dc8d-ef8e-4fef-b4a0-da25c891ccf9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fd8e8e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.460826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Updating instance_info_cache with network_info: [{"id": "f2705b5b-7c12-46c6-8392-b100046efd4e", "address": "fa:16:3e:8d:6c:a5", "network": {"id": "391fa7c1-09e8-4581-8a97-ce32dc76b623", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-708637502-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "30b2a95273e6417babc48661728340bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf2705b5b-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:16:19.477454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Releasing lock "refresh_cache-ba1ea8ca-9643-4259-b2ca-e3b8e1592508" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:16:19.479343 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-00ae0e5b-f0e7-4a3c-8903-0b80a52293c6 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action" status: 202 len: 0 microversion: 2.1 time: 2.006719 Aug 21 01:16:19.480853 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1253/2191] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:16:17 2022] POST /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508/action => generated 0 bytes in 2009 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:16:19.489314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67065fbe-c43d-408a-923a-5100ad19aec7", "name": "network-vif-deleted", "tag": "fd42da64-950d-468e-9a9c-1b85f72c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:19.501017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.501503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.502121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.518613 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] Creating event network-vif-deleted:fd42da64-950d-468e-9a9c-1b85f72c2526 for instance 67065fbe-c43d-408a-923a-5100ad19aec7 on n-h2-master-1 Aug 21 01:16:19.529714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1a651fea-8b0d-46d1-837d-b3a6bcbaa96c req-e8cb48e3-9ab7-4758-91f4-797211f17fed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047405 Aug 21 01:16:19.533108 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1254/2192] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:19.539441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.540410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:19.548217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.548719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.549233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.549951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.550456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.550882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.553463 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f50dc8d-ef8e-4fef-b4a0-da25c891ccf9 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 204 len: 0 microversion: 2.1 time: 0.742291 Aug 21 01:16:19.554484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 939/2193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:18 2022] DELETE /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:19.563250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.564202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:19.573971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.574473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.575904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.576820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.577590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.578857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.592408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.593119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.593863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.594606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lazy-loading 'fault' on Instance uuid d1fda47c-a559-4695-9f5d-0776c831994e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:19.643630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:19.652983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:19.654595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:19.655973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6eaed47d-8ea8-4ca8-8668-df665beb35d4 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 200 len: 1352 microversion: 2.25 time: 0.121410 Aug 21 01:16:19.656546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1255/2194] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:19 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 1352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:19.661330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:19.671778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.672511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.672984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.685026 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] Creating event network-changed:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:16:19.690960 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-db3a2df9-8c2a-4599-b88a-5828b2d404c4 req-d97287af-bbe8-46d6-a3f8-32b4ec7208f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033117 Aug 21 01:16:19.691762 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1256/2195] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:19.701326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47158ad2-0d16-4a85-b7c6-be96028efecf tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '.version_select at 0x7fc3fa265430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.705891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47158ad2-0d16-4a85-b7c6-be96028efecf tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.706456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47158ad2-0d16-4a85-b7c6-be96028efecf tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.706892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47158ad2-0d16-4a85-b7c6-be96028efecf tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.719383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47158ad2-0d16-4a85-b7c6-be96028efecf tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.026096 Aug 21 01:16:19.720254 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1257/2196] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:16:19 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:19.725560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.727146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:19.734585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.735442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.736034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.736953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.737563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.737980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.874839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:19.883157 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bfff2e7-4e40-4a98-a266-bb6a621cf895 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.161676 Aug 21 01:16:19.883705 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1258/2197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:19 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:19.888664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.889196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:19.898084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.898676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.899105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.899797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.900241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.900651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.915216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] HTTP exception thrown: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Request method failure captured: Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 HTTP/1.1 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYb2KdfCQPGwCo1_Lt4Ai2CgKg38qFRJtcBJQJIrGJdOud5sNDR8dPM6HXTOuKOD731z2lfXsDpbgQh454OUvdyKmJ1PiMfEn1R6aIsKVL5t4HM9NtU7CQ7d0gZiMU64RtELOHO-q6ksFPMelo_VluVdmHNEcwc842WRuGYnBvRjKiE Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30b2a95273e6417babc48661728340bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30b2a95273e6417babc48661728340bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}] Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b3d2e0ca31ba428d9391b4fa5c91bf4e Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '67065fbe-c43d-408a-923a-5100ad19aec7'} Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:19.917069 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Returning 404 to user: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7dc8248c-8e35-45dd-a5dd-9fdd3bf7e4de tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 404 len: 111 microversion: 2.1 time: 0.033809 Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1259/2198] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:19 2022] DELETE /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:19.925654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:19.940355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.941147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.941648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.942420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:19.943027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:19.943534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:19.973522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:20.110948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec6388fe-6768-46e1-8052-7424b4237b68 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 204 len: 0 microversion: 2.1 time: 0.188282 Aug 21 01:16:20.114831 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1260/2199] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:19 2022] DELETE /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:20.150926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:20.152526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:20.159752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.160531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.161009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.161812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.162376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.166520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.221163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:20.238314 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f0229309-2cba-434c-be50-3c3149f81e06 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.682421 Aug 21 01:16:20.239352 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 940/2200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:19 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:20.265494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:20.268676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: 67065fbe-c43d-408a-923a-5100ad19aec7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:20.295284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.296059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.296667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.298944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.300518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.301131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.326180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] HTTP exception thrown: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Request method failure captured: Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 HTTP/1.1 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYb2KdfCQPGwCo1_Lt4Ai2CgKg38qFRJtcBJQJIrGJdOud5sNDR8dPM6HXTOuKOD731z2lfXsDpbgQh454OUvdyKmJ1PiMfEn1R6aIsKVL5t4HM9NtU7CQ7d0gZiMU64RtELOHO-q6ksFPMelo_VluVdmHNEcwc842WRuGYnBvRjKiE Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30b2a95273e6417babc48661728340bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30b2a95273e6417babc48661728340bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}] Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b3d2e0ca31ba428d9391b4fa5c91bf4e Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '67065fbe-c43d-408a-923a-5100ad19aec7'} Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:20.330315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. Aug 21 01:16:20.334419 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:20.336203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Returning 404 to user: Instance 67065fbe-c43d-408a-923a-5100ad19aec7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:20.338142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-484887a6-dfae-451b-94d2-87bb24a7b2da tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7" status: 404 len: 111 microversion: 2.1 time: 0.095905 Aug 21 01:16:20.339183 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 941/2201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:20 2022] GET /compute/v2.1/servers/67065fbe-c43d-408a-923a-5100ad19aec7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:20.345414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-77380370", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ec7abf5-e561-48e7-9db1-bc3c2f1218ae"}], "security_groups": [{"name": "tempest-securitygroup--2027334498"}], "key_name": "tempest-keypair-2061475518", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:20.373586 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d52ea8f0-0b6e-48c3-b0f9-20dfab092cf6 tempest-LiveMigrationTest-301865026 tempest-LiveMigrationTest-301865026-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1532 microversion: 2.1 time: 0.247378 Aug 21 01:16:20.374472 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1261/2202] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:20 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1532 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:20.379262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1647052948", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:20.445456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] validate_networks() for [('70d1bb96-9a7b-4f2a-a0c5-c9e7ba67c524', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:20.505704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] validate_networks() for [('4ec7abf5-e561-48e7-9db1-bc3c2f1218ae', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:20.909396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:20.909943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:20.910274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:20.911999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:20.912869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:20.922787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.923321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.924789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.925884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:20.926657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:20.927508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:20.946749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:20.952101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Getting quotas for user 2a2ecc1a81574d7aa2679307a7985908 and project 985e65b1266f46c196e8a07a9a016210. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:20.976284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:20.980577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:21.057917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80254f23-efb9-4f30-a911-1b767f447270 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682219 Aug 21 01:16:21.058863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1262/2203] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:16:21.063966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80151301-04d2-4fdd-aed2-6c7c70d41d22 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '.version_select at 0x7fc3f9cb5670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:21.579612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:21.580738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:21.581650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:21.582259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:21.583129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:21.596361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.597650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.598449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.600408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.601367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.602505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.627074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:21.634740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:21.650152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:21.652888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:21.710895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c33c3b8f-7f9d-4c79-9210-0a66d053bd38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.369518 Aug 21 01:16:21.713096 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 942/2204] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:16:21.720184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:21.721049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:21.730182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.730922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.731774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.733102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.733892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.734645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.763731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:21.872528 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af1ca8b8-529b-43c8-89d0-05ffce4f251f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 204 len: 0 microversion: 2.1 time: 0.157680 Aug 21 01:16:21.874356 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 943/2205] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:21 2022] DELETE /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:21.882304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:21.883265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: d1fda47c-a559-4695-9f5d-0776c831994e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:21.889734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.890308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.890790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.891550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.892395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.893034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.910050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] HTTP exception thrown: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Request method failure captured: Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e HTTP/1.1 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYV1H2NTuDlkV7NlVhwIT9HoMW5iVYujsrlWERD7dVtoKA3I4DWARz8FwoLm-Z1I0x105H6T5hwL4Gl77BoDwS0KcAGO0kJoT6F07OJ7VqQNWwi6oayObCKOItRtkXBVuH82WSn8OzSYBqA5GoTzPn61FuZdaaQptRqdl2BvOQusbyQ Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.25 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ce70f9ff025c4666be942f9399ae72dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}] Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 547522b0b07f472a91ec83f15a36bb90 Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd1fda47c-a559-4695-9f5d-0776c831994e'} Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. Aug 21 01:16:21.912197 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. Aug 21 01:16:21.916377 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:21.917891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Returning 404 to user: Instance d1fda47c-a559-4695-9f5d-0776c831994e could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:21.919149 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2730f63d-795b-4a20-8849-13cbaca582ae tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e" status: 404 len: 111 microversion: 2.25 time: 0.043400 Aug 21 01:16:21.920033 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 944/2206] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:21 2022] GET /compute/v2.1/servers/d1fda47c-a559-4695-9f5d-0776c831994e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:16:21.926081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:21.926884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:21.935065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.935719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.936589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:21.938222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:21.939334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:21.939899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.115233 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80151301-04d2-4fdd-aed2-6c7c70d41d22 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/5b6c8f20-9c0d-46a9-b927-da10cc0bc110" status: 202 len: 0 microversion: 2.1 time: 1.055200 Aug 21 01:16:22.119596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1263/2207] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:16:21 2022] DELETE /compute/v2.1/os-floating-ips/5b6c8f20-9c0d-46a9-b927-da10cc0bc110 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:16:22.125741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.126622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.135594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.136444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.136940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.137936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.138834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.139884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.251485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:22.263409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74ccaaa2-9308-48e7-9cea-f4a34a8a1065 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1204 microversion: 2.1 time: 0.142562 Aug 21 01:16:22.265164 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1264/2208] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:22.271628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.272462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.279755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.280335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.280692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.282149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.282598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.283017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.334814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:22.344440 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7422462c-ce28-441e-8ece-e2f44d96bc73 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.422925 Aug 21 01:16:22.346029 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 945/2209] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:21 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:22.351725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d93aaa-bbc5-4845-b568-c783ac5d7db8", "name": "network-vif-unplugged", "status": "completed", "tag": "ca3e1fd8-049f-4314-b371-5b74979def42"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:22.363711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.364177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.364594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.381900 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] Creating event network-vif-unplugged:ca3e1fd8-049f-4314-b371-5b74979def42 for instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 on n-h1-master-1 Aug 21 01:16:22.388716 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-38ba4118-fb64-4e7e-aedf-8686d7070f3b req-9f0f4c14-2d6e-43cd-9463-4595f215f05c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040768 Aug 21 01:16:22.389986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 946/2210] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:22.399157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5b7874d-0f48-4bb0-8227-3871eb14612f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.400222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5b7874d-0f48-4bb0-8227-3871eb14612f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.484649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:22.485695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5b7874d-0f48-4bb0-8227-3871eb14612f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:22.494162 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5b7874d-0f48-4bb0-8227-3871eb14612f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1237 microversion: 2.1 time: 0.101958 Aug 21 01:16:22.494817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 947/2211] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:22.501287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.502060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.508956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.509430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.509923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.510770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.511213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.511622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.512365 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99a7349a-bad3-4979-bfe2-48681dc0f3cc tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.245312 Aug 21 01:16:22.513593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1265/2212] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:22.519145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fda47c-a559-4695-9f5d-0776c831994e", "name": "network-vif-deleted", "tag": "b6c935c7-030a-4ece-808c-f233e7f14c4d"}, {"name": "network-changed", "server_uuid": "e542315f-a0cc-4835-8263-a209fc72a7ca", "tag": "9c19a2fc-1f1b-47f8-821e-c2753f6bad7a"}, {"name": "network-changed", "server_uuid": "2af42a19-35cf-4295-8a1c-fb49c6397e3f", "tag": "a644ebe0-1796-413d-ad5a-7abc5a51e968"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:22.534707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.535432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.536329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.555301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Creating event network-vif-deleted:b6c935c7-030a-4ece-808c-f233e7f14c4d for instance d1fda47c-a559-4695-9f5d-0776c831994e on n-h2-master-1 Aug 21 01:16:22.555805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Creating event network-changed:9c19a2fc-1f1b-47f8-821e-c2753f6bad7a for instance e542315f-a0cc-4835-8263-a209fc72a7ca on n-h2-master-1 Aug 21 01:16:22.556300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] Creating event network-changed:a644ebe0-1796-413d-ad5a-7abc5a51e968 for instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f on n-h2-master-1 Aug 21 01:16:22.565573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bed634bc-9522-4bf8-8042-459357f0b5d8 req-977d2397-7117-4c33-abf4-47488a1e2026 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.050245 Aug 21 01:16:22.566192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1266/2213] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:22.571813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.572378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.579741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.580311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.580712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.581579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.582055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.582525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.614552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:22.641113 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:22.712989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c8cd54d-56ab-47a2-8fc7-4a9ed9c402bd tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 204 len: 0 microversion: 2.25 time: 0.145177 Aug 21 01:16:22.713700 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1267/2214] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:16:22 2022] DELETE /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:16:22.720345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.721420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.728109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.729126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.729879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.730927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.731982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.732667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.785047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:22.855362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:22.873880 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f900ac8-9a65-40b8-ae49-fe1e77750271 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1387 microversion: 2.1 time: 0.377795 Aug 21 01:16:22.880555 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 948/2215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1387 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:22.889073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.890010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.898502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.899273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.899865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.900917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.901529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.901955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.928560 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-654874d3-d9e1-4a66-8223-c0a181be1438 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 204 len: 0 microversion: 2.1 time: 0.212568 Aug 21 01:16:22.932103 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1268/2216] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:22 2022] DELETE /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:22.940309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:22.941292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:22.948854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.949395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.950749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:22.951682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:22.952550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:22.953102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.109928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.124972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d54dc00-1760-42f1-80cb-af1752ccb147 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1525 microversion: 2.1 time: 0.190971 Aug 21 01:16:23.136813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1269/2217] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:23.256304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.265177 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.266675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.267810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5280b8b6-428d-4aac-80e5-3d0c0f48beed tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1563 microversion: 2.25 time: 0.383065 Aug 21 01:16:23.268457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 949/2218] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:22 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1563 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:23.290906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:23.291581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:23.298398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.298981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.299477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.300169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.300608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.301050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.366291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:23.366457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.367139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:23.373862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.374609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.374754 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-122cc43a-b9cf-4158-bb39-9321df7ca366 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1266 microversion: 2.1 time: 0.089367 Aug 21 01:16:23.375329 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1270/2219] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:23 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:23.375568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.376366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.377051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.377602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.515697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:23.516323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:23.522802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.523282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.523714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.524409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.524886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.525315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.602409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.614118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-581fbde4-421c-49b8-85d5-1eade90ea876 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1289 microversion: 2.1 time: 0.102280 Aug 21 01:16:23.614667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1271/2220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:23 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:23.633725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:23.634350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:23.641132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.641624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.642058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.642765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.643214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.643637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.780702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.788911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-764fc40e-9d25-49d9-ab57-21fe4136c780 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.160507 Aug 21 01:16:23.789592 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1272/2221] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:23 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:23.895915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:23.896608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:23.905343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.905836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.906369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.906960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:23.907467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:23.907895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:23.912188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:23.922816 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-360a458b-c406-4228-99be-f9c8d745ca20 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.560492 Aug 21 01:16:23.923624 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 950/2222] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:23 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:24.000379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.012332 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6207dd3-8571-4cfc-9155-b6e8243aa344 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1345 microversion: 2.1 time: 0.119918 Aug 21 01:16:24.013374 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1273/2223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:23 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:24.148842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.149815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.156816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.157490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.157955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.158664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.159176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.159735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.293039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.294164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.306254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.308873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.309429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.310400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.313838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.314592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.437454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.454405 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12ff8111-3a03-4a5b-b63a-2b9edaae1fa7 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1525 microversion: 2.1 time: 0.310465 Aug 21 01:16:24.455745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 951/2224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1525 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:24.472300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.473235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.480651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.481524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.482175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.483122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.483938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.484602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.537910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.555522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.557349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.558711 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2222c88e-f64e-4914-950e-27c860c0040f tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1563 microversion: 2.25 time: 0.270759 Aug 21 01:16:24.559437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1274/2225] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1563 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:24.597977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d93aaa-bbc5-4845-b568-c783ac5d7db8", "name": "network-vif-deleted", "tag": "ca3e1fd8-049f-4314-b371-5b74979def42"}, {"server_uuid": "d64161bf-6b32-4616-b029-f7d2d76ad8a6", "name": "network-vif-deleted", "tag": "dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:24.607166 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:24.610307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.610961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.611525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.633394 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Creating event network-vif-deleted:ca3e1fd8-049f-4314-b371-5b74979def42 for instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 on n-h1-master-1 Aug 21 01:16:24.633903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] Creating event network-vif-deleted:dde9cdf8-8eb0-42c6-bd8a-0d0e128b2aee for instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 on n-h1-master-1 Aug 21 01:16:24.640275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4c684126-a2b2-4844-9e90-58599a17cc80 req-5a0a7e27-37ca-4470-96c5-2d713b0e5057 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045929 Aug 21 01:16:24.641116 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1275/2226] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:16:24.646386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.647526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.661356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.662204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.662810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.664651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.665299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.665900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.678386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.686859 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5ff2327-b68c-4d77-b23a-7cf0af550591 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1266 microversion: 2.1 time: 0.229836 Aug 21 01:16:24.690147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 952/2227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:24.799161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:24.815963 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b02399c0-3f14-4dec-ac41-00958131cf37 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1297 microversion: 2.1 time: 0.173414 Aug 21 01:16:24.822744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.823849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.833571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.834359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.835184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.836120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.836470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1276/2228] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1297 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:24.842305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.843563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.943846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:24.945158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:24.954557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.955043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.955473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:24.956613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:24.956818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:24.957216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.110244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:25.119111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-787c874f-6a76-4dcc-9b21-d0e09b534a8d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.179369 Aug 21 01:16:25.131106 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1277/2229] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:25.131106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:25.131106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:25.139611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.140717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.141292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.143109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.143109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.143109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.218598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:25.229239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f47b4be9-d83d-4402-928e-44ad3e6fc641 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1183 microversion: 2.1 time: 0.106669 Aug 21 01:16:25.230128 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1278/2230] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:25 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:25.348563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:25.356983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1beec28d-6557-48a5-abda-0fbf143afe88 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.546561 Aug 21 01:16:25.371034 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 953/2231] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:24 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:25.477037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:25.477908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:25.486295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.487890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.488412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.489610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.490147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.490642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.586656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:25.588199 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:25.598711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.599632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.600305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.602376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.603012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.603747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.669748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:25.678833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-231efc36-1d25-4f64-b9db-b4946fb75c3d tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1525 microversion: 2.1 time: 0.206387 Aug 21 01:16:25.689885 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1279/2232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:25 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1525 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:25.710045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:25.711145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:25.718462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.718962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.719526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.720324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.720961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.721479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.877587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:25.889156 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-564fb3fe-868b-4f40-a398-21ed647ba866 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.182944 Aug 21 01:16:25.890284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1280/2233] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:25 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:25.895586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:25.896194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:25.913663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.914700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.915287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:25.916807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:25.917482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:25.918045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.008851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.022923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c135be11-557a-4def-bc59-3958c0e46227 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1295 microversion: 2.1 time: 0.131682 Aug 21 01:16:26.023910 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1281/2234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:25 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:26.087127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.096958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.098660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.100173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff6d15df-d399-460d-b0e0-4497860ed047 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1563 microversion: 2.25 time: 0.519378 Aug 21 01:16:26.100892 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 954/2235] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:25 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1563 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:16:26.171991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:26.178065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:26.201755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.209090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.213257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.214339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.215013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.215891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.253594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:26.254426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:26.265047 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:26.267805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.269205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.269647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.270907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.271616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.272541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.479569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.496866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9feb3856-db94-4463-ae93-7a7212b1e4cd tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1183 microversion: 2.1 time: 0.244623 Aug 21 01:16:26.501376 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 955/2236] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:26 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:26.516928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:26.517790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:26.537006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.538042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.538630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.541266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.541911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.544895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.549432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.588510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72b5d949-1e36-4499-bf0a-f9e15b5632ec tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.435430 Aug 21 01:16:26.591761 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1282/2237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:26 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:26.595791 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:26.680511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ea8ca-9643-4259-b2ca-e3b8e1592508", "name": "network-vif-deleted", "tag": "f2705b5b-7c12-46c6-8392-b100046efd4e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:26.709307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.721024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.726571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.758016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] Creating event network-vif-deleted:f2705b5b-7c12-46c6-8392-b100046efd4e for instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 on n-h1-master-1 Aug 21 01:16:26.768603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-abacf6b6-f5ca-4289-8f01-0a5e86ad8585 req-e44bbb9a-7543-45cc-8d9a-cfbbd2c648d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093976 Aug 21 01:16:26.773575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1283/2238] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:26.790080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:26.790884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:26.812386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.813414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.817510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.819197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.825080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.825532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.905830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:26.905830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:26.906767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:26.909976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lazy-loading 'fault' on Instance uuid ba1ea8ca-9643-4259-b2ca-e3b8e1592508 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:26.964867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3d2e0ca31ba428d9391b4fa5c91bf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b2a95273e6417babc48661728340bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:26.975389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-473c5d17-5e49-49a5-af3d-8a982d5e99f8 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 200 len: 1314 microversion: 2.1 time: 0.200207 Aug 21 01:16:26.986727 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1284/2239] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:26 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:26.995768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:26.996544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:27.008338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.008988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.010113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.011425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.011603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.012248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.206038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:27.216745 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f195623-3916-40c0-bb59-19cef90e9f13 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.238330 Aug 21 01:16:27.217528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1285/2240] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:26 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:27.224836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:27.227125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:27.238434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.239529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.240153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.241352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.242629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.243203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.265671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:27.280740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c04a3ef9-f109-4a57-9abb-191bfea3c5d2 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.777029 Aug 21 01:16:27.282809 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 956/2241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:26 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:27.289987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:27.290826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:27.306177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.307521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.308304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.310800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.311805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.312554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.457617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:27.468039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5643077c-84ba-4f20-8f53-a1bec8a43fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.247871 Aug 21 01:16:27.468898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1286/2242] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:27 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:27.532519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:27.533465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:27.544302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.546682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.547287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.548483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.549103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.551293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.667975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:27.680999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e955fbda-420f-4a15-b635-8648ef938ddc tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1183 microversion: 2.1 time: 0.159337 Aug 21 01:16:27.682324 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1287/2243] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:27 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:27.687517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:27.688259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:27.700123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.700708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.701276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.702081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:27.702611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:27.703035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:27.876859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:27.885803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab97b071-6545-45ae-813d-c506c5c476b5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.202117 Aug 21 01:16:27.886891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1288/2244] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:27 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:27.999927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:28.000554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] [instance: ba1ea8ca-9643-4259-b2ca-e3b8e1592508] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:28.007830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.008305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.008726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.009612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.010054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.010465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.038102 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] HTTP exception thrown: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Request method failure captured: Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 HTTP/1.1 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYb2KdfCQPGwCo1_Lt4Ai2CgKg38qFRJtcBJQJIrGJdOud5sNDR8dPM6HXTOuKOD731z2lfXsDpbgQh454OUvdyKmJ1PiMfEn1R6aIsKVL5t4HM9NtU7CQ7d0gZiMU64RtELOHO-q6ksFPMelo_VluVdmHNEcwc842WRuGYnBvRjKiE Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30b2a95273e6417babc48661728340bf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30b2a95273e6417babc48661728340bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30b2a95273e6417babc48661728340bf"}]}] Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 30b2a95273e6417babc48661728340bf Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1953518361 Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b3d2e0ca31ba428d9391b4fa5c91bf4e Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1953518361-project Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ba1ea8ca-9643-4259-b2ca-e3b8e1592508'} Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:28.039808 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] Returning 404 to user: Instance ba1ea8ca-9643-4259-b2ca-e3b8e1592508 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:28.044078 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3cc08ee-f10d-4a18-b148-f6fb47966dc0 tempest-FloatingIPsAssociationTestJSON-1953518361 tempest-FloatingIPsAssociationTestJSON-1953518361-project] 10.222.0.46 "GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508" status: 404 len: 111 microversion: 2.1 time: 0.045861 Aug 21 01:16:28.045538 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1289/2245] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:27 2022] GET /compute/v2.1/servers/ba1ea8ca-9643-4259-b2ca-e3b8e1592508 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:16:28.246233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:28.248431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:28.255115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:28.272437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:28.273711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.275745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.277707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:28.278461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.279437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.282070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.283147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.284303 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dbc67860-2d12-4963-b095-c853dfecdb82 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1563 microversion: 2.25 time: 0.997328 Aug 21 01:16:28.287541 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 957/2246] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:27 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1563 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:28.314141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:28.314141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:28.344790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.345746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.346293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.347122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.348742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.349620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.678290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:28.690355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1cc66765-5b3e-4ffc-be5b-a3ada4bbbb9a tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.445951 Aug 21 01:16:28.691552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1290/2247] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:28 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:28.698595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:28.699414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:28.711758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.714539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.714987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.715707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:28.716160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:28.716581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:28.962397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:28.973474 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebc3b21c-3058-4a46-8b56-03e4251e90e7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.673666 Aug 21 01:16:28.974069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 958/2248] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:28 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:28.996222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.001905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:29.002535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:29.008698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.009216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.009655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.010357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.010810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.011229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.011660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e678acf9-e29f-41dd-8f3c-4b639328efe7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.318290 Aug 21 01:16:29.017954 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1291/2249] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:28 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:29.023898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317b285b-b9f0-48ac-803e-c3f1072a9f65", "tag": "992713aa-67fb-4d1e-9e9a-22e6be7f12b0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:29.052736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.054024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.054678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.075598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] Creating event network-changed:992713aa-67fb-4d1e-9e9a-22e6be7f12b0 for instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 on n-h1-master-1 Aug 21 01:16:29.086599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bdfeb23d-98f3-4daa-be20-c6d249720d47 req-1adc3146-1850-4013-b988-c81e414d317f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066306 Aug 21 01:16:29.087670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1292/2250] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:29.096168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:29.099603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:29.109225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.111130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.112532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.114817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.116013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.117869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.297209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.309784 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fabdadde-cf47-4dbe-bb8c-ade7c94bddfb tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 200 len: 1183 microversion: 2.1 time: 0.323786 Aug 21 01:16:29.310699 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 959/2251] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:28 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 1183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:29.320904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:29.321492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:29.338079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.338601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.339002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.339718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.340162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.340586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.553510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.554519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.564978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.566391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08bf43b9-c917-454a-8b23-f3d1926d11d6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.477090 Aug 21 01:16:29.568555 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1293/2252] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:29 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:29.571079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:29.572281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8c6d083-fefa-4fc6-a1f0-70c2df1efb80 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1521 microversion: 2.25 time: 0.260523 Aug 21 01:16:29.572856 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 960/2253] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:29 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:29.586607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e542315f-a0cc-4835-8263-a209fc72a7ca", "name": "network-vif-plugged", "status": "completed", "tag": "9c19a2fc-1f1b-47f8-821e-c2753f6bad7a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:29.606306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.607053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.607623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.625879 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] Creating event network-vif-plugged:9c19a2fc-1f1b-47f8-821e-c2753f6bad7a for instance e542315f-a0cc-4835-8263-a209fc72a7ca on n-h2-master-1 Aug 21 01:16:29.633564 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1bbff34c-ebc7-4f94-90c6-fbe1de61e981 req-1959e96c-f29c-4d12-ab04-583c70a8dcd1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063374 Aug 21 01:16:29.639330 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1294/2254] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:29.714847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:29.715462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:29.728706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.729502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.730086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.730942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:29.731544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:29.732283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:29.999675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:30.001603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:30.020345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.021189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.022339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.029319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.029940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.030523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.311719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:30.329161 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25d10e42-afda-4e72-bd52-fcff396c6312 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.333892 Aug 21 01:16:30.330185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1295/2255] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:29 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:30.342777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:30.344910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:30.352226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.352837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.353286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.354008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.354537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.354970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.527176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:30.537659 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11f28e52-50e7-4907-98b9-838c622be067 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.827124 Aug 21 01:16:30.539908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 961/2256] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:29 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:30.552641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:30.555814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: d64161bf-6b32-4616-b029-f7d2d76ad8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:30.574098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.577279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.578353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.579577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.582351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.584596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.603826 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] HTTP exception thrown: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Request method failure captured: Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 HTTP/1.1 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWxRyyweAe7oTRFiLtL8XlBadWND0qzzkMT4DncSIMs0SwC7dD1EPeQXJScI_O7mAluz0ic2FzaeW7J8wWrwvIl1awfMVWiusxuWTMMlhCY0WAxCwvza-vpIGg4xU33eTjyC_0nSsjl_TIP8RJvwbOZYYvfjvqRjX1uAemqtWKk90s Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6073ae2e8036492faa2a4f7a26489134", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}] Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-LiveMigrationTest-34772514 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b0bd3eeeb578465a8f5e5eaa3b3fdc85 Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd64161bf-6b32-4616-b029-f7d2d76ad8a6'} Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:30.605779 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. Aug 21 01:16:30.609641 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:30.611745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Returning 404 to user: Instance d64161bf-6b32-4616-b029-f7d2d76ad8a6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:30.613808 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-77b9ac61-638c-4fa8-a476-79f0ac0f4090 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6" status: 404 len: 111 microversion: 2.1 time: 0.070634 Aug 21 01:16:30.614398 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 962/2257] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:30 2022] GET /compute/v2.1/servers/d64161bf-6b32-4616-b029-f7d2d76ad8a6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:30.619826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:30.620020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:30.631244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.632040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.632630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.633832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.634598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.635586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.728943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:30.776249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9a99957-2ede-4e9a-b9d6-20689eb32768 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.440763 Aug 21 01:16:30.779913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1296/2258] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:30 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:30.793744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:30.796164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:30.813892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.813892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.814298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.814735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.816428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.817061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.857613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:30.858329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:30.860056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:30.860909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lazy-loading 'fault' on Instance uuid 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:30.936717 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:30.946818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:30.955102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6912e4f5-73b4-4767-97fa-956c1d242af0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.339604 Aug 21 01:16:30.955604 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 963/2259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:30 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:30.964050 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:30.986593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:30.995492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:31.000666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '547522b0b07f472a91ec83f15a36bb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce70f9ff025c4666be942f9399ae72dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:31.003972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69f40f29-6c68-48c8-b05a-d9b44bdd73b2 tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 200 len: 1351 microversion: 2.25 time: 0.222568 Aug 21 01:16:31.006343 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1297/2260] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:30 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 1351 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:31.154251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfe02f3-fc88-49b2-b376-6d362bdc1b4c", "name": "network-vif-deleted", "tag": "59e99352-1bdf-4d06-9a88-cd5f4b0ba642"}, {"name": "network-changed", "server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:31.179775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.180441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.181029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.199421 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Creating event network-vif-deleted:59e99352-1bdf-4d06-9a88-cd5f4b0ba642 for instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c on n-h2-master-1 Aug 21 01:16:31.200731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] Creating event network-changed:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:16:31.212656 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9868cb69-64fe-47a3-b807-b60f1806dad1 req-5226e50d-08ea-47f0-8edd-37e29104ce90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061668 Aug 21 01:16:31.213836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 964/2261] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:31.357207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:31.358110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:31.376397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.377491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.379596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.380553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.381310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.383011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.562238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:31.563837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:31.578660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.579537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.580208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.583804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.584585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.587487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.657372 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:31.819085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:31.828574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4dfca30-1af6-464e-9fa2-b4832160aeeb tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.479006 Aug 21 01:16:31.836179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1298/2262] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:31 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:31.858699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:31.859505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:31.874924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.882905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.885240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:31.892953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:31.897460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:31.898137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.191786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:32.204588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8985a4a9-de40-4cc3-af40-ff4fee13b6a0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.646721 Aug 21 01:16:32.208001 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 965/2263] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:31 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:32.223067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:32.225357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:32.245670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.248390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.249288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.251556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.252261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.252944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.490587 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:32.622389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:32.640101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd85ab24-451b-4b17-a883-e8fb076ad0ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.800442 Aug 21 01:16:32.641014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1299/2264] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:31 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:32.658469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:32.661251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] [instance: 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:32.677013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.678720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.679944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.682453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.683082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.684932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.731307 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] HTTP exception thrown: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Request method failure captured: Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c HTTP/1.1 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYV1H2NTuDlkV7NlVhwIT9HoMW5iVYujsrlWERD7dVtoKA3I4DWARz8FwoLm-Z1I0x105H6T5hwL4Gl77BoDwS0KcAGO0kJoT6F07OJ7VqQNWwi6oayObCKOItRtkXBVuH82WSn8OzSYBqA5GoTzPn61FuZdaaQptRqdl2BvOQusbyQ Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.25 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ce70f9ff025c4666be942f9399ae72dc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ce70f9ff025c4666be942f9399ae72dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ce70f9ff025c4666be942f9399ae72dc"}]}] Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ce70f9ff025c4666be942f9399ae72dc Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 547522b0b07f472a91ec83f15a36bb90 Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1576809236-project Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2cfe02f3-fc88-49b2-b376-6d362bdc1b4c'} Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. Aug 21 01:16:32.738890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] Returning 404 to user: Instance 2cfe02f3-fc88-49b2-b376-6d362bdc1b4c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eaed25b0-e2d8-4cf3-83a7-d5ff6462815e tempest-LiveAutoBlockMigrationV225Test-1576809236 tempest-LiveAutoBlockMigrationV225Test-1576809236-project] 10.222.0.46 "GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c" status: 404 len: 111 microversion: 2.25 time: 0.095742 Aug 21 01:16:32.743109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1300/2265] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:32 2022] GET /compute/v2.1/servers/2cfe02f3-fc88-49b2-b376-6d362bdc1b4c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:16:32.751948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af42a19-35cf-4295-8a1c-fb49c6397e3f", "name": "network-vif-plugged", "status": "completed", "tag": "a644ebe0-1796-413d-ad5a-7abc5a51e968"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:32.782467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.786064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.786926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.818630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] Creating event network-vif-plugged:a644ebe0-1796-413d-ad5a-7abc5a51e968 for instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f on n-h2-master-1 Aug 21 01:16:32.828372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8d47ac7f-3970-4ed2-9c84-ab1adb34b395 req-474b23a6-5af9-4168-9e16-29745644cfef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084421 Aug 21 01:16:32.830457 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1301/2266] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:32.843842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:32.859714 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c98b48d4-499b-4f63-aa6d-ba5f0d32e7fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1314 microversion: 2.1 time: 0.644589 Aug 21 01:16:32.860407 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 966/2267] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:32 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:32.870565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:32.870565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:32.870565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.870565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.870565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.871220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:32.871922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:32.872557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:32.945385 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:33.233248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:33.234571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:33.244596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:33.246750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:33.247388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:33.249209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:33.252013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:33.252755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:33.336551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:33.345598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bc7e315-fa0a-419c-bf11-4067a0c9a5f3 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.489593 Aug 21 01:16:33.357838 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1302/2268] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:32 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:33.666288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:33.667592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:33.680992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:33.685620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:33.686408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:33.687302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:33.689295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:33.692303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.193480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:34.209741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b7442c0-28ed-42d3-84a1-413422c232f4 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.981663 Aug 21 01:16:34.225674 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 967/2269] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:33 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:34.231464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:34.232346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:34.244308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.245210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.246096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.247044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.248437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.249260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.466464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:34.478123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16e59124-6a3e-4a37-a815-84e53a55a5bf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.818377 Aug 21 01:16:34.481236 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1303/2270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:33 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:34.486782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:34.491932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:34.506825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.507483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.510826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.512048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.513906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.516797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.796405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:34.819339 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-41261189-f924-44fe-93d2-ba4b2dc85db6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1501 microversion: 2.1 time: 0.591403 Aug 21 01:16:34.822266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 968/2271] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:34 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1501 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:34.842931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:34.859575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:34.895417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.902191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.902890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.906074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:34.906741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:34.907732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:34.977553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lazy-loading 'flavor' on Instance uuid e542315f-a0cc-4835-8263-a209fc72a7ca {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:35.037219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:35.049476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5006f487-ce0c-43a8-bd7c-635e78e41da1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1316 microversion: 2.1 time: 0.567032 Aug 21 01:16:35.052367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1304/2272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:34 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:35.189501 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3f00c971-23f0-4eca-83d1-836bea8dd065 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "POST /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca/action" status: 200 len: 32 microversion: 2.1 time: 0.350588 Aug 21 01:16:35.190581 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 969/2273] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:16:34 2022] POST /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:16:35.200255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:35.201305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:35.216369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.219492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.220243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.222190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.224010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.225384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.237870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:35.238560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:35.251872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.252362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.252815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.253554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.253993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.254406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.509131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:35.533272 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df0745ea-b1f0-4366-9ad2-bc22a59cbbcd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.333102 Aug 21 01:16:35.538447 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1305/2274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:35 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:35.552988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:35.555194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:35.595898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.597218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.598643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.600590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.601333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.602013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.728481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:35.748742 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-366ad50d-cc15-4c10-b09c-dd8cfa62f069 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.514939 Aug 21 01:16:35.763362 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 970/2275] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:35 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:35.822041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317b285b-b9f0-48ac-803e-c3f1072a9f65", "name": "network-vif-plugged", "status": "completed", "tag": "992713aa-67fb-4d1e-9e9a-22e6be7f12b0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:35.850740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:35.851194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:35.852114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:35.981942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:35.997138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b15654c1-d5ee-490b-884e-6740f17d4376 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.454971 Aug 21 01:16:35.997998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1306/2276] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:35 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:36.072498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.073269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.084741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.086365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.086876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.091022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.091710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.092202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.258703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] Creating event network-vif-plugged:992713aa-67fb-4d1e-9e9a-22e6be7f12b0 for instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 on n-h1-master-1 Aug 21 01:16:36.267117 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2f17de68-8dde-40f4-852c-c786f12c0ae5 req-479bbc9a-9953-4061-9cd4-118ac87a0c8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449568 Aug 21 01:16:36.271279 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 971/2277] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:36.298120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.301616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.331591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.332676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.333528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.335101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.337676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.338488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.410590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:36.442165 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:36.500457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:36.509912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6949670-5ad8-4cd8-84df-69a7efb2cfc5 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1504 microversion: 2.1 time: 0.442121 Aug 21 01:16:36.512559 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1307/2278] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:36 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:36.532533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.533612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.540912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.541609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.542224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.543776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.544429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.545125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.616061 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c799e7f4-781b-4b25-a10b-22978916e781 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 204 len: 0 microversion: 2.1 time: 0.324561 Aug 21 01:16:36.624588 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 972/2279] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:36 2022] DELETE /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:36.650992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.651698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.653728 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:36.668643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.669161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.669595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.670306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.670789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.671337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.706573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e708c4d-a7f4-4a7a-8e3f-a4816b29f790 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.177931 Aug 21 01:16:36.713401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1308/2280] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:16:36 2022] DELETE /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f/os-server-password => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:16:36.725795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.726584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.736360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.737321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.738040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.739835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.740796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.741508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.934436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:36.945079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7c68e62-4c4f-468e-b623-fbb402451729 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1668 microversion: 2.1 time: 0.229150 Aug 21 01:16:36.957553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1309/2281] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:36 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1668 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:36.964869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:36.967936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:36.968639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:36.976597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.978445 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b3ccbf6-b12e-4d3d-ade2-e0eb1354edfd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.349060 Aug 21 01:16:36.978655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.980017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.980968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:36.981592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:36.982157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:36.996600 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 973/2282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:36 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:37.002293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:37.002886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:37.010756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9135ab10-81d2-42a6-a812-9dac96deafa1 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051762 Aug 21 01:16:37.011581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1310/2283] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:16:36 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f/os-server-password => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:16:37.024316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:37.025309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:37.026099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.026586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.027436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.028146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.028748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.029334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.034025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.034650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.035088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.035861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.036402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.037283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.192185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:37.201138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0392645f-0295-4a05-af8e-81eb18bc8701 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.180702 Aug 21 01:16:37.202070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1311/2284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:37 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:37.217692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:37.218412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:37.225122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.225607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.226042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.226753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.227275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.227699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.257472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:37.347596 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b062c58-b22d-4922-8a1d-f0b2edde8d09 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 204 len: 0 microversion: 2.1 time: 0.144048 Aug 21 01:16:37.348520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1312/2285] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:37 2022] DELETE /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:37.357879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:37.358562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:37.366631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.367102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.367765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.368524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.369046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.369535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.378923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:37.393069 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c14e3152-22ce-4f91-9c53-95f15433d78d tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1308 microversion: 2.1 time: 0.395025 Aug 21 01:16:37.394104 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 974/2286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:36 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:37.527699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:37.542561 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0046cd76-9eb6-4d2c-aec9-1e6cd7cb88b7 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1510 microversion: 2.1 time: 0.189600 Aug 21 01:16:37.555935 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1313/2287] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:37 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:37.972183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:37.972906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:37.986857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:37.997298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:37.997793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:37.998666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.000029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.000311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.006271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:38.007096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:38.016934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.018352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.018943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.019846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.020636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.021065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.272651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:38.282069 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-038275f6-7f2c-4f6d-88a1-fc582ba3f5bd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.281950 Aug 21 01:16:38.283185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1314/2288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:37 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:38.288301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:38.288720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:38.296102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.296601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.297069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.297929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.298472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.298954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.526451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:38.540923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43c2bfc3-dff5-44ee-9f96-ffd31ad7f2f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.256534 Aug 21 01:16:38.555947 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1315/2289] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:38 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:38.574719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:38.575659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:38.586580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.586580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.586580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.587054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.587743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.588352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.612740 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:38.748138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:38.767598 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-75d5281a-bc46-4a17-abd4-68424693008d tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1668 microversion: 2.1 time: 0.800226 Aug 21 01:16:38.768212 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 975/2290] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:37 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1668 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:38.773066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:38.777557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:38.788851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.789440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.789882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.790704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:38.791633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:38.792079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:38.950842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:38.961936 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28402f4c-806d-427a-8f39-b0f48e98ec49 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1487 microversion: 2.1 time: 0.396849 Aug 21 01:16:38.979931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1316/2291] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:38 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1487 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:39.002397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1444742256"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:39.009867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:39.024143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.025074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.025562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.026676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.029293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.030627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.125486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:39.164502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef53b369-8565-4e0e-9f3a-17bc56c0c4ab tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1510 microversion: 2.1 time: 0.394897 Aug 21 01:16:39.165164 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 976/2292] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:38 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:39.304141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:39.304682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:39.324754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.325359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.325883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.326706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.327284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.327845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.341609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84b11276-3407-44c0-9ea0-96420fabfef3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "POST /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65/action" status: 202 len: 0 microversion: 2.1 time: 0.359752 Aug 21 01:16:39.347778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1317/2293] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:16:38 2022] POST /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:16:39.359923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2747ca7b-64a7-44fd-8db9-2009bffdc973 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9b719d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:39.425537 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2747ca7b-64a7-44fd-8db9-2009bffdc973 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674" status: 200 len: 1412 microversion: 2.1 time: 0.075902 Aug 21 01:16:39.426796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1318/2294] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:39 2022] GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:39.444081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-baa957be-ee6a-4950-b825-c747656c1c4c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9dcc820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:39.512908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-baa957be-ee6a-4950-b825-c747656c1c4c tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674" status: 200 len: 1412 microversion: 2.1 time: 0.075563 Aug 21 01:16:39.514080 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1319/2295] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:39 2022] GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:39.540733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36dccce8-5ca4-4ce2-b3c8-62a9e9e70f40 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9ee3430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:39.908283 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36dccce8-5ca4-4ce2-b3c8-62a9e9e70f40 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674" status: 204 len: 0 microversion: 2.1 time: 0.379591 Aug 21 01:16:39.909471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1320/2296] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:39 2022] DELETE /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:39.922475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:39.923489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:39.936444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.938017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.939133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.940525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:39.941363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:39.942283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:39.963232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:40.000461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c26414a3-b47a-4a85-9e2d-7af2c86e3991 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.694956 Aug 21 01:16:40.001721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 977/2297] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:39 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:40.023402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:40.024011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:40.047213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.047729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.048171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:40.049495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.052722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.054769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:40.506795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:40.526230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4784b3ee-e0e5-45d6-98e8-e4b1699964e8 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 200 len: 1600 microversion: 2.1 time: 0.520245 Aug 21 01:16:40.526800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 978/2298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:40 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 1600 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:40.542602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d42567b-adcb-47dd-accc-8d25920c6776 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fdaedb80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:40.575282 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7d42567b-adcb-47dd-accc-8d25920c6776 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Image not found. Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d42567b-adcb-47dd-accc-8d25920c6776 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 HTTP/1.1 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e52c88b8-bca8-443c-99e0-84d034afd674'} Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e52c88b8-bca8-443c-99e0-84d034afd674 Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:16:40.578250 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e52c88b8-bca8-443c-99e0-84d034afd674 could not be found. Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:16:40.584290 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:40.592424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d42567b-adcb-47dd-accc-8d25920c6776 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:40.593636 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d42567b-adcb-47dd-accc-8d25920c6776 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674" status: 404 len: 62 microversion: 2.1 time: 0.065565 Aug 21 01:16:40.594781 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 979/2299] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:16:40 2022] GET /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:16:40.598184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:40.606193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:40.606817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:40.613611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53d6bc90-4faa-4dbe-855d-6460b69569b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.697857 Aug 21 01:16:40.614990 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1321/2300] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:39 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:40.620665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:40.621295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:40.633349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.633926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.634412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:40.635111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.635595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.635954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:40.637704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.638420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.639373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:40.640733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:40.641316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:40.641863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.069371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:41.080066 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-143d359b-9bd4-4e3f-a650-81c16805cbd0 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1505 microversion: 2.1 time: 0.463853 Aug 21 01:16:41.087614 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1322/2301] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:40 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:41.099162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-plugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:41.114864 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:41.127273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.129359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.130079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.169221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] Creating event network-vif-plugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:16:41.179413 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d40e66d0-0d3a-4fa4-bb12-84b19dc2fc37 req-96f08a7d-7902-42e0-a8e2-a9c6c4afd580 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089671 Aug 21 01:16:41.182582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1323/2302] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:41.195577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:41.197602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39804aef-6cc7-4646-b04c-68554a76c011", "name": "network-vif-deleted", "tag": "55ba18c6-789b-4a24-ace3-77312116e258"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:41.206938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cce00f51-57c1-4030-9e5a-2f77b0dc1a04 tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1510 microversion: 2.1 time: 0.610629 Aug 21 01:16:41.209753 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 980/2303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:40 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:41.219869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:41.222028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.222526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.222958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.223227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:41.239899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.240398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.240911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.241658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.242149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.242644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.272911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] Creating event network-vif-deleted:55ba18c6-789b-4a24-ace3-77312116e258 for instance 39804aef-6cc7-4646-b04c-68554a76c011 on n-h1-master-1 Aug 21 01:16:41.288807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4ecd6c9b-8c0e-40ea-91c7-c86d21423c40 req-b5d09a8b-9b85-4af7-8f36-3817c3d63aaa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104409 Aug 21 01:16:41.291982 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1324/2304] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:41.554696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:41.555632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: 39804aef-6cc7-4646-b04c-68554a76c011] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:41.585033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.585837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.586895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.587326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.587813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.588390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.625181 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] HTTP exception thrown: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Request method failure captured: Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 HTTP/1.1 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWxRyyweAe7oTRFiLtL8XlBadWND0qzzkMT4DncSIMs0SwC7dD1EPeQXJScI_O7mAluz0ic2FzaeW7J8wWrwvIl1awfMVWiusxuWTMMlhCY0WAxCwvza-vpIGg4xU33eTjyC_0nSsjl_TIP8RJvwbOZYYvfjvqRjX1uAemqtWKk90s Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6073ae2e8036492faa2a4f7a26489134", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}] Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveMigrationTest-34772514 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b0bd3eeeb578465a8f5e5eaa3b3fdc85 Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '39804aef-6cc7-4646-b04c-68554a76c011'} Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:41.627079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Returning 404 to user: Instance 39804aef-6cc7-4646-b04c-68554a76c011 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d95390e-32ab-4cb4-9ac8-0d59fdb88ea7 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011" status: 404 len: 111 microversion: 2.1 time: 0.080694 Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1325/2305] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:41 2022] GET /compute/v2.1/servers/39804aef-6cc7-4646-b04c-68554a76c011 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:41.637139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:41.640869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:41.647564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.648544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.649321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.650249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:41.650786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:41.651584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:41.972173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:42.013538 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be1f9f23-64c4-4d98-a792-dfa1fbef2a97 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.801119 Aug 21 01:16:42.015791 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 981/2306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:41 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:42.035479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-375e63fa-75dd-451e-9f98-7ddb8aa6471f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '.version_select at 0x7fc3fd9bea60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:42.058979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:42.070241 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3165c0f-4ae7-4699-b269-c83ab56d6af8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.438069 Aug 21 01:16:42.088782 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1326/2307] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:41 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:42.100272 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-375e63fa-75dd-451e-9f98-7ddb8aa6471f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098711560" status: 202 len: 0 microversion: 2.1 time: 0.079659 Aug 21 01:16:42.103668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 982/2308] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:16:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098711560 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:16:42.134501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:42.136698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:42.161990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:42.164315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:42.165078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:42.167482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:42.172101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:42.175483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:42.237545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:42.239446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:42.254126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:42.254635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:42.255063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:42.255795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:42.260935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:42.261404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:42.358175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:42.359676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:42.360329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:42.361064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lazy-loading 'fault' on Instance uuid 2af42a19-35cf-4295-8a1c-fb49c6397e3f {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:42.480007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7913dc06b5764a5f88399c5a9407feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa16ca726eda42c2ab2983a6b22e73c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:42.502029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f986f977-da9c-4894-bca4-170ba865fc0c tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 200 len: 1306 microversion: 2.1 time: 0.272267 Aug 21 01:16:42.504472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 983/2309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:42 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 1306 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:42.638628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:42.652190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9f96f47-6cda-44b2-bab6-22bd9e1b7079 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1505 microversion: 2.1 time: 0.542560 Aug 21 01:16:42.652700 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1327/2310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:42 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:43.035412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:43.036023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:43.053421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.055072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.057771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.058701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.059369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.060540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.095362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:43.096228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:43.109637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.110451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.111619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.117812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.118674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.120151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.351148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:43.362504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cdd701eb-1837-4e0e-86de-9a35402b3c89 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.330849 Aug 21 01:16:43.376955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 984/2311] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:43 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:43.435407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af42a19-35cf-4295-8a1c-fb49c6397e3f", "name": "network-vif-deleted", "tag": "a644ebe0-1796-413d-ad5a-7abc5a51e968"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:43.452674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.453678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.454398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.475728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] Creating event network-vif-deleted:a644ebe0-1796-413d-ad5a-7abc5a51e968 for instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f on n-h2-master-1 Aug 21 01:16:43.481939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-212b68c1-eb2e-4bae-884e-e561050c2dd0 req-9bbd4df2-fa01-4aa9-939e-a33b72e33a05 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061977 Aug 21 01:16:43.483484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 985/2312] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:43.536099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:43.538044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] [instance: 2af42a19-35cf-4295-8a1c-fb49c6397e3f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:43.552612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.553541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.554293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.556094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.556743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.557431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.579773 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] HTTP exception thrown: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Request method failure captured: Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f HTTP/1.1 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdQ4XHqudunZfGJaxNWVnpyMXW_BSuH-CosSLNBvY02u1eeFHHS5_dXGQoLc3TXQwnSw9V9KtQ4CzIXZed393HqlHT_P8nWuZtyVPeWbot1r0CZAwSLN6c5EzPWLJT1ERdu4A4XBDaFb1zz3Znp-0lJKHSm9qgqdoPArvmrbF667q4 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: aa16ca726eda42c2ab2983a6b22e73c1 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerPasswordTestJSON-288247706 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa16ca726eda42c2ab2983a6b22e73c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_aa16ca726eda42c2ab2983a6b22e73c1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/aa16ca726eda42c2ab2983a6b22e73c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/aa16ca726eda42c2ab2983a6b22e73c1"}]}] Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerPasswordTestJSON-288247706 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: aa16ca726eda42c2ab2983a6b22e73c1 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerPasswordTestJSON-288247706 Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerPasswordTestJSON-288247706-project Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7913dc06b5764a5f88399c5a9407feec Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerPasswordTestJSON-288247706-project Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2af42a19-35cf-4295-8a1c-fb49c6397e3f'} Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:43.581979 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. Aug 21 01:16:43.585789 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:43.587685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] Returning 404 to user: Instance 2af42a19-35cf-4295-8a1c-fb49c6397e3f could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:43.589254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c31b8bf5-77b4-46f6-af9e-4d7e3aa09fcd tempest-ServerPasswordTestJSON-288247706 tempest-ServerPasswordTestJSON-288247706-project] 10.222.0.46 "GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f" status: 404 len: 111 microversion: 2.1 time: 0.063645 Aug 21 01:16:43.595531 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 986/2313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:43 2022] GET /compute/v2.1/servers/2af42a19-35cf-4295-8a1c-fb49c6397e3f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:43.650467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:43.664737 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5e3b3525-3638-4c12-9a33-a6e7ef5648bc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1363 microversion: 2.1 time: 0.575785 Aug 21 01:16:43.665602 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1328/2314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:43 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:43.684017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:43.687534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:43.713415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.714536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.722439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:43.723842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:43.725156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:43.725967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.416405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:44.427648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:44.460519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.467145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.467971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.473955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.474730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.475485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.676552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:44.688033 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4a32c4e5-d24b-481f-971d-c25c9668530f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1487 microversion: 2.1 time: 1.013592 Aug 21 01:16:44.690479 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 987/2315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:43 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1487 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:44.711638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:44.712147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:44.719497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.720955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.721612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.722559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.723211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.723851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.761808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:44.906321 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-315926bd-4450-4a56-9b34-b4c5ced7cc1e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 204 len: 0 microversion: 2.1 time: 0.197998 Aug 21 01:16:44.912700 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 988/2316] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:44 2022] DELETE /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:44.923980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:44.924729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:44.936007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.939074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.939797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:44.940899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:44.941605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:44.942773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.004887 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:45.144152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:45.154240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc797c57-0be1-4980-bcad-b12a9d42dc1b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.773287 Aug 21 01:16:45.165939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1329/2317] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:44 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:45.178903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed669180-3816-4005-954e-517cad5c55a1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc4032c9940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:45.222483 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ed669180-3816-4005-954e-517cad5c55a1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Image not found. Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed669180-3816-4005-954e-517cad5c55a1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 HTTP/1.1 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e52c88b8-bca8-443c-99e0-84d034afd674'} Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e52c88b8-bca8-443c-99e0-84d034afd674 to delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e52c88b8-bca8-443c-99e0-84d034afd674 could not be found. Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.225038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:16:45.228487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:45.231774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed669180-3816-4005-954e-517cad5c55a1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:45.232942 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed669180-3816-4005-954e-517cad5c55a1 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674" status: 404 len: 62 microversion: 2.1 time: 0.059798 Aug 21 01:16:45.234433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1330/2318] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:45 2022] DELETE /compute/v2.1/images/e52c88b8-bca8-443c-99e0-84d034afd674 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:16:45.246312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:45.248296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:45.266937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.268840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.269412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.272548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.274649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.275197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.324237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:45.441874 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Instance is already in deleting state, ignoring this request Aug 21 01:16:45.442917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a60c5b4-a080-4c81-b374-bce7e0051455 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 204 len: 0 microversion: 2.1 time: 0.204504 Aug 21 01:16:45.449284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1331/2319] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:45 2022] DELETE /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:45.462363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:45.485055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:45.496435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.496985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.497419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.498164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.498603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.499147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.782461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:45.801752 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94b2212e-2ea0-4875-b46b-0cedc6c364f9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1549 microversion: 2.1 time: 0.891796 Aug 21 01:16:45.802441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 989/2320] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:44 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1549 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:45.823103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:45.823924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:45.830948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.831763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.832430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.834796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.835489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.836250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.890440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:45.894915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:45.906630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-667e8f50-8aad-4a63-8bf6-283620c0511e tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1493 microversion: 2.1 time: 0.455741 Aug 21 01:16:45.908267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1332/2321] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:45 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1493 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:45.942852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:45.945301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:45.961057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.963170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.964154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:45.967700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:45.968486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:45.969558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.045741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1030419-f50d-47c1-ad60-34167bd95465 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 204 len: 0 microversion: 2.1 time: 0.225001 Aug 21 01:16:46.050958 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 990/2322] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:45 2022] DELETE /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:46.064064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:46.065109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:46.077295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.082815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.083535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.084437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.085104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.085704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.251371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e0fd5e4-3965-443f-bd71-eff90a5006f8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.327225 Aug 21 01:16:46.253930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1333/2323] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:16:45 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:46.268718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:46.270133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:46.302149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.303656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.305191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.306231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.307100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.307751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.524658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:46.542816 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f248db7-06a4-445f-acce-7a177743f97f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1483 microversion: 2.1 time: 0.488927 Aug 21 01:16:46.545244 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 991/2324] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:46 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1483 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:46.914203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:46.929361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:46.929971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:46.934040 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5be131fa-3e67-4351-81ad-65eda81cb508 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.678592 Aug 21 01:16:46.935914 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1334/2325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:46 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:46.952032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.953018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.953700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:46.954589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:46.955188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:46.955761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:47.434127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:47.443347 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df5b9f6f-bbb3-4b8a-bc31-ed41c32248a3 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1493 microversion: 2.1 time: 0.518372 Aug 21 01:16:47.443924 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 992/2326] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:46 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1493 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:47.565195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:47.566052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:47.579267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:47.580336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:47.584174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:47.585173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:47.585843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:47.586477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:47.945689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a5c00c-30be-4977-82a9-9a81a38ff941", "name": "network-vif-deleted", "tag": "e56fb51b-dbea-4d39-a86b-679406b04734"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:47.968470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:47.975462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:47.975916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.000314 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] Creating event network-vif-deleted:e56fb51b-dbea-4d39-a86b-679406b04734 for instance e0a5c00c-30be-4977-82a9-9a81a38ff941 on n-h1-master-1 Aug 21 01:16:48.016011 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-568950ff-7d30-42ec-a5b3-d03f299333fc req-e9ca5a7c-d287-4714-b983-29ba9731dcbe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079816 Aug 21 01:16:48.027077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 993/2327] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:16:48.041466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:48.046409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:48.058053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:48.058549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:48.058986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.059841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:48.060425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:48.060927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.310176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:48.320867 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-73df3b56-e1c2-4dfb-a8d4-7f631f5b742c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.291804 Aug 21 01:16:48.322196 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 994/2328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:48 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:48.468196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:48.468846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:48.475647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:48.479874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:48.482666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.483831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:48.484736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:48.485289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.531814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:48.541867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:48.542184 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbbab924-036c-46dd-b26d-b62f64af3103 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 200 len: 1441 microversion: 2.1 time: 0.980861 Aug 21 01:16:48.542575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:48.543096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:48.543788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lazy-loading 'fault' on Instance uuid 317b285b-b9f0-48ac-803e-c3f1072a9f65 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:16:48.549598 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1335/2329] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:47 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 1441 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:48.605699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ecc1a81574d7aa2679307a7985908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985e65b1266f46c196e8a07a9a016210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:48.615146 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15879e9e-4432-4ce5-ba3b-5d358dfad563 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 200 len: 1298 microversion: 2.1 time: 0.151323 Aug 21 01:16:48.615846 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 995/2330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:48 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:49.343059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:49.343956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:49.351344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.351829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.352258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.352988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.353446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.353862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.566172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:49.567601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: e0a5c00c-30be-4977-82a9-9a81a38ff941] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:49.577530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.578032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.578426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.579320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.579758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.580152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.596162 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] HTTP exception thrown: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Request method failure captured: Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 HTTP/1.1 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYWxRyyweAe7oTRFiLtL8XlBadWND0qzzkMT4DncSIMs0SwC7dD1EPeQXJScI_O7mAluz0ic2FzaeW7J8wWrwvIl1awfMVWiusxuWTMMlhCY0WAxCwvza-vpIGg4xU33eTjyC_0nSsjl_TIP8RJvwbOZYYvfjvqRjX1uAemqtWKk90s Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6073ae2e8036492faa2a4f7a26489134", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}] Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-LiveMigrationTest-34772514 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: b0bd3eeeb578465a8f5e5eaa3b3fdc85 Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e0a5c00c-30be-4977-82a9-9a81a38ff941'} Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:49.597848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Returning 404 to user: Instance e0a5c00c-30be-4977-82a9-9a81a38ff941 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:49.601554 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6920de3-190b-43ac-a86a-d14dff52875f tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941" status: 404 len: 111 microversion: 2.1 time: 0.038987 Aug 21 01:16:49.602950 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 996/2331] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:49 2022] GET /compute/v2.1/servers/e0a5c00c-30be-4977-82a9-9a81a38ff941 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:49.607717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:49.608205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:49.614978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.615372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.615938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.616598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.617408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.617809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.649337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:16:49.754907 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-584b833d-54e9-4e07-9c41-96b430fdb898 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 204 len: 0 microversion: 2.1 time: 0.150366 Aug 21 01:16:49.756223 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 997/2332] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:49 2022] DELETE /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:16:49.765758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:49.768448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 317b285b-b9f0-48ac-803e-c3f1072a9f65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.790993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.803903 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 HTTP/1.1 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '317b285b-b9f0-48ac-803e-c3f1072a9f65'} Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.805863 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:49.811066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:49.811994 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16cffec0-5bd4-4a61-8edb-f0bab4881fe5 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65" status: 404 len: 111 microversion: 2.1 time: 0.053472 Aug 21 01:16:49.812631 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 998/2333] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:49 2022] GET /compute/v2.1/servers/317b285b-b9f0-48ac-803e-c3f1072a9f65 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:49.818724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:49.819772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:49.835933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.836912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.837562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.838589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:49.839266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:49.839892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:49.908692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:49.913476 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:49.934541 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8f3537e-d556-4737-a9cb-a163e2d820a6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.595845 Aug 21 01:16:49.955490 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1336/2334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:49 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:49.977199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3f41e2b-e22f-4d15-a3b1-06a3d0404213 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3f9509ca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.048345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e3f41e2b-e22f-4d15-a3b1-06a3d0404213 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Image not found. Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3f41e2b-e22f-4d15-a3b1-06a3d0404213 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b HTTP/1.1 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '20c61dee-b810-45a2-82af-390bb31db82b'} Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20c61dee-b810-45a2-82af-390bb31db82b to delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20c61dee-b810-45a2-82af-390bb31db82b could not be found. Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.050401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:16:50.055594 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.071274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3f41e2b-e22f-4d15-a3b1-06a3d0404213 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.073272 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3f41e2b-e22f-4d15-a3b1-06a3d0404213 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b" status: 404 len: 62 microversion: 2.1 time: 0.111022 Aug 21 01:16:50.074558 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1337/2335] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:49 2022] DELETE /compute/v2.1/images/20c61dee-b810-45a2-82af-390bb31db82b => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:16:50.088904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.089893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:50.148147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.148800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.149713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.151815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.152295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.154005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.186432 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 HTTP/1.1 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '91d93aaa-bbc5-4845-b568-c783ac5d7db8'} Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:50.192995 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eca77b3c-8bc4-4256-a791-7867e56cf9de tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 404 len: 111 microversion: 2.1 time: 0.115839 Aug 21 01:16:50.200109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1338/2336] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:50 2022] DELETE /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:50.326439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1447395078", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "b125c716-ca40-41e6-86cc-e1a8db2bc69b"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:50.427122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] validate_networks() for [('b125c716-ca40-41e6-86cc-e1a8db2bc69b', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:50.440436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:50.461010 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b37d0e46-c781-408f-9242-92f3baa4df73 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1498 microversion: 2.1 time: 0.646827 Aug 21 01:16:50.461875 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 999/2337] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:49 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1498 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:50.473456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317b285b-b9f0-48ac-803e-c3f1072a9f65", "name": "network-vif-deleted", "tag": "992713aa-67fb-4d1e-9e9a-22e6be7f12b0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:50.499100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.500292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.500957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.541582 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] Creating event network-vif-deleted:992713aa-67fb-4d1e-9e9a-22e6be7f12b0 for instance 317b285b-b9f0-48ac-803e-c3f1072a9f65 on n-h1-master-1 Aug 21 01:16:50.558001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-26744e85-f0f0-403a-9eab-ee6ddf07913b req-a152804e-015e-4ca7-89e9-8145d45a12ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094689 Aug 21 01:16:50.561439 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1000/2338] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:50.578322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.579793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 91d93aaa-bbc5-4845-b568-c783ac5d7db8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:50.597827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.599109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.600198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.602157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.604528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.605238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.645892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 HTTP/1.1 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '91d93aaa-bbc5-4845-b568-c783ac5d7db8'} Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.651096 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. Aug 21 01:16:50.655077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.658753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 91d93aaa-bbc5-4845-b568-c783ac5d7db8 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.661478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9035942b-b64d-4164-a8ac-ac298816effb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8" status: 404 len: 111 microversion: 2.1 time: 0.096330 Aug 21 01:16:50.664326 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1001/2339] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:50 2022] GET /compute/v2.1/servers/91d93aaa-bbc5-4845-b568-c783ac5d7db8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:50.673804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:50.712063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.712891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.715142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.747834 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] Creating event network-changed:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:16:50.775828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a67c6338-a3bf-40cd-895d-7f48e36e3a76 req-d500774f-f6be-4aa2-adcf-11f5e0f57042 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096913 Aug 21 01:16:50.780580 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1002/2340] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:50.786921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63c0c673-ae4c-4846-8e91-ba300d1939bc tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3fdaed430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.825185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-63c0c673-ae4c-4846-8e91-ba300d1939bc tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Image not found. Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63c0c673-ae4c-4846-8e91-ba300d1939bc tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 HTTP/1.1 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '01bc2c58-c022-40df-abab-eb2eff8a45c8'} Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 01bc2c58-c022-40df-abab-eb2eff8a45c8 to delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01bc2c58-c022-40df-abab-eb2eff8a45c8 could not be found. Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.829111 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.833780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63c0c673-ae4c-4846-8e91-ba300d1939bc tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.836536 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63c0c673-ae4c-4846-8e91-ba300d1939bc tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8" status: 404 len: 62 microversion: 2.1 time: 0.053823 Aug 21 01:16:50.837643 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1003/2341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:50 2022] DELETE /compute/v2.1/images/01bc2c58-c022-40df-abab-eb2eff8a45c8 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:16:50.847796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.848948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:50.872655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.873773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.874508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.876589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.877258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.877793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.925096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 HTTP/1.1 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '92c1e5ba-78de-4638-b4a6-4a73f0b85fd4'} Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:50.930667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.934913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.940242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.941373 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5e7fc2a-2acd-4df1-8791-6298b45330bb tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 404 len: 111 microversion: 2.1 time: 0.099918 Aug 21 01:16:50.943455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1004/2342] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:50 2022] DELETE /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:16:50.954713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:50.956312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:50.964729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.965503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.966081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.966947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:50.967611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:50.968246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:50.985184 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 HTTP/1.1 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '92c1e5ba-78de-4638-b4a6-4a73f0b85fd4'} Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.987098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. Aug 21 01:16:50.991508 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:50.993546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:50.994761 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b8209ff-ff7a-4608-9bab-90e9f1ea1021 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4" status: 404 len: 111 microversion: 2.1 time: 0.044276 Aug 21 01:16:50.995872 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1005/2343] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:50 2022] GET /compute/v2.1/servers/92c1e5ba-78de-4638-b4a6-4a73f0b85fd4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:51.002994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:51.003871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:51.011186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.011961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.012564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:51.013533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.014253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.015047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:51.842958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:51.844839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:51.846087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:51.846844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:51.847436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:51.870769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:51.875810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.877933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.879450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:51.885661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.889055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be4c8cec-a8b0-4ce6-a01c-047ffeb05ecc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.888522 Aug 21 01:16:51.892042 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1006/2344] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:50 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:51.892628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.894339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:51.903025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62e8a324-2ca9-4af5-8024-f5e8504bc4a6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '.version_select at 0x7fc3feb63550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:51.938488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-62e8a324-2ca9-4af5-8024-f5e8504bc4a6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Image not found. Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62e8a324-2ca9-4af5-8024-f5e8504bc4a6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc HTTP/1.1 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e3b80962-7702-412a-b201-975abb3269fc'} Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e3b80962-7702-412a-b201-975abb3269fc to delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e3b80962-7702-412a-b201-975abb3269fc could not be found. Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.940684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62e8a324-2ca9-4af5-8024-f5e8504bc4a6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62e8a324-2ca9-4af5-8024-f5e8504bc4a6 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc" status: 404 len: 62 microversion: 2.1 time: 0.048012 Aug 21 01:16:51.945201 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1007/2345] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:51 2022] DELETE /compute/v2.1/images/e3b80962-7702-412a-b201-975abb3269fc => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:16:51.954359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:51.954819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Getting quotas for project 7026e7b12fc24e5c979db5f97191405d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:51.954977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:51.968344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Getting quotas for user 9648ebb42868486d81c91e753a293f8f and project 7026e7b12fc24e5c979db5f97191405d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:51.968598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.969961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.970418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:51.972540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:51.973182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:51.975957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.034099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:52.040062 n-d-master-1 devstack@n-api.service[122482]: WARNING nova.utils [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1447395078 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-144739507 Aug 21 01:16:52.054958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:52.180431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-211cf9a6-1dfc-4017-9dda-9dec52582860 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983528 Aug 21 01:16:52.183372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1339/2346] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:16:52.193596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:52.197415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:52.214088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.219014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.219978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.221002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.221774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.222409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.250391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 HTTP/1.1 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '67035c79-2bb6-40e8-874b-628c13c6c026'} Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:52.254603 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.259800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.262017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:52.263113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6f74379-12e6-4cd7-a437-1802dc3d2e85 tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "DELETE /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 404 len: 111 microversion: 2.1 time: 0.077883 Aug 21 01:16:52.264347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1340/2347] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:16:52 2022] DELETE /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:52.270809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc19a73e-115c-49ec-946e-2bdf8fd7300d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:52.271808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc19a73e-115c-49ec-946e-2bdf8fd7300d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:52.279235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0bd3eeeb578465a8f5e5eaa3b3fdc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073ae2e8036492faa2a4f7a26489134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:52.318470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-503f47a4-bc02-4917-8b9d-aad165b85a2a tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 200 len: 1456 microversion: 2.1 time: 0.370906 Aug 21 01:16:52.319809 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1008/2348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:51 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 1456 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:52.324724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:52.331791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] [instance: 67035c79-2bb6-40e8-874b-628c13c6c026] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:52.339361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.339859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.340293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.341026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.341477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.341901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.394489 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] HTTP exception thrown: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Request method failure captured: Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 HTTP/1.1 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYaP2Sd85TLc1UJd0K5sHd3Byw9d6IxiLXlzhZop4b9PoFwdWnV5cx0LuvsqLrSSD_t10BlTUO_8-rrLMP8OUDMjt_KB4d6xUaOQXkRTXP5H5k-KJzYZOX8Cpsmci_YuHDVSzcmWh8F9wvXINSylZpRHDVxBYSOw8W6GG67O3UfEDvM Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_985e65b1266f46c196e8a07a9a016210", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/985e65b1266f46c196e8a07a9a016210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/985e65b1266f46c196e8a07a9a016210"}]}] Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 985e65b1266f46c196e8a07a9a016210 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesTestJSON-349984159 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 2a2ecc1a81574d7aa2679307a7985908 Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesTestJSON-349984159-project Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '67035c79-2bb6-40e8-874b-628c13c6c026'} Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.396133 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] Returning 404 to user: Instance 67035c79-2bb6-40e8-874b-628c13c6c026 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:52.400056 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f169d350-68f6-47e7-a48f-0a9df475387f tempest-ImagesTestJSON-349984159 tempest-ImagesTestJSON-349984159-project] 10.222.0.46 "GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026" status: 404 len: 111 microversion: 2.1 time: 0.076816 Aug 21 01:16:52.401654 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1009/2349] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:52 2022] GET /compute/v2.1/servers/67035c79-2bb6-40e8-874b-628c13c6c026 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:52.602844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc19a73e-115c-49ec-946e-2bdf8fd7300d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:52.620631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc19a73e-115c-49ec-946e-2bdf8fd7300d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1232 microversion: 2.1 time: 0.349402 Aug 21 01:16:52.633820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1341/2350] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:52 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1232 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:52.913681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:52.915009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:52.934226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.937267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.945139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.946800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:52.948090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:52.950004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:52.999399 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:53.172249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ace031ba-8e78-4cbe-b793-3f5b049e087a", "name": "network-vif-deleted", "tag": "8e552111-0642-4a93-828e-0d461d33f953"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:53.196884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:53.197371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:53.197807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:53.254028 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] Creating event network-vif-deleted:8e552111-0642-4a93-828e-0d461d33f953 for instance ace031ba-8e78-4cbe-b793-3f5b049e087a on n-h1-master-1 Aug 21 01:16:53.276082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-df082816-84f3-4449-880e-a5e31db57a46 req-dc62e87d-77dd-4d51-954e-e6d5c6a36684 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106820 Aug 21 01:16:53.280571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1342/2351] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:16:53.344265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:53.345138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] [instance: ace031ba-8e78-4cbe-b793-3f5b049e087a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:53.352428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:53.353354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:53.353943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:53.355071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:53.355828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:53.356570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:53.393273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] HTTP exception thrown: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Request method failure captured: Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a HTTP/1.1 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYWxRyyweAe7oTRFiLtL8XlBadWND0qzzkMT4DncSIMs0SwC7dD1EPeQXJScI_O7mAluz0ic2FzaeW7J8wWrwvIl1awfMVWiusxuWTMMlhCY0WAxCwvza-vpIGg4xU33eTjyC_0nSsjl_TIP8RJvwbOZYYvfjvqRjX1uAemqtWKk90s Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6073ae2e8036492faa2a4f7a26489134", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6073ae2e8036492faa2a4f7a26489134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6073ae2e8036492faa2a4f7a26489134"}]}] Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-LiveMigrationTest-34772514 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6073ae2e8036492faa2a4f7a26489134 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-LiveMigrationTest-34772514 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b0bd3eeeb578465a8f5e5eaa3b3fdc85 Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-LiveMigrationTest-34772514-project Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ace031ba-8e78-4cbe-b793-3f5b049e087a'} Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:16:53.395320 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:16:53.398942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] Returning 404 to user: Instance ace031ba-8e78-4cbe-b793-3f5b049e087a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:16:53.401662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc0aa7c4-8a50-48f4-8c6a-5d9d823ad488 tempest-LiveMigrationTest-34772514 tempest-LiveMigrationTest-34772514-project] 10.222.0.46 "GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a" status: 404 len: 111 microversion: 2.1 time: 0.062030 Aug 21 01:16:53.403774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1343/2352] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:53 2022] GET /compute/v2.1/servers/ace031ba-8e78-4cbe-b793-3f5b049e087a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:16:53.648693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:53.649342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:53.663186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:53.664141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:53.665479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:53.666251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:53.666895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:53.667330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:53.880164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:53.888597 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12271ae2-3931-4a18-855a-355dd5f4eafd tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.980176 Aug 21 01:16:53.889017 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1010/2353] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:52 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:53.897248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:53.912324 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c413234-7321-4c03-a1a1-02a553889a61 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1236 microversion: 2.1 time: 0.269840 Aug 21 01:16:53.914560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1344/2354] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:53 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1236 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:54.696435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:54.698422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:54.708530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:54.710210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:54.711962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:54.715151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:54.715654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:54.716048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:54.912908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:54.914272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:54.924927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:54.925828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:54.926631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:54.927681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:54.928344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:54.929019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:55.288340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:55.302998 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6677464-2244-4117-9181-f09708cf81fa tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.395563 Aug 21 01:16:55.303671 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1345/2355] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:54 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:55.309470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:55.310089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:55.322095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:55.323408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:55.324142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:55.325743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:55.327075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:55.329858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:55.477549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:55.494148 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-000f23aa-b0e3-472b-befe-aa9132ca9189 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1290 microversion: 2.1 time: 0.188846 Aug 21 01:16:55.518245 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1346/2356] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:55 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1290 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:55.617819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:55.640470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:55.642483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:55.643738 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00092b5e-fef5-4c86-9e7d-d5247152aa01 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2944 microversion: 2.32 time: 0.955758 Aug 21 01:16:55.644420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1011/2357] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:16:54 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2944 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:55.684606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:55.684858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:55.718364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:55.719445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:55.722475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:55.726879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:55.728055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:55.728900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:56.004741 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57cebadf-0066-4482-bd9b-ae4f550175b7 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.334599 Aug 21 01:16:56.009511 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1347/2358] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:16:55 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270/os-interface => generated 1828 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:16:56.332621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:56.333274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:56.360865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:56.361366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:56.361798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:56.362517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:56.371887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:56.371887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:56.533204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:56.534837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:56.542971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:56.549923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:56.553458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:56.554640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:56.557439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:56.566236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:56.780051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:56.793707 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2413265b-eff6-4bde-8f6a-037e31c0e59f tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1290 microversion: 2.1 time: 0.265343 Aug 21 01:16:56.795640 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1348/2359] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:56 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1290 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:56.916340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:56.926934 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f152af97-f5ab-4bd6-aa56-74089d23989f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.604119 Aug 21 01:16:56.937334 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1012/2360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:56 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:57.823674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:57.825475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:57.840470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:57.841289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:57.842050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:57.844567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:57.845324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:57.845938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:57.964224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:57.965677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:57.975489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:57.976669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:57.977605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:57.978828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:57.979495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:57.980121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:58.517568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:58.521302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:58.537454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b932d358-61ec-40ae-a28d-a042f5a89d70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.578456 Aug 21 01:16:58.540299 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1013/2361] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:57 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:16:58.543336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5e37c13-5a3f-4781-a8c2-d5227ed62391 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.729146 Aug 21 01:16:58.551923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1349/2362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:57 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:58.802130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-708450666", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:16:58.810007 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:16:58.895843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:16:59.561316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:59.562193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:59.580558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:59.581069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:59.581502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:59.582194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:59.582641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:59.583053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:59.791405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:16:59.791878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:16:59.792278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:16:59.792684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:16:59.793138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:16:59.815831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:59.816316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:59.816743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:59.817648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:59.818253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:59.818676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:16:59.875808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Getting quotas for project a3b035ec7bd0473788f89c45e4950066. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:16:59.898141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Getting quotas for user b69e173eef9b42a9ae6a0e1255ea2b4c and project a3b035ec7bd0473788f89c45e4950066. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:16:59.952202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:16:59.964841 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b73fd307-3a9f-401a-b356-89603016e4b6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.408011 Aug 21 01:16:59.965794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1350/2363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:59 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:16:59.966375 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:16:59.971333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:16:59.980202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:16:59.982068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:16:59.995794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:16:59.996658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:16:59.998646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:00.000087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:00.000921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:00.002430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:00.121686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5eb46ab-faaf-4c00-a741-5972baedc2d3 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576883 Aug 21 01:17:00.125707 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1014/2364] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:17:00.373121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:00.385033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ca1c615-13a7-4b11-a607-9b8ae1c68594 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.417126 Aug 21 01:17:00.385033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1351/2365] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:16:59 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:00.393933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ed67162-3882-45d7-9a8a-af63915d0be7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:00.394956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ed67162-3882-45d7-9a8a-af63915d0be7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:00.483288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ed67162-3882-45d7-9a8a-af63915d0be7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:00.495273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ed67162-3882-45d7-9a8a-af63915d0be7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1213 microversion: 2.1 time: 0.105697 Aug 21 01:17:00.497043 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1352/2366] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:00 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:00.582311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a1c030-1222-4076-951f-8b9bda8d896d", "tag": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:00.596495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:00.599907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:00.602315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:00.629800 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] Creating event network-changed:ffdead26-b8af-41ba-b0ee-1bfb0bf65072 for instance 17a1c030-1222-4076-951f-8b9bda8d896d on n-h1-master-1 Aug 21 01:17:00.639912 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1d1bbbdb-36ed-4be7-b418-066aebb6ff37 req-1079b678-b319-4c74-89fe-66f120895389 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.512270 Aug 21 01:17:00.644468 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1015/2367] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:00.688125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3467feef-16d4-45f3-beef-1b652e997707 tempest-ExtensionsTest-1349892641 tempest-ExtensionsTest-1349892641-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:00.691403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3467feef-16d4-45f3-beef-1b652e997707 tempest-ExtensionsTest-1349892641 tempest-ExtensionsTest-1349892641-project] 10.222.0.46 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.192286 Aug 21 01:17:00.698540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1353/2368] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:17:00 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:00.706152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-567484f7-9341-448d-abbe-868c368dc860 tempest-ExtensionsTest-1349892641 tempest-ExtensionsTest-1349892641-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:00.708595 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-567484f7-9341-448d-abbe-868c368dc860 tempest-ExtensionsTest-1349892641 tempest-ExtensionsTest-1349892641-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008026 Aug 21 01:17:00.709863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1016/2369] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:17:00 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:17:00.989614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:00.996687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:01.016880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.017637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.019412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.020864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.022473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.024085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.360746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:01.371897 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b6b77b3b-ce00-4592-be29-61faa136f521 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.386533 Aug 21 01:17:01.384791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1354/2370] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:00 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:01.410611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:01.414001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:01.423306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.424281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.424911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.425795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.426430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.427008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.521167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:01.522467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:01.572009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.573499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.574343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.575361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:01.576429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:01.577759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:01.726521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:01.743818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56774b6f-10d7-489e-8c18-65c7a8ddee8e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1265 microversion: 2.1 time: 0.229350 Aug 21 01:17:01.746389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1355/2371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:01 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:01.829263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:01.848616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e0a4e19-1ab0-465d-822d-837b6020f760 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.445332 Aug 21 01:17:01.849260 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1017/2372] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:01 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:02.396304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:02.396757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:02.406768 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:02.410510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.411013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.411453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:02.412170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.412621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.418215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:02.743078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:02.754248 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47f79dad-1e4d-484a-a4eb-423db0387a67 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.364730 Aug 21 01:17:02.755287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1356/2373] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:02 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:02.777157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:02.778618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:02.788484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.789431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.790113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:02.791358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.792038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.792899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:02.873958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:02.875722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:02.894294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.896395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.900288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:02.901313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:02.901935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:02.903468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:03.019500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:03.030609 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1271 microversion: 2.1 time: 0.262550 Aug 21 01:17:03.031948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1018/2374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:02 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:03.132813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:03.143937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.273722 Aug 21 01:17:03.144710 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1357/2375] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:02 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:03.359749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:03.362141 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002718 Aug 21 01:17:03.363141 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1019/2376] 10.222.0.46 () {56 vars in 886 bytes} [Sun Aug 21 01:17:03 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 21 01:17:03.370487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:03.373660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003607 Aug 21 01:17:03.374452 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1358/2377] 10.222.0.46 () {54 vars in 1035 bytes} [Sun Aug 21 01:17:03 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 21 01:17:03.384738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:03.386811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e815fbc-9a86-47f9-8b76-7bb5d69eb1ac tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003649 Aug 21 01:17:03.389082 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1020/2378] 10.222.0.46 () {54 vars in 1041 bytes} [Sun Aug 21 01:17:03 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:03.397318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:03.398453 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3991e04a-d143-4a4e-a3bb-c2440ad1c2da tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001541 Aug 21 01:17:03.407466 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1359/2379] 10.222.0.46 () {56 vars in 886 bytes} [Sun Aug 21 01:17:03 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 21 01:17:03.780367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:03.781885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:03.793143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:03.797284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:03.798647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:03.801604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:03.802664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:03.804062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:04.056936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:04.058192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:04.100131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:04.107822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:04.111190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:04.116871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:04.120511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:04.121817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:04.249651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:04.263693 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7872837-c40f-416f-9f2f-96913aa255cc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.488890 Aug 21 01:17:04.282351 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1021/2380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:03 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:04.289391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:04.297699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:04.307882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:04.308383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:04.308858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:04.309588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:04.310036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:04.310658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:04.602856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:04.614829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-068dc1b9-3bb2-4050-869c-a10ee0eb2c24 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.330049 Aug 21 01:17:04.617496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:04.629737 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1022/2381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:04 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:04.632440 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bea26d52-620a-409f-856d-f68966cc71ff tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1271 microversion: 2.1 time: 0.584234 Aug 21 01:17:04.633103 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1360/2382] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:04 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1271 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:05.287848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:05.288640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:05.295631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.296503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.297293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:05.298002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.298594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.299018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:05.645241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:05.646702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:05.664684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.666073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.666876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:05.667542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.667968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.668428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:05.769417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:05.790263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3dee5a60-00f3-45aa-b7aa-41e0dc46e144 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1507 microversion: 2.1 time: 0.506811 Aug 21 01:17:05.792619 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1023/2383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:05 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:05.803687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:05.804642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:05.826531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.827876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.829278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:05.844280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:05.846179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:05.847457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:06.041064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:06.054148 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba527425-edb0-4add-a163-bc217bb0a777 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.414976 Aug 21 01:17:06.054802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1361/2384] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:05 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:06.257528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:06.267181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d60270e-83e8-4165-9a16-4d3ff66251a0 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.473043 Aug 21 01:17:06.273651 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1024/2385] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:05 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:06.294768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a1c030-1222-4076-951f-8b9bda8d896d", "name": "network-vif-plugged", "status": "completed", "tag": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:06.348610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:06.349246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:06.349693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:06.387304 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] Creating event network-vif-plugged:ffdead26-b8af-41ba-b0ee-1bfb0bf65072 for instance 17a1c030-1222-4076-951f-8b9bda8d896d on n-h1-master-1 Aug 21 01:17:06.411483 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0e0ec067-6b19-48d8-8a4d-e0528afecd60 req-a72566a4-e77b-45a8-a13f-c5586f634f5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129472 Aug 21 01:17:06.412199 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1025/2386] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:06.412453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4aa1a20b-c243-4a00-af53-9965f6c518cb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc4032c9ee0>, body: {"keypair": {"name": "tempest-keypair-1339257067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZET0uOyTRn+DutjTkqymxA2o/rKK6gvH69msRAU3ltYimde3Iy4PEFUC4aauZbpDoLo0PAP0vp0dLonGm1KKgr3JTQbPwYZuqwnuP9avVTevv3SKVWPqOsFcn/N9rRwA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:06.459590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4aa1a20b-c243-4a00-af53-9965f6c518cb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:06.469691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4aa1a20b-c243-4a00-af53-9965f6c518cb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:06.499637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4aa1a20b-c243-4a00-af53-9965f6c518cb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430806 Aug 21 01:17:06.501306 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1362/2387] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:06.512278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8232e7c9-70e0-4a7d-96eb-ebcccdf044eb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3fd873310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:06.523126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8232e7c9-70e0-4a7d-96eb-ebcccdf044eb tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1339257067" status: 200 len: 498 microversion: 2.1 time: 0.015265 Aug 21 01:17:06.530457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1026/2388] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:17:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1339257067 => generated 498 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:06.535401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfa88230-9354-499b-9e60-f468d703c4aa tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3f95631f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:06.557446 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:06.585044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dfa88230-9354-499b-9e60-f468d703c4aa tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339257067" status: 202 len: 0 microversion: 2.1 time: 0.049488 Aug 21 01:17:06.586103 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1363/2389] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1339257067 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:06.599206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec170fb4-cbf8-495a-8b72-e90be8c057f7 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc3fda803a0>, body: {"keypair": {"name": "tempest-keypair-1792208219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+YeqoR18TwghUpbh8F2g4uqhqq2TLmKFLTo+JVUeFJ5BUod1PLRu3owOcCExiaT0ik7tSJBuEu9JyyTOb9LizC0OyeRpCYL6I/2v387HcFFRqVtvW6wmNWNz0Nt/ogNw=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:06.618182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ec170fb4-cbf8-495a-8b72-e90be8c057f7 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:06.633743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ec170fb4-cbf8-495a-8b72-e90be8c057f7 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:06.679771 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec170fb4-cbf8-495a-8b72-e90be8c057f7 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085430 Aug 21 01:17:06.681155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1027/2390] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:06.693552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48ec9104-527a-43ea-9c0b-e6b70892a23e tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3f9563820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:06.722912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48ec9104-527a-43ea-9c0b-e6b70892a23e tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792208219" status: 202 len: 0 microversion: 2.1 time: 0.035506 Aug 21 01:17:06.723987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1364/2391] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792208219 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:06.734774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2c8a5b8-492e-4aac-8b56-806387d5f744 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc3fd982310>, body: {"keypair": {"name": "tempest-keypair-381489414", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:06.758915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a2c8a5b8-492e-4aac-8b56-806387d5f744 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:06.776484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a2c8a5b8-492e-4aac-8b56-806387d5f744 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:06.817610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:06.818233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:06.829324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:06.829811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:06.831440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:06.832256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:06.833407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:06.834378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:06.839800 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2c8a5b8-492e-4aac-8b56-806387d5f744 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.110587 Aug 21 01:17:06.845880 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1028/2392] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:06 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:06.855214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a816d53b-2fd3-4c5a-bf5e-01fa18cafaaf tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3fd84c0d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:06.893862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a816d53b-2fd3-4c5a-bf5e-01fa18cafaaf tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381489414" status: 202 len: 0 microversion: 2.1 time: 0.046023 Aug 21 01:17:06.897279 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1029/2393] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381489414 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:06.908823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22c04347-e044-4791-bc75-412843115323 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc3fdcbb160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2111259572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQLY1XMapCtdH67Ow9LItYd/KY+Rh388+p08xntH5IOOtHVe4+arjvYFe464jHTpib1ydObOEKg6+2gAsqg8mTud37YaPjSwLSfsk3ANOaGVKmKsjFziH9alX6MfxbTDw=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:06.945657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-22c04347-e044-4791-bc75-412843115323 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:06.958131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-22c04347-e044-4791-bc75-412843115323 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:07.007144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22c04347-e044-4791-bc75-412843115323 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.103715 Aug 21 01:17:07.008452 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1030/2394] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:07.024618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8adc194a-db91-462d-adb1-dd195045fb5f tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc3fe315940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1856918829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJVvTRU57F0jPdZi8fpuZWjpt9ec5M6pyjQjpw2j5x9z3+Ve5/0waIoIjEmh0vg/fVZpACIA8q7krFWRQkjXcqI5I+f6f788UCOzg+WM4BmkK6Bv0vsfnVARuDheD505Q=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:07.052188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8adc194a-db91-462d-adb1-dd195045fb5f tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:07.062367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8adc194a-db91-462d-adb1-dd195045fb5f tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:07.089999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:07.099707 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8adc194a-db91-462d-adb1-dd195045fb5f tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.081799 Aug 21 01:17:07.100305 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1031/2395] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:07.102377 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f69381f6-881b-4522-9733-d79366614e5d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1487 microversion: 2.1 time: 0.293545 Aug 21 01:17:07.105248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:07.106155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:07.113228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:07.113704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:07.114136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:07.114832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:07.115275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:07.115857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:07.119203 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1365/2396] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:06 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1487 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:07.145561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15b6fa17-b580-47ad-9ef0-34a15c15a9db tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Action: 'create', calling method: .version_select at 0x7fc3f9509160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-84015940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpkF8fradBFqz5o1YbZY7Rwtgo1TJrwN1EE+UkA1ap19p8pZwTPI4D1k03ACFJs6gZeyqYg9KXdJcSDG3rcMxmG+jGBs/REua+M3nI+BT85cbAJLe9msh4WSkeipqffEw=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:07.171551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-15b6fa17-b580-47ad-9ef0-34a15c15a9db tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:07.178195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-15b6fa17-b580-47ad-9ef0-34a15c15a9db tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Getting quotas for user ba233f6cc0734ad9aca8c0fe2899a4f1 and project 37bc012ea49c49eface4c4e899a53460. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:07.212042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15b6fa17-b580-47ad-9ef0-34a15c15a9db tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.091637 Aug 21 01:17:07.213042 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1366/2397] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:07.226093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef688909-7ccf-4e2e-9087-24b9a47155da tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3f94c10d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:07.230886 n-d-master-1 devstack@n-api.service[122482]: WARNING oslo_db.sqlalchemy.utils [None req-ef688909-7ccf-4e2e-9087-24b9a47155da tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:17:07.237392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef688909-7ccf-4e2e-9087-24b9a47155da tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.017807 Aug 21 01:17:07.237973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1367/2398] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:17:07 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:07.251517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-639893034", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:07.317877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] validate_networks() for [('9ebbddb4-9d42-4559-aced-caebe39ccd22', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:17:07.556895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:07.568080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-48b9e675-ce84-4ab0-8623-55bdf7d6bd06 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1332 microversion: 2.1 time: 0.466415 Aug 21 01:17:07.569894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1032/2399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:07 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1332 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:07.589945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5da004fc-b5f0-4f13-a3ec-d8548c87b5cf tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3fd873670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:07.623908 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5da004fc-b5f0-4f13-a3ec-d8548c87b5cf tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-84015940" status: 202 len: 0 microversion: 2.1 time: 0.051863 Aug 21 01:17:07.624894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1033/2400] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-84015940 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:07.633094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:07.634103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:07.646134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:07.647779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:07.648378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:07.650017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:07.650763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:07.652313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:07.996618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:17:07.998027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:17:07.998747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:17:07.999667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:17:08.000249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:17:08.021366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:08.021851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:08.025359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:08.026177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:08.026809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:08.027237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:08.029859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:08.041740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe1bc8ed-13cd-4565-8bc3-0b4bf9ddeaf5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.415570 Aug 21 01:17:08.046086 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.047822 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1034/2401] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:07 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:08.055962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fa74be-f069-4b2e-bf2c-8305cfd1189b", "tag": "76b68206-3418-4d13-806a-dab8a5726784"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:08.076359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Getting quotas for project 7461e4a0b7124b3bbbb6396de9b59656. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:08.084677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:08.085349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:08.086402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:08.087701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Getting quotas for user 22a8b93432dd4d699a28a8db26bc3c98 and project 7461e4a0b7124b3bbbb6396de9b59656. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:08.102176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:17:08.104925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:17:08.108454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] Creating event network-changed:76b68206-3418-4d13-806a-dab8a5726784 for instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b on n-h2-master-1 Aug 21 01:17:08.121399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b43007dc-4fc5-4bda-b5ab-c1595b933863 req-a7623df4-3518-44f0-bd02-12521a616629 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068318 Aug 21 01:17:08.121933 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1035/2402] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:08.133671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d199bb7-9875-424a-88f9-8fc1ef0f37ea tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3fda804c0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:08.167421 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d199bb7-9875-424a-88f9-8fc1ef0f37ea tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856918829" status: 202 len: 0 microversion: 2.1 time: 0.044084 Aug 21 01:17:08.169917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2ca5195-07d9-415e-96f4-bc8143ce6e11 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.923777 Aug 21 01:17:08.171873 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1036/2403] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1856918829 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:08.177177 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1368/2404] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:17:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:17:08.177783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9df220df-df38-4964-b55e-10a04022ad00 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] Calling method '.version_select at 0x7fc3fdadb1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:08.185931 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:08.188152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d1b7d4c-c2a0-4f96-a6da-95b071194060 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:08.190219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d1b7d4c-c2a0-4f96-a6da-95b071194060 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:08.206178 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9df220df-df38-4964-b55e-10a04022ad00 tempest-KeyPairsV2TestJSON-1106863152 tempest-KeyPairsV2TestJSON-1106863152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2111259572" status: 202 len: 0 microversion: 2.1 time: 0.032925 Aug 21 01:17:08.207003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1037/2405] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 01:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2111259572 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:08.283938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8d1b7d4c-c2a0-4f96-a6da-95b071194060 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:08.302858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d1b7d4c-c2a0-4f96-a6da-95b071194060 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1213 microversion: 2.1 time: 0.123644 Aug 21 01:17:08.307765 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1369/2406] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:08 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:08.592224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:08.593877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:08.608226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:08.611009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:08.611543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:08.612378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:08.619901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:08.629179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:08.921904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:08.931318 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c626380b-528a-48c8-8f00-3c4c28f3f28a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1536 microversion: 2.1 time: 0.343554 Aug 21 01:17:08.932108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1038/2407] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:08 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1536 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:08.955248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7695775a-920b-40c2-9186-569bec9e827b tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'create', calling method: .version_select at 0x7fc3f950d670>, body: {"pool": "747ccea1-029c-4226-a640-bd1cbebbd4e4"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:09.068016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:09.068729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:09.085796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:09.086712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:09.087423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:09.088342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:09.089009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:09.089686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:09.325703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:09.335114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0e7eae8-01ae-4841-9ebe-95b12c8e8d6e tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.271059 Aug 21 01:17:09.336153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1039/2408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:09 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:09.341657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:09.342144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:09.349290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:09.349894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:09.350342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:09.351078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:09.352210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:09.352659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:09.427266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:09.438493 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11ece947-cc42-4c26-864d-1ed2a7e71476 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1265 microversion: 2.1 time: 0.101149 Aug 21 01:17:09.440623 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1040/2409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:09 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:10.356823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:10.358556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:10.369052 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:10.376443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:10.378420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:10.379533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:10.382322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:10.383027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:10.383925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:10.653779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:10.656978 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:10.674087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc366398-2430-438b-9c1a-0c95250ea414 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.320942 Aug 21 01:17:10.690789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1041/2410] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:10 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:10.728271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:10.728271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:10.747395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:10.749334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:10.751221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:10.754143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:10.755613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:10.757161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:11.508794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:11.527478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f63fabc-64f5-4c1c-9fa1-0d67fb57f9c2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.836403 Aug 21 01:17:11.528361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1042/2411] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:10 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:12.013923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1930199332", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:12.073649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:17:12.764034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:17:12.764733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:17:12.770124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:17:12.771040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:17:12.771730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:17:12.787345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:12.788043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:12.788579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:12.801613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:12.802260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:12.802804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:12.829632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:12.839322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:12.863904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:17:12.871536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:17:12.933669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92315707-7a8b-4479-a32e-63c3ad2c7436 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403994 Aug 21 01:17:12.938470 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1043/2412] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:17:12.999180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7695775a-920b-40c2-9186-569bec9e827b tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.047845 Aug 21 01:17:13.001229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1370/2413] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:17:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:17:13.009745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:13.011311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:13.023760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:13.025679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.026317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.027809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.028719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.029350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.030595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.032620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.034714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.036321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.037652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.042816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.052098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.060108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20f25957-9cc5-436a-b578-0afa1b9c3719 tempest-AZV2TestJSON-1123952503 tempest-AZV2TestJSON-1123952503-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.113982 Aug 21 01:17:13.060959 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1044/2414] 10.222.0.46 () {58 vars in 1164 bytes} [Sun Aug 21 01:17:12 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:17:13.075342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:13.076174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:13.085245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.085894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.087019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.087927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.088530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.089151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.395483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:13.407360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7729cda1-b98e-49f3-a28c-f1ebb75dfc26 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.404516 Aug 21 01:17:13.408269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1371/2415] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:13 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:13.426318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54429a76-e88a-4906-ab5d-8857a375ba36 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:13.427162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54429a76-e88a-4906-ab5d-8857a375ba36 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:13.563183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:13.582646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54429a76-e88a-4906-ab5d-8857a375ba36 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:13.590483 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a994b7a-ac8c-4c76-9ed5-f2da09a0771e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.519332 Aug 21 01:17:13.590665 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1045/2416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:13 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:13.600847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.251"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:13.609564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:13.622084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.623047 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54429a76-e88a-4906-ab5d-8857a375ba36 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1217 microversion: 2.1 time: 0.211811 Aug 21 01:17:13.625164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.625808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.626519 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1372/2417] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:13 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:13.628238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.628864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.630108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.690954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:17:13.691422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquired lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:17:13.886100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f68483-18ba-4b22-bab2-ed26991c7dca", "tag": "9df4987f-ed28-4166-a8c8-d6bc33bf2c66"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:13.914055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:13.915175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:13.916192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:13.958954 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] Creating event network-changed:9df4987f-ed28-4166-a8c8-d6bc33bf2c66 for instance f6f68483-18ba-4b22-bab2-ed26991c7dca on n-h1-master-1 Aug 21 01:17:13.978494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-efbcfd39-6ee9-4654-9a9f-25c930c9722e req-2daeebbf-c388-4e8e-a823-9627e3d5b034 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096253 Aug 21 01:17:13.979143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1373/2418] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:17:14.429241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:14.430050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:14.436943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:14.437988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:14.438785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:14.440447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:14.441822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:14.442605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:14.724689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:14.737474 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d8c3df9-21cd-4428-bac0-1cf83daede85 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.308872 Aug 21 01:17:14.738546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1374/2419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:14 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:14.746489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:14.749219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:14.762088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:14.772161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:14.772996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:14.773987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:14.774658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:14.775283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:15.180178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:15.188442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4b36d66-50d4-4792-a02b-dd18b54b9ba6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.448601 Aug 21 01:17:15.189944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1375/2420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:14 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:15.195373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:15.196212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:15.203495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:15.204151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:15.204583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:15.205313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:15.205753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:15.206365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:15.352068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:15.363046 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-909812ee-e638-4b7f-8047-f29c9017ecf7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1275 microversion: 2.1 time: 0.171670 Aug 21 01:17:15.363790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1376/2421] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:15 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:15.670837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa74be-f069-4b2e-bf2c-8305cfd1189b", "name": "network-vif-plugged", "status": "completed", "tag": "76b68206-3418-4d13-806a-dab8a5726784"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:15.696571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:15.696982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:15.697411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:15.731836 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] Creating event network-vif-plugged:76b68206-3418-4d13-806a-dab8a5726784 for instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b on n-h2-master-1 Aug 21 01:17:15.741227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9aa7cc5c-b568-40db-8adc-66abd40337ed req-3a951cd9-f35f-4f45-82e0-0c1597963c5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362072 Aug 21 01:17:15.747344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1377/2422] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:15.760817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:15.761817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:15.786761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:15.787344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:15.794717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:15.795904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:15.796651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:15.797383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:16.036727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:16.051981 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65ab789a-9522-4786-8857-037dccb4131d tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.296521 Aug 21 01:17:16.065539 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1378/2423] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:15 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:16.271954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2791005e-924f-4e9d-a544-3e53a2bc5512 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: .version_select at 0x7fc403177d30>, body: {"keypair": {"name": "tempest-keypair-124134900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrvMtUD8YXpV4v6FvEtngNQ4R8FxiF8/rzAcktV69xd8NKcWXVP7CSvOmvQ/jSKVwAv6unCSg27Z43tVfM1F6t5dYxRmt5cuBpA0a7V91BJnytZLVAhWAYPq8O4PSV6XQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:16.295876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2791005e-924f-4e9d-a544-3e53a2bc5512 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for project fe917515a56c4577b45df3eb16642a2d. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:16.308970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2791005e-924f-4e9d-a544-3e53a2bc5512 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for user 3338f52621ec4501b2f0b88ff5cb36fb and project fe917515a56c4577b45df3eb16642a2d. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:16.340186 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2791005e-924f-4e9d-a544-3e53a2bc5512 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.285810 Aug 21 01:17:16.341013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1379/2424] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:17:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:16.349729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:16.350344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:16.360250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:16.361077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:16.361682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:16.362580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:16.363215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:16.363818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:16.606192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:16.621470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76fb3535-6b4f-445a-bc9f-b59949fb2fc1 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.278872 Aug 21 01:17:16.636538 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1380/2425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:16 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:16.641159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:16.642060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:16.648883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:16.649375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:16.649824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:16.650644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:16.651223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:16.651631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:16.978351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:16.993872 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c35e123-e8ce-4c20-b7b5-fda8cc428efc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1275 microversion: 2.1 time: 0.362054 Aug 21 01:17:16.995924 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1381/2426] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:16 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:17.074039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:17.079600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:17.088914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:17.089439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:17.089869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:17.090818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:17.091419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:17.091874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:17.302129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:17.315168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79516d4c-53dc-489c-a263-2883a36a644a tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1313 microversion: 2.1 time: 0.244780 Aug 21 01:17:17.316330 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1382/2427] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:17 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:17.560009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:17.560711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:17.578373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:17.579271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:17.579780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:17.580566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:17.581424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:17.582083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.042340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:18.046286 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:18.055936 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f546192d-41ab-4788-8e2b-8e86fdb851f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.499930 Aug 21 01:17:18.060348 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1383/2428] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:17 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:18.065750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:18.070422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:18.087244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.091036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.091716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.097533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.098494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.099198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.342603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:18.353229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c1bd63f6-68b4-4159-af6d-87edbaffec9b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.291475 Aug 21 01:17:18.367852 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1384/2429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:18 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:18.374348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:18.375206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:18.381756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.382574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.383167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.384293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.385160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.385735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.670393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:18.684589 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48be6180-a60a-4068-893a-b05ef04d6728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1275 microversion: 2.1 time: 0.315333 Aug 21 01:17:18.689712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1385/2430] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:18 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:18.699688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:18.707552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:18.721782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.722740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.723375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.724737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:18.725547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:18.726193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:18.764573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:17:19.218357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:19.238075 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4ba1049-bb1f-4dad-a63f-c4abac32f87b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.545786 Aug 21 01:17:19.238929 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1386/2431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:18 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:19.248077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:19.249054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:19.269275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:19.276186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:19.276974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:19.278327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:19.279009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:19.280743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:19.647430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:19.655911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-44b1c468-397a-418b-b354-1e985b4fcdd7 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1462 microversion: 2.1 time: 0.412464 Aug 21 01:17:19.656512 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1387/2432] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:19 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1462 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:19.678238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a1c030-1222-4076-951f-8b9bda8d896d", "tag": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:19.709607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:19.710430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:19.714375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:19.755057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] Creating event network-changed:ffdead26-b8af-41ba-b0ee-1bfb0bf65072 for instance 17a1c030-1222-4076-951f-8b9bda8d896d on n-h1-master-1 Aug 21 01:17:19.785394 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f1b6191b-d056-4e41-82e6-e3a945009c5a req-4aa7291d-6a61-40dd-be74-a49caee75bca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119754 Aug 21 01:17:19.787002 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1388/2433] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:19.794290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:19.795591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:19.802627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:19.803604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:19.804251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:19.807144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:19.807848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:19.808475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:20.003434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:20.014544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-957ece5b-a4fa-4fd7-9d8f-122ff7201e80 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.225035 Aug 21 01:17:20.016839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1389/2434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:19 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:20.031406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2027479497", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa556953-a792-46d3-9fb5-d1fa66df1f0f"}], "security_groups": [{"name": "tempest-securitygroup--554674719"}], "key_name": "tempest-keypair-124134900", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:20.334069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] validate_networks() for [('fa556953-a792-46d3-9fb5-d1fa66df1f0f', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:17:20.432038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Updating instance_info_cache with network_info: [{"id": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072", "address": "fa:16:3e:75:75:21", "network": {"id": "b125c716-ca40-41e6-86cc-e1a8db2bc69b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1158799128-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7026e7b12fc24e5c979db5f97191405d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffdead26-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:17:20.448696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Releasing lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:17:20.449802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65cb2af7-05c7-4a0c-a4ec-ffcb8d62edee tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 202 len: 0 microversion: 2.1 time: 6.856855 Aug 21 01:17:20.455085 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1046/2435] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:13 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 0 bytes in 6863 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:17:20.466448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:20.468032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:20.482868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:20.485257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:20.486055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:20.486978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:20.487589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:20.488167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:20.922798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:20.949277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-daf841a4-28a9-48ff-b8a9-afb5fa1bb8a3 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.492917 Aug 21 01:17:20.950724 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1047/2436] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:20 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:21.057870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:17:21.058533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:17:21.064580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:17:21.067478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:17:21.068185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:17:21.086899 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=33 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:21.089798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.090416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.090972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.093315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.094470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.095872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.160176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for project fe917515a56c4577b45df3eb16642a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:21.168331 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:21.169917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for user 3338f52621ec4501b2f0b88ff5cb36fb and project fe917515a56c4577b45df3eb16642a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:21.194970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:17:21.203574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:17:21.317489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5bc5d939-cfcc-46fc-9dc8-6df76beaaf42 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.296430 Aug 21 01:17:21.325165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1390/2437] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:17:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:17:21.336279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:21.343797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:21.356887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.357376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.357813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.358605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.359072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.363667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.427925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Calling method '.version_select at 0x7fc3fd84ce50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:21.445188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.447847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.447847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.470447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.471282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.472468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.504130 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1fe174e-0c7f-4035-be93-07f2739684d6 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/a3b035ec7bd0473788f89c45e4950066?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725" status: 200 len: 694 microversion: 2.1 time: 0.551769 Aug 21 01:17:21.505861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1048/2438] 10.222.0.46 () {58 vars in 1412 bytes} [Sun Aug 21 01:17:20 2022] GET /compute/v2.1/os-simple-tenant-usage/a3b035ec7bd0473788f89c45e4950066?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725 => generated 694 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:21.517746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1916912123"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:21.520719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:21.529511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.530233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.530937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:21.531876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:21.533398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:21.534075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.008038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:22.019527 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2c90454-2095-49a6-962c-fae01ea77a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.692273 Aug 21 01:17:22.021806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1391/2439] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:21 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:22.031948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e8b18e4-4dad-4ac7-b3e5-5ce76a75fe03 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'create', calling method: .version_select at 0x7fc3f9b71940>, body: {"pool": "747ccea1-029c-4226-a640-bd1cbebbd4e4"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:22.076057 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c54f5439-3c11-4245-a485-b3af1918ba3e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.567981 Aug 21 01:17:22.077629 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1049/2440] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:21 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 21 01:17:22.119589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f68483-18ba-4b22-bab2-ed26991c7dca", "name": "network-vif-plugged", "status": "completed", "tag": "9df4987f-ed28-4166-a8c8-d6bc33bf2c66"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:22.154548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.155644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.156422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.179878 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] Creating event network-vif-plugged:9df4987f-ed28-4166-a8c8-d6bc33bf2c66 for instance f6f68483-18ba-4b22-bab2-ed26991c7dca on n-h1-master-1 Aug 21 01:17:22.185765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8aeffe33-978f-49d4-a9f7-538e53dacc01 req-983f78a8-941f-4183-8d36-d91037d71ca2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094112 Aug 21 01:17:22.188683 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1050/2441] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:22.225653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-41054981-e384-4ac4-8f60-ad799fc95639 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:22.226712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-41054981-e384-4ac4-8f60-ad799fc95639 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:22.377538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-41054981-e384-4ac4-8f60-ad799fc95639 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:22.391477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-41054981-e384-4ac4-8f60-ad799fc95639 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1237 microversion: 2.1 time: 0.177700 Aug 21 01:17:22.394178 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1051/2442] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:22 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1237 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:22.402062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '.version_select at 0x7fc3fda80c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:22.417879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.418645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.419234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.431530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.432471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.433140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.447768 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4db43ec4-77d5-4cfd-94d1-056f5c02a887 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/a3b035ec7bd0473788f89c45e4950066?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725" status: 200 len: 694 microversion: 2.1 time: 0.052194 Aug 21 01:17:22.449106 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1052/2443] 10.222.0.46 () {58 vars in 1412 bytes} [Sun Aug 21 01:17:22 2022] GET /compute/v2.1/os-simple-tenant-usage/a3b035ec7bd0473788f89c45e4950066?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725 => generated 694 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:22.462912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f732fd-f08f-4545-9ddd-111094e6b979", "tag": "4d43ba82-7160-4ac1-86ef-6cab4b54268c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:22.478944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.479472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.479991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.494051 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] Creating event network-changed:4d43ba82-7160-4ac1-86ef-6cab4b54268c for instance 44f732fd-f08f-4545-9ddd-111094e6b979 on n-h2-master-1 Aug 21 01:17:22.500478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b64ad852-dee3-4b8a-b73b-cd707f8775b4 req-5dd3c060-4839-440e-8c07-9b7394f7a2a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049598 Aug 21 01:17:22.501766 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1053/2444] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:22.508639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:22.509582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:22.518859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.519712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.520373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.521402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.522644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.523408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.745919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:22.755481 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92ec7617-d467-470a-ac7d-6af40f980250 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.252142 Aug 21 01:17:22.756074 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1054/2445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:22 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:22.765161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Calling method '.version_select at 0x7fc3fd99fa60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:22.779270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.779787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.780283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.796550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.797192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.797624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.894994 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0e14b75-cc77-4917-973b-dddb9595c177 tempest-TenantUsagesTestJSON-65751388 tempest-TenantUsagesTestJSON-65751388-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725&detailed=1" status: 200 len: 27742 microversion: 2.1 time: 0.137688 Aug 21 01:17:22.895825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1055/2446] 10.222.0.46 () {58 vars in 1335 bytes} [Sun Aug 21 01:17:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-20T01%3A17%3A19.669725&end=2022-08-22T01%3A17%3A19.669725&detailed=1 => generated 27742 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:17:22.931895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:22.932393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:22.940452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.940968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.941398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.942098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:22.942542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:22.942956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:22.970130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:17:23.064927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c8045e9-b7a8-450c-9283-10c5cd00f36b tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 204 len: 0 microversion: 2.1 time: 0.136023 Aug 21 01:17:23.069794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1056/2447] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:17:22 2022] DELETE /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:17:23.075482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:23.076183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:23.083246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.083467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.084129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.084461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.085487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.085608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.238744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:23.247668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8075016-8280-4b3e-b12e-fffd76c601be tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.176494 Aug 21 01:17:23.248411 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1057/2448] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:23 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:23.253634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:23.254516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:23.261000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.261722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.262305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.263014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.263616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.264043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.450645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:23.459770 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fc9a771-3ffb-4b7b-879b-450842a395d1 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1468 microversion: 2.1 time: 0.209945 Aug 21 01:17:23.472797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1058/2449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:23 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:23.472797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:23.472797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:23.474786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.475263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.475864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.476903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.477361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.477758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.559729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:23.570018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-269d6aee-9a01-4afa-9ed1-6ab732d0c2a3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1289 microversion: 2.1 time: 0.107405 Aug 21 01:17:23.583703 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1059/2450] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:23 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:23.777675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:23.778744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:23.786010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.787108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.787108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.787831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:23.788361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:23.788808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:23.794841 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:23.996287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:24.006474 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88a1e5e3-67a4-441a-9a30-f254c1f69c79 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1313 microversion: 2.1 time: 0.233207 Aug 21 01:17:24.008834 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1060/2451] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:23 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:24.267866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:24.268701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:24.276465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.277307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.277794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.278693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.279305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.279885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.423437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:24.432218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd59179a-05b2-4ba1-aeeb-b2b9f7b01457 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.168466 Aug 21 01:17:24.432978 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1061/2452] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:24 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:24.484916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:24.488115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:24.495275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.495673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.496103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.496857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.497301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.497741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.656698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:24.666020 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ae04283-ed02-4b85-af6f-f389e9fbcb53 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1468 microversion: 2.1 time: 0.187749 Aug 21 01:17:24.677515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1062/2453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:24 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:24.688489 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:24.689770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:24.695895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.696560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.697016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.698390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.698993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.699560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.742038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e8b18e4-4dad-4ac7-b3e5-5ce76a75fe03 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.717591 Aug 21 01:17:24.749900 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1392/2454] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:17:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:24.763290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.185"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:24.772046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:24.785804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.786585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.787011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.787708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:24.788148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:24.788561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:24.792615 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:24.811675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:24.826243 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8063f752-0f57-43bf-b935-743b7414b7a8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1289 microversion: 2.1 time: 0.145625 Aug 21 01:17:24.826946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:17:24.827539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquired lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:17:24.828594 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1063/2455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:24 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:25.030155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:25.030155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:25.036364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.036890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.037320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.038032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.038570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.038998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.515524 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4.", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:17:25.516755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Releasing lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:17:25.517668 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.517668 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Request method failure captured: Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action HTTP/1.1 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 46 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeBc_-RmtYRNuceGPoWi-pRzvMeyiKEziaN3TZkFO_dJJSOx871EK9_HXuXxrS7-OrbDS2qAJ7vtE0JYRjEGQqsV7k9pD7JZ2phGMauKSWcoC2LJhz_nv_cWb86P4jz0uSZPYxKSIvCZTsBpxP-BGX1C5sAPv_np5l0O-ZEUSQWxH4 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7026e7b12fc24e5c979db5f97191405d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}] Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9648ebb42868486d81c91e753a293f8f Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: {"addFloatingIp": {"address": "172.35.1.185"}} Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '17a1c030-1222-4076-951f-8b9bda8d896d', 'body': {'addFloatingIp': {'address': '172.35.1.185'}}} Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:17:25.520367 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] Aug 21 01:17:25.524849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:25.528526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Returning 400 to user: Cannot associate floating IP 172.35.1.185 (2e543862-3498-428c-b95b-709d3dc40257) with port ffdead26-b8af-41ba-b0ee-1bfb0bf65072 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 747ccea1-029c-4226-a640-bd1cbebbd4e4. Aug 21 01:17:25.528526 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-0d35390b-8066-4621-bc7e-62a10daafdf4'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:25.528991 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf108531-eee7-4e1b-9b46-001de30d20e6 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 400 len: 381 microversion: 2.1 time: 0.775370 Aug 21 01:17:25.529576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1393/2456] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:24 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 381 bytes in 779 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:17:25.539581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:25.544487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:25.553395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.553877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.555127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.555849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.556910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.557246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.625988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:25.649958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0266038b-ecea-41bf-9097-938ca1b0c878 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1499 microversion: 2.1 time: 0.625625 Aug 21 01:17:25.650994 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1064/2457] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:25 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1499 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:25.657470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-467ba68d-26a7-45be-ba8c-2b9cd139131a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '.version_select at 0x7fc3fd84c0d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:25.823608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:25.837628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5d480c8-b8fc-4bb5-9b21-c241d7709249 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.306551 Aug 21 01:17:25.848804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1394/2458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:25 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:25.848804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:25.849317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:25.860616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.861395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.862028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.862922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:25.863685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:25.864264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:25.890809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lazy-loading 'flavor' on Instance uuid f6f68483-18ba-4b22-bab2-ed26991c7dca {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:17:25.984753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba2a2637-412c-4217-8ed4-88570a154efe tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "POST /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca/action" status: 200 len: 32 microversion: 2.1 time: 0.143457 Aug 21 01:17:25.991850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1395/2459] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:25 2022] POST /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:17:26.013035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:26.013932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:26.031235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.032368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.033003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:26.033937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.035014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.035595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:26.514876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:26.539341 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1f494ce-fe8b-400a-a96d-00033befb0bc tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1468 microversion: 2.1 time: 0.537434 Aug 21 01:17:26.543136 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1396/2460] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:25 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1468 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:26.560710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:26.564331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:26.576286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.580463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.581262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:26.584199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.584932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.587181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:26.808444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:26.826634 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a9ae38e-6ac9-4566-8db7-52823ea97500 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1289 microversion: 2.1 time: 0.279413 Aug 21 01:17:26.828848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1397/2461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:26 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1289 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:26.834607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:26.837773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:26.857446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.858813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.859904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:26.862282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:26.864525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:26.870127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.041603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-467ba68d-26a7-45be-ba8c-2b9cd139131a tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/2e543862-3498-428c-b95b-709d3dc40257" status: 202 len: 0 microversion: 2.1 time: 1.389204 Aug 21 01:17:27.043141 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1065/2462] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:17:25 2022] DELETE /compute/v2.1/os-floating-ips/2e543862-3498-428c-b95b-709d3dc40257 => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:27.050191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:27.051033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:27.073839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.074331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.074773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.075502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.075955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.079786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.102499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:27.114391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a806e4a-294f-4d75-845b-414f9baa461d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.284171 Aug 21 01:17:27.115294 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1398/2463] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:26 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:27.119920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.251"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:27.319505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:27.327432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.328937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.329444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.337998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.339586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.340205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.443252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:27.452740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2efe541-3695-430b-a57d-19eb1d4f7444 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.408128 Aug 21 01:17:27.456360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1066/2464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:27 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:27.564346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:27.564804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:27.593923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.595491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.597924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.599748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:27.600574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:27.601679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:27.861808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:17:27.862374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquired lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:17:28.184361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:28.203389 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e79d8160-9a8b-4f6c-9dd0-b76d4a6d57ba tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1468 microversion: 2.1 time: 0.638288 Aug 21 01:17:28.204675 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1067/2465] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:27 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1468 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:28.215986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:28.219615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:28.237103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:28.238497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:28.240747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:28.242030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:28.244209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:28.247193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:28.449310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:28.457957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-847849da-ade1-4785-be2b-25410684a827 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1295 microversion: 2.1 time: 0.251947 Aug 21 01:17:28.463137 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1068/2466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:28 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:28.469309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:28.481580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:28.493228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:28.494023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:28.494641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:28.495978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:28.500857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:28.501729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:29.469638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Building network info cache for instance {{(pid=122482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:17:30.077151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:30.103483 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc033ccf-e84c-4822-8aab-c816b0ba1f0a tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.637487 Aug 21 01:17:30.110594 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1069/2467] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:28 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:30.131335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:30.137401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:30.161824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:30.162611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:30.163185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:30.164073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:30.164857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:30.165580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:30.668612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Updating instance_info_cache with network_info: [{"id": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072", "address": "fa:16:3e:75:75:21", "network": {"id": "b125c716-ca40-41e6-86cc-e1a8db2bc69b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1158799128-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7026e7b12fc24e5c979db5f97191405d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapffdead26-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:17:30.716853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Releasing lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:17:30.721622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4025929-1692-4b55-bb88-7744f3825dcc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 202 len: 0 microversion: 2.1 time: 3.603850 Aug 21 01:17:30.731072 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1399/2468] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:27 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 0 bytes in 3613 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:17:30.746861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-plugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:30.769645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:30.770656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:30.772464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:30.822827 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] Creating event network-vif-plugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:17:30.837768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c5760abb-b343-4a0b-b69e-9ce36ecfe652 req-310143e1-7bce-4990-bccf-1340f829cde2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103960 Aug 21 01:17:30.839323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:30.840315 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1400/2469] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:30.848809 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc31de16-4a20-4e8c-80b5-e640d12edc6c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.736603 Aug 21 01:17:30.851462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:30.852211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1070/2470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:30 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:30.852893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:30.890308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:30.890991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:30.893770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:30.896900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:30.901675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:30.904560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.098057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.109984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.115832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.127362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lazy-loading 'fault' on Instance uuid e8fa74be-f069-4b2e-bf2c-8305cfd1189b {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:17:31.152914 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:31.187966 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:31.277161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69e173eef9b42a9ae6a0e1255ea2b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b035ec7bd0473788f89c45e4950066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:31.285924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be894d2a-c880-4658-932f-9a2cbcdab3d5 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 200 len: 1303 microversion: 2.1 time: 0.444005 Aug 21 01:17:31.287695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1401/2471] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:30 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 1303 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:31.313479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:31.314757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:31.328135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.329039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.329704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.331521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.332282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.333037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.463407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:31.472937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8ce53f7-24ea-4c3c-8b69-c8844d7d3ce4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1295 microversion: 2.1 time: 0.183206 Aug 21 01:17:31.473516 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1402/2472] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:31 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:31.514568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa74be-f069-4b2e-bf2c-8305cfd1189b", "name": "network-vif-deleted", "tag": "76b68206-3418-4d13-806a-dab8a5726784"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:31.529144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.529620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.530049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.556193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a1c030-1222-4076-951f-8b9bda8d896d", "tag": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:31.567794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] Creating event network-vif-deleted:76b68206-3418-4d13-806a-dab8a5726784 for instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b on n-h2-master-1 Aug 21 01:17:31.576648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.579497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.580113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.581842 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7cfa607e-7379-4131-bcdc-df19a5269233 req-c994dca6-3c22-44d3-b8ff-d9073e52b068 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087451 Aug 21 01:17:31.585929 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1403/2473] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:31.591410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36fdb2a8-2a01-481d-9e65-1881a7f1b41e tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '.version_select at 0x7fc3f959cf70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:31.633660 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] Creating event network-changed:ffdead26-b8af-41ba-b0ee-1bfb0bf65072 for instance 17a1c030-1222-4076-951f-8b9bda8d896d on n-h1-master-1 Aug 21 01:17:31.641873 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a56f417c-96b4-4072-a39f-879b38d03666 req-a04fa36f-0e36-4248-88b5-eb42c2d040d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.787557 Aug 21 01:17:31.642443 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1071/2474] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:31.654224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:31.654952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:31.678667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.684208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.684957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:31.685882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:31.688821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:31.689773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:32.382438 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=30 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:32.791498 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:32.920067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:32.929155 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17818cd2-f1d9-4c9d-944e-34ab8c2c246d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.285274 Aug 21 01:17:32.929747 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1072/2475] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:31 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:32.946108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:32.946743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:32.973542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:32.974756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:32.976329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:32.980327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:32.982118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:32.984386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.758709 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36fdb2a8-2a01-481d-9e65-1881a7f1b41e tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/d81794fb-2871-4d5e-8905-fa4feb2e79d7" status: 202 len: 0 microversion: 2.1 time: 2.171320 Aug 21 01:17:33.759967 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1404/2476] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:17:31 2022] DELETE /compute/v2.1/os-floating-ips/d81794fb-2871-4d5e-8905-fa4feb2e79d7 => generated 0 bytes in 2173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:33.771019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:33.772021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] [instance: e8fa74be-f069-4b2e-bf2c-8305cfd1189b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:33.789618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:33.790535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:33.791325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.792202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:33.792991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:33.794054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.863693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] HTTP exception thrown: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Request method failure captured: Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b HTTP/1.1 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeIFwrgFSgr-GWQWhz10E6tNHbfrGXhhkYYkV3zTCkV0Z6KBlreiIDEbfK3NLftvqkZQWR0wfIRnX19wAtbcQxAIwP4c1lavDv6HkEzIwKvPbsOFdloOb0vlLiCtlCa_c_4ooalShXYEMMTB7RECsg09aAwCITC57xUQ8HmGZxQza0 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a3b035ec7bd0473788f89c45e4950066 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TenantUsagesTestJSON-1572312356 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3b035ec7bd0473788f89c45e4950066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a3b035ec7bd0473788f89c45e4950066", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a3b035ec7bd0473788f89c45e4950066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3b035ec7bd0473788f89c45e4950066"}]}] Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TenantUsagesTestJSON-1572312356 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a3b035ec7bd0473788f89c45e4950066 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1572312356 Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TenantUsagesTestJSON-1572312356-project Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b69e173eef9b42a9ae6a0e1255ea2b4c Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TenantUsagesTestJSON-1572312356-project Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: exception: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e8fa74be-f069-4b2e-bf2c-8305cfd1189b'} Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:33.870385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:33.875755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] Returning 404 to user: Instance e8fa74be-f069-4b2e-bf2c-8305cfd1189b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:33.878904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57fb203f-3397-4fe5-bb1c-fc2bc8aa4479 tempest-TenantUsagesTestJSON-1572312356 tempest-TenantUsagesTestJSON-1572312356-project] 10.222.0.46 "GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b" status: 404 len: 111 microversion: 2.1 time: 0.113033 Aug 21 01:17:33.889454 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1405/2477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:33 2022] GET /compute/v2.1/servers/e8fa74be-f069-4b2e-bf2c-8305cfd1189b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:17:33.897524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:33.898150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:33.903902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:33.905449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:33.906099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:33.906718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.907437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:33.908477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:33.908942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.915403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11d8da94-e73d-4b24-889d-d73535a01e4b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.973053 Aug 21 01:17:33.919575 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1073/2478] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:32 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:33.933759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f732fd-f08f-4545-9ddd-111094e6b979", "name": "network-vif-plugged", "status": "completed", "tag": "4d43ba82-7160-4ac1-86ef-6cab4b54268c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:33.953408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:33.953790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:33.954224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:33.981889 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] Creating event network-vif-plugged:4d43ba82-7160-4ac1-86ef-6cab4b54268c for instance 44f732fd-f08f-4545-9ddd-111094e6b979 on n-h2-master-1 Aug 21 01:17:34.002074 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-abfef49e-428b-4611-afb6-96efb9407a08 req-f0c9f665-3c01-4d0b-a105-89fa1043107f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081170 Aug 21 01:17:34.003019 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1074/2479] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:34.011600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fb9d2cf-7bb4-4334-855c-f9a346373299 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fb9d2cf-7bb4-4334-855c-f9a346373299 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Request method failure captured: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action HTTP/1.1 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 34 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeBc_-RmtYRNuceGPoWi-pRzvMeyiKEziaN3TZkFO_dJJSOx871EK9_HXuXxrS7-OrbDS2qAJ7vtE0JYRjEGQqsV7k9pD7JZ2phGMauKSWcoC2LJhz_nv_cWb86P4jz0uSZPYxKSIvCZTsBpxP-BGX1C5sAPv_np5l0O-ZEUSQWxH4 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7026e7b12fc24e5c979db5f97191405d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}] Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9648ebb42868486d81c91e753a293f8f Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: {"addFloatingIp": {"address": ""}} Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '17a1c030-1222-4076-951f-8b9bda8d896d', 'body': {'addFloatingIp': {'address': ''}}} Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '' Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:17:34.018315 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 21 01:17:34.022719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.023418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fb9d2cf-7bb4-4334-855c-f9a346373299 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:34.024096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fb9d2cf-7bb4-4334-855c-f9a346373299 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 400 len: 142 microversion: 2.1 time: 0.019979 Aug 21 01:17:34.027420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1075/2480] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:34 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:17:34.045291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:34.046759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:34.064639 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:34.071083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.071769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.074814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.078222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.079250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.079876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.360087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:34.385727 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e4ed9c1-d7ac-4724-b78f-ba0cdf36e3bc tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.494849 Aug 21 01:17:34.399558 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1406/2481] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:33 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:34.399558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:34.400481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:34.436305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.437396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.438034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.441254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.443166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.448166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.536416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:17:34.538214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquired lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:17:34.853688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Releasing lock "refresh_cache-17a1c030-1222-4076-951f-8b9bda8d896d" {{(pid=122482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:17:34.855104 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] HTTP exception thrown: floating IP not found Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Request method failure captured: Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action HTTP/1.1 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 41 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeBc_-RmtYRNuceGPoWi-pRzvMeyiKEziaN3TZkFO_dJJSOx871EK9_HXuXxrS7-OrbDS2qAJ7vtE0JYRjEGQqsV7k9pD7JZ2phGMauKSWcoC2LJhz_nv_cWb86P4jz0uSZPYxKSIvCZTsBpxP-BGX1C5sAPv_np5l0O-ZEUSQWxH4 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7026e7b12fc24e5c979db5f97191405d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}] Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9648ebb42868486d81c91e753a293f8f Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: exception: floating IP not found Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '17a1c030-1222-4076-951f-8b9bda8d896d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 21 01:17:34.857609 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 21 01:17:34.861954 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.863349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Returning 404 to user: floating IP not found {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:34.864372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2e38889-df61-4688-b0f0-c2ac6840488c tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 404 len: 67 microversion: 2.1 time: 0.475843 Aug 21 01:17:34.869518 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1407/2482] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:34 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 67 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:17:34.875415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bbddd69-c913-444c-ba4c-50ebf78b91c7 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:34.882162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:34.896463 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f48cbca9-a7e3-4f0c-94bf-c05e56185519 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.867672 Aug 21 01:17:34.897081 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1076/2483] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:34 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:34.943377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:34.946571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:34.969101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.972185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.973197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.975351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:34.979400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:34.981008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:34.997067 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1bbddd69-c913-444c-ba4c-50ebf78b91c7 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bbddd69-c913-444c-ba4c-50ebf78b91c7 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Request method failure captured: Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action HTTP/1.1 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 44 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeBc_-RmtYRNuceGPoWi-pRzvMeyiKEziaN3TZkFO_dJJSOx871EK9_HXuXxrS7-OrbDS2qAJ7vtE0JYRjEGQqsV7k9pD7JZ2phGMauKSWcoC2LJhz_nv_cWb86P4jz0uSZPYxKSIvCZTsBpxP-BGX1C5sAPv_np5l0O-ZEUSQWxH4 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7026e7b12fc24e5c979db5f97191405d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}] Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9648ebb42868486d81c91e753a293f8f Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: exception: Floating IP not found for address 0.0.0.0. Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '17a1c030-1222-4076-951f-8b9bda8d896d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 21 01:17:34.999778 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bbddd69-c913-444c-ba4c-50ebf78b91c7 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bbddd69-c913-444c-ba4c-50ebf78b91c7 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action" status: 404 len: 88 microversion: 2.1 time: 0.130784 Aug 21 01:17:35.003429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1408/2484] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:34 2022] POST /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d/action => generated 88 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:17:35.021777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:35.022705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:35.050013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.050525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.050963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.051679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.052129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.057012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.141292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:17:35.248126 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:35.381516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7070a4ec-18de-4407-88af-69358fc172fd tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "DELETE /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 204 len: 0 microversion: 2.1 time: 0.373306 Aug 21 01:17:35.384318 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1409/2485] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:17:35 2022] DELETE /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:17:35.400993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:35.402453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:35.410621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.411675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.412343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.413504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.414248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.414889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.434744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:35.446145 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-260b2799-2a2c-47d2-8e46-7fcfe9384ade tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 0.514206 Aug 21 01:17:35.466360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1077/2486] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:34 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:35.480941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:35.481844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:35.498792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.501398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.501843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.503393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.505743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.506417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.857118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:35.889401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:35.898762 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a97b329c-5b82-46f6-a6b7-4c24a49caa91 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.405677 Aug 21 01:17:35.906076 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1078/2487] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:35 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:35.907017 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2595cee9-f7f6-4ff3-9642-48ac1958d5bc tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1542 microversion: 2.1 time: 0.517110 Aug 21 01:17:35.908172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1410/2488] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:35 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1542 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:35.928327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b529918-528f-4ae1-8f5b-552174a5c2e9", "tag": "5c277213-83ec-41af-8143-213b4e1b5301"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:35.938001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:35.939396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:35.962716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.965312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.966736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.968049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.968902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.970805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:35.995102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:35.995720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:35.996564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:36.054412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] Creating event network-changed:5c277213-83ec-41af-8143-213b4e1b5301 for instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 on n-h2-master-1 Aug 21 01:17:36.069703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f17f665f-d0f8-4dc3-8c1a-7b013a739aec req-a08e350d-4e23-47b0-8332-6ba987eb2132 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161690 Aug 21 01:17:36.072164 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1079/2489] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:36.476192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:36.477037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:36.491067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:36.491656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:36.492172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:36.493880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:36.495394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:36.496588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:36.682668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:36.699520 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8db8f3d7-4a34-4ff9-ab9f-8de06ae3a45f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.782427 Aug 21 01:17:36.715301 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1411/2490] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:35 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:36.930450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:36.932230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:36.951617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:36.952045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:36.952510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:36.955006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:36.965426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:36.966162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:37.275114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:37.286870 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8769f8c-2ab5-41f7-808c-c918f08aebc1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.364331 Aug 21 01:17:37.287747 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1412/2491] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:36 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:37.296146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:37.298537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:37.311245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:37.316640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:37.317404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:37.318478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:37.321257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:37.321893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:37.557564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:37.562163 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:37.579198 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ba24882-264f-4b21-b1f1-22e4b207f879 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1317 microversion: 2.1 time: 1.105769 Aug 21 01:17:37.581951 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1080/2492] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:36 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1317 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:37.603074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:37.612595 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-743b7889-5974-4bd5-b572-31ce4966f5b1 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1542 microversion: 2.1 time: 0.320953 Aug 21 01:17:37.615654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1413/2493] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:37 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:37.736993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:37.737520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:37.762695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:37.764464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:37.765315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:37.766175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:37.766846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:37.767670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:38.307594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:38.308217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:38.330608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:38.331604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:38.335722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:38.336666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:38.337318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:38.337901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.049655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:39.060142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9ae88c5-e48f-43d8-8203-47d9e50b4e70 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.327558 Aug 21 01:17:39.076257 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1081/2494] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:37 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:39.086297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:39.091804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:39.092434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:39.102383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2c938f2-263c-43b9-bf48-1b1af890f676 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.794656 Aug 21 01:17:39.103714 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1414/2495] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:38 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:39.112270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:39.112785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:39.113227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.113942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:39.114195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:39.115062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:39.123922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:39.126821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:39.127525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.127877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:39.128791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.129591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:39.130779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:39.131446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.432441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9648ebb42868486d81c91e753a293f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7026e7b12fc24e5c979db5f97191405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:39.457118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7aa979b-6577-4dc3-8443-ac5f96eb7e95 tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 200 len: 1542 microversion: 2.1 time: 0.338074 Aug 21 01:17:39.479918 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1415/2496] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:39 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:39.805465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a1c030-1222-4076-951f-8b9bda8d896d", "name": "network-vif-deleted", "tag": "ffdead26-b8af-41ba-b0ee-1bfb0bf65072"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:39.822270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:39.823187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:39.823893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:39.838205 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] Creating event network-vif-deleted:ffdead26-b8af-41ba-b0ee-1bfb0bf65072 for instance 17a1c030-1222-4076-951f-8b9bda8d896d on n-h1-master-1 Aug 21 01:17:39.844611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b706e0fd-3364-43c3-b89e-92c797af1bd5 req-b666297e-b8b5-4dc2-a85a-b8ab4382b5a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045585 Aug 21 01:17:39.846269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1416/2497] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:39.895430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:39.906468 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b729f90-6dd9-49b1-b552-0cfc04352332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1466 microversion: 2.1 time: 0.828765 Aug 21 01:17:39.911476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1082/2498] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:39 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1466 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:40.091567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:40.094125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:40.106487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.108410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.109811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:40.112351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.113705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.114289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:40.500299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:40.501340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:40.516064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.516557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.525918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:40.526821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.537372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.538140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:40.645333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:40.682901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3526bc65-4f88-4403-9d57-dbc12aca587b tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.601568 Aug 21 01:17:40.692138 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1083/2499] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:40 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:40.697886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:40.710773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:40.726516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.729204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.729734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:40.732580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:40.733845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:40.736368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:41.138146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-18c33b86-9159-4d0d-85c9-f8c93997f930 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1617 microversion: 2.1 time: 1.210190 Aug 21 01:17:41.139715 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1417/2500] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:39 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1617 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:41.164536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:41.167949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] [instance: 17a1c030-1222-4076-951f-8b9bda8d896d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:41.199257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:41.205773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:41.211479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:41.212381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:41.213130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:41.213896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:41.279642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] HTTP exception thrown: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Request method failure captured: Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d HTTP/1.1 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeBc_-RmtYRNuceGPoWi-pRzvMeyiKEziaN3TZkFO_dJJSOx871EK9_HXuXxrS7-OrbDS2qAJ7vtE0JYRjEGQqsV7k9pD7JZ2phGMauKSWcoC2LJhz_nv_cWb86P4jz0uSZPYxKSIvCZTsBpxP-BGX1C5sAPv_np5l0O-ZEUSQWxH4 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7026e7b12fc24e5c979db5f97191405d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7026e7b12fc24e5c979db5f97191405d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7026e7b12fc24e5c979db5f97191405d"}]}] Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7026e7b12fc24e5c979db5f97191405d Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547 Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9648ebb42868486d81c91e753a293f8f Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '17a1c030-1222-4076-951f-8b9bda8d896d'} Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. Aug 21 01:17:41.285780 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] Returning 404 to user: Instance 17a1c030-1222-4076-951f-8b9bda8d896d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:41.290071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5ae4159-b6e0-4190-85bd-c4e9bef2a04d tempest-FloatingIPsAssociationNegativeTestJSON-933851547 tempest-FloatingIPsAssociationNegativeTestJSON-933851547-project] 10.222.0.46 "GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d" status: 404 len: 111 microversion: 2.1 time: 0.145617 Aug 21 01:17:41.306427 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1418/2501] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:41 2022] GET /compute/v2.1/servers/17a1c030-1222-4076-951f-8b9bda8d896d => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:17:41.322510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: .version_select at 0x7fc3f959c8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-396041328", "policies": ["affinity"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:41.394896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:41.406161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:41.419585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:41.461923 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a750fe0-d285-4692-ad2d-0a6f9adc502d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.760541 Aug 21 01:17:41.465332 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1084/2502] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:40 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:41.592714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:41.631007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:41.701411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-814acd02-cf5c-4604-b7f0-811a107feb46 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.393456 Aug 21 01:17:41.721210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1419/2503] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:17:41 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:41.721427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:41.721427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:41.738803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:41.745302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:41.745825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:41.746703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:41.747178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:41.747602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:41.958745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1699647897", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "23bc45c5-9d79-4154-8d3e-52c09266b97c"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:42.182314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:17:42.495023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:42.510215 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0ee4b1c-1491-43f9-9069-d1e0d6b45336 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.804154 Aug 21 01:17:42.511290 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1085/2504] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:41 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:42.523175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:42.527297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:42.542636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:42.543117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:42.543574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:42.553437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:42.554184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:42.554776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:43.072609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:43.087022 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-517535ec-21e1-4661-bc7a-e406d811d8d0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.572415 Aug 21 01:17:43.087759 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1086/2505] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:42 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:43.531221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:43.532026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:43.551916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:43.552406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:43.552902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:43.559728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:43.560251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:43.560696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:43.651903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:17:43.652381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:17:43.652817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:17:43.653376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:17:43.653794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:17:43.738621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:43.741403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:43.742184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:43.743601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:43.744423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:43.745226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:43.802446 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:43.831210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:43.861602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:43.898787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 2 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:17:43.901382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:17:43.910503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:43.935280 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7677d852-b09b-4fd8-aa88-0a5f59ae1380 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.408246 Aug 21 01:17:43.941235 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1087/2506] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:43 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:44.035102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122482) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 21 01:17:44.110099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:44.111140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:44.142129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:44.146018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:44.153152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:44.155449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:44.159294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:44.161317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:44.161936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:44.162121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:44.335190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:44.347226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:44.401463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=74e98cac-7976-46ef-8708-58f0dc8198eb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:17:44.527854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:44.547576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:44.724021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:17:44.755562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:17:44.966311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0630bcf1-7402-43a8-b5da-1f2a63020ce4 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.012798 Aug 21 01:17:44.972114 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1420/2507] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:17:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 3020 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 21 01:17:44.989567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:44.993050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:45.022387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:45.026602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:45.028099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:45.038224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:45.041401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:45.045927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:45.111834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:45.149179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1659a525-beef-41c0-b4ac-db078afed071 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 1.028216 Aug 21 01:17:45.152659 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1088/2508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:44 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:45.175887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:45.218043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:45.219664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Searching by: {'deleted': False, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:17:45.310756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:45.312155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:45.315586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:45.316754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:45.323916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:45.327238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:45.419713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:17:45.495978 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-014aad0a-7870-462a-ad70-e7a78dbb860a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.335458 Aug 21 01:17:45.497005 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1089/2509] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:17:45 2022] GET /compute/v2.1/servers => generated 1004 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:45.509206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e135249c-d37d-42dd-9cfa-dda2f36185da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:45.509824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e135249c-d37d-42dd-9cfa-dda2f36185da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:45.790660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e135249c-d37d-42dd-9cfa-dda2f36185da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:45.822868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e135249c-d37d-42dd-9cfa-dda2f36185da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1219 microversion: 2.1 time: 0.314241 Aug 21 01:17:45.829166 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1090/2510] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:45 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1219 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:45.940389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:45.948534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be33f4de-2a12-4469-897b-e4d5bdd126df tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.973840 Aug 21 01:17:45.954737 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1421/2511] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:44 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:46.173769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:46.174425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:46.230741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.231245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.231685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:46.237030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.237557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.246557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:46.851220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:46.852360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:46.865427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:46.876295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.881997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.882509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:46.883268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.883735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.894959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:46.895729 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0779e710-5458-4634-b8fa-0c55924d6478 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.728419 Aug 21 01:17:46.896375 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1091/2512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:46 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:46.975852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:46.976474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:46.993700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.994222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.994676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:46.995418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:46.995877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:46.996307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:47.206673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:47.224296 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-00cf150b-4deb-4628-a143-795dfa4baeb5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1223 microversion: 2.1 time: 0.379546 Aug 21 01:17:47.230496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1422/2513] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:46 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1223 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:47.923140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:47.923789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:47.940347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:47.940347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:47.956299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:47.959383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:47.960055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:47.961029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:48.889223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:48.904674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04e980db-75e5-48e0-8081-992e51f4c9db tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.933145 Aug 21 01:17:48.905302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1092/2514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:46 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:48.924038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b529918-528f-4ae1-8f5b-552174a5c2e9", "name": "network-vif-plugged", "status": "completed", "tag": "5c277213-83ec-41af-8143-213b4e1b5301"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:48.967621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:48.968384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:48.969019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:48.994507 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] Creating event network-vif-plugged:5c277213-83ec-41af-8143-213b4e1b5301 for instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 on n-h2-master-1 Aug 21 01:17:49.002073 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c1c3d732-0d39-4d93-b321-8ebbf21613ef req-fbee986e-7fcb-415e-9ea2-a17bd41d4f36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095359 Aug 21 01:17:49.007855 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1093/2515] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:49.018825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:49.021856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:49.041861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:49.043375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:49.043993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:49.044929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:49.045525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:49.049827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:49.058707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:49.088374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4665a9d9-8070-4622-9d8d-f82927f46680 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 1.170182 Aug 21 01:17:49.088998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1423/2516] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:47 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:49.297798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:49.308451 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba0c4f2b-572f-452c-a551-27f5c0d9a21d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1277 microversion: 2.1 time: 0.298903 Aug 21 01:17:49.318602 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1094/2517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:49 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:49.933003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:49.933886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:49.949242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:49.967852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:49.974551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:49.978646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:49.982420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:49.986754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:50.113088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:50.114335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:50.132095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:50.135685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:50.137060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:50.140437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:50.144102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:50.144747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:50.684898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:50.717311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d20e29f-8c56-45ff-86d8-468bf00a9391 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1362 microversion: 2.1 time: 0.605953 Aug 21 01:17:50.739708 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1095/2518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:50 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1362 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:50.740885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:50.750425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4d4e731-2691-45b8-a379-06bacd8b04c0 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.822052 Aug 21 01:17:50.750712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:50.756620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:50.761980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1424/2519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:49 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:50.799349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:50.800288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:50.801234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:50.806556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:50.808360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:50.810361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:51.197711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:51.212302 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b207d7a3-04b0-4ea1-9bf8-a16ad75f28d5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1277 microversion: 2.1 time: 0.469660 Aug 21 01:17:51.213456 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1096/2520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:50 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1277 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:51.746538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:51.747880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:51.759549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:51.760062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:51.760478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:51.761261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:51.761691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:51.762114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:51.793536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:51.800213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:51.818619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:51.819616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:51.820346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:51.824240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:51.825152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:51.826299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:52.282204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:52.291075 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e46fc4d-99d9-4c57-91e2-c1c816e03065 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1547 microversion: 2.1 time: 0.549500 Aug 21 01:17:52.297019 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1425/2521] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:51 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1547 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:52.302222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:52.313327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:52.341658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:52.343220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:52.344730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:52.346438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:52.348008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:52.349206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:53.038871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:53.054196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcd740d4-2ebc-42e2-9869-bd67637c693f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.276607 Aug 21 01:17:53.070480 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1097/2522] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:51 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:53.089304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:53.089878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:53.129025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:53.130380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:53.133055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:53.136578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:53.139478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:53.139967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:53.419860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:53.429246 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04455525-291b-4650-aa9f-9c4f12f2e372 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 1.130887 Aug 21 01:17:53.433293 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1426/2523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:52 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:53.524246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76c53c61-a167-4836-8692-f20a855b3edb tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.452659 Aug 21 01:17:53.525820 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1098/2524] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:17:53 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-interface => generated 284 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:54.093858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:54.095209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:54.114436 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:54.127474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:54.134664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:54.135349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:54.136295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:54.136936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:54.137524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:54.457899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:54.458535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:54.482567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:54.487898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:54.488487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:54.489311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:54.489888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:54.499755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:54.510041 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:54.813075 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=30 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:55.120422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:55.147531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55202606-1919-44e3-9f40-649921ed4cef tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.056381 Aug 21 01:17:55.149807 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1427/2525] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:54 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:55.174486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:55.175198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:55.183620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:55.190276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:55.190926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:55.191858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:55.192706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:55.193459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:55.362157 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:55.693697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:55.714831 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47de6c25-4656-47c4-9022-335732b88434 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.560217 Aug 21 01:17:55.715437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1428/2526] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:55 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:55.801084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:55.815223 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:55.828103 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1aacc954-de96-4140-9516-4e56be90d075 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 1.375197 Aug 21 01:17:55.829003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1099/2527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:54 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:56.170589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:56.171882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:56.187631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:56.190059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:56.194160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:56.196118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:56.197462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:56.198735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:56.268178 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:56.302730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff1f14e-30e6-4660-9f1f-dc2276c62818", "tag": "c880605c-ea4c-4827-8d31-201a9c606e58"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:56.336859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:56.338366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:56.338807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:56.365868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] Creating event network-changed:c880605c-ea4c-4827-8d31-201a9c606e58 for instance eff1f14e-30e6-4660-9f1f-dc2276c62818 on n-h1-master-1 Aug 21 01:17:56.376384 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3223dd36-ed7b-4f11-b0c6-1161a9ed62c2 req-6ff43f16-5e05-447a-af6f-1ff0910ba9e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076003 Aug 21 01:17:56.377969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1100/2528] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:56.642617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:56.660550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d87bf075-3054-4f0a-9c07-709af73636dc tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.494035 Aug 21 01:17:56.666396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1429/2529] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:56 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:56.737666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:56.738513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:56.754592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:56.755080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:56.755508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:56.756211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:56.756655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:56.757113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:56.864578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] Calling method '.version_select at 0x7fc3fe1459d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:56.957170 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 083b4c57-1321-44ea-a533-e916b62fb725 could not be found", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:17:56.958183 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] HTTP exception thrown: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] Request method failure captured: Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-floating-ips/083b4c57-1321-44ea-a533-e916b62fb725 HTTP/1.1 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYfEkWTcdyUDsbK7SVub7xc1Wgy9G8jEWLhjvGu2AhxHOozboF1lFNe-_YOujuQmRn6tItx-WFGwp_cJs0ELzRzs4mvrAJMGrbIuuNmCkKEmCJMXbV1lsYbm9wRb_SRGVJ5wN9NgOQv3pOTuy1PA8WTok0DBDBUBCYyPJIeyk00gLj0 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: ad45304b99cf41a6a4ab1b908f47cefb Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-605221827 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad45304b99cf41a6a4ab1b908f47cefb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ad45304b99cf41a6a4ab1b908f47cefb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ad45304b99cf41a6a4ab1b908f47cefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad45304b99cf41a6a4ab1b908f47cefb"}]}] Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-605221827 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: ad45304b99cf41a6a4ab1b908f47cefb Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-605221827 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-605221827-project Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7983c2fd79234b14b8f76c282f5b32a8 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-605221827-project Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '083b4c57-1321-44ea-a533-e916b62fb725'} Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 083b4c57-1321-44ea-a533-e916b62fb725 could not be found Aug 21 01:17:56.960323 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31282cbd-4160-49fe-9712-5a3741a2cd3f'] Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725. Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725 Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725 Aug 21 01:17:56.964409 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:17:56.968446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] Returning 404 to user: Floating IP not found for ID 083b4c57-1321-44ea-a533-e916b62fb725 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:17:56.971037 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8043fe6a-0399-4878-a871-893055da6e09 tempest-FloatingIPDetailsNegativeTestJSON-605221827 tempest-FloatingIPDetailsNegativeTestJSON-605221827-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/083b4c57-1321-44ea-a533-e916b62fb725" status: 404 len: 111 microversion: 2.1 time: 0.578547 Aug 21 01:17:56.978907 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1101/2530] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:17:56 2022] GET /compute/v2.1/os-floating-ips/083b4c57-1321-44ea-a533-e916b62fb725 => generated 111 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:17:56.990752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:56.995713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:57.014486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:57.027822 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-160ce3d6-b424-428b-a2d2-e8b0eb1da410 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.294621 Aug 21 01:17:57.028908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1430/2531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:56 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:57.032640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.033187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.033621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.034332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.034782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.050444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.051639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-941626843"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:57.057664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:57.073562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.081292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.082673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.084281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.087618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.088286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.509836 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f47350a-53fc-4c08-a7f3-a06f590fcb58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.462852 Aug 21 01:17:57.525438 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1431/2532] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:57 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 21 01:17:57.690283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:57.691383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:57.704042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.705197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.705934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.707168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:57.708094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:57.709416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:57.946044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:57.980051 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ecb72fac-8e91-4928-9c8b-d818a0ea7223 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1485 microversion: 2.1 time: 0.282612 Aug 21 01:17:57.981109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1432/2533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:57 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1485 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:58.039593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:58.040564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:58.057062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:58.060350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:58.061157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:58.075145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:58.075145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:58.075145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:58.080591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:58.094775 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53b87542-ff86-4079-bb91-b50300abf6c9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 1.114425 Aug 21 01:17:58.113077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1102/2534] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:56 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:17:58.232451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebdee694-1bb8-4041-a787-ed41fcf1b56e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "POST /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca/action" status: 202 len: 0 microversion: 2.1 time: 0.196332 Aug 21 01:17:58.239560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1433/2535] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:17:58 2022] POST /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:17:58.246943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:58.247580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:58.257987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:58.258590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:58.259043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:58.260093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:58.260865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:58.262005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:59.119092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:17:59.119967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:17:59.134049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:59.134888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:59.135649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:59.136590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:59.137303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:59.138080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:59.513615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:59.526802 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9ca5f84-32be-44b3-8545-2d7a61480181 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.410380 Aug 21 01:17:59.527737 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1434/2536] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:59 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:17:59.538896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e98cac-7976-46ef-8708-58f0dc8198eb", "tag": "6f0691fa-8e19-440b-89a6-5cd06624a3c8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:17:59.569338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:17:59.569989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:17:59.572985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:17:59.597437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] Creating event network-changed:6f0691fa-8e19-440b-89a6-5cd06624a3c8 for instance 74e98cac-7976-46ef-8708-58f0dc8198eb on n-h1-master-1 Aug 21 01:17:59.609787 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-dec5a655-911c-47bc-8afc-9348fbe3ea22 req-3503f645-f4d9-42ee-a814-ad67ae18a185 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078232 Aug 21 01:17:59.619454 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1435/2537] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:17:59.639049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:17:59.649136 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67f2a3f5-73c6-4951-b291-b9cdf45a79f5 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1493 microversion: 2.1 time: 1.407699 Aug 21 01:17:59.649726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1103/2538] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:17:58 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1493 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:00.447802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-unplugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:00.467650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:00.468748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:00.469868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:00.484227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] Creating event network-vif-unplugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:18:00.491697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c04014a6-4626-4e58-a092-630741f22111 req-555a3d77-ffe5-4111-9ad7-4d2edfc95644 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048553 Aug 21 01:18:00.493226 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1436/2539] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:00.551017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:00.552374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:00.567347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:00.568244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:00.570160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:00.571178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:00.572882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:00.574349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:00.678127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:00.679294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:00.694297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:00.695212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:00.696965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:00.699323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:00.701190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:00.701786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:01.113497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:01.127743 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-212b78f8-468f-4e9e-bbe9-310664f13954 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1493 microversion: 2.1 time: 0.451231 Aug 21 01:18:01.128635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1437/2540] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:00 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1493 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:01.466452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:01.480930 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76a0b70e-0458-4632-a6a2-02a2f0492aad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.929544 Aug 21 01:18:01.482645 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1104/2541] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:00 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:01.710132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b529918-528f-4ae1-8f5b-552174a5c2e9", "tag": "5c277213-83ec-41af-8143-213b4e1b5301"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:01.745020 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:01.755488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:01.760010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:01.762460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:01.825904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] Creating event network-changed:5c277213-83ec-41af-8143-213b4e1b5301 for instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 on n-h2-master-1 Aug 21 01:18:01.846783 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-dfdbd18b-5125-486e-80c9-4a6f66db0312 req-9fa508fc-f297-46a5-a12b-371bd2c03bce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141532 Aug 21 01:18:01.853505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1438/2542] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:02.151062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:02.151681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:02.191353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:02.191854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:02.192317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:02.193039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:02.193496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:02.217100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:02.508468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:02.509682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:02.519917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:02.521161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:02.521857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:02.522926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:02.523575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:02.524192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:02.854017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:02.875603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba846f7b-7627-4021-85ba-a29106ba8724 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.373420 Aug 21 01:18:02.876196 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1439/2543] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:02 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:03.897483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:03.899944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:03.924680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:03.928080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:03.930644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:03.931667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:03.936164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:03.937405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:04.252139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:04.279920 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-24ee8575-407a-4e79-b7da-44156fadc80e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1493 microversion: 2.1 time: 2.132467 Aug 21 01:18:04.289123 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1105/2544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:02 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1493 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:04.452186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:04.478437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85a10105-efa5-4c0a-b2d4-548e99cb3332 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.574148 Aug 21 01:18:04.492285 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1440/2545] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:03 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:05.305159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:05.306834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:05.318094 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=60 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:05.339514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:05.341589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:05.344429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:05.345599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:05.348842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:05.349608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:05.500985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:05.501744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:05.519367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:05.520295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:05.520993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:05.529478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:05.530347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:05.531157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:06.020725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:06.035470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e443b1c0-ec8d-4dac-a66c-7ccdc8b2e526 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.539770 Aug 21 01:18:06.045563 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1441/2546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:05 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:06.457256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:06.467728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6e467c30-d5ec-4dbd-9ad7-bbca0d9a3667 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1493 microversion: 2.1 time: 1.166326 Aug 21 01:18:06.493214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1106/2547] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:05 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1493 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:07.069809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:07.070422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:07.089297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:07.090337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:07.093130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:07.099335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:07.103174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:07.106653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:07.494690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:07.495910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:07.507668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:07.510856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:07.511485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:07.516602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:07.519457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:07.520794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:07.863321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:07.873494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e423ee1-7538-4217-afb4-c19007d27f8e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.809167 Aug 21 01:18:07.879697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1442/2548] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:07 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:07.884552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-plugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:07.938429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:07.939650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:07.940323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:07.954033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] Creating event network-vif-plugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:18:07.966917 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2f308242-de35-4112-9ef0-668c1e1275ee req-f9b89b62-7794-4404-8949-232231831521 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085821 Aug 21 01:18:07.969018 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1443/2549] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:08.899445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:08.900450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:08.914625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:08.916994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:08.921660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:08.923173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:08.923861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:08.924486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:09.164140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:09.173060 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4038f03-5f8e-453c-9afb-13bd090b1232 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1499 microversion: 2.1 time: 1.682200 Aug 21 01:18:09.181924 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1107/2550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:07 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1499 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:09.254745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:09.270333 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9db2270c-ae20-4383-b219-3b8b213da932 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.373914 Aug 21 01:18:09.273628 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1444/2551] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:08 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:09.286302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:09.288694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:09.303184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:09.304743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:09.305878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:09.311874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:09.315353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:09.320421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:09.396878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:18:09.433393 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:09.508801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-148b0011-dd1b-4989-bc3e-81c08cb0d405 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Calling method '.version_select at 0x7fc3fdcbbdc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:09.579045 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0eea5cbb-5850-4283-b538-c844ab85f051 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 204 len: 0 microversion: 2.1 time: 0.301356 Aug 21 01:18:09.580396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1445/2552] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:18:09 2022] DELETE /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:18:09.609667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:09.612961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:09.632931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:09.651709 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-148b0011-dd1b-4989-bc3e-81c08cb0d405 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.468422 Aug 21 01:18:09.653344 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1108/2553] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:18:09 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:09.666310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d205e5f5-2cd7-48a4-8455-98dac62dd025 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Action: 'create', calling method: .version_select at 0x7fc3fe574820>, body: {"pool": "non_exist_pool"} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:09.802586 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d205e5f5-2cd7-48a4-8455-98dac62dd025 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] HTTP exception thrown: Floating IP pool not found. Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d205e5f5-2cd7-48a4-8455-98dac62dd025 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Request method failure captured: Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 26 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYfQ_Q8alobrlxyakigolXlZr6l1Mdz0mwHkna49QPxKvdcB5lmFUXyT70-ppyVyJi95JNfR3MZN5k6ln1g8gZuCZTSqS5hC6kH-6i4C5PEDYBt-bI0OODQfaiLgMuPG3fg7Qa6g5zdgydqgWcOvWu0oIdN8GzwIZ4pzUspUwZNhVj8 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9b3c412cc63c4c8e8e5b95907220ea1f Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b3c412cc63c4c8e8e5b95907220ea1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b3c412cc63c4c8e8e5b95907220ea1f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b3c412cc63c4c8e8e5b95907220ea1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b3c412cc63c4c8e8e5b95907220ea1f"}]}] Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9b3c412cc63c4c8e8e5b95907220ea1f Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsNegativeTestJSON-588357878-project Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 012c8932a3134c0d936b2ecc3c1924ff Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-588357878-project Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: {"pool": "non_exist_pool"} Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP pool not found. Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:18:09.804220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:18:09.808515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 21 01:18:09.808515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.808515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d205e5f5-2cd7-48a4-8455-98dac62dd025 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Returning 404 to user: Floating IP pool not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:18:09.808515 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d205e5f5-2cd7-48a4-8455-98dac62dd025 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.143720 Aug 21 01:18:09.808515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1109/2554] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:18:09 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:18:09.824259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Calling method '.version_select at 0x7fc3fdd78280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:09.925447 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6b6b861e-1b43-44c6-a004-50aeeee47709 could not be found", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:18:09.926358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] HTTP exception thrown: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Request method failure captured: Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-floating-ips/6b6b861e-1b43-44c6-a004-50aeeee47709 HTTP/1.1 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYfQ_Q8alobrlxyakigolXlZr6l1Mdz0mwHkna49QPxKvdcB5lmFUXyT70-ppyVyJi95JNfR3MZN5k6ln1g8gZuCZTSqS5hC6kH-6i4C5PEDYBt-bI0OODQfaiLgMuPG3fg7Qa6g5zdgydqgWcOvWu0oIdN8GzwIZ4pzUspUwZNhVj8 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9b3c412cc63c4c8e8e5b95907220ea1f Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b3c412cc63c4c8e8e5b95907220ea1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9b3c412cc63c4c8e8e5b95907220ea1f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9b3c412cc63c4c8e8e5b95907220ea1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9b3c412cc63c4c8e8e5b95907220ea1f"}]}] Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9b3c412cc63c4c8e8e5b95907220ea1f Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-588357878 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-FloatingIPsNegativeTestJSON-588357878-project Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 012c8932a3134c0d936b2ecc3c1924ff Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-588357878-project Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: exception: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '6b6b861e-1b43-44c6-a004-50aeeee47709'} Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6b6b861e-1b43-44c6-a004-50aeeee47709 could not be found Aug 21 01:18:09.930146 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-907310e5-fd1f-4dea-89c7-9d826fcc9e71'] Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709. Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709 Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709 Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] Returning 404 to user: Floating IP not found for ID 6b6b861e-1b43-44c6-a004-50aeeee47709 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc331ab9-af56-440d-8df4-2d0467fe9fc6 tempest-FloatingIPsNegativeTestJSON-588357878 tempest-FloatingIPsNegativeTestJSON-588357878-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/6b6b861e-1b43-44c6-a004-50aeeee47709" status: 404 len: 111 microversion: 2.1 time: 0.117366 Aug 21 01:18:09.934395 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1110/2555] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:18:09 2022] DELETE /compute/v2.1/os-floating-ips/6b6b861e-1b43-44c6-a004-50aeeee47709 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:10.001390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff1f14e-30e6-4660-9f1f-dc2276c62818", "name": "network-vif-plugged", "status": "completed", "tag": "c880605c-ea4c-4827-8d31-201a9c606e58"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:10.045613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:10.046210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:10.047975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:10.154626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:10.168047 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] Creating event network-vif-plugged:c880605c-ea4c-4827-8d31-201a9c606e58 for instance eff1f14e-30e6-4660-9f1f-dc2276c62818 on n-h1-master-1 Aug 21 01:18:10.177554 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-175d24de-3c2a-4fe2-bf1d-cb27ffb1a32e tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.591545 Aug 21 01:18:10.178666 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1446/2556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:09 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:10.191205 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-699e3a82-3416-4614-93b9-3ce9f13dbf40 req-ff075903-f853-4c70-9a9a-0ce40234195d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194657 Aug 21 01:18:10.197638 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1111/2557] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:10.312035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:10.312839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:10.353334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:10.353822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:10.354254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:10.355020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:10.414686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.059s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:10.418984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:10.657784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:10.670106 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c969c1e8-21a8-4ce3-b1f5-30e90970b7ba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.366507 Aug 21 01:18:10.672159 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1447/2558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:10 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:11.216060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:11.217699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:11.236090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:11.236939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:11.240376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:11.241413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:11.242360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:11.244089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:11.692334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:11.693005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:11.706959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:11.707776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:11.711663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:11.712807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:11.713470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:11.717665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:12.567316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:12.589007 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05b4682e-48a4-4d9d-a753-ec066587438e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.897771 Aug 21 01:18:12.591026 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1448/2559] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:11 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:12.722110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:12.736978 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1a5a6fd-b888-4ecb-ad39-f4345ddf3d1d tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 1.539171 Aug 21 01:18:12.740484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1112/2560] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:11 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:13.617162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:13.618472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:13.636566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:13.637137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:13.637578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:13.638314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:13.643571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:13.647011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:13.761188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:13.762606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:13.778519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:13.779649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:13.782576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:13.784491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:13.790372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:13.791720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:14.007440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:14.026775 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73e13324-2097-4e65-a763-3731a53c69de tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1319 microversion: 2.1 time: 0.418019 Aug 21 01:18:14.028075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1449/2561] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:13 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:14.044548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e98cac-7976-46ef-8708-58f0dc8198eb", "name": "network-vif-plugged", "status": "completed", "tag": "6f0691fa-8e19-440b-89a6-5cd06624a3c8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:14.086910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:14.087598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:14.088291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:14.136182 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] Creating event network-vif-plugged:6f0691fa-8e19-440b-89a6-5cd06624a3c8 for instance 74e98cac-7976-46ef-8708-58f0dc8198eb on n-h1-master-1 Aug 21 01:18:14.159638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-fd8ff385-f0a0-460a-a968-2c63542395b2 req-714abd0a-f018-41f6-a62c-7e07e251d43f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128947 Aug 21 01:18:14.165891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1450/2562] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:14.442872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:14.455172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c0c3c13-062c-4a7b-aa31-b0394e296d1c tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1505 microversion: 2.1 time: 0.700879 Aug 21 01:18:14.463077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1113/2563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:13 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1505 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:15.024412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f68483-18ba-4b22-bab2-ed26991c7dca", "name": "network-vif-deleted", "tag": "9df4987f-ed28-4166-a8c8-d6bc33bf2c66"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:15.052633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:15.053297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:15.059253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.061355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.062096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.068384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.077039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.078128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.078966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.079810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.080289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.096279 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] Creating event network-vif-deleted:9df4987f-ed28-4166-a8c8-d6bc33bf2c66 for instance f6f68483-18ba-4b22-bab2-ed26991c7dca on n-h1-master-1 Aug 21 01:18:15.108368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-fd6da3bf-e724-4637-9973-fde6cea93aa4 req-c87846ee-d6a2-49af-830a-9373768abd41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087448 Aug 21 01:18:15.109877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1451/2564] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:15.475429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:15.487431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:15.488487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:15.490445 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e2c8030-0682-46c3-8a30-ff9ca01d4e45 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1469 microversion: 2.1 time: 0.440289 Aug 21 01:18:15.505755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.507570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.510052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.513084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.513883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.514799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.516058 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1114/2565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:15 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:15.525195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:15.526040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:15.534969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.537391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.538076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.540158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.541447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.542119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.623540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:15.624613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:15.625857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:15.626332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lazy-loading 'fault' on Instance uuid f6f68483-18ba-4b22-bab2-ed26991c7dca {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:18:15.697368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:15.707568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f7d7fbc-b773-49c7-9170-b9115034dae2 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 200 len: 1303 microversion: 2.1 time: 0.226159 Aug 21 01:18:15.709442 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1452/2566] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:15 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:16.021346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:16.055349 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b29ef5b4-e474-4aa9-bb60-c3f19a1fd3aa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1319 microversion: 2.1 time: 0.537763 Aug 21 01:18:16.058534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1115/2567] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:15 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1319 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:16.730130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:16.731452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: f6f68483-18ba-4b22-bab2-ed26991c7dca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:16.751844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:16.752814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:16.753968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:16.760414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:16.761255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:16.761961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:16.798557 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] HTTP exception thrown: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Request method failure captured: Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca HTTP/1.1 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYdSKhWeMp_MJI98J6U0v-5eVP4xikNd37rvUVn5z3FKG7or74zL5iKlskyw7-MlIDna5Z01D4EsmPjUau1uU1cKuKJdLuHPjFTfd5aCmicBxb_bLg_5G9LWXnQrFMFavJzFy_RT75il7tWbQwzgdMxa37mlb3ePir401ITlOF5Cfng Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7461e4a0b7124b3bbbb6396de9b59656 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7461e4a0b7124b3bbbb6396de9b59656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7461e4a0b7124b3bbbb6396de9b59656", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7461e4a0b7124b3bbbb6396de9b59656"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7461e4a0b7124b3bbbb6396de9b59656"}]}] Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7461e4a0b7124b3bbbb6396de9b59656 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerRescueTestJSON-864318692-project Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 22a8b93432dd4d699a28a8db26bc3c98 Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerRescueTestJSON-864318692-project Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f6f68483-18ba-4b22-bab2-ed26991c7dca'} Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:16.801180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. Aug 21 01:18:16.805424 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:18:16.810221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Returning 404 to user: Instance f6f68483-18ba-4b22-bab2-ed26991c7dca could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:18:16.814831 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-03218f94-1536-421a-a24f-fe7283c196f6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca" status: 404 len: 111 microversion: 2.1 time: 0.089346 Aug 21 01:18:16.818499 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1453/2568] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:16 2022] GET /compute/v2.1/servers/f6f68483-18ba-4b22-bab2-ed26991c7dca => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:16.827286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:16.828458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:16.843627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:16.847644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:16.853673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:16.857390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:16.857878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:16.863328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:16.963431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:18:17.093708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:17.094825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:17.111240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.111869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.113841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.122552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.123339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.143230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.327749 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-736c8590-703a-4dfe-bc4c-592ef46b4c28 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 204 len: 0 microversion: 2.1 time: 0.504709 Aug 21 01:18:17.328718 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1116/2569] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:18:16 2022] DELETE /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:18:17.338142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:17.338875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:17.369080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.369579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.370100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.370768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.371290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.371692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.496576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:17.505415 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-134f5217-c4a2-4484-8431-00ee30baced5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1468 microversion: 2.1 time: 0.416080 Aug 21 01:18:17.507238 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1454/2570] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:17 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1468 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:17.518716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ab5ce2d-51ed-4961-91b6-24f94809a491 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3f9436670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:17.720546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ab5ce2d-51ed-4961-91b6-24f94809a491 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1" status: 200 len: 637 microversion: 2.1 time: 0.205683 Aug 21 01:18:17.721486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1455/2571] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:18:17 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1 => generated 637 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:18:17.732894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:17.755017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:17.757590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Searching by: {'reservation_id': 'r-xdkqhg0q', 'deleted': False, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:18:17.759303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:17.777378 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-411c72dd-b27b-4d3c-b9d7-bb9da759c760 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1493 microversion: 2.1 time: 0.443066 Aug 21 01:18:17.779828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.780686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.787466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.788534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:17.789230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:17.789869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:17.792246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1117/2572] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:17 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1493 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:17.798033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-225baad5-fdf6-4924-bddf-56d62a195f5a tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3fe368790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:17.910552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-225baad5-fdf6-4924-bddf-56d62a195f5a tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:17.932757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-225baad5-fdf6-4924-bddf-56d62a195f5a tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:18.068532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:18:18.255699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:18.266107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.266873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.267647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.425954 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-225baad5-fdf6-4924-bddf-56d62a195f5a tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.632403 Aug 21 01:18:18.426568 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1118/2573] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:17 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:18.438030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f44835cf-e60f-42c5-86d3-d6293f62c228 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3fe315430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:18.509788 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6c57a9e-c621-4b4c-a710-c35e9a1ba979 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-xdkqhg0q" status: 200 len: 2930 microversion: 2.1 time: 0.785157 Aug 21 01:18:18.510663 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1456/2574] 10.222.0.46 () {58 vars in 1197 bytes} [Sun Aug 21 01:18:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xdkqhg0q => generated 2930 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:18.540740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:18.568889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_groups [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Querying cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) for 2 instances {{(pid=122482) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 21 01:18:18.576625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.577488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.578104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.657496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d449267e-45b6-4ec3-af79-fa1fa6182889 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/23bc45c5-9d79-4154-8d3e-52c09266b97c" status: 200 len: 265 microversion: 2.1 time: 0.122639 Aug 21 01:18:18.662813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1457/2575] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:18:18 2022] GET /compute/v2.1/os-server-groups/23bc45c5-9d79-4154-8d3e-52c09266b97c => generated 265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:18.674203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:18.674839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:18.692478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.693096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.693553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.694397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.694837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.695261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.804073 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f44835cf-e60f-42c5-86d3-d6293f62c228 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "DELETE /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.371522 Aug 21 01:18:18.804975 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1119/2576] 10.222.0.46 () {58 vars in 1296 bytes} [Sun Aug 21 01:18:18 2022] DELETE /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_version => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:18:18.814682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:18.815388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:18.822258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.822748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.823192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.823967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:18.829119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:18.834254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:18.943506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2d8fed4-f9f2-4862-9844-66047a7b6e75 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 200 len: 1620 microversion: 2.1 time: 0.277802 Aug 21 01:18:18.944556 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1458/2577] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:18 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 1620 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:18.949173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0416c01e-bac5-4bb4-9dea-fd3cc5cb61ad tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3f95509d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:19.010130 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0416c01e-bac5-4bb4-9dea-fd3cc5cb61ad tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 37 microversion: 2.1 time: 0.063169 Aug 21 01:18:19.011568 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1459/2578] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:18:18 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:19.020293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:19.021518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:19.037345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:19.041333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:19.042170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:19.043156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:19.045730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:19.047620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:19.281886 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbbe01b3-a27e-49f9-88e8-675f47b951a0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1619 microversion: 2.1 time: 0.268666 Aug 21 01:18:19.288363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1460/2579] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:19 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1619 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:19.293586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad9ec506-bb0c-4f06-aaec-07a5c4456804 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3f93d4ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:19.370907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ad9ec506-bb0c-4f06-aaec-07a5c4456804 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:19.378344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ad9ec506-bb0c-4f06-aaec-07a5c4456804 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:19.427952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:19.442941 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7236d90-09e4-4ae5-a883-9db74434a801 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1493 microversion: 2.1 time: 0.632651 Aug 21 01:18:19.460327 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1120/2580] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:18 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1493 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:19.472278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: .version_select at 0x7fc3fe32f820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1446450489", "policies": ["anti-affinity"]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:19.517226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:19.528988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:19.723511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:19.741919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:19.787150 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17bea215-ef51-48a9-9f22-820fbddb0453 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.325588 Aug 21 01:18:19.802888 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1121/2581] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:18:19 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:19.811470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad9ec506-bb0c-4f06-aaec-07a5c4456804 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.520882 Aug 21 01:18:19.817839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1461/2582] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:19 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:19.831795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3dd621d3-5fc7-4d7d-bba3-bf673da6ea52 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3fe32f8b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:19.903140 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3dd621d3-5fc7-4d7d-bba3-bf673da6ea52 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.084257 Aug 21 01:18:19.907705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1122/2583] 10.222.0.46 () {58 vars in 1290 bytes} [Sun Aug 21 01:18:19 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_distro => generated 33 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:19.917723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbccf0bf-216a-48d0-ac1b-404fbe4d96a9 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3f94c1430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:20.006965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dbccf0bf-216a-48d0-ac1b-404fbe4d96a9 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:20.026100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dbccf0bf-216a-48d0-ac1b-404fbe4d96a9 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:20.168590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-942348035", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ad9a89c8-9332-451b-acc3-314db318b9e0"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:20.286997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:18:20.447765 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbccf0bf-216a-48d0-ac1b-404fbe4d96a9 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.534551 Aug 21 01:18:20.448373 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1462/2584] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:19 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:20.457939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b936c548-5620-40b8-954f-1cf8e32a8e3c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3f94c1820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:20.523227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b936c548-5620-40b8-954f-1cf8e32a8e3c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069127 Aug 21 01:18:20.534179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1463/2585] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:18:20 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:20.539420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:20.540043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:20.568921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:20.569794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:20.570435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:20.571374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:20.572011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:20.572611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:20.743367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:20.756891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f189a239-15a5-4294-ba99-484540ae454f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1493 microversion: 2.1 time: 0.219502 Aug 21 01:18:20.769449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1464/2586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:20 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1493 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:20.777138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-227cd122-4518-4e8a-bc8e-68ba9292781c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3f938bca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:20.870070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-227cd122-4518-4e8a-bc8e-68ba9292781c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:20.897394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-227cd122-4518-4e8a-bc8e-68ba9292781c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:21.188255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-227cd122-4518-4e8a-bc8e-68ba9292781c tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.416920 Aug 21 01:18:21.191141 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1465/2587] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:20 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:21.204570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-700c2d53-854e-4280-bda4-61a18efaba45 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc4031778b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:21.329569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-700c2d53-854e-4280-bda4-61a18efaba45 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:21.336881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-700c2d53-854e-4280-bda4-61a18efaba45 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:21.498567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:18:21.499135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:18:21.500556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:18:21.501176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:18:21.502107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:18:21.600678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.601788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.604004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.606094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.606812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.609975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.677082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:21.689543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:21.724719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 2 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:18:21.729747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:21.800526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122483) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 21 01:18:21.814028 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-700c2d53-854e-4280-bda4-61a18efaba45 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.615708 Aug 21 01:18:21.815301 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1466/2588] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:21 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 64 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:21.820656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e542315f-a0cc-4835-8263-a209fc72a7ca", "name": "network-vif-deleted", "tag": "9c19a2fc-1f1b-47f8-821e-c2753f6bad7a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:21.830963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.831817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.832497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.844853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] Creating event network-vif-deleted:9c19a2fc-1f1b-47f8-821e-c2753f6bad7a for instance e542315f-a0cc-4835-8263-a209fc72a7ca on n-h2-master-1 Aug 21 01:18:21.850221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-86d1d20d-ede7-4b79-8b17-6b6f61f40f98 req-b43804fa-6002-42ab-a19b-22708052f738 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Aug 21 01:18:21.851421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1467/2589] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:21.857744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:21.858710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:21.860243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:21.865908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.866940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.867536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:21.867776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.868659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.869417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.870011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.941284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:21.942158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:21.943004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:21.943691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lazy-loading 'fault' on Instance uuid e542315f-a0cc-4835-8263-a209fc72a7ca {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:18:21.959924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:21.973017 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:21.974961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:21.995796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=221bea62-a2f8-4fe6-a809-4fb25d34080d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:22.006358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8b93432dd4d699a28a8db26bc3c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7461e4a0b7124b3bbbb6396de9b59656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:22.016143 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2aca5c38-be08-48bb-85ad-8f7d68a9a2c6 tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 200 len: 1304 microversion: 2.1 time: 0.163230 Aug 21 01:18:22.029115 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1468/2590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:21 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:22.036084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-047cf855-0650-4a57-b624-66423b030d46 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3f9350d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:22.093800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-047cf855-0650-4a57-b624-66423b030d46 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063097 Aug 21 01:18:22.095094 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1469/2591] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:18:22 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:22.105666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a65ec856-cfdd-4ae8-b96b-742082dd8c18 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3f9284160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:22.133203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:22.154360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:22.195364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a65ec856-cfdd-4ae8-b96b-742082dd8c18 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:22.204642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a65ec856-cfdd-4ae8-b96b-742082dd8c18 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:22.209708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:22.227758 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:22.229281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'server_group_members'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:22.360526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3634131-ad60-4380-b53e-27c49471e1cc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.198013 Aug 21 01:18:22.365369 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1123/2592] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:18:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2205 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:18:22.376461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:22.381710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:22.382596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Searching by: {'deleted': False, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:18:22.416206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:22.418627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:22.420180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:22.422850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:22.429421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:22.429856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:22.451112 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:22.471774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:18:22.653528 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59e2ce5f-cefd-4930-9c14-87b2ec3a6abc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.284141 Aug 21 01:18:22.656549 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1124/2593] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:18:22 2022] GET /compute/v2.1/servers => generated 1664 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:22.674466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30c7c90a-51eb-4447-a2df-6170d73a1c9b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:22.675352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30c7c90a-51eb-4447-a2df-6170d73a1c9b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:22.727675 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a65ec856-cfdd-4ae8-b96b-742082dd8c18 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.626005 Aug 21 01:18:22.728508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1470/2594] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:22 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:18:22.738564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-453f33aa-17e2-46fb-9e77-14bbd7f21d56 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update', calling method: .version_select at 0x7fc3f9419d30>, body: {"meta": {"os_version": "alt"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:22.837269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30c7c90a-51eb-4447-a2df-6170d73a1c9b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:22.847096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30c7c90a-51eb-4447-a2df-6170d73a1c9b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1218 microversion: 2.1 time: 0.179343 Aug 21 01:18:22.848001 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1125/2595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:22 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:22.873442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-453f33aa-17e2-46fb-9e77-14bbd7f21d56 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:22.895942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-453f33aa-17e2-46fb-9e77-14bbd7f21d56 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:23.046866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:23.047468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] [instance: e542315f-a0cc-4835-8263-a209fc72a7ca] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:23.070444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:23.079792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:23.081930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:23.085754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:23.088716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:23.095746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:23.191792 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] HTTP exception thrown: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Request method failure captured: Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca HTTP/1.1 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdSKhWeMp_MJI98J6U0v-5eVP4xikNd37rvUVn5z3FKG7or74zL5iKlskyw7-MlIDna5Z01D4EsmPjUau1uU1cKuKJdLuHPjFTfd5aCmicBxb_bLg_5G9LWXnQrFMFavJzFy_RT75il7tWbQwzgdMxa37mlb3ePir401ITlOF5Cfng Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7461e4a0b7124b3bbbb6396de9b59656 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7461e4a0b7124b3bbbb6396de9b59656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7461e4a0b7124b3bbbb6396de9b59656", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7461e4a0b7124b3bbbb6396de9b59656"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7461e4a0b7124b3bbbb6396de9b59656"}]}] Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7461e4a0b7124b3bbbb6396de9b59656 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueTestJSON-864318692 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueTestJSON-864318692-project Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 22a8b93432dd4d699a28a8db26bc3c98 Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueTestJSON-864318692-project Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e542315f-a0cc-4835-8263-a209fc72a7ca'} Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:18:23.197930 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. Aug 21 01:18:23.202213 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:18:23.208255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] Returning 404 to user: Instance e542315f-a0cc-4835-8263-a209fc72a7ca could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:18:23.212437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40546117-cc78-4a93-819e-a001c85e039f tempest-ServerRescueTestJSON-864318692 tempest-ServerRescueTestJSON-864318692-project] 10.222.0.46 "GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca" status: 404 len: 111 microversion: 2.1 time: 0.173794 Aug 21 01:18:23.213463 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1126/2596] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:23 2022] GET /compute/v2.1/servers/e542315f-a0cc-4835-8263-a209fc72a7ca => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:18:23.449005 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-453f33aa-17e2-46fb-9e77-14bbd7f21d56 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.714773 Aug 21 01:18:23.451155 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1471/2597] 10.222.0.46 () {60 vars in 1313 bytes} [Sun Aug 21 01:18:22 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata/os_version => generated 31 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:18:23.461638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69981f0f-70d4-4c5e-9683-f644606e3c81 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3f92840d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:23.528634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Calling method '.version_select at 0x7fc3fdac0310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:23.549955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69981f0f-70d4-4c5e-9683-f644606e3c81 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 58 microversion: 2.1 time: 0.092514 Aug 21 01:18:23.551413 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1472/2598] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:18:23 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 58 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:23.563205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b344dc9-6a84-435b-9945-05d7697cdb57 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'update_all', calling method: .version_select at 0x7fc3f94674c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:23.572683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:23.574989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:23.575566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:23.576402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:23.579882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:23.580454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:23.657130 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11c2bd38-043d-4210-af61-e3077ccb102b tempest-AbsoluteLimitsTestJSON-1794767626 tempest-AbsoluteLimitsTestJSON-1794767626-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.438546 Aug 21 01:18:23.680263 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1127/2599] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:18:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:23.684198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5b344dc9-6a84-435b-9945-05d7697cdb57 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:23.698336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5b344dc9-6a84-435b-9945-05d7697cdb57 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:23.870797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-042be2ee-6b89-40a8-8359-e1eda23e6dc3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:23.871661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-042be2ee-6b89-40a8-8359-e1eda23e6dc3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:24.091320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-042be2ee-6b89-40a8-8359-e1eda23e6dc3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:24.107403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-042be2ee-6b89-40a8-8359-e1eda23e6dc3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1218 microversion: 2.1 time: 0.243256 Aug 21 01:18:24.108522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1128/2600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:23 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:24.301344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b344dc9-6a84-435b-9945-05d7697cdb57 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 61 microversion: 2.1 time: 0.742478 Aug 21 01:18:24.302092 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1473/2601] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:18:23 2022] PUT /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 61 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:24.313026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20265762-e26b-472c-a112-93e2a41290c0 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Action: 'create', calling method: .version_select at 0x7fc3fdefcb80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:24.430272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-20265762-e26b-472c-a112-93e2a41290c0 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:24.460638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-20265762-e26b-472c-a112-93e2a41290c0 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Getting quotas for user 21c92ec7190947049a8afabbcd5b5c74 and project 5eb0cf10be5a4aba9fb1c4d079bd38f1. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:25.146805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:25.148465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:25.166819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:25.168958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:25.169503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:25.174292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:25.175618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:25.186572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:25.229712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20265762-e26b-472c-a112-93e2a41290c0 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "POST /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.920847 Aug 21 01:18:25.236680 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1129/2602] 10.222.0.46 () {60 vars in 1281 bytes} [Sun Aug 21 01:18:24 2022] POST /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 85 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:25.243168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d1a4423-6e53-4658-a8be-821682f2f865 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] Calling method '.version_select at 0x7fc3fdf02940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:25.372356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d1a4423-6e53-4658-a8be-821682f2f865 tempest-ImagesMetadataTestJSON-322387665 tempest-ImagesMetadataTestJSON-322387665-project] 10.222.0.46 "GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata" status: 200 len: 85 microversion: 2.1 time: 0.134220 Aug 21 01:18:25.385573 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1130/2603] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 01:18:25 2022] GET /compute/v2.1/images/56381188-26c6-4c60-9daa-d4469e8589e1/metadata => generated 85 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:18:25.422156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:25.434651 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:25.444053 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a5f7fc5-dee7-4d14-8e08-e30f969408f3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1270 microversion: 2.1 time: 0.316541 Aug 21 01:18:25.462918 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1474/2604] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:25 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1270 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:26.471984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:26.472713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:26.495485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:26.496209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:26.497930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:26.500270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:26.500996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:26.502999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:26.743111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:26.754963 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e2a45d0-04a1-4f46-9f41-7332ddb89dcd tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1276 microversion: 2.1 time: 0.287514 Aug 21 01:18:26.756524 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1131/2605] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:26 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:27.786159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:27.789217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:27.821044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:27.821888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:27.823316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:27.826255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:27.827177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:27.828569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:27.914779 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:27.951444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:27.953832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:27.963929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:27.964727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:27.965411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:27.966946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:27.968445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:27.970488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:28.118300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:28.130554 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d30822d2-5fd8-4f3e-a56f-47c48e4e98db tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1276 microversion: 2.1 time: 0.350096 Aug 21 01:18:28.144403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1475/2606] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:27 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:28.506438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:28.523237 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afa62768-f043-41c0-a7d6-b6675be7a162 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.572989 Aug 21 01:18:28.524561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1132/2607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:27 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:29.151576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:29.152408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:29.162204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:29.172392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:29.173114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:29.174052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:29.174701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:29.175296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:29.602961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:29.606592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:29.637629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:29.638163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:29.638609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:29.639352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:29.639810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:29.640507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:30.278458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:30.299460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f82227e-fcaf-4942-abc7-4d8d82f75ef1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 1.151103 Aug 21 01:18:30.300372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1476/2608] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:29 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:30.617600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:30.648500 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8a53f9e-07ab-4677-9f81-dddad8f01b0e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 1.099523 Aug 21 01:18:30.650900 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1133/2609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:29 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:30.674858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-646038839"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:30.679027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:30.705257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:30.706824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:30.709263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:30.711322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:30.713399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:30.715529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:31.069891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f761fe3-8174-4e79-b95c-4e028dd8e23b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.393198 Aug 21 01:18:31.078587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1477/2610] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:18:30 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 21 01:18:31.089401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:31.090409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:31.111835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:31.112397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:31.115814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:31.117370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:31.119425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:31.120089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:31.324592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:31.325330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:31.333079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:31.333804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:31.334444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:31.335337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:31.335950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:31.336526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:31.730975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:31.746487 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab7b00d8-713a-4a5b-ac83-d7c59d7fe54c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.426155 Aug 21 01:18:31.747095 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1478/2611] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:31 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:32.266364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-unplugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:32.296870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:32.297452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:32.298841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:32.640261 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] Creating event network-vif-unplugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:18:32.646763 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-45d1ee59-0140-47c5-9524-d96690b3ffbb req-5a2d9325-b16e-48b6-b385-7aaf7480b0d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.407899 Aug 21 01:18:32.647985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1479/2612] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:18:32.656072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-90730267-fd2f-40b9-aeee-9346018d3a37 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Action: 'create', calling method: .version_select at 0x7fc3f92d4670>, body: {"keypair": {"name": "tempest-keypair-543659224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmk69cMRs7MuOxJXG/AApPFKAkhyAEdanvLTbi28sYn0FXOre14vhk2SYj7lEfJe+ln7dlzmJcphNKDwT1CKy7ruAPSOLergA5txJbYIjU/ui90PbdDGvGK4FmbZIAx9g=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:32.679590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-90730267-fd2f-40b9-aeee-9346018d3a37 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Getting quotas for project 9d702749939d4b8cb8471857ba668f07. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:32.687549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-90730267-fd2f-40b9-aeee-9346018d3a37 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Getting quotas for user 5437fbb8d7fa4c6b8dca85efdc8fc694 and project 9d702749939d4b8cb8471857ba668f07. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:32.721909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-90730267-fd2f-40b9-aeee-9346018d3a37 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.072148 Aug 21 01:18:32.722818 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1480/2613] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:18:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:18:32.771828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:32.772673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:32.786277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:32.787015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:32.787638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:32.788674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:32.789294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:32.790046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:32.832969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:32.850232 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cedb6d6b-fe90-4c54-971b-7c7a832106c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 1.765927 Aug 21 01:18:32.851544 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1134/2614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:31 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:33.596551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:33.607728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221bea62-a2f8-4fe6-a809-4fb25d34080d", "tag": "8320a3de-b235-4251-b103-e33527aa3409"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:33.612858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-222bb88a-c312-4f4f-b359-5ba02d189c7f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.845609 Aug 21 01:18:33.626819 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:33.631347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:33.632615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1481/2615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:32 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:33.637887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:33.639308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:33.691090 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] Creating event network-changed:8320a3de-b235-4251-b103-e33527aa3409 for instance 221bea62-a2f8-4fe6-a809-4fb25d34080d on n-h2-master-1 Aug 21 01:18:33.723311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d99b6330-7a5a-42e3-9f04-e173db647c9f req-04ac28f4-a8a1-4f97-ab0a-c97dd684085e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125216 Aug 21 01:18:33.725090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1135/2616] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:18:33.877385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:33.881124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:33.892658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:33.894440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:33.895435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:33.897642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:33.898490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:33.899202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:34.636013 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=44 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:34.640532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:34.641297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:34.649023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:34.649845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:34.650453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:34.651375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:34.652023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:34.652616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:34.756810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:34.785368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df89cde3-e672-4ba9-839c-36fd06e9f3ae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1685 microversion: 2.1 time: 0.913479 Aug 21 01:18:34.804958 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1482/2617] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:33 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1685 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:35.602316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:35.616979 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3059075-a25c-4c83-9d17-3ef4f7f2e81b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.980899 Aug 21 01:18:35.634275 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1136/2618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:34 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:35.776898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74ed2f83-2786-4c42-be00-b998554dbc32", "tag": "3a575123-fe9c-4948-9cc5-485f77016f26"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:35.801060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:35.801765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:35.804354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:35.816279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:35.816975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:35.841824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:35.842346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:35.842787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:35.843589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:35.844190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:35.844613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:35.849948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] Creating event network-changed:3a575123-fe9c-4948-9cc5-485f77016f26 for instance 74ed2f83-2786-4c42-be00-b998554dbc32 on n-h1-master-1 Aug 21 01:18:35.870014 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3398d36d-73be-4f7f-9c07-76ea758c7691 req-39ccaf62-f563-4b3c-92a1-3884ac8ba13c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097914 Aug 21 01:18:35.878996 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1483/2619] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:36.170547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:36.179055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ed2a37d-fe82-4809-8592-54278f2818f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.367153 Aug 21 01:18:36.196475 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1137/2620] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:35 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:36.643001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:36.643718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:36.653227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:36.653722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:36.658621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:36.659608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:36.660262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:36.660981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:37.101588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:37.145955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b613b83-ac64-43a2-80ef-c122db1a68e1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.508136 Aug 21 01:18:37.148973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1484/2621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:36 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:37.212711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:37.214007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:37.240074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:37.240584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:37.241039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:37.247350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:37.268502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:37.270502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:38.171650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:38.172460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:38.195884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:38.196426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:38.196909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:38.197663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:38.198122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:38.205130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:38.233330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:38.250310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bcbbe4c-5b38-4303-8db8-874ea0d50e81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 1.042306 Aug 21 01:18:38.256132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1138/2622] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:37 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:38.778882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-173730231", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8a12bb77-138f-4e75-af2d-98a0051efc2e"}, {"port": "ee2defc2-fa33-496d-ade2-18c43587603e", "tag": "port-1"}, {"port": "67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8", "tag": "port-2"}, {"uuid": "90cc8cd8-2a68-48ca-b38f-a2dd1adcfc0d", "tag": "net-1"}, {"uuid": "90cc8cd8-2a68-48ca-b38f-a2dd1adcfc0d"}, {"uuid": "42a38c2b-8b26-45a2-a741-ada168bfb63b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "42a38c2b-8b26-45a2-a741-ada168bfb63b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0536455c-2b4f-40e1-b17c-95f892ca147e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "0b499bca-548b-4e7d-8ce6-be8e7ed9595c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4a831000-adff-495b-9852-48a279bb27c7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1519806631"}], "key_name": "tempest-keypair-543659224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:39.014285 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:39.033390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2f5aad5-e861-4a77-84a4-0775ef12cd55 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.864329 Aug 21 01:18:39.034357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1485/2623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:38 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:39.233176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] validate_networks() for [('8a12bb77-138f-4e75-af2d-98a0051efc2e', None, None, None, None, None), (None, None, 'ee2defc2-fa33-496d-ade2-18c43587603e', None, None, None), (None, None, '67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8', None, None, None), ('90cc8cd8-2a68-48ca-b38f-a2dd1adcfc0d', None, None, None, None, None), ('90cc8cd8-2a68-48ca-b38f-a2dd1adcfc0d', None, None, None, None, None), ('42a38c2b-8b26-45a2-a741-ada168bfb63b', '10.2.2.100', None, None, None, None), ('42a38c2b-8b26-45a2-a741-ada168bfb63b', '10.2.2.200', None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:18:39.279431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:39.280271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:39.293926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:39.294434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:39.294885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:39.299468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:39.303016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:39.303508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:39.815434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:39.834767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac7b29e7-d1cc-453b-a65f-a27fb3a5bcd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.559642 Aug 21 01:18:39.835354 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1486/2624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:39 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:39.854527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-plugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:39.894882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:39.895680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:39.896271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:39.926390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] Creating event network-vif-plugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:18:39.951451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e109af6d-f285-4941-9410-fbe195956dc7 req-ee09a61a-42af-466a-b53f-897244932517 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111960 Aug 21 01:18:39.957259 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1487/2625] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:40.056081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:40.057104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:40.076277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:40.078772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:40.103239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:40.105854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:40.106664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:40.110414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:41.471453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:41.494876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b4694e1-bbf5-4b09-bc44-eca38f6bef44 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 1.440797 Aug 21 01:18:41.495796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1488/2626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:40 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:41.529778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:41.535825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:41.561197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:41.563387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:41.567365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:41.569497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:41.570205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:41.572350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:42.250915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:42.297652 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec8e645b-5ac2-456d-82d8-b13d7ff463d8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.784072 Aug 21 01:18:42.316383 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1489/2627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:41 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:42.537732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:42.539232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:42.560487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:42.562083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:42.576090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:42.581447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:42.582425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:42.584523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:42.696732 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=34 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:43.469942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:43.483292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fe6a2fd7-fa26-4783-af29-3b0839e8704e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.951331 Aug 21 01:18:43.484197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1490/2628] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:42 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:43.489207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:43.494416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:43.509416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:43.509910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:43.510351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:43.511059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:43.511809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:43.511932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:44.060616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:44.071592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-440877e3-e8e8-438d-a6fe-34ee90a36cff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.586119 Aug 21 01:18:44.077148 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1491/2629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:43 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:44.310445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ed2f83-2786-4c42-be00-b998554dbc32", "name": "network-vif-plugged", "status": "completed", "tag": "3a575123-fe9c-4948-9cc5-485f77016f26"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:44.338137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:44.338832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:44.343516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:44.386632 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] Creating event network-vif-plugged:3a575123-fe9c-4948-9cc5-485f77016f26 for instance 74ed2f83-2786-4c42-be00-b998554dbc32 on n-h1-master-1 Aug 21 01:18:44.416045 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-21b04aa7-e018-45e7-96fd-40d239a53909 req-aaedba25-ccf2-4419-a2ce-3e386b30540e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109665 Aug 21 01:18:44.418123 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1492/2630] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:18:44.508646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:44.509431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:44.530079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:44.530630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:44.533328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:44.535319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:44.535971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:44.537963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:45.108367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:45.122786 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:45.136544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9459d16-b72b-40c8-b6cc-1a89e19969c3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1318 microversion: 2.1 time: 0.633265 Aug 21 01:18:45.137947 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1493/2631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:44 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:45.145294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:45.146560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:45.154066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:45.160576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:45.161536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:45.162494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:45.166341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:45.166787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:45.579832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:18:45.581940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:18:45.582443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:18:45.582856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:18:45.583271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:18:45.613833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:45.623584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:45.624064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:45.624987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:45.633035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:45.635201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:45.736249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Getting quotas for project 9d702749939d4b8cb8471857ba668f07. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:45.762495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Getting quotas for user 5437fbb8d7fa4c6b8dca85efdc8fc694 and project 9d702749939d4b8cb8471857ba668f07. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:46.269972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:18:46.274336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0536455c-2b4f-40e1-b17c-95f892ca147e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='0b499bca-548b-4e7d-8ce6-be8e7ed9595c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a831000-adff-495b-9852-48a279bb27c7',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:46.432206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:46.454449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1da5a1a1-6ca3-45e5-b4ec-e3aaf5597be4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 1.315128 Aug 21 01:18:46.457377 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1494/2632] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:45 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:46.499547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:46.499547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:46.518453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:46.519330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:46.520083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:46.524625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:46.525673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:46.526430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:46.987784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:46.999647 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69006dd8-6654-4f6e-bdf1-e57c16003dc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1468 microversion: 2.1 time: 0.540709 Aug 21 01:18:47.004801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1495/2633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:46 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1468 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:47.017827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221bea62-a2f8-4fe6-a809-4fb25d34080d", "name": "network-vif-plugged", "status": "completed", "tag": "8320a3de-b235-4251-b103-e33527aa3409"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:47.086671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:47.087272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:47.089042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:47.127566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] Creating event network-vif-plugged:8320a3de-b235-4251-b103-e33527aa3409 for instance 221bea62-a2f8-4fe6-a809-4fb25d34080d on n-h2-master-1 Aug 21 01:18:47.161580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1c34e34d-3671-40e3-8ca5-dd1cf401d9b1 req-6f01e16c-20c1-475f-b2e1-d224a0a8977d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150771 Aug 21 01:18:47.162371 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1496/2634] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:47.171056 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad0045d9-a4af-4ce3-bb40-007ba635d581 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.392499 Aug 21 01:18:47.172668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1139/2635] 10.222.0.46 () {62 vars in 1189 bytes} [Sun Aug 21 01:18:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 8399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:18:47.211754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:47.213510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:47.234969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:47.235461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:47.235899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:47.253861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:47.254424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:47.254874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:47.618284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:47.626950 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68228658-922a-46ca-8197-2a1d28fe9d7c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1318 microversion: 2.1 time: 0.452946 Aug 21 01:18:47.637682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1140/2636] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:47 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:47.642989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:47.646604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:47.755739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:47.766121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:47.770842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:47.774412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0dd7b88d-199e-44e4-ad41-903eeadb8c3f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1284 microversion: 2.42 time: 0.134699 Aug 21 01:18:47.775653 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1141/2637] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:47 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:47.787019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:47.789394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:47.795426 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:47.822159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2126298668", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "acffc57e-3be7-4fff-a540-98f65a8e9f0a"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:47.825943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:47.826630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:47.827180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:47.828366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:47.829097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:47.838557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:48.014414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] validate_networks() for [('acffc57e-3be7-4fff-a540-98f65a8e9f0a', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:18:48.216420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:48.231354 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a26fc10-e0ff-47c3-890c-196396ba6b1f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.452366 Aug 21 01:18:48.232521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1142/2638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:47 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:48.662927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:48.664091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:48.682544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:48.684348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:48.685088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:48.690055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:48.693158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:48.694581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:49.102801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:49.113454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-952e1c95-51e9-4c2c-8bdf-68ef111b228c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1318 microversion: 2.1 time: 0.458235 Aug 21 01:18:49.135448 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1143/2639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:48 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:49.174681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:49.175819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:49.345972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:49.361031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:49.361031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:49.361031 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a021a153-fba4-45a4-9ceb-dce631905762 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1284 microversion: 2.42 time: 0.222376 Aug 21 01:18:49.361031 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1144/2640] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:49 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:49.407819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:49.410492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:49.433891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:49.435011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:49.437413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:49.438645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:49.440927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:49.448925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:49.632643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:18:49.633702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:18:49.634626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:18:49.635210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:18:49.635805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:18:49.668133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:49.668944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:49.669862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:49.673206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:49.674369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:49.675336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:49.751596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Getting quotas for project 9830900560b14834aad5e7231fbbb8c6. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:49.775603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Getting quotas for user 0958585bb2a74c9daa0b0d55c735782c and project 9830900560b14834aad5e7231fbbb8c6. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:49.814631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:49.831660 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d73c87ee-43a1-4607-8a09-3709742f2db0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.470678 Aug 21 01:18:49.831881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:18:49.844589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:49.846181 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1145/2641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:49 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:49.933704 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a12632c2-7408-4f1e-8106-026cee6e07d3 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.766294 Aug 21 01:18:49.934912 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1497/2642] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:18:49.962306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:49.963252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:50.165646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:50.179152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:50.180863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:50.193258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8526b5c4-3b52-464f-ad88-97b49c2fdaa9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1259 microversion: 2.21 time: 0.233341 Aug 21 01:18:50.208796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1498/2643] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:49 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:50.214920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:50.215713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:50.239490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:50.240683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:50.241928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:50.242891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1192281043", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "e6f82eb3-b825-46c0-b61c-d12af3e74890"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:50.243982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:50.245298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:50.247394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:50.409152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] validate_networks() for [('e6f82eb3-b825-46c0-b61c-d12af3e74890', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:18:50.790618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:50.822702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0788245a-32a7-4097-947d-bbe4ed69a944 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1468 microversion: 2.1 time: 0.623710 Aug 21 01:18:50.824054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1499/2644] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:50 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1468 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:50.835511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:50.838863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:50.865033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:50.866386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:50.868621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:50.871795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:50.873238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:50.874314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.080421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:51.099477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:51.104027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:51.106285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce7bfaeb-fcc6-4f9c-9bb3-41ebb3a833cd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1582 microversion: 2.42 time: 0.280025 Aug 21 01:18:51.110846 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1500/2645] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:50 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1582 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:51.126423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:51.136370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:51.145431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Searching by: {'reservation_id': 'r-2l28wi40', 'deleted': False, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:18:51.160705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.162495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.164562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.168035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.168895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.171965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.437596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:18:51.439530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:18:51.440254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:18:51.440933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:18:51.441587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:18:51.487121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.487882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.488436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.489411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.493088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.493616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.553385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Getting quotas for project c1a2f3b0bed743dabb7579f7dd78135f. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:51.565858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Getting quotas for user e228e38ee832453f8fc35feb25d65a15 and project c1a2f3b0bed743dabb7579f7dd78135f. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:51.587072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:18:51.625367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:18:51.646615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:51.775130 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-52d8a7ec-6ffc-41e2-844c-8a4cec53c106 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902998 Aug 21 01:18:51.776860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1146/2646] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:18:51.786583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:51.787594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:51.795585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.796502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.797213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.798154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.798831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.799476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:51.830200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:51.838522 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:51.866166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:51.866656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:51.867091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.238792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8158f937-e070-42c5-b622-504b43ec3495 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-2l28wi40" status: 200 len: 2929 microversion: 2.1 time: 1.123463 Aug 21 01:18:52.239418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1501/2647] 10.222.0.46 () {58 vars in 1197 bytes} [Sun Aug 21 01:18:51 2022] GET /compute/v2.1/servers/detail?reservation_id=r-2l28wi40 => generated 2929 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:52.250321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:52.253921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:52.276841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.277335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.282571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.284702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.285361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.286067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.425798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:52.438913 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9a7e088-25c8-453a-8664-4186fb8e5032 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.660305 Aug 21 01:18:52.442280 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1147/2648] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:51 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:52.458301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc4c9a0c-d0a9-4c46-a18a-61a35e8492eb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:52.459144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc4c9a0c-d0a9-4c46-a18a-61a35e8492eb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:52.506113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:52.517936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:52.519407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:52.520531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3acf9d53-4721-411d-a8e2-0c323789bf22 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1319 microversion: 2.21 time: 0.279989 Aug 21 01:18:52.534672 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1502/2649] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:52 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:52.563027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:52.566786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:52.582568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.585070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.586022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.589621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.591081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.591783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.645379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc4c9a0c-d0a9-4c46-a18a-61a35e8492eb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:52.659986 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc4c9a0c-d0a9-4c46-a18a-61a35e8492eb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1216 microversion: 2.1 time: 0.213676 Aug 21 01:18:52.662459 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1148/2650] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:52 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1216 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:52.682788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:52.722484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.server_groups [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Querying cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) for 2 instances {{(pid=122483) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 21 01:18:52.725675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.726210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.729364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.809119 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=89 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:52.889916 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c96d0aa9-27ec-4b30-ac6c-aea5ceaf6f28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/ad9a89c8-9332-451b-acc3-314db318b9e0" status: 200 len: 271 microversion: 2.1 time: 0.221945 Aug 21 01:18:52.894002 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1149/2651] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:18:52 2022] GET /compute/v2.1/os-server-groups/ad9a89c8-9332-451b-acc3-314db318b9e0 => generated 271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:18:52.918421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:52.926304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:52.959657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.972566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.977512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:52.982996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:52.983961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:52.991093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:53.446532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:53.456833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:53.469978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:53.475692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-154b9ded-5f81-4a62-8c8b-bfbcafde0ce8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1592 microversion: 2.42 time: 0.937251 Aug 21 01:18:53.479144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1503/2652] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:52 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1592 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:53.491916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:53.502097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:53.525582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:53.532649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:53.533370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:53.534440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:53.538164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:53.538813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.085780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ab421c1-76ea-4026-9261-34a47a73c020 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 200 len: 1619 microversion: 2.1 time: 1.188362 Aug 21 01:18:54.096632 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1150/2653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:52 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 1619 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:54.105369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:54.122688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:54.155895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.157021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.174878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.176099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.176804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.178997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.317397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:54.346393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bae64f34-8514-4476-bf26-2451f328014b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.861887 Aug 21 01:18:54.350579 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1504/2654] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:53 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:54.382952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:54.388754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:54.435160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.435827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.436108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.451652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.454986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.457466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.586071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:54.599002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3c29c5c-28db-4eea-8fdd-e21e7a2295ad tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1286 microversion: 2.1 time: 0.248031 Aug 21 01:18:54.602988 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1505/2655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:54 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:54.611171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:54.620891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:54.629843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.632405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.635147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.636048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.636654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.637716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.747598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:54.761162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:54.764679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:54.768490 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e88cf57e-4a9c-4237-b0b1-aba51b7bcf9e tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1317 microversion: 2.21 time: 0.668270 Aug 21 01:18:54.776525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1151/2656] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:54 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:54.789804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:54.790641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:54.815315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.817332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.820482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.821468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:54.822087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:54.822905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:54.962428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b71d1f3b-7dd8-47e6-bbb7-dc7909dea7de tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1619 microversion: 2.1 time: 0.357943 Aug 21 01:18:54.964461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1506/2657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:54 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1619 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:55.052050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:55.072710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:55.078025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:55.079526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1097534b-c97b-460d-9658-1168f55b6ac4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1592 microversion: 2.42 time: 0.301693 Aug 21 01:18:55.085853 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1152/2658] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:54 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1592 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:55.245679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-881740445", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "44f732fd-f08f-4545-9ddd-111094e6b979"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:18:55.369551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:18:55.370394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:55.371168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:55.392188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:55.392826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:55.393291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:55.394043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:55.394499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:55.405944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:55.818361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:18:55.818830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:18:55.819317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:18:55.819731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:18:55.825459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:18:55.848232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:55.848741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:55.849238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:55.850177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:55.856716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:55.857636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:55.893110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:18:55.902913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:18:55.931264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:18:55.934243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:18:56.059541 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30af5388-1dca-44d8-873b-613dd86954e3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817781 Aug 21 01:18:56.068485 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1507/2659] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:18:56.082193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:56.085120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:56.134271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:56.135921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:56.137277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:56.172643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:56.173628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:56.176544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:56.565006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:56.585319 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b8e54c3-5254-4be3-b092-be40f6dbc362 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1274 microversion: 2.1 time: 0.517523 Aug 21 01:18:56.596081 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1508/2660] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:56 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1274 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:56.622661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:56.623198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:56.634998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:56.635483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:56.635919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:56.636629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:56.637126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:56.637548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:57.085537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.109702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.116531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.119955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7ab9c90d-73a7-4218-853a-206bf1f971c7 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.523152 Aug 21 01:18:57.121920 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1509/2661] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:56 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:57.144008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b2bb63f-6eca-4e88-898f-dc0dff412ecb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:57.144320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b2bb63f-6eca-4e88-898f-dc0dff412ecb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:57.334956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b2bb63f-6eca-4e88-898f-dc0dff412ecb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.350311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b2bb63f-6eca-4e88-898f-dc0dff412ecb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1216 microversion: 2.1 time: 0.223602 Aug 21 01:18:57.360808 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1510/2662] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:57 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1216 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:57.378229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:57.379439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:57.391368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:57.395531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:57.396257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:57.397193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:57.397687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:57.398121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:57.697822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.716926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.720664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.723166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.727365 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8d8e2ec-0dad-45ea-8e52-ac80dd5454da tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1660 microversion: 2.42 time: 0.374860 Aug 21 01:18:57.730346 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1511/2663] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:57 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1660 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:57.732280 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-074bf52c-2425-441d-be03-9617a3bb31ba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 2.365966 Aug 21 01:18:57.739057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1153/2664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:55 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:57.742145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:57.743001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:57.752466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:57.753096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:57.753759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:57.754704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:57.755929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:57.757058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:57.848261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:57.860907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1930744c-7539-47a3-9608-0428dba0ff75 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1274 microversion: 2.1 time: 0.128371 Aug 21 01:18:57.861747 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1512/2665] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:57 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:58.152869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:58.154338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:58.180895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.183227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.185169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:58.186131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.195501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.196627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:58.373807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:58.374696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:58.383853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.384343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.392684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:58.393624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.394097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.394551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:58.542153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:58.545789 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:18:58.554728 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-44568011-86eb-49ef-892a-db2a555dd678 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1286 microversion: 2.1 time: 0.184830 Aug 21 01:18:58.570980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1513/2666] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:58 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:18:58.757946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:58.759284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:58.778921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.781779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.784912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:58.786280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:58.786871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:58.787311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.087294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.118617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.121969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.123341 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bc7e440-d288-4aca-befb-4070cf8b4077 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1660 microversion: 2.42 time: 0.371199 Aug 21 01:18:59.124555 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1514/2667] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:58 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1660 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:59.137055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:59.138239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:59.152583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.153108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.153542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.160216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.160798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.161410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.174358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.191447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.192985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.194121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8ad3936-8b12-42ec-bf5c-afb1ab923c3f tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 1.048456 Aug 21 01:18:59.203012 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1154/2668] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:18:58 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:18:59.213389 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:59.214010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:59.235164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.235647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.236264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.237170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.237776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.238451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.492175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.502988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.505361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e04cb1d1-7b7b-4610-9071-05a4fd6aa213 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.378934 Aug 21 01:18:59.507755 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1515/2669] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:59 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:59.516288 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21097b70-e337-4260-94a0-b2e23f242585 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1274 microversion: 2.1 time: 0.311898 Aug 21 01:18:59.529660 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1155/2670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:59 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:18:59.578366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:18:59.578997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:18:59.594730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.595520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.597233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.598156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:18:59.601360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:18:59.601899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:18:59.695990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:18:59.705155 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d23e8675-41bd-469c-845c-53ee931830f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1274 microversion: 2.1 time: 0.131041 Aug 21 01:18:59.716797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1516/2671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:18:59 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:00.153210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:00.154085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:00.187960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.191017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.192558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.193795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.196110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.197623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.215633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:00.216629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:00.229101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.229993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.234401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.235412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.236232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.237011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.488442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.500677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.503980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.509567 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-033ddd2f-beea-4a61-8045-56351510b266 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.297276 Aug 21 01:19:00.510664 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1517/2672] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:00 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:00.538284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:00.539219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:00.552533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.554195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.555512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.558221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.558796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.560437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.635053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.655633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.665314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.668743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c87f2fc6-849c-4d8c-9b6c-83cf144818f0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1660 microversion: 2.42 time: 0.521052 Aug 21 01:19:00.672176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1156/2673] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:00 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1660 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:00.691378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:00.694256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:00.725601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.726527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.727269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.729143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:00.729892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:00.731544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:00.971047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:00.981111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf22fc97-76fc-4ee3-97ea-968874d5e2d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.450650 Aug 21 01:19:00.981737 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1518/2674] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:00 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:01.519183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:01.525584 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:01.540710 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce52d2e1-5073-4326-81b4-bad0a74dfb3b tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.867327 Aug 21 01:19:01.568003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1157/2675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:00 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:01.576145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:01.577442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:01.591540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:01.594946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:01.595613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:01.598921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:01.599636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:01.600308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:01.752834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:01.753936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:01.779618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:01.789799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:01.790565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:01.791486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:01.797315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:01.797995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:01.884642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:19:02.094811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9fa1eaef-552d-4408-a204-84cf36488196 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 204 len: 0 microversion: 2.32 time: 1.111466 Aug 21 01:19:02.095650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1519/2676] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:19:00 2022] DELETE /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:19:02.103741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:02.104967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:02.113387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.114141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.115659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.116820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.117852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.118517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.121890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:02.134430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd0b8ec6-8b92-49d2-9ccc-ee3486d60be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1274 microversion: 2.1 time: 0.565008 Aug 21 01:19:02.136374 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1158/2677] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:01 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1274 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:02.151021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:02.151883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:02.164337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.166665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.167398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.169961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.170654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.171895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.492509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:02.503440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:02.506922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:02.508391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e680ef1c-960b-45da-9e2c-352812539021 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.411299 Aug 21 01:19:02.509338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1520/2678] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:02 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:02.514519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:02.515645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:02.525596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.526732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.529879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.531373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.532190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.532907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.655177 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=18 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:02.733934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:02.743611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f640418d-e88f-4b60-8a06-f1d64de4d8f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.232838 Aug 21 01:19:02.756904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1521/2679] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:02 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:02.757535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be59c61-6a4f-428b-8223-096eceee4b65", "tag": "c1c85692-fdc6-461b-9f88-0f70a8a77fb7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:02.775665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.776903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.777453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.803055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] Creating event network-changed:c1c85692-fdc6-461b-9f88-0f70a8a77fb7 for instance 5be59c61-6a4f-428b-8223-096eceee4b65 on n-h2-master-1 Aug 21 01:19:02.810636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e26a0825-a13f-4014-9ed5-d8fe41e24e7e req-dea5eb60-c467-42d1-be64-23f6a349742b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063224 Aug 21 01:19:02.812039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1522/2680] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:02.818719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:02.820464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:02.834562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.835479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.836145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:02.837165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:02.837848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:02.838934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.399810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.420488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.421916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.428705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d6ba330-3124-4bf5-bf12-2ab10c861122 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 0.609634 Aug 21 01:19:03.429599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1523/2681] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:02 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:03.449975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:03.450603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:03.476603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.477115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.477550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.478256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.478701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.479119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.651673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.668808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.673590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.675581 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45453fba-3a91-4ecd-81f8-f1dbc11af664 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1707 microversion: 2.42 time: 1.537954 Aug 21 01:19:03.678283 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1159/2682] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:02 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1707 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:03.695377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:03.696431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:03.711401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.716135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.718729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.720940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.721673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.725334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.895297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:03.906619 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a41e2fe-31c1-499a-a522-07c0cf5d9b51 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.460326 Aug 21 01:19:03.928368 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1524/2683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:03 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:03.942017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:03.942880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:03.965096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.968796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.976041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:03.977834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:03.978488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:03.979085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.320228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:04.330822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:04.331800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:04.333135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d3c3bea-9169-42d2-ac92-3c680bdb3759 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.403248 Aug 21 01:19:04.334084 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1525/2684] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:03 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:04.342064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:04.342838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:04.353409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.353968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.354602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.355364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.356141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.356618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.465714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:04.485672 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3f6fa59-1bd1-4b2b-9193-699b74af1bf8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.803535 Aug 21 01:19:04.486405 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1160/2685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:03 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:04.495814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:04.496573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:04.513145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.514560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.515130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.516112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.518517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.519571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.538859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:04.549336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad2fa4c3-d980-42a2-a68e-b5c4dc10367f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.214000 Aug 21 01:19:04.560793 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1526/2686] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:04 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:04.704644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:04.705688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:04.721303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.724420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.726036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:04.727130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:04.727776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:04.728756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.109578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.123364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.125398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.130259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-006351e3-67e3-4cef-8f2a-42b324f325c6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1707 microversion: 2.42 time: 0.430364 Aug 21 01:19:05.134836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1527/2687] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:04 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1707 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:05.147849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:05.148982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:05.184489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.188923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.191364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.194105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.196100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.199637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.417105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.438876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b418cfd6-631b-4ba6-bfcd-f1065cd3dd19 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.300644 Aug 21 01:19:05.445842 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1528/2688] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:05 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:05.454666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:05.455531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:05.470514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.473065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.475009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.476139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.476851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.477515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.543597 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:05.731668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.746751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.749806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.766109 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51cac6b4-7e8c-4de9-bae4-d23d04e61cae tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 1.276541 Aug 21 01:19:05.769254 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1161/2689] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:04 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:05.786864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:05.787525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:05.816048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.816662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.819020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.820270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.821311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.821747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.830328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.844825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.850578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:05.855106 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15e08a09-a6a9-458c-945b-e4e5dccf6c11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.407208 Aug 21 01:19:05.858142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1529/2690] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:05 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:05.873488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:05.875448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:05.890267 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:05.892558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.893412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.895374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:05.896663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:05.898386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:05.898977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.156858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.169981 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf506cb0-211c-4ecc-a0d9-5f5993578ec3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.309602 Aug 21 01:19:06.175743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1530/2691] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:05 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:06.185048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:06.186185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:06.198876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.199647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.200249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.201216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.201853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.202534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.402042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.416116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.418702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.420202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-231d9e24-b4a0-476d-8ddc-a773b1ee59b4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1707 microversion: 2.42 time: 0.243164 Aug 21 01:19:06.421049 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1531/2692] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:06 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1707 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:06.467088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:06.468117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:06.495669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.496864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.497785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.499056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.508309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.509283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.713222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.713222 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea53c805-2907-4e7c-ac35-178e69fedba9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.942525 Aug 21 01:19:06.731512 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1162/2693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:05 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:06.772387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:06.781595 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9697a3e-34a2-406b-a840-e49e6294e48e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.317570 Aug 21 01:19:06.782868 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1532/2694] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:06 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:06.798736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:06.799440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:06.808025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.808593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.809717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.822036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.825091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.826598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.880656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:06.881402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:06.891806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.894942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.896873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:06.897674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:06.902523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:06.903144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.151429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.164463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.167189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.168702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6a629d4-998e-4a7e-bf08-f1e7f6d66300 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.292243 Aug 21 01:19:07.181235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1533/2695] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:06 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:07.217918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc16a44-73e4-45d0-b26a-c1576a79513b", "tag": "16f90d08-b8e8-4b17-af1b-f778c546f47c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:07.228387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.229119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.229726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.245351 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] Creating event network-changed:16f90d08-b8e8-4b17-af1b-f778c546f47c for instance 6fc16a44-73e4-45d0-b26a-c1576a79513b on n-h1-master-1 Aug 21 01:19:07.251173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c7432ed9-ba8d-4a2d-83a5-a2fe034dca32 req-aaa0a918-f402-4b8d-b744-31a2270e8336 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055363 Aug 21 01:19:07.253362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1534/2696] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:07.260621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:07.261861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:07.272901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.273630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.275010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.276128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.276833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.277648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.346659 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=18 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:07.461830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.484285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fbe6523-0a40-4183-bfd5-80506db6147d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1680 microversion: 2.1 time: 0.229080 Aug 21 01:19:07.497734 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1535/2697] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:07 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:07.507973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:07.508660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:07.517607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.518309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.518752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.519523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.519924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.520348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.742036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.756027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.785347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.788311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.790675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.791690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:07.794375 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70d50b8f-eb72-49e0-baa5-d82ffa7624fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 1.000120 Aug 21 01:19:07.795423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99a01078-cae4-4b47-a33e-1400e50b1e2c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1707 microversion: 2.42 time: 0.292405 Aug 21 01:19:07.796664 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1536/2698] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:07 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1707 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:07.820673 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1163/2699] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:06 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:07.827218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:07.828816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:07.829631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:07.830398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:07.845491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.846384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.847058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.847693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.848281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.850918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.852069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.852708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.852985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:07.853592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:07.855198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:07.855548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.112112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.120671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7a87816-00e1-4fb8-9b8c-170528642d73 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.305349 Aug 21 01:19:08.124367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1537/2700] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:07 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:08.205627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:08.206839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:08.224865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.225491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.226048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.227194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.227764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.228472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.483362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.499017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.510843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.515044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8efdd8bf-547f-4dd7-b509-4dc4a6b6b99c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.314552 Aug 21 01:19:08.534379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1538/2701] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:08 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:08.544798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:08.546813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:08.554040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.567600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.569440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.572327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.574144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.576990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.579046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.590495 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cebe4f0b-2f5a-4171-9efc-cda3df4b13b8 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.765516 Aug 21 01:19:08.599115 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1164/2702] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:07 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:08.820113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:08.821187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:08.828644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.829595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.830270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.832007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.832533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.833192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.834179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:08.844310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ed31e77-12ce-43e2-8ff5-5eb562e075b4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.308595 Aug 21 01:19:08.846252 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1539/2703] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:08 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:08.851807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:08.852422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:08.859271 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:08.860727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.861237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.861906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:08.871640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:08.873598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:08.877801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.072249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.088525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.090910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.094387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab0389cd-82a3-4e84-8d37-b2bc4feaf211 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1754 microversion: 2.42 time: 0.277365 Aug 21 01:19:09.110293 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1165/2704] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:08 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1754 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:09.120003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:09.120585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:09.128228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.128984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.129798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.130756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.131052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.131552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.134641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.139596 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:09.146810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.148547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.149898 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7153b6a6-27f0-41d9-b611-205330b87965 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 0.302695 Aug 21 01:19:09.170980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1540/2705] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:08 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:09.177313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:09.178034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:09.186470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.188186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.189420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.190340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.190973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.192213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.468976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.483226 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-44d81a13-4c3d-4a4b-a206-ce8c1e8951f8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.311046 Aug 21 01:19:09.484901 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1541/2706] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:09 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:09.491721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f9f5f4-1857-4827-a6f3-1217fc5e817d", "tag": "eb4d40f5-fd04-4fea-b649-89d97d2d8558"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:09.510037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.511127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.513871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.531085 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] Creating event network-changed:eb4d40f5-fd04-4fea-b649-89d97d2d8558 for instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d on n-h1-master-1 Aug 21 01:19:09.553751 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e4a11cc2-829a-482c-95c9-f339968c1b88 req-e9376799-b888-4459-ae50-3d3c924c06c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067331 Aug 21 01:19:09.555016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1542/2707] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:09.563002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:09.564385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:09.574138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.574925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.575553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.577606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.578505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.579135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.610246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.631189 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ddead5f-8e03-4e51-84e4-1658be16f585 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.518636 Aug 21 01:19:09.643509 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1166/2708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:09 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:09.649322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:09.650574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:09.660738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.661576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.662184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.663078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.663708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.664302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:09.885388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.904721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.909770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:09.913639 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c6460c2-cabb-4491-ba11-35c5d52bb3ba tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.356504 Aug 21 01:19:09.914855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1543/2709] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:09 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:09.945409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "67a9430a-b35b-4d92-91c6-42f46492d842"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:09.975065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:09.975544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:09.975982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.000797 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] Creating event network-vif-unplugged:67a9430a-b35b-4d92-91c6-42f46492d842 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:10.014605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a5055f28-cf5d-4bb5-a742-61eea7fd2e07 req-b6978beb-3663-4ec7-b552-936506f008ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080484 Aug 21 01:19:10.015427 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1544/2710] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:10.123508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:10.145161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:10.170803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.171355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.181029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.183293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.186503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.187208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.461498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.473378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.484139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.485565 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fef97c18-2af1-46db-a2c1-dbb63911dfd4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1754 microversion: 2.42 time: 0.368922 Aug 21 01:19:10.489480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1545/2711] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:10 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1754 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:10.495902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:10.504503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:10.513817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.515776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.518834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.523068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.523594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.524052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.843179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.854089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.859419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:10.863649 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b7ac95e-d144-4fb1-bfe0-136242c1d547 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 0.372836 Aug 21 01:19:10.868508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1546/2712] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:10 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:10.879164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:10.880174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:10.907630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.908370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.908895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:10.909681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:10.910201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:10.911295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.109556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.123158 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f153bc50-140f-4e28-8674-b0774dcc699e tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 1.477952 Aug 21 01:19:11.123769 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1167/2713] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:09 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:11.169474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.174165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:11.178853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:11.185232 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5abb9ed6-61a2-4e1c-bd6f-afa82616b022 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.313678 Aug 21 01:19:11.197044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.198737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.199355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.201129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.202714 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1547/2714] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:10 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:11.204177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.204831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.423314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:11.424196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:11.437150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.441347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.442052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.442978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.445664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.446366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.485264 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:11.659891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.681943 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0b4bf9b-0987-4b5e-9a52-eacb4e7121f3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.254137 Aug 21 01:19:11.682632 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1548/2715] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:11 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:11.697356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:11.697968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:11.704892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.713561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.714230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.715881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.716502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.717242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.918678 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.930481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.931966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:11.946746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d9274fc-375b-4468-a3fb-82ecbe5948a2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1754 microversion: 2.42 time: 0.263010 Aug 21 01:19:11.947534 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1549/2716] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:11 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1754 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:11.954393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:11.955235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:11.984241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.984722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.985179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:11.985905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:11.989561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:11.997202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.099747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.124244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.155032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.161847 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6255591-9aed-439d-857d-5c010650f6e0 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 1.028274 Aug 21 01:19:12.163431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1168/2717] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:11 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:12.176620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:12.180314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:12.194812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.196350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.196815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.200009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.200486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.201020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.321387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.332755 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc1973fe-3ebe-4c8f-80bd-0f2ab3595faa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.383694 Aug 21 01:19:12.333249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1550/2718] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:11 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:12.353856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-unplugged", "status": "completed", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "09ee1a66-22fc-4784-bfd8-33aa4d4f401b"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "2b34f8d9-a956-4cd7-88dc-cd02dd48506a"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "8c042ceb-0474-43e0-9d18-f60ab556f200"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "af9fedc1-ee77-4233-9405-39aa90621b2a"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-unplugged", "status": "completed", "tag": "ed52380b-6a18-402a-9e3c-afd08577e340"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:12.367169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.367889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.368539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.384719 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:19:12.385697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:09ee1a66-22fc-4784-bfd8-33aa4d4f401b for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:12.386407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:2b34f8d9-a956-4cd7-88dc-cd02dd48506a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:12.387204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:8c042ceb-0474-43e0-9d18-f60ab556f200 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:12.388126 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:af9fedc1-ee77-4233-9405-39aa90621b2a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:12.388961 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] Creating event network-vif-unplugged:ed52380b-6a18-402a-9e3c-afd08577e340 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:12.401797 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a4c41130-d7dd-40da-8ad3-69b6dd69e294 req-fbd17299-9535-45fe-b0f5-351bf68a8da6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.051953 Aug 21 01:19:12.402895 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1551/2719] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:12.408523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:12.409536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:12.417485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.418405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.419160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.420074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.420911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.421586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.602783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.615372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3aa3f5de-8862-41bd-925d-8f8329b63969 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.210661 Aug 21 01:19:12.630801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1552/2720] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:12 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:12.637519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:12.638431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:12.653819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.655970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.657849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.662654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:12.664385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:12.666344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:12.949321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:12.957871 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e95c3ef-06df-4666-8199-472be8c7cec7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.324790 Aug 21 01:19:12.958473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1553/2721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:12 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:12.980460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:12.981890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:12.996994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.003162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.003916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.005036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.005753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.006180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.262093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.275548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6cce070d-d81d-48e2-a8a6-1670b71abb8b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.303038 Aug 21 01:19:13.279033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1554/2722] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:12 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:13.291582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:13.292574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:13.306492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.308788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.309425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.312785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.313417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.314521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.420389 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.437919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.439754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.449183 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-585de53d-51d0-4f1b-9ab7-f3ee5bf79e93 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2950 microversion: 2.32 time: 1.273206 Aug 21 01:19:13.450151 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1169/2723] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:12 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2950 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:13.474810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:13.479947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:13.488362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.490455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.495224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.495991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.496462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.496935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.576933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.590801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.596519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.603466 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f834233c-7c7f-4dcb-bc95-497e9509ff43 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1754 microversion: 2.42 time: 0.322494 Aug 21 01:19:13.607029 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1555/2724] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:13 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1754 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:13.615633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:13.619603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:13.628085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.628967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.629728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.630451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.631099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.631761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.770459 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-272c5f44-eb04-40a7-8df2-253041408f44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.160470 Aug 21 01:19:13.774418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1556/2725] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:19:13 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:19:13.780799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:13.782096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:13.790222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.790778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.791271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.792043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:13.792504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:13.793180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:13.962368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:13.973362 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4155c78a-07af-407f-9199-4012a282d492 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.200513 Aug 21 01:19:13.974437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1557/2726] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:13 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:13.983260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:13.984614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:14.000676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.004834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.009893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.013416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.013899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.016319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.289450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:14.325883 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9de8ee2-0278-45fb-9fb5-37b8c7731930 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1669 microversion: 2.1 time: 0.343309 Aug 21 01:19:14.327576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1558/2727] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1669 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:14.343623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:14.344283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:14.361338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.361835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.362268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.362986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.363435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.363857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.550943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:14.565985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5bf76a62-39d1-495c-a7a6-e55d46805aba tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.236549 Aug 21 01:19:14.579271 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1559/2728] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:14 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:14.579271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:14.579271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:14.594493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.594991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.595427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.598495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.599040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.599474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.656308 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcd0deaf-94f3-45e9-9327-98f31c833932 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/ips" status: 200 len: 145 microversion: 2.1 time: 0.086006 Aug 21 01:19:14.664806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1560/2729] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:19:14 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:14.671623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:14.672359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:14.692855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.693364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.696154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.697377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:14.697910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:14.698350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:14.982650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:14.994394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:14.996358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:14.998462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef4330f5-736b-4167-a730-d9c2c762a125 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2929 microversion: 2.32 time: 0.336187 Aug 21 01:19:14.999549 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1561/2730] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:14 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2929 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:15.005264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:15.006129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:15.013122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.013835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.014421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.016300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.017672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.018254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.171650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.183254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.187111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.194267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9c5cc86b-b533-4ce0-a3c6-2cd4e46b3f79 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 1.742634 Aug 21 01:19:15.196222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1170/2731] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:13 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:15.207349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be59c61-6a4f-428b-8223-096eceee4b65", "name": "network-vif-plugged", "status": "completed", "tag": "c1c85692-fdc6-461b-9f88-0f70a8a77fb7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:15.226877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.228051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.230307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.258421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.270151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] Creating event network-vif-plugged:c1c85692-fdc6-461b-9f88-0f70a8a77fb7 for instance 5be59c61-6a4f-428b-8223-096eceee4b65 on n-h2-master-1 Aug 21 01:19:15.273737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.275841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.278263 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d66fe33b-ec61-45a6-a811-edfe3e564abb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1801 microversion: 2.42 time: 0.277358 Aug 21 01:19:15.281254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8b3fda95-4dbd-4a16-97e5-59ecfbfc2274 req-d72ad95a-6b5a-4845-bddd-6dcad9bfb1b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082911 Aug 21 01:19:15.282305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1562/2732] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:14 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1801 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:15.284465 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1171/2733] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:15.289285 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:15.290050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:15.301632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.302825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.303570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.304536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.305402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.306089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.357023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:15.357845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:15.372033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.372865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.373542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.374468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.375832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.376505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.600001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.613765 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-018df461-a993-473e-b4cd-f998a9f15d02 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.327288 Aug 21 01:19:15.614402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1563/2734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:15 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:15.631271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:15.631896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:15.655259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.655544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.655944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.656678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:15.657260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:15.657583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:15.829505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.841772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a07f1db8-ad6b-4c1c-84f2-fc7bedfc5036 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1669 microversion: 2.1 time: 0.497961 Aug 21 01:19:15.842648 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1172/2735] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:15 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:15.966191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:15.973939 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:15.990227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54d2ceda-a3f1-4efb-9cc9-8ab45a84a6b2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.372532 Aug 21 01:19:15.991580 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1564/2736] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:15 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:16.032098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:16.032718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:16.043775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.044289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.044724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.052003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.052521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.053010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.230906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:16.231664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:16.251252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.251976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.252637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.253580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.254203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.255008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.471170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:16.480970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:16.488755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:16.490578 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf422925-d2a5-4f7c-9203-b59b0a5af045 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1359 microversion: 2.21 time: 0.276540 Aug 21 01:19:16.514391 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1565/2737] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:16 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:16.520117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:16.521116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:16.539328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.541051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.541729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.542655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:16.543320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:16.543948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:16.988427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.007673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.027384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.032448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a21a07c-38dc-4c21-bbdd-dd896064a4b9 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2929 microversion: 2.32 time: 1.004636 Aug 21 01:19:17.047882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.050836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1173/2738] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:16 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2929 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:17.055976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:17.056591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.062566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.067985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.071664 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6329271-c9a8-4944-a451-056cdd0d14e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1801 microversion: 2.42 time: 0.553414 Aug 21 01:19:17.078085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.078592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.079023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.079763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.086393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.086543 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1566/2739] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:16 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1801 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:17.086893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.100857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:17.101491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.115964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.116793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.117225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.118312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.118776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.119205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.414821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.444549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-138ad320-ed2a-487f-8ae4-0569d455bbb1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.347195 Aug 21 01:19:17.446487 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1567/2740] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:17 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:17.459045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:17.460083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.477579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.478332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.478987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.483776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.484637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.485356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.666097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.705068 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ffd4aa4-a0e6-43c9-b67c-a479c2cf91d2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.650122 Aug 21 01:19:17.705974 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1174/2741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:17 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:17.712941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9f5f4-1857-4827-a6f3-1217fc5e817d", "name": "network-vif-plugged", "status": "completed", "tag": "eb4d40f5-fd04-4fea-b649-89d97d2d8558"}, {"server_uuid": "6fc16a44-73e4-45d0-b26a-c1576a79513b", "name": "network-vif-plugged", "status": "completed", "tag": "16f90d08-b8e8-4b17-af1b-f778c546f47c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:17.755714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:17.764893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.765526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.766111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.770887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad920638-9d3c-4f17-a7c2-716d01f396b1 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.322987 Aug 21 01:19:17.771542 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1568/2742] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:17 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:17.776383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:17.790866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.801589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Creating event network-vif-plugged:eb4d40f5-fd04-4fea-b649-89d97d2d8558 for instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d on n-h1-master-1 Aug 21 01:19:17.802149 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] Creating event network-vif-plugged:16f90d08-b8e8-4b17-af1b-f778c546f47c for instance 6fc16a44-73e4-45d0-b26a-c1576a79513b on n-h1-master-1 Aug 21 01:19:17.808807 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f73c3c4d-2799-4319-a380-9b22094d3799 req-a46af61e-9682-451e-9bba-e14dbd9f4773 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100866 Aug 21 01:19:17.809482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1175/2743] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:17.812841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.813438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.817696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.818718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.819352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.820686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.821041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:17.821971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.832614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.833453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.834066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.843941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.844792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.845558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.902792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab9b848b-7082-4ab1-8524-aac7a20bc2bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 200 len: 322 microversion: 2.1 time: 0.129948 Aug 21 01:19:17.903859 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1569/2744] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:19:17 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 322 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:17.915867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:17.916607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:17.936955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.940826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.941418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:17.943326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:17.943933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:17.945271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.218147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.229314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-720b4ce6-a7ae-46e9-b312-44c5ca2472c3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.319587 Aug 21 01:19:18.231105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1570/2745] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:17 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:18.237208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:18.238032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:18.245258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.245963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.246601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.247666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.248262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.249065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.451847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.458263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.469926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.471891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.473607 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e21c8dd7-80a3-49be-ab2c-4ba250b02e11 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1551 microversion: 2.21 time: 0.662845 Aug 21 01:19:18.474849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1176/2746] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:17 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1551 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:18.476003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.478626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:18.480626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:18.481556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33bb5b92-1d5b-48b4-b466-9ccea1209f5f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2908 microversion: 2.32 time: 0.248159 Aug 21 01:19:18.481901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:18.482143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1571/2747] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:18 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2908 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:18.490658 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:18.492439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.493599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.494345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.495293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.495971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.496664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.498629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53532cd8-4dc7-440f-ba31-33a0144dff86"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:18.504375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:18.522262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.523259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.524030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.525007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:18.525661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:18.526637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:18.951304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac2b5300-5bbb-4553-a107-cd5224b66c11 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467463 Aug 21 01:19:18.952296 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1572/2748] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:19:18 2022] POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:18.986547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:18.990815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:19.007992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.009401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.011530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.013932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.014601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.015477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.326068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:19.337423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02ac770e-0d58-4524-adbf-093eae56ba07 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.383606 Aug 21 01:19:19.338528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1573/2749] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:18 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:19.343970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:19.344691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:19.352393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.353168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.353859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.354781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.355567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.356185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.386635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:19:19.418627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:19.431768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:19.440843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:19.442601 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf2d9540-e6de-45c5-8746-9fdce31e4542 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1848 microversion: 2.42 time: 0.966445 Aug 21 01:19:19.443726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1177/2750] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:18 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1848 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:19.454011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:19.455061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:19.464258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.466305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.467019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.469489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.471241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.471680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.511406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-902352a2-ecc8-4e05-8a6a-efc70fda03a6 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 204 len: 0 microversion: 2.21 time: 0.171199 Aug 21 01:19:19.515764 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1574/2751] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:19:19 2022] DELETE /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:19:19.522969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:19.524581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:19.534284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.534839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.535281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.536280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.536741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.537358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.825179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:19.845062 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a681aa2f-7f35-4468-9ee0-420e23f18bff tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1316 microversion: 2.1 time: 0.321021 Aug 21 01:19:19.847135 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1575/2752] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:19 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:19.858176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:19.861996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:19.873691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.875928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.877087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:19.878136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:19.878832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:19.879881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.017310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.029259 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54866346-0654-4a2c-ab65-5356be4fd034 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1316 microversion: 2.1 time: 0.582290 Aug 21 01:19:20.029910 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1178/2753] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:19 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:20.046984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-deleted", "tag": "2b34f8d9-a956-4cd7-88dc-cd02dd48506a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:20.072917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.073402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.073831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.104668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] Creating event network-vif-deleted:2b34f8d9-a956-4cd7-88dc-cd02dd48506a for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:20.149364 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8ba9dc7a-d56d-40c3-ad4e-2ba50453490e req-41f3f2d0-06c7-4930-8cc8-31b3b628532b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083107 Aug 21 01:19:20.150360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1179/2754] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:20.166754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:20.170786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:20.189451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.190240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.190672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.191510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.192068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.192666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.216289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.229676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7190a657-4d83-4649-aa4e-d8c05b5e73e5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.379488 Aug 21 01:19:20.230800 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1576/2755] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:19 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:20.236234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:20.237186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:20.245583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.246426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.247089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.248335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.249077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.250469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.449241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.465077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.467701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.470753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e61de761-f2b3-4453-9b5e-d84bdcd2879c tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1557 microversion: 2.21 time: 0.238201 Aug 21 01:19:20.471759 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1577/2756] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:20 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1557 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:20.478302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:20.479174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:20.495800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.496977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.497681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.498750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.499446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.500134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.589182 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.603596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.608847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.612611 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7166226c-e3c2-47dd-b9f1-45c1f9c013bc tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2862 microversion: 2.32 time: 0.451969 Aug 21 01:19:20.629636 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1180/2757] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:20 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2862 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:20.640146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:20.641861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:20.651907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.652414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.653156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.653724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.654273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.654695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.718096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:20.722410 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:20.730711 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5b25652-8513-4943-94c6-ea7d28a7be54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.256739 Aug 21 01:19:20.738359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1578/2758] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:20 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:20.867698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:20.868504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:20.897145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.899685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.901775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:20.903193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:20.903615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:20.905342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.013136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.031373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.032832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.034014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5c3c397-6c6a-45e7-bc5f-7f4592b461d0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1848 microversion: 2.42 time: 0.403121 Aug 21 01:19:21.034574 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1181/2759] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:20 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1848 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:21.040831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2017296524", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "4ec7abf5-e561-48e7-9db1-bc3c2f1218ae"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:21.141665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] validate_networks() for [('4ec7abf5-e561-48e7-9db1-bc3c2f1218ae', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:21.472649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.485132 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8aa1b8f1-4acc-4404-ad65-a8c22be678a3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1465 microversion: 2.1 time: 0.622230 Aug 21 01:19:21.487116 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1579/2760] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:20 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1465 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:21.492251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:21.493127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:21.512547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.513289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.513835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.514554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.515178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.516812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.676685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.689892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5ff5ff5-46d7-4da5-8003-5d936545b3dd tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1503 microversion: 2.1 time: 0.200833 Aug 21 01:19:21.691067 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1580/2761] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:21 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:21.697021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:21.697953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:21.708216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.709133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.709901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.711611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.712301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.712991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.901478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.916749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.919622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0958585bb2a74c9daa0b0d55c735782c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9830900560b14834aad5e7231fbbb8c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:21.921452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0087dd90-1601-494d-b068-b34d536bbdaf tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 200 len: 1557 microversion: 2.21 time: 0.228541 Aug 21 01:19:21.922670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1581/2762] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:21 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:21.931674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:21.932622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:21.941711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.942203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.942649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:21.943531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:21.943999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:21.945029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.236987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65edebe0-6435-4a24-9210-eb32e872ae08 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1616 microversion: 2.1 time: 0.310442 Aug 21 01:19:22.237834 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1582/2763] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:21 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1616 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:22.246997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:22.250192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:22.281197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.284508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.285872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.287648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.289397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.290430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.611644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:22.624222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:22.628085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:22.632644 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf66b8b4-899d-484d-9b09-fd8676e9ea1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2702 microversion: 2.32 time: 0.388981 Aug 21 01:19:22.633614 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1583/2764] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:22 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2702 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:22.645877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:22.646588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:22.653303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.653778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.654211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.654922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.655450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.655873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.685157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:19:22.849561 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:22.870602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3951d410-54a5-4b9d-9b98-4f111f7a55a2 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 204 len: 0 microversion: 2.1 time: 0.235698 Aug 21 01:19:22.871936 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1584/2765] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:19:22 2022] DELETE /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:19:22.880318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:22.881051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:22.887129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.887608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.888039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:22.888740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:22.889209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:22.889626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.110408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:23.123105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:23.126689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:23.128147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7db9dc75-68c3-4155-b765-827c48a2d5e7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1857 microversion: 2.42 time: 0.255077 Aug 21 01:19:23.129269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1585/2766] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:22 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1857 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:23.134371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "836feede-bb0f-4bf4-aa52-925140922dbc"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-deleted", "tag": "67a9430a-b35b-4d92-91c6-42f46492d842"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:23.151342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.164088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.164584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.186171 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Creating event network-changed:836feede-bb0f-4bf4-aa52-925140922dbc for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:23.188976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] Creating event network-vif-deleted:67a9430a-b35b-4d92-91c6-42f46492d842 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:23.208010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-fe0993d9-648d-4176-8afc-d4ca190ecf6c req-2540aa97-c2ae-4219-8b09-dce10c78607c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077036 Aug 21 01:19:23.208834 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1586/2767] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:23.222113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-249692517", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["44f732fd-f08f-4545-9ddd-111094e6b979"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:23.284586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:23.285180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:23.285503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:23.286865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:23.287361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:23.311352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:23.313592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.313755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.315653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.316472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.316964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.317390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.354516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:23.363495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:23.400356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:23.406483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:23.533339 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-967af2f2-8ac2-4da1-85a3-3673b5b72fb6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.497476 Aug 21 01:19:23.534887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1182/2768] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:23.542216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:23.545906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:23.560523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.561370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.563295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.565934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.567231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.567828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.786959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:23.787470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:23.788042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:23.788546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:23.789074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:23.799773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.800379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.800955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.801796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.802501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.803179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.828296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:23.835234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:23.849189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:23.852148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:23.913501 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84a84ff3-1f7d-4267-bba3-1953d00a2011 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703415 Aug 21 01:19:23.915015 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1587/2769] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:23.925069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:23.927944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:23.947567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.948217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.948481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:23.949458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:23.949793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:23.950226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.001538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] HTTP exception thrown: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Request method failure captured: Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 HTTP/1.1 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf261Z1pcVaQazsWmAEnOnvvMxSNc8F0YZnVikE7lkgipkT5ZPzB_9W19AJ4VWPTM6uN_y5bDsBt4Oq1Y8RIIHfvThHKpVs1HBZGhM-x2huc9KfN1vPpfrUVsNuBA5neDK-tTy3MITrdP9-8USsikOY0o7nvk85-F-xoZaCL6b356A Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.21 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9830900560b14834aad5e7231fbbb8c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}] Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 0958585bb2a74c9daa0b0d55c735782c Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5be59c61-6a4f-428b-8223-096eceee4b65'} Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:24.003418 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Returning 404 to user: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a321fe6-42a7-4380-a8a1-2b6f4cb3cb70 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 404 len: 111 microversion: 2.21 time: 0.088664 Aug 21 01:19:24.009930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1588/2770] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:23 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:19:24.015721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72602699-1c00-4f09-9845-b2d4ec88f2d3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:24.016370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72602699-1c00-4f09-9845-b2d4ec88f2d3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:24.192629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72602699-1c00-4f09-9845-b2d4ec88f2d3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:24.202785 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72602699-1c00-4f09-9845-b2d4ec88f2d3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1215 microversion: 2.1 time: 0.195924 Aug 21 01:19:24.205770 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1589/2771] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:24 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:24.220013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:24.223256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:24.234310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.234808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.235257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.236021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.236486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.242989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.625442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:24.651260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:24.661640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:24.665298 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83c32037-9209-48d2-a81f-9a0c56301080 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2656 microversion: 2.32 time: 0.457142 Aug 21 01:19:24.668000 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1590/2772] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:24 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2656 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:24.685324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d00bda8-2e4c-49f1-9752-28b7ef4c0b94 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:24.685959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d00bda8-2e4c-49f1-9752-28b7ef4c0b94 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:24.802591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d00bda8-2e4c-49f1-9752-28b7ef4c0b94 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:24.812759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d00bda8-2e4c-49f1-9752-28b7ef4c0b94 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1216 microversion: 2.1 time: 0.141294 Aug 21 01:19:24.813961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1591/2773] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:24 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:24.820286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '.version_select at 0x7fc3fa166b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:24.821178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:24.833825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.835565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.839391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.840758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.841860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.842346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.935707 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad3503b3-7d5c-4fdc-ad2d-ebc99edf9194 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.120104 Aug 21 01:19:24.936344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1592/2774] 10.222.0.46 () {60 vars in 1337 bytes} [Sun Aug 21 01:19:24 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:19:24.942947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:24.949684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:24.956332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.957533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.957970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:24.958677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:24.959121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:24.959748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.019488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:25.033388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2338b2e6-e50a-4ff4-8d5f-2a6d3102a047 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1509 microversion: 2.1 time: 1.491376 Aug 21 01:19:25.034344 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1183/2775] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:23 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1509 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:25.046169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:25.047050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:25.058564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.062550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.063444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.066917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.067646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.069232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.108598 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] HTTP exception thrown: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Request method failure captured: Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 HTTP/1.1 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYf261Z1pcVaQazsWmAEnOnvvMxSNc8F0YZnVikE7lkgipkT5ZPzB_9W19AJ4VWPTM6uN_y5bDsBt4Oq1Y8RIIHfvThHKpVs1HBZGhM-x2huc9KfN1vPpfrUVsNuBA5neDK-tTy3MITrdP9-8USsikOY0o7nvk85-F-xoZaCL6b356A Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.21 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9830900560b14834aad5e7231fbbb8c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}] Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0958585bb2a74c9daa0b0d55c735782c Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5be59c61-6a4f-428b-8223-096eceee4b65'} Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:25.114934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.119031 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.122825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Returning 404 to user: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:25.128128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-068c9f7d-6d4f-4464-9caf-db916a4fd48d tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 404 len: 111 microversion: 2.21 time: 0.091091 Aug 21 01:19:25.131184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1184/2776] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:19:25 2022] DELETE /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:19:25.147352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:25.149064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] [instance: 5be59c61-6a4f-428b-8223-096eceee4b65] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:25.171314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.176046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.177257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.178426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.179471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.180256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.208650 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] HTTP exception thrown: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Request method failure captured: Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 HTTP/1.1 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYf261Z1pcVaQazsWmAEnOnvvMxSNc8F0YZnVikE7lkgipkT5ZPzB_9W19AJ4VWPTM6uN_y5bDsBt4Oq1Y8RIIHfvThHKpVs1HBZGhM-x2huc9KfN1vPpfrUVsNuBA5neDK-tTy3MITrdP9-8USsikOY0o7nvk85-F-xoZaCL6b356A Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.21 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9830900560b14834aad5e7231fbbb8c6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9830900560b14834aad5e7231fbbb8c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9830900560b14834aad5e7231fbbb8c6"}]}] Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9830900560b14834aad5e7231fbbb8c6 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-986557086 Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0958585bb2a74c9daa0b0d55c735782c Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-InstanceActionsV221TestJSON-986557086-project Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5be59c61-6a4f-428b-8223-096eceee4b65'} Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.210828 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. Aug 21 01:19:25.216041 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:25.219379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] Returning 404 to user: Instance 5be59c61-6a4f-428b-8223-096eceee4b65 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:25.221744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bd7eec9-6c57-4db7-b22e-09c8884efca9 tempest-InstanceActionsV221TestJSON-986557086 tempest-InstanceActionsV221TestJSON-986557086-project] 10.222.0.46 "GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65" status: 404 len: 111 microversion: 2.21 time: 0.084201 Aug 21 01:19:25.223044 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1185/2777] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:25 2022] GET /compute/v2.1/servers/5be59c61-6a4f-428b-8223-096eceee4b65 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:19:25.235849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:25.237514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:25.247976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.249237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.249995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.251448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.252412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.254183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.411864 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:25.436891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:25.442719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:25.449106 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7dde928-6305-4d37-8bb3-ef5e6b3b1bd5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1857 microversion: 2.42 time: 0.511448 Aug 21 01:19:25.450339 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1593/2778] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:24 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1857 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:25.465842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be59c61-6a4f-428b-8223-096eceee4b65", "name": "network-vif-deleted", "tag": "c1c85692-fdc6-461b-9f88-0f70a8a77fb7"}, {"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "ee2defc2-fa33-496d-ade2-18c43587603e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:25.487090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.487791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.491156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.520712 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Creating event network-vif-deleted:c1c85692-fdc6-461b-9f88-0f70a8a77fb7 for instance 5be59c61-6a4f-428b-8223-096eceee4b65 on n-h2-master-1 Aug 21 01:19:25.522641 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] Creating event network-changed:ee2defc2-fa33-496d-ade2-18c43587603e for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:25.533899 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c673777e-d936-40b1-aec2-ec58f9530092 req-c8460c25-d23c-4036-9c7b-3f77386ab334 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.082065 Aug 21 01:19:25.534703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1594/2779] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:25.693063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:25.694795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:25.712898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.716068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.720479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.721602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.723282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.723947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.772649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:25.775299 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:25.788235 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a33dc2f-8c46-424a-bfa2-8f081d2f9f61 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1275 microversion: 2.1 time: 0.563841 Aug 21 01:19:25.791908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1186/2780] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:25 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1275 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:25.834447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:25.835083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:25.847040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.847539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.847973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:25.848685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:25.849162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:25.849582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.024673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:26.040225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:26.044532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:26.047250 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6641558-75db-4ac5-8bcc-005c066132f4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2656 microversion: 2.32 time: 0.359304 Aug 21 01:19:26.050744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1595/2781] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:25 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2656 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:26.059742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:26.060609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:26.089878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.092512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.094136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.099837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.101035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.101566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.197060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:26.210696 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67e67195-9049-4971-8394-c6cc2ef07d05 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1274 microversion: 2.1 time: 0.380125 Aug 21 01:19:26.211574 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1187/2782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:25 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:26.473961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:26.474868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:26.482316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.483192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.484067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.485057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.485745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.486354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.660752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:26.670084 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a581e501-1e8e-4cda-a336-5df72bdab9c5 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1509 microversion: 2.1 time: 0.617823 Aug 21 01:19:26.670453 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1596/2783] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:26 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1509 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:26.819706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:26.820317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:26.834557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.835225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.835676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:26.836422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:26.847821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:26.848858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:27.251449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:27.260122 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21d857eb-e250-4156-8e1f-cbe58037bf87 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.444628 Aug 21 01:19:27.271630 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1597/2784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:26 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:27.291375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:27.292631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:27.310689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:27.312023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:27.313737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:27.317124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:27.326377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:27.327159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:27.361334 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:27.772632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:27.788552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:27.794820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:27.796718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edefa55c-b5bc-406d-97ab-e8fecfaac5fa tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2543 microversion: 2.32 time: 0.523550 Aug 21 01:19:27.812956 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1598/2785] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:27 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2543 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:27.813464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:27.814545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:27.832221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:27.833263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:27.834124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:27.835117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:27.835992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:27.836543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:27.947189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:27.973866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-242f424d-36ad-48b6-aac9-a4861d199076 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1274 microversion: 2.1 time: 0.172615 Aug 21 01:19:27.975586 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1599/2786] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:27 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:27.991706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-deleted", "tag": "8c042ceb-0474-43e0-9d18-f60ab556f200"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:28.006041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.006928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.007669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.059460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] Creating event network-vif-deleted:8c042ceb-0474-43e0-9d18-f60ab556f200 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:28.084033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-42bc5e7d-3049-492e-bebc-6b0b8cb955cc req-bd42ae79-f5d0-4ae0-9f22-a8ede432e822 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106642 Aug 21 01:19:28.115716 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1600/2787] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:28.151379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:28.153286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:28.167667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.168652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.169653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.170779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.172455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.175614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.621056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:28.634044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aeb394ab-cb8c-4c10-b3ab-61708809dc39 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1509 microversion: 2.1 time: 0.509794 Aug 21 01:19:28.635425 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1601/2788] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:28 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1509 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:28.642576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:28.656754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:28.657515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc16a44-73e4-45d0-b26a-c1576a79513b", "name": "network-vif-unplugged", "status": "completed", "tag": "16f90d08-b8e8-4b17-af1b-f778c546f47c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:28.658224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:28.665034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1acbc079-906c-4bed-a78f-7e0073675874 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 2.195169 Aug 21 01:19:28.665659 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1188/2789] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:26 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 2197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:28.678291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.678919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.679453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.685716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:28.686326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:28.694257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.694730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.695154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.698949 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] Creating event network-vif-unplugged:16f90d08-b8e8-4b17-af1b-f778c546f47c for instance 6fc16a44-73e4-45d0-b26a-c1576a79513b on n-h1-master-1 Aug 21 01:19:28.700800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.701291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.702735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.704831 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f4f5acd4-5e3c-425a-813d-c8ce8506cf22 req-0092a212-b418-4713-ae95-c43ca27b78d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068101 Aug 21 01:19:28.706032 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1602/2790] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:28.830447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:28.831822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:28.843883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.846950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.847659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:28.851464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:28.852323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:28.854226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.239487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.254731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.257586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.259207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d76681a-8077-4654-b6a6-c60595c2fdb2 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2257 microversion: 2.32 time: 0.434142 Aug 21 01:19:29.260943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1603/2791] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:28 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2257 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:29.276232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2209cb63-15f9-488c-803f-c2c15bd81fd6", "tag": "1443add1-5d7b-414c-9555-12edbf5f3c07"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:29.291194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.292665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.293737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.311546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] Creating event network-changed:1443add1-5d7b-414c-9555-12edbf5f3c07 for instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 on n-h2-master-1 Aug 21 01:19:29.322805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-96a86d8e-9858-458d-8182-23e7f121f43b req-925851e8-c245-41b8-a1ad-c82696e8413c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059463 Aug 21 01:19:29.323576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1604/2792] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:29.332437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:29.333286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:29.340887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.341529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.342058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.343271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.343846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.344345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.450823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.468900 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-136e9bee-b9e0-41e1-9e89-5efe1e2de599 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1274 microversion: 2.1 time: 0.143509 Aug 21 01:19:29.482171 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1605/2793] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:29 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:29.608023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.632384 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9745785f-85ea-4fc0-8fd0-2e6b62d89a88 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.965180 Aug 21 01:19:29.633901 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1189/2794] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:28 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:29.665357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:29.667073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:29.690488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:29.692046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:29.695392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.695890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.696329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.703557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.704062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.704513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.724324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.724925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.725503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.729051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:29.729555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:29.730191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:29.828279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e228e38ee832453f8fc35feb25d65a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a2f3b0bed743dabb7579f7dd78135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:29.840093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-88446410-2e60-4181-912c-c1d9856f42ba tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 200 len: 1467 microversion: 2.1 time: 0.187937 Aug 21 01:19:29.845391 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1606/2795] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:29 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 1467 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:30.286808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:30.287694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:30.296383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.297238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.297919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.299111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.300108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.300847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.579464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.602830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.605160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.607016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3b7cdde-22ca-4cf8-9cb3-8199edad0ed3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2211 microversion: 2.32 time: 0.325760 Aug 21 01:19:30.608186 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1607/2796] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:30 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2211 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:30.616676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8"}, {"server_uuid": "6fc16a44-73e4-45d0-b26a-c1576a79513b", "name": "network-vif-deleted", "tag": "16f90d08-b8e8-4b17-af1b-f778c546f47c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:30.629512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.629978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.630459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.646853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Creating event network-changed:67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:30.647369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] Creating event network-vif-deleted:16f90d08-b8e8-4b17-af1b-f778c546f47c for instance 6fc16a44-73e4-45d0-b26a-c1576a79513b on n-h1-master-1 Aug 21 01:19:30.656549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-176ee00d-783b-46e3-b8f2-c7f88c50b95d req-db223d86-b206-4326-b135-54e68390b27d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046719 Aug 21 01:19:30.657206 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1608/2797] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:30.662388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:30.663355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:30.670255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.670911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.671251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.672517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.673009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.673439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.763935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.780266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.788725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.793017 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-295665a1-0e99-483a-a933-58966beaef81 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.107745 Aug 21 01:19:30.797972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1190/2798] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:29 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:30.814435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:30.822613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:30.837262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.837766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.838201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.838934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:30.839383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:30.839801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:30.957495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:30.968757 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74fca7f0-ff8e-48d2-a2fd-824d8ed6fc9a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.310327 Aug 21 01:19:30.970375 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1609/2799] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:30 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:30.990955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:30.992310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.000390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.001223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.001806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.002694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.003307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.005010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.023775 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b HTTP/1.1 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6fc16a44-73e4-45d0-b26a-c1576a79513b'} Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.026639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.031717 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.039663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.040586 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d59ca21-eee0-40e9-9eec-b586fd9db7cb tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 404 len: 111 microversion: 2.1 time: 0.054650 Aug 21 01:19:31.041596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1610/2800] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:30 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.053207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1505649417", "metadata": {"image_type": "test"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:31.056570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.063947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.065784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.066742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.067653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.068317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.069013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.116079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b/action HTTP/1.1 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 112 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1505649417", "metadata": {"image_type": "test"}}} Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6fc16a44-73e4-45d0-b26a-c1576a79513b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1505649417', 'metadata': {'image_type': 'test'}}}} Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 21 01:19:31.118126 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.123772 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.126232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.127309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0c383e0-e0a6-48e3-8958-9a5ffd6ae809 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "POST /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b/action" status: 404 len: 111 microversion: 2.1 time: 0.079539 Aug 21 01:19:31.148674 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1611/2801] 10.222.0.46 () {60 vars in 1279 bytes} [Sun Aug 21 01:19:31 2022] POST /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.158592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-680684218", "metadata": {"image_type": "test"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:31.161955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Failed to fetch instance by id tempest-invalid-419560377 {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:19:31.162759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance tempest-invalid-419560377 could not be found. Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/tempest-invalid-419560377/action HTTP/1.1 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 111 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-680684218", "metadata": {"image_type": "test"}}} Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: exception: Instance tempest-invalid-419560377 could not be found. Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'tempest-invalid-419560377', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-680684218', 'metadata': {'image_type': 'test'}}}} Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-419560377 could not be found. Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.174048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-419560377 could not be found. Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-419560377 could not be found. Aug 21 01:19:31.179030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.182270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance tempest-invalid-419560377 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.183476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56ddfa94-e57c-457d-a458-062ba23077dc tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "POST /compute/v2.1/servers/tempest-invalid-419560377/action" status: 404 len: 100 microversion: 2.1 time: 0.030972 Aug 21 01:19:31.190068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1612/2802] 10.222.0.46 () {60 vars in 1246 bytes} [Sun Aug 21 01:19:31 2022] POST /compute/v2.1/servers/tempest-invalid-419560377/action => generated 100 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.197862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-524081783"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:31.200684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:19:31.201405 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 56 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-test-snap-524081783"}} Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-524081783'}}} Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.205621 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.210299 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.212245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.213577 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0dfbcf4-75a6-459e-91d6-d1125e532876 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022260 Aug 21 01:19:31.214310 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1613/2803] 10.222.0.46 () {60 vars in 1275 bytes} [Sun Aug 21 01:19:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.226685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-959532733"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:31.229357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:19:31.230198 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 56 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-test-snap-959532733"}} Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-959532733'}}} Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.232301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 21 01:19:31.237363 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.239327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.240750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d30b178-6756-494a-9007-5ad081413de9 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020265 Aug 21 01:19:31.246123 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1614/2804] 10.222.0.46 () {60 vars in 1281 bytes} [Sun Aug 21 01:19:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.252225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:31.253009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.260943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.261693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.262417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.263377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.263971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.264553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.289567 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b HTTP/1.1 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6fc16a44-73e4-45d0-b26a-c1576a79513b'} Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.291783 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.296258 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.298239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.299322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6100e2dd-417e-4135-a051-d46890e23f41 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 404 len: 111 microversion: 2.1 time: 0.051935 Aug 21 01:19:31.305145 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1615/2805] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:19:31 2022] DELETE /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.311311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:31.312287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] [instance: 6fc16a44-73e4-45d0-b26a-c1576a79513b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.324633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.325764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.326211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.327426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.327783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.328452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.349142 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] HTTP exception thrown: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Request method failure captured: Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b HTTP/1.1 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYf507HdY0pPBRPEBfaKnlluHqcF-1KXN4OxyClF-D0YMBkkgrKiEM7mKO5EQqqElHqxr--K6gNHhaYBBaU_g-an39tBwCtlroA7Tv0sj64Kn7tdl5IlouDZtX8k9r5cNvBpMKv0YE_enQzON3DK1w5w8zZ-9ZOZ3bSR9sXdatzuc84 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c1a2f3b0bed743dabb7579f7dd78135f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c1a2f3b0bed743dabb7579f7dd78135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c1a2f3b0bed743dabb7579f7dd78135f"}]}] Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c1a2f3b0bed743dabb7579f7dd78135f Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1024934218 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e228e38ee832453f8fc35feb25d65a15 Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesNegativeTestJSON-1024934218-project Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6fc16a44-73e4-45d0-b26a-c1576a79513b'} Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:31.351426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] Returning 404 to user: Instance 6fc16a44-73e4-45d0-b26a-c1576a79513b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af3d7e25-c10b-4d79-830f-630e3d9f9489 tempest-ImagesNegativeTestJSON-1024934218 tempest-ImagesNegativeTestJSON-1024934218-project] 10.222.0.46 "GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b" status: 404 len: 111 microversion: 2.1 time: 0.048225 Aug 21 01:19:31.359799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1616/2806] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:31 2022] GET /compute/v2.1/servers/6fc16a44-73e4-45d0-b26a-c1576a79513b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:19:31.632861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:31.633511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.643366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.643905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.644324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.645305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.645726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.646178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.810536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:31.822637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:31.825160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:31.826437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e833962-f514-4b85-a69c-dceb794baffe tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2211 microversion: 2.32 time: 0.197614 Aug 21 01:19:31.827014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1617/2807] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:31 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:31.839942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:31.840686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:31.847182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.847913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.848354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.849051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:31.849497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:31.849910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:31.997067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:32.009648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5ea7b61-474d-4af4-ae4d-6d8b05215350 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 1.210461 Aug 21 01:19:32.010610 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1191/2808] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:30 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:32.020607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:32.021557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:32.054037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:32.055200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:32.056149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:32.060236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:32.061630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:32.062517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:32.180230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:32.201168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:32.204531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:32.206711 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2b8c4ba-f2e6-41e0-bf6e-946e2c32a595 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.370746 Aug 21 01:19:32.208815 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1618/2809] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:31 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:32.709857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-deleted", "tag": "ed52380b-6a18-402a-9e3c-afd08577e340"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:32.724197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:32.724788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:32.725564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:32.739696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] Creating event network-vif-deleted:ed52380b-6a18-402a-9e3c-afd08577e340 for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:32.744983 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a8ddc87e-e223-4ec6-ae2d-721d05bdb562 req-19df734e-3408-43a4-aca6-1f877a9ac298 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047210 Aug 21 01:19:32.746282 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1619/2810] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:32.856213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:32.857845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:32.866034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:32.866648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:32.867154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:32.867926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:32.868473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:32.869173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:32.950497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:32.962793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-557edbf1-ae8b-48b1-ae87-b3d87c6b796b tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.950860 Aug 21 01:19:32.964211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1192/2811] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:32 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:33.034382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.044989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.046568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.048096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73f14a0a-877c-4a01-a953-79ae87242136 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2053 microversion: 2.32 time: 0.200922 Aug 21 01:19:33.049205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1620/2812] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:32 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2053 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:33.051504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:33.052818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:33.062372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.064950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.065750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:33.068035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.068722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.069622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:33.242683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:33.243238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:33.254862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.256295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.256757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:33.257505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.257968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.258394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:33.343083 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:33.391281 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:33.493696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.504519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.506071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.507506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ef5c0d9-fee5-4790-bdca-29a616b7f7f4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.276928 Aug 21 01:19:33.520828 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1621/2813] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:33 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:33.836366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:33.846163 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de294c1a-1a2a-4d28-b261-1478bc6d16f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.811857 Aug 21 01:19:33.847143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1193/2814] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:33 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:33.984885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:33.985739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:33.989432 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:33.996527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.997053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.997499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:33.998287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:33.998688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:33.999165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.079924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:34.080563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:34.090906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:34.095029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:34.095838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.098577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:34.099239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:34.100690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.269301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.280075 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb45f676-542c-4278-a5ac-9d1d08367e02 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.300117 Aug 21 01:19:34.281338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1622/2815] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:33 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:34.533488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:34.534327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:34.551413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:34.552067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:34.552941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.553754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:34.554358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:34.554843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.810862 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:34.842800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.871666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.873681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.875481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bc6b658-8aff-49a6-8805-85d020191468 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.347151 Aug 21 01:19:34.876199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1623/2816] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:34 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:34.882840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68"}, {"server_uuid": "f9a919bf-c110-4241-92bf-ecb73d8b8270", "name": "network-vif-deleted", "tag": "09ee1a66-22fc-4784-bfd8-33aa4d4f401b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:34.893066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.898612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:34.899426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:34.900081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:34.904797 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:34.926034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.933541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:34.941317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33afd99b-3ebf-444d-a183-992557243a5b tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 2053 microversion: 2.32 time: 0.865120 Aug 21 01:19:34.942235 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Creating event network-changed:eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:34.943932 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] Creating event network-vif-deleted:09ee1a66-22fc-4784-bfd8-33aa4d4f401b for instance f9a919bf-c110-4241-92bf-ecb73d8b8270 on n-h2-master-1 Aug 21 01:19:34.954266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1194/2817] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:34 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 2053 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:34.972822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:34.975344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:34.976074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4f466613-e2e4-4e4a-b5cc-4454ac04ceea req-b45d9944-1ee3-44df-8168-fb1c25f021e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094462 Aug 21 01:19:34.981451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1624/2818] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:35.008325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.009683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.010141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.010884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.011342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.011771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.305788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:35.306655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:35.319606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.320102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.321609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.323590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.325985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.328759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.603302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:35.614908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e55b59af-31bb-438e-a779-3d1e43fc2659 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.312868 Aug 21 01:19:35.615532 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1625/2819] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:35 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:35.655114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:35.666055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.667606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.669051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.702957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:19:35.743155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:35.760006 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd8a2b76-a04f-4a4a-ad30-e0df8ebced38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.802976 Aug 21 01:19:35.781875 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1195/2820] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:34 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:35.785539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a43c4690-8452-4f72-9c1d-1c87160d5041 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action" status: 202 len: 0 microversion: 2.1 time: 0.135692 Aug 21 01:19:35.787615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1626/2821] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:19:35 2022] POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:19:35.798564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:35.799127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:35.810679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.811549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.812250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.813448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.814471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.815111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.901983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:35.902614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:35.916012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.916537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.917005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:35.917747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:35.918201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:35.918630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.251034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.260562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.265990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.268051 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ea52172-831b-451c-8af2-2f14ba494bd3 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.370637 Aug 21 01:19:36.285609 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1627/2822] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:35 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:36.296638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:36.297424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:36.306594 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:36.322832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.323442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.323946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.325383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.325864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.326297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.502570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.518337 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9757df4-0325-424c-a1fd-20cc69eb7f78 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.725548 Aug 21 01:19:36.518848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1196/2823] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:35 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:36.539829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2209cb63-15f9-488c-803f-c2c15bd81fd6", "name": "network-vif-plugged", "status": "completed", "tag": "1443add1-5d7b-414c-9555-12edbf5f3c07"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:36.573042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.573431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.573852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.596799 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] Creating event network-vif-plugged:1443add1-5d7b-414c-9555-12edbf5f3c07 for instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 on n-h2-master-1 Aug 21 01:19:36.632361 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e4b10b3e-729f-4c95-b918-64c1e4946641 req-4d77ce02-1804-4e72-a24a-617835080aba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102124 Aug 21 01:19:36.633291 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1197/2824] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:36.638843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:36.659063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:36.676307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.678179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.678954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.680223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.687108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.701466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.829250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.846942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.849845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:36.851306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac87d1bd-64aa-46a8-9f2b-fab54d025470 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.564424 Aug 21 01:19:36.852192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1628/2825] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:36 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:36.861005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:36.862830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:36.876698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.878825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.879508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:36.880678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:36.881399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:36.882071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.166808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:37.178352 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0d99cb7-e63a-45fe-a182-74523195f913 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.322953 Aug 21 01:19:37.179497 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1629/2826] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:36 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:37.292508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:37.293188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:37.305014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.305720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.306185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.306944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.314317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.315044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.842171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:37.856093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:37.857056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:37.859050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:37.862945 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-112a4498-2da8-4ce2-b02b-824eac2b621e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.574448 Aug 21 01:19:37.866156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1630/2827] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:37 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:37.872987 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-543bfb76-8750-4162-8114-00af6fdc7d43 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 1.236202 Aug 21 01:19:37.873132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678c0d69-1450-4b11-9eed-2719cb7bcf9d", "tag": "4dbc436c-6fe8-4fca-bd68-8f5a407c7934"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:37.885179 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1198/2828] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:36 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:37.892435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:37.893092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:37.899780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.900688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.901915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.902639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.903061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.903227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.903733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.904067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.904671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.928137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] Creating event network-changed:4dbc436c-6fe8-4fca-bd68-8f5a407c7934 for instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d on n-h1-master-1 Aug 21 01:19:37.941122 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5a989742-def9-4740-977c-1965babf3a86 req-6ddadc87-3ecd-49ea-a16d-4b531f421825 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073466 Aug 21 01:19:37.945243 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1631/2829] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:37.951245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:37.952346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:37.960425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.961174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.961823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:37.962754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:37.963388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:37.964005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.168996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:38.185890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:38.187916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:38.189590 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a9c317c-fa7c-4061-adfd-99fa9794383a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.242657 Aug 21 01:19:38.198060 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1632/2830] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:37 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:38.203750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:38.207697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:38.228798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.229493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.230648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.232033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.233849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.234573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.289858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:38.310417 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c826721d-0085-45c2-bce6-834e4d5174e8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.423717 Aug 21 01:19:38.325336 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1199/2831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:37 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:38.678982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:38.691202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4fac6a6-5ec2-4643-9f56-0f4dd6e1fbb4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1315 microversion: 2.1 time: 0.491650 Aug 21 01:19:38.691801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1633/2832] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:38 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:38.895047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:38.895685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:38.907416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:38.908193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:38.914091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.914581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.915009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.915894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.916756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.917365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.921507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.922083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.922523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:38.923347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:38.923671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:38.924095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.368902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:39.380255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8580046-cf71-4a6f-9a44-43829a82bfda tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.486273 Aug 21 01:19:39.381654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1634/2833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:38 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:39.411821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:39.417111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:39.435073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.437144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.440685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.444237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.445866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.446305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.611365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:39.636391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:39.639322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:39.640981 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-45afca39-e6d1-47f5-8969-9f80ddd889b4 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.257915 Aug 21 01:19:39.656300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1635/2834] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:39 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:39.673055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:39.675423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:39.692537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.694621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.695365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.698960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.699560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.701277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.937977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:39.947579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4177cf6-8aae-4cf1-aa59-c266bb18ff4f tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.289800 Aug 21 01:19:39.963030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1636/2835] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:39 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:39.968703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:39.969738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:39.977173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.978103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.978799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.980083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:39.980825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:39.981488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:39.996185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:40.016276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:40.021173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:40.023100 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d950bc48-7ca4-4866-a045-54c661847d44 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.136214 Aug 21 01:19:40.024252 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1200/2836] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:38 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:40.037749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "a0e520f1-9c2c-4d81-8968-f6843c1e140a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:40.049267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.049761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.050197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.062633 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] Creating event network-changed:a0e520f1-9c2c-4d81-8968-f6843c1e140a for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:40.069640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1bf392b0-bb7c-4e1e-8bea-123e54ee42e6 req-57033705-c010-4bef-8a7d-a02bc8dfb57a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Aug 21 01:19:40.071109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1201/2837] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:40.320010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:40.341712 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25242fd6-7e06-4b64-8f7a-b9d842de84b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1501 microversion: 2.1 time: 0.377097 Aug 21 01:19:40.342487 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1637/2838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:39 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:40.369553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:40.385375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.390947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.392201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.403403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:40.404270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:40.416140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.417501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.418678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.419782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.421697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.423425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.481462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Going to try to stop instance {{(pid=122483) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:19:40.544927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f0713771-6e6a-43b5-91a3-31deb8d4b68a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6/action" status: 202 len: 0 microversion: 2.1 time: 0.180061 Aug 21 01:19:40.546950 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1202/2839] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:19:40 2022] POST /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:19:40.570594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:40.576569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:40.592475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.593597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.595469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.596376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.597897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.598478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.856176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:40.869827 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abcf9641-8fc8-49aa-af8e-ced22f3a2a90 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.472286 Aug 21 01:19:40.872085 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1638/2840] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:40 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:19:40.883426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:40.887331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:40.904864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.907538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.910274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:40.912708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:40.913494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:40.914122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.083826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.099915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.106143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.110562 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-111a6fba-7bb4-410c-9dba-8e1a8593b561 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.236213 Aug 21 01:19:41.111268 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1639/2841] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:40 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:41.125789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:41.126538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:41.140333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.141101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.141605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.145927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.146493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.147004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.469218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.479208 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9df4541a-fbdf-4056-827f-5d7bf8ebe3c3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.365950 Aug 21 01:19:41.480356 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1640/2842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:41 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:41.486297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:41.487227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:41.493773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.494757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.495460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.496462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.497192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.497833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.503047 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:41.867852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.888699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.892814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:41.894511 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9183506-3656-491c-8a34-d4c06c5e92b1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.412884 Aug 21 01:19:41.900850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1641/2843] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:41 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:41.910190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:41.911077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:41.925385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.927511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.928124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:41.928908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:41.929375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:41.932620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.121383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:42.125686 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:42.136792 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-298cb053-3b78-4f84-a44b-f025fb4c3caf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 1.576481 Aug 21 01:19:42.152963 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1203/2844] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:40 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:42.168615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:42.169642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:42.181127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.181811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.182436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.183330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.184059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.184633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.395109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:42.408905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63c01a36-5972-466f-b8dc-ed704065be0d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.506126 Aug 21 01:19:42.417574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1642/2845] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:41 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:42.506701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:42.507435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:42.520601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.521690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.522132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.523056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.523524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.526078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.543833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:42.566837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:42.568381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:42.576307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2767458-c046-42fd-99c3-3489b1877357 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.420772 Aug 21 01:19:42.590174 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1204/2846] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:42 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:42.656053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "7a20a8ea-6567-42f9-94ca-f1db209ee871"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:42.679380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.679861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.680796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.699996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] Creating event network-changed:7a20a8ea-6567-42f9-94ca-f1db209ee871 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:42.715133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-95aaf7b0-0f89-4904-878f-3ea67ba702b9 req-fbceff0b-1d8e-4c84-8344-9a8b64f39e26 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062912 Aug 21 01:19:42.719534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1205/2847] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:42.877020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678c0d69-1450-4b11-9eed-2719cb7bcf9d", "name": "network-vif-plugged", "status": "completed", "tag": "4dbc436c-6fe8-4fca-bd68-8f5a407c7934"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:42.896748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.897670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.898306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.922506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] Creating event network-vif-plugged:4dbc436c-6fe8-4fca-bd68-8f5a407c7934 for instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d on n-h1-master-1 Aug 21 01:19:42.938434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c6dbfda4-1014-4a6f-b09e-2236a10f6e2f req-70d6f814-ac53-4347-a446-9c6ea991409a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066203 Aug 21 01:19:42.944381 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1206/2848] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:19:42.950989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:42.957586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:42.980066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.980581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.981049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:42.983698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:42.983986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:42.984875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:43.341508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:43.359166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb5b4502-1ee9-4ba7-bd47-423929d348b9 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.855182 Aug 21 01:19:43.375251 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1643/2849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:42 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:43.392155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:43.393257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:43.409448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:43.410355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:43.410967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:43.413634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:43.414441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:43.415059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:43.763422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:43.776129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da32cf24-7310-4046-9b74-e8b489b51156 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.399410 Aug 21 01:19:43.776823 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1644/2850] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:43 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:43.791289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:43.792279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:43.806754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:43.809667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:43.810535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:43.811448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:43.814463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:43.815155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.187217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.211889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.214693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.217827 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a47770b6-6cae-4277-a410-a2bc70f3ca8a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.271959 Aug 21 01:19:44.221058 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1207/2851] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:42 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:44.246963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:44.247618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:44.261797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.262575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.265933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.266701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.267354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.267793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.315487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.329794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ef00a6c-4eeb-40d2-b072-21252c1a2e31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 0.547762 Aug 21 01:19:44.344964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1645/2852] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:43 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:44.386899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:44.387529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:44.400057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.416330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.417083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.418016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.418649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.420876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.528094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.557981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.562336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.567554 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7d0bf56-95a2-40c6-914d-234daabfff1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.344619 Aug 21 01:19:44.568699 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1208/2853] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:44 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:44.748796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:44.772851 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f909276-a822-4d30-8a1d-e4daf616ba54 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.391023 Aug 21 01:19:44.773396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1646/2854] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:44 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:44.797484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:44.798119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:44.818444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.818947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.822915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:44.823655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:44.824137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:44.824546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.244568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:45.245433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:45.261266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.261977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.262632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.263554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.264180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.264713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.322076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:45.336675 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4005cc3-4d87-4b0e-ae6c-5c56fb7c1fcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.543509 Aug 21 01:19:45.338911 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1209/2855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:44 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:45.354459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:45.358022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:45.374826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.375865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.377080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.378428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.380195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.382720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.775075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:45.803158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:45.804799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:45.814418 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da739bd5-bc1a-45fb-8c9c-07b56e4ec438 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.574787 Aug 21 01:19:45.815038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1647/2856] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:45 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:19:45.832801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "fe5c9337-719f-4457-a1d0-4be329e250ec"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:45.853540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.857355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.858286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.901340 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] Creating event network-changed:fe5c9337-719f-4457-a1d0-4be329e250ec for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:19:45.918304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-db2cd06c-8580-417c-820e-e4a464f8d4a3 req-8bc2ee0c-3ead-464e-b1cd-6ecd428a49bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094383 Aug 21 01:19:45.920905 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1648/2857] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:45.936136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:45.937530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:45.951867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.952918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.954307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:45.955889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:45.956591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:45.957420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.076636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.092577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.098393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.102270 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a4e7e36-e1a6-430b-8ec3-93bee073110c tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.179056 Aug 21 01:19:46.105080 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1649/2858] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:45 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:46.125378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:46.126295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:46.142896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.144180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.145185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.147000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.148822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.150112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.469691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.497697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ed4f019-e9f8-46cb-b712-2e2b6e1065fa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.390623 Aug 21 01:19:46.499297 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1650/2859] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:46 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:46.508224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:46.509393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:46.518828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.520198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.520936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.522004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.522695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.523355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.720906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.734292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23101d10-7945-4752-9960-b237fed35c5b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.232625 Aug 21 01:19:46.735054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1651/2860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:46 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:46.776635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:46.788181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc48d401-6bd0-411d-84cf-04e617a48fb2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1316 microversion: 2.1 time: 1.440721 Aug 21 01:19:46.797934 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1210/2861] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:45 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1316 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:46.847663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:46.849826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:46.866606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.870266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.874272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:46.876724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:46.880318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:46.881348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:47.166826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:47.173329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:47.198389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:47.198881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:47.199313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:47.200035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:47.202868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:47.203337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:47.523132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.535300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.537062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.538737 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26b66e2c-1272-4e7e-aeb8-1b93376553f1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.413719 Aug 21 01:19:47.544573 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1211/2862] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:47 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:47.809282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.838636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.842907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:47.847089 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-292867ab-362f-47d2-8b37-548b1670e221 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.007872 Aug 21 01:19:47.851479 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1652/2863] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:46 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:47.867051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:47.869880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:47.890504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:47.892003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:47.893448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:47.894910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:47.895721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:47.898589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:48.100168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-632508991", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "19831399-2803-48dd-ab23-2d1b6c595cc7"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:48.221296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] validate_networks() for [('19831399-2803-48dd-ab23-2d1b6c595cc7', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:48.273364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:48.290467 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1e23dce-e2ab-4c7b-9142-a5ec60501151 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.435953 Aug 21 01:19:48.311975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1653/2864] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:47 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:48.318136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:48.319014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:48.327788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:48.328785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:48.329579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:48.330473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:48.334996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:48.335832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:48.634009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:48.644902 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-858722ad-aff3-41db-94ea-59e6c2b59458 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.330978 Aug 21 01:19:48.661902 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1654/2865] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:48 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:48.668586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:48.669452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:48.679015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:48.679870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:48.680862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:48.682474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:48.683228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:48.684030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:48.931875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:48.949401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e33bb9b1-3bcf-4074-98c9-06119eede069 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1465 microversion: 2.1 time: 0.285483 Aug 21 01:19:48.972599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1655/2866] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:48 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1465 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:48.985477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:48.986583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:49.001198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.001693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.002175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.002883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.003335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.003755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.147844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.167452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.181188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.183001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ad52ef9-b1c3-4a0c-9d4d-711d740dc46e tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.207340 Aug 21 01:19:49.184703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1656/2867] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:48 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:49.201049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:49.202291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:49.219326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.220187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.220634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.221412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.221883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.222461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.422805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:49.423321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:49.423701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:49.424055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:49.424549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:49.426987 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:49.446063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.446561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.450329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.455240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.456037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.456479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.484829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:49.515923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for user 0c247647f8e34c638bec5e68826171e5 and project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:49.572021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:49.577577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:49.589704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.602667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.604382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:49.606304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f59cac65-c9ac-4be8-b2f6-87329317d833 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.420460 Aug 21 01:19:49.607095 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1657/2868] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:49 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:49.621731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:49.623937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:49.640923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.643011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.643658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.644683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.647588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.648029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.693027 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:49.712678 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6cedc022-fb5a-46de-943f-4302359b8353 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171781 Aug 21 01:19:49.714980 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1212/2869] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:49.728553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:49.729152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:49.787597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.788383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.789264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.789986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.790436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.790858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.919483 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-429f3ac4-2ec1-4bcf-b784-c33308623e53 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1616 microversion: 2.1 time: 0.310755 Aug 21 01:19:49.922582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1658/2870] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:49 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1616 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:49.941502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:49.943060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:49.965829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.967351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.971055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:49.974314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:49.975880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:49.976326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:50.192736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:50.210355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-25f75086-de68-434b-8c2b-11617846d6a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1722 microversion: 2.1 time: 0.488434 Aug 21 01:19:50.211662 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1213/2871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:49 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:50.382402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:50.395882 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9920b5ce-474a-4a89-a747-a732d9fc1ad7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.471916 Aug 21 01:19:50.397690 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1659/2872] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:49 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:50.406171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-555100649", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "19831399-2803-48dd-ab23-2d1b6c595cc7"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:50.507433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] validate_networks() for [('19831399-2803-48dd-ab23-2d1b6c595cc7', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:50.593368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c35ae4c-1939-48b1-816d-ba8d4d938056 tempest-ListImageFiltersNegativeTestJSON-291557644 tempest-ListImageFiltersNegativeTestJSON-291557644-project] Calling method '.version_select at 0x7fc3fda35af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:50.621120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1c35ae4c-1939-48b1-816d-ba8d4d938056 tempest-ListImageFiltersNegativeTestJSON-291557644 tempest-ListImageFiltersNegativeTestJSON-291557644-project] HTTP exception thrown: Image not found. Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c35ae4c-1939-48b1-816d-ba8d4d938056 tempest-ListImageFiltersNegativeTestJSON-291557644 tempest-ListImageFiltersNegativeTestJSON-291557644-project] Request method failure captured: Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/images/df36437d-9861-4a31-9adf-1c13fe8d738d HTTP/1.1 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYg1WAi5R2Sdk9BTt2pvZncMq78972_qj2jXl1K2iJPfkT8k5-LqMVBTMdWa96P81FrwqzEiUCerDfmp1-YqlTA7H2LiMQAjPR2PL8HBuwTKdbLtGEiYhAJizUuKYb-sAH4A8YoSRmE7QxHNZDjGi5TbN32YslwCuyPmwiUbk6qCQUU Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f535e3a028764f5cb0ee9b5ef7b4c9ae Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-291557644 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f535e3a028764f5cb0ee9b5ef7b4c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f535e3a028764f5cb0ee9b5ef7b4c9ae", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f535e3a028764f5cb0ee9b5ef7b4c9ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f535e3a028764f5cb0ee9b5ef7b4c9ae"}]}] Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-291557644 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f535e3a028764f5cb0ee9b5ef7b4c9ae Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-291557644 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListImageFiltersNegativeTestJSON-291557644-project Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d7ac40aef2424a0b966d43d19b28cb88 Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-291557644-project Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'df36437d-9861-4a31-9adf-1c13fe8d738d'} Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df36437d-9861-4a31-9adf-1c13fe8d738d Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:19:50.623568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df36437d-9861-4a31-9adf-1c13fe8d738d could not be found. Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:19:50.628407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:19:50.634560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c35ae4c-1939-48b1-816d-ba8d4d938056 tempest-ListImageFiltersNegativeTestJSON-291557644 tempest-ListImageFiltersNegativeTestJSON-291557644-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:50.635664 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c35ae4c-1939-48b1-816d-ba8d4d938056 tempest-ListImageFiltersNegativeTestJSON-291557644 tempest-ListImageFiltersNegativeTestJSON-291557644-project] 10.222.0.46 "GET /compute/v2.1/images/df36437d-9861-4a31-9adf-1c13fe8d738d" status: 404 len: 62 microversion: 2.1 time: 0.422692 Aug 21 01:19:50.636861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1214/2873] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:19:50 2022] GET /compute/v2.1/images/df36437d-9861-4a31-9adf-1c13fe8d738d => generated 62 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:19:50.659938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-756353841", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "44f732fd-f08f-4545-9ddd-111094e6b979"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:50.812923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:51.314943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:51.315763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:51.316330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:51.317011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:51.317692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:51.337664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.348787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.349963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.351003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.351785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.353562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.388582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:51.397927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for user 0c247647f8e34c638bec5e68826171e5 and project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:51.415494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:51.419521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:51.518913 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d09e144-1563-49f4-b2ad-51f39d471db7 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119981 Aug 21 01:19:51.520121 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1660/2874] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:51.539411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:51.540448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:51.549810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.550910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.551737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.553213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.553921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.554641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.600028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:51.601196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:51.602030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:51.602608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:51.603267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:51.628404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.631722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.633196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.636987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.643010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.645339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.727253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:51.740868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Getting quotas for user 01c0d38c6d9440e88565277af4433660 and project cf7a5bb4dadb4bfd80ab9793b96e8795. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:51.782908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:51.786779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:51.895823 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-143d702d-550a-47d2-84f3-4b66f74c3cad tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257590 Aug 21 01:19:51.900150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1215/2875] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:51.911077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:51.916065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:51.917532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:51.927737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:51.931490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:51.936094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d85b957-42ac-4b62-b515-a50eb93ed1e1 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.402092 Aug 21 01:19:51.938606 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1661/2876] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:51 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:51.940878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.942304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.947492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.950386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.954144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.954718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:51.955819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:51.956825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:51.996993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:51.997808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:51.999939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:52.002081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:52.006199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:52.007706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:52.391818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:52.402732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-59dc3723-045c-41c6-8092-d39f5c496cf2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1699 microversion: 2.1 time: 0.456493 Aug 21 01:19:52.407834 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1662/2877] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:51 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1699 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:52.414145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:52.420194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:52.430901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:52.431757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:52.438502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:52.440128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:52.441299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:52.441899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:52.765155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:52.790162 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4092f71-8048-4589-b718-e8a75b92e22b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.378085 Aug 21 01:19:52.793554 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1663/2878] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:52 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:52.817318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-469927248", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "451", "networks": [{"uuid": "19831399-2803-48dd-ab23-2d1b6c595cc7"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:52.887492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:52.909019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:52.922750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:52.924675 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d558260e-98d0-4c6b-b7d0-a9a2993070d8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.022325 Aug 21 01:19:52.926237 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1216/2879] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:51 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:52.953804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] validate_networks() for [('19831399-2803-48dd-ab23-2d1b6c595cc7', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:52.958102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:52.959228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:52.986682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:52.988184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:52.995485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:52.996466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:52.998378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:52.999369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.196591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:53.209625 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa82a862-e897-4d03-865b-93897011a3e0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1220 microversion: 2.1 time: 0.278841 Aug 21 01:19:53.210662 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1217/2880] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:52 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1220 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:53.222779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:53.244422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:53.246482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:53.247253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.342022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Going to try to start instance {{(pid=122483) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 01:19:53.497852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eec262f2-a4d3-4f6b-9da0-7239d278f66b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action" status: 202 len: 0 microversion: 2.1 time: 0.285062 Aug 21 01:19:53.502939 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1218/2881] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:19:53 2022] POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:19:53.520715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:53.521458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:53.540787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:53.545402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:53.549476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.550239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:53.550711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:53.551141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.913120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:19:53.913711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:19:53.913998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:19:53.914415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:19:53.914822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:19:53.926409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:53.926903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:53.927363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.928219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:53.928689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:53.929149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:53.951350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:53.958734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Getting quotas for user 0c247647f8e34c638bec5e68826171e5 and project 30ccb279d8144dd39f613a6b57f42067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:53.973451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:19:53.975998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:19:54.000854 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:54.037022 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89888762-37be-4a0c-a4c6-266c39c5bb4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240495 Aug 21 01:19:54.043338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1664/2882] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:19:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:19:54.048312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:54.048939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:54.056226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.056720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.057175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:54.058582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.059048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.059471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:54.321137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:54.333587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-240ca0de-7a17-4759-83f1-6ad78fcff945 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1708 microversion: 2.1 time: 0.291472 Aug 21 01:19:54.334677 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1665/2883] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:54 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1708 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:54.339929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:54.340919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:54.355230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.356388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.357101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:54.358174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.359340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.360887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:54.667434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:54.688411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:54.691782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:54.700537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:54.714294 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80f0be8c-826f-44ff-99db-03de60f479c6 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 1.209678 Aug 21 01:19:54.717072 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1219/2884] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:53 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:54.726225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:54.727763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:54.733502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-684b986e-eb21-4ea7-a3be-908500e3d4cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.397186 Aug 21 01:19:54.734737 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1666/2885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:54 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:54.742704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.743558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.744830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:54.761285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:54.764985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:54.768652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.044158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Calling method '.version_select at 0x7fc3f9e26ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:55.063327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.064587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.066785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.068128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.068865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.070182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.101496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec76ecc0-2caa-488b-9b1c-892f6f5c0ef9 tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.365113 Aug 21 01:19:55.103704 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1667/2886] 10.222.0.46 () {58 vars in 1122 bytes} [Sun Aug 21 01:19:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:55.126299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:55.126957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:55.136011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.136514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.140892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.141718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.145672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.145672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.298262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:55.317609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-881d0674-9a44-4d8a-af83-b0793e88d489 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1272 microversion: 2.1 time: 0.211411 Aug 21 01:19:55.319334 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1668/2887] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:55 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:55.329128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:55.331151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:55.341795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.342831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.344148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.345722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.346552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.347737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.456027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:55.471101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-517364d5-b320-4b9b-ad8d-c02fc9542965 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1274 microversion: 2.1 time: 0.148317 Aug 21 01:19:55.484793 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1669/2888] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:55 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:55.492127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-152925554", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:55.581533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:19:55.660854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:55.676608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:55.678435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:55.690777 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8760cea6-303e-462a-8aad-ca7dd12363e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.971313 Aug 21 01:19:55.691855 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1220/2889] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:54 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:55.698042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:55.698896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:55.719087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.719580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.720018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:55.720732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:55.721220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:55.721642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:56.126921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Getting quotas for project 9770e31bc3be400aab624a2fdbead32c. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:19:56.152233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Getting quotas for user 5f4ac45d762a419ab95c6880dccc4335 and project 9770e31bc3be400aab624a2fdbead32c. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:19:56.205005 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Request method failure captured: Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 1751 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYg5uNNFXQ_7CwmU17NG0ExgGgyXGmupnEMuYFqZqBBu5Cf34eSqNnPgmIDuxHgZrBjLwCbQcbWZCsgqzE1ltNTpKgwMNwUyYYgnG3IGOsyxMX82TwYxQpVDCrZSoGayHba42j7RFyesu__9AGo79AbqsB0t_2I8_s_hvtdOQf4VSDQ Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9770e31bc3be400aab624a2fdbead32c Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2085786563 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9770e31bc3be400aab624a2fdbead32c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9770e31bc3be400aab624a2fdbead32c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9770e31bc3be400aab624a2fdbead32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9770e31bc3be400aab624a2fdbead32c"}]}] Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2085786563 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9770e31bc3be400aab624a2fdbead32c Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2085786563 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 5f4ac45d762a419ab95c6880dccc4335 Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-152925554", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:56.208264 n-d-master-1 devstack@n-api.service[122482]: exception: Maximum number of metadata items exceeds 128 Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-152925554', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:56.210524 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 21 01:19:56.213205 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:56.223463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:56.238808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4af66168-ae4a-444b-9dc9-8da5629bf9cd tempest-AbsoluteLimitsNegativeTestJSON-2085786563 tempest-AbsoluteLimitsNegativeTestJSON-2085786563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.762827 Aug 21 01:19:56.243759 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1670/2890] 10.222.0.46 () {60 vars in 1148 bytes} [Sun Aug 21 01:19:55 2022] POST /compute/v2.1/servers => generated 87 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:19:56.264875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:56.276922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:56.295884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:56.300405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:56.303027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:56.306283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:56.307961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:56.309382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:56.551437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:56.569488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:56.576475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:56.581229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3bba012-2b71-4ee4-8a98-b61cfedb54b0 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.335681 Aug 21 01:19:56.589821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1671/2891] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:56 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:56.611183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:56.612425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:56.626181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:56.627897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:56.628904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:56.629896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:56.630563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:56.631209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.067110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:57.076757 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ba26c01-7f1d-4496-b772-bd51d32d6bde tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1708 microversion: 2.1 time: 1.383285 Aug 21 01:19:57.081003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1221/2892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:55 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1708 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:57.087637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:57.093644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:57.107408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.109777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.113152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.114087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.114723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.115296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.149239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:57.159237 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86ced0eb-f2c8-4e1b-af8d-da54de78ec1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.565180 Aug 21 01:19:57.173751 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1672/2893] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:56 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:57.179179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:57.179793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:57.200429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.202942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.204655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.205600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.207165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.209331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.301420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:57.322142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2194a8cb-1643-4196-bd6b-1095502f096d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1278 microversion: 2.1 time: 0.237997 Aug 21 01:19:57.323361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1222/2894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:57 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:57.329307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:57.330194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:57.343265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.349369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.350107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.351031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.351669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.352270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.357686 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:57.942747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:57.956351 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cacd99a3-0d9d-437d-be59-9add1a483492 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.781490 Aug 21 01:19:57.957394 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1673/2895] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:57 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:57.964085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:57.966210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:57.973801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.974724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.975316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:57.976280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:57.977063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:57.977650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.110773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.136701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.140660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25d98f9b858449a0af6ed328aa334600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503c042abb9448a393e983403fa0c1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.145071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68e80e77-b2fb-4bcd-833c-26f36cf9ae1a tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 200 len: 1605 microversion: 2.32 time: 0.186125 Aug 21 01:19:58.166780 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1674/2896] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:57 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:58.179119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:58.181641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:58.196913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.198199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.198730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.199570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.200117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.200626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.314797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.331741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.334226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.335790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af65f215-1b8f-4a01-ad96-45e88a69a0a6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.011185 Aug 21 01:19:58.336599 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1223/2897] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:57 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:58.350810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:58.355077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:58.364100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.364596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.365066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.365778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.366287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.366703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.578368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.593406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a660a8a3-76cc-4722-8afc-b222043dc817 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1708 microversion: 2.1 time: 0.425220 Aug 21 01:19:58.599399 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1675/2898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:58 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:58.610233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea58aa8e-b1a5-434d-906b-b83250012539", "tag": "ba8ceee1-3348-4d16-afa1-2fb58e7b3e43"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:19:58.636301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.637013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.638544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.656693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] Creating event network-changed:ba8ceee1-3348-4d16-afa1-2fb58e7b3e43 for instance ea58aa8e-b1a5-434d-906b-b83250012539 on n-h2-master-1 Aug 21 01:19:58.670828 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6d844f52-5a03-4154-8f2a-5ca970c5292c req-f29ce06b-8a0e-428d-98a8-1df5132a8fd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069047 Aug 21 01:19:58.677983 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1676/2899] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:19:58.685187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:58.689564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:58.697643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.699109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.700365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.701330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.702412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.703100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.816508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.831530 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-959493d0-664a-422c-8c44-d86ad5fb11e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.493177 Aug 21 01:19:58.834180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1224/2900] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:58 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:58.869554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:58.881382 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1fa63f91-9468-4af9-b614-53055f446f6d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1278 microversion: 2.1 time: 0.201567 Aug 21 01:19:58.893906 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1677/2901] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:58 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:58.979125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:58.979962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:58.987092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.987922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.988590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:58.989622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:58.990278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:58.990903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.171032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:59.171752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:59.184760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.185277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.185782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.193670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.194175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.194618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.227369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] HTTP exception thrown: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Request method failure captured: Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 HTTP/1.1 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ91VQVmTxs2D3uDk1aQbtyF00HWwHKGTiaDiWxRBUwcKf3ny1rycmF6OOEE2V9eoJ0QfDRpSNj1NFHkUaBzJBbRyeGAOAs0c4S7ioz16pIR5scQ0AHUw6KUo3lFA72C9KkkcJrsbj3zf3EIOt_O-dcSAhBwmAFP5F8NoZnh17yFfI Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.32 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_503c042abb9448a393e983403fa0c1fe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}] Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25d98f9b858449a0af6ed328aa334600 Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f9a919bf-c110-4241-92bf-ecb73d8b8270'} Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:59.228897 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Returning 404 to user: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be7c637e-548d-4a02-b725-6504ba5012e3 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 404 len: 111 microversion: 2.32 time: 0.063300 Aug 21 01:19:59.233107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1678/2902] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:59 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:19:59.243105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bd3ad1c5-f678-44e1-8122-b36732cd022f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '.version_select at 0x7fc4031d3e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:59.275993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bd3ad1c5-f678-44e1-8122-b36732cd022f tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147848782" status: 204 len: 0 microversion: 2.32 time: 0.035712 Aug 21 01:19:59.276631 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1679/2903] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:19:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147848782 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 21 01:19:59.360653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:59.362032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:59.370554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.371373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.372342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.373642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.374379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.375123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.402316 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:19:59.627031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:59.648928 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3af0d669-8711-451c-885e-23538c15526e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.673687 Aug 21 01:19:59.651278 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1225/2904] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:58 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:19:59.658944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:59.665329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:59.683890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:59.684222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.686456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.691150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.697037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:59.697231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.697682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.698124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.706063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:19:59.711033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9db05a7-a3d5-4f18-b277-cff1211493a7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.353374 Aug 21 01:19:59.712601 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1680/2905] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:19:59 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:19:59.854297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:19:59.855085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:19:59.891703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.893468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.895046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:19:59.896131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:19:59.896879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:19:59.898063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.100392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:00.114126 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9fa51598-6e82-4024-a223-23a1bd649a54 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.263887 Aug 21 01:20:00.114717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1681/2906] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:59 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:00.133119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:00.133755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:00.140098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.144803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.145422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.146153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.146610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.147122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.409126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:00.421795 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-35d8e786-6072-4e52-9389-093b217103b5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.305651 Aug 21 01:20:00.433137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1682/2907] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:00 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:00.439327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4a7ce9-b4a1-4069-bf56-21ec641b0d88", "tag": "5bdfa04d-6fbc-4e8f-8528-ef1c840306a4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:00.452314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.453141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.453718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.469439 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] Creating event network-changed:5bdfa04d-6fbc-4e8f-8528-ef1c840306a4 for instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 on n-h1-master-1 Aug 21 01:20:00.475861 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e95b7c07-7614-4fd0-9095-14c5d9dc28ff req-45064163-2eb8-4e19-8cde-783684a56000 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041197 Aug 21 01:20:00.477230 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1683/2908] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:00.487992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:00.513410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5cc59135-54bf-4f5f-aca7-14d66657e671 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1708 microversion: 2.1 time: 0.857496 Aug 21 01:20:00.525584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1226/2909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:19:59 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1708 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:00.677198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:00.681555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:00.696701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.697640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.699556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.700644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.701547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.702123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.749709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:00.750238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:00.763720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.765608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.766470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:00.769715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:00.775342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:00.776183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.175087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.187581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d74ea0cd-36a3-47d9-b0c8-f3e2fe868920 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.518418 Aug 21 01:20:01.188804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1684/2910] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:00 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:01.199953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:01.202815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:01.219373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.220596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.221161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.222739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.224103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.225175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.505879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.521955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-70c72662-2610-436e-bdde-bf25f274b9d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.329342 Aug 21 01:20:01.523231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1685/2911] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:01 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:01.542299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:01.542943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:01.554243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.554947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.555396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.556129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.556857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.557455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.700816 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:01.763570 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:01.881577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.898370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.902210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.906183 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b455762a-98c0-4a14-8e57-fcb4cdeaedb0 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.171886 Aug 21 01:20:01.919607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1227/2912] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:00 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:01.933386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:01.935214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:01.943868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-39bb8bf4-faf5-469d-a101-505343c1fa89 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.419213 Aug 21 01:20:01.953332 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1686/2913] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:01 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:01.955229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:01.966590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.967332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.967844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:01.968786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:01.969247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:01.969669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.210259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:02.211208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:02.241271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.242515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.243737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.244823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.246283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.246925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.533019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:02.545358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c72a3e44-83e0-4966-990d-9fb481957eb7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.337037 Aug 21 01:20:02.546358 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1687/2914] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:02 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:02.561583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:02.562312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:02.575519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.577855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.578997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.581591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.583497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.584034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.587604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:02.606736 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6131375-5db8-4e8c-a94d-3ff3c49bc373 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1712 microversion: 2.1 time: 0.683303 Aug 21 01:20:02.623136 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1228/2915] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:01 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1712 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:02.731959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3039f082-a793-4be2-b9d4-90faa6e79f6e", "tag": "db592c0a-7268-4e4a-b8a7-c243e305a5ce"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:02.747090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.747761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.748347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.786248 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] Creating event network-changed:db592c0a-7268-4e4a-b8a7-c243e305a5ce for instance 3039f082-a793-4be2-b9d4-90faa6e79f6e on n-h2-master-1 Aug 21 01:20:02.795045 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e31b35e5-7bec-421e-bb92-8a28ebdfa89b req-1f17b597-9dfa-4b8f-8e83-dbbc3b49a325 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067137 Aug 21 01:20:02.796874 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1229/2916] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:20:02.933309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:02.933915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:02.953306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.955838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.956600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:02.959204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:02.961593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:02.962807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:03.051139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.067287 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72023810-b210-4b03-91f6-c1495806c3b9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.517059 Aug 21 01:20:03.069046 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1688/2917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:02 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:03.074803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:03.075611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:03.090244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:03.091318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:03.092032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:03.093055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:03.093736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:03.094560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:03.372253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.392364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-78525fcc-4747-4468-a085-9486cd224b41 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.321459 Aug 21 01:20:03.393572 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1689/2918] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:03 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:03.568679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:03.570221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:03.579087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:03.579638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:03.580309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:03.581811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:03.582631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:03.583239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:03.834030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.865768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.872905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.875802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8d63da14-3fb3-4898-8cab-24bd7b5f3820 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.948230 Aug 21 01:20:03.877624 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1230/2919] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:02 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:03.887247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:03.899395 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4cd2ce0f-8a2a-494b-ace4-7bd864f786bb tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.336057 Aug 21 01:20:03.902943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1690/2920] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:03 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:04.094790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:04.095425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:04.115520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.116024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.122043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:04.124603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.144954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.147643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:04.413635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:04.414611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:04.423149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.428327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.429299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:04.430903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.437884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.438664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:04.813035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:04.839216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ac13b3a-19df-4e25-b141-250c3484a032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.429276 Aug 21 01:20:04.846137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1691/2921] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:04 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:04.903532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:04.904256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:04.926372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.926911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.927557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:04.931047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:04.931532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:04.932018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:05.088017 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:05.513611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:05.529643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95504a76-fb8d-45a3-907d-ac9ac249b698 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 1.445459 Aug 21 01:20:05.543296 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1231/2922] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:04 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:05.548824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:05.549479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:05.566369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:05.567448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:05.568055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:05.569607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:05.571068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:05.573932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.073215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:06.095760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:06.098575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:06.102229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f5224a9-6f9b-441c-b359-d901fbc5ec50 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.203803 Aug 21 01:20:06.121564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1692/2923] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:04 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:06.147589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5", "tag": "f5eaf974-d899-4153-9703-36fb8c971b8a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:06.180794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:06.190423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:06.190886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.195491 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=18 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:06.217652 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] Creating event network-changed:f5eaf974-d899-4153-9703-36fb8c971b8a for instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 on n-h1-master-1 Aug 21 01:20:06.227979 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-aff7bfe1-610b-4cc1-8c31-81a2309cab35 req-da042f45-7d1e-45ba-a062-5c6e8f295712 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105023 Aug 21 01:20:06.229768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:06.238995 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9940ffe-7a91-4a5b-8e1c-802a4ca30357 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.694465 Aug 21 01:20:06.241691 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1693/2924] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:06.243746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1232/2925] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:05 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:06.258074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:06.258783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:06.272225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:06.275534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:06.275640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.276360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:06.276859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:06.277286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.550945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:06.551736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:06.564474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:06.567048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:06.569118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.571443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:06.572239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:06.573322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:06.716525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:06.728320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1340107c-f175-4163-ba82-6d8eacfc09c3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.481816 Aug 21 01:20:06.729317 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1694/2926] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:06 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:07.129915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:07.130522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:07.150593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.151801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.152240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.152979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.153669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.165659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.482414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:07.503340 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbb5c5d0-18f3-4db5-930a-64e2b81b3e9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.952936 Aug 21 01:20:07.516269 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1233/2927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:06 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:07.535313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:07.542655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:07.559139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.562363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.563300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.568597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.569506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.570115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.881145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:07.897852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:07.899958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:07.902466 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2f2b1ae-9a7c-4b46-bd5e-535277121dc2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.777673 Aug 21 01:20:07.903841 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1695/2928] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:07 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:20:07.921300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:07.923503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:07.937642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.938471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.939567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.940817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:07.942034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:07.942723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:07.988517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:08.007179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e140ea64-d7d0-44d3-95d3-0f2dc35e03ee tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.488415 Aug 21 01:20:08.007763 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1234/2929] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:07 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:08.181817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:08.193119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ef6e190-0045-4679-8999-902c4c9487d8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.287897 Aug 21 01:20:08.193792 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1696/2930] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:07 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:08.463531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea58aa8e-b1a5-434d-906b-b83250012539", "name": "network-vif-plugged", "status": "completed", "tag": "ba8ceee1-3348-4d16-afa1-2fb58e7b3e43"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:08.480932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:08.481713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:08.482306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:08.500015 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] Creating event network-vif-plugged:ba8ceee1-3348-4d16-afa1-2fb58e7b3e43 for instance ea58aa8e-b1a5-434d-906b-b83250012539 on n-h2-master-1 Aug 21 01:20:08.511112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6395cb8a-cb27-44ab-93bb-4b6913a4a490 req-6d92e28c-d27b-4a97-8654-6de53b6c4082 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051599 Aug 21 01:20:08.522377 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1235/2931] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:08.555925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:08.557304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:08.565513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:08.566022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:08.566638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:08.567337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:08.567812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:08.568227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:08.723961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:08.732288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adabb64f-7268-46c8-9f84-fafd26be8eae tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.194433 Aug 21 01:20:08.733546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1697/2932] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:08 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:08.931216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:08.933417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:08.946007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:08.946715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:08.947216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:08.950412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:08.951513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:08.952259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.004349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:09.005284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:09.012161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.012980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.013661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.014646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.015381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.016008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.041592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] HTTP exception thrown: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Request method failure captured: Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 HTTP/1.1 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ91VQVmTxs2D3uDk1aQbtyF00HWwHKGTiaDiWxRBUwcKf3ny1rycmF6OOEE2V9eoJ0QfDRpSNj1NFHkUaBzJBbRyeGAOAs0c4S7ioz16pIR5scQ0AHUw6KUo3lFA72C9KkkcJrsbj3zf3EIOt_O-dcSAhBwmAFP5F8NoZnh17yFfI Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.32 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_503c042abb9448a393e983403fa0c1fe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}] Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25d98f9b858449a0af6ed328aa334600 Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f9a919bf-c110-4241-92bf-ecb73d8b8270'} Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:09.044038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Returning 404 to user: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7816701f-722e-4a45-9b92-5355ad6d8bee tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 404 len: 111 microversion: 2.32 time: 0.051225 Aug 21 01:20:09.051725 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1698/2933] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:20:08 2022] DELETE /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:20:09.054716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:09.055478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:09.066304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.067885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.068343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.070493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.071264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.072956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.094598 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:09.289456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:09.299731 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64a2bd5b-2035-411d-afda-5408dd212059 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.250556 Aug 21 01:20:09.301041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1699/2934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:09 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:09.308078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:09.309200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] [instance: f9a919bf-c110-4241-92bf-ecb73d8b8270] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:09.317389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.318399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.319340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.320361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.321159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.321951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.342426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] HTTP exception thrown: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Request method failure captured: Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 HTTP/1.1 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYZ91VQVmTxs2D3uDk1aQbtyF00HWwHKGTiaDiWxRBUwcKf3ny1rycmF6OOEE2V9eoJ0QfDRpSNj1NFHkUaBzJBbRyeGAOAs0c4S7ioz16pIR5scQ0AHUw6KUo3lFA72C9KkkcJrsbj3zf3EIOt_O-dcSAhBwmAFP5F8NoZnh17yFfI Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.32 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_503c042abb9448a393e983403fa0c1fe", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/503c042abb9448a393e983403fa0c1fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/503c042abb9448a393e983403fa0c1fe"}]}] Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 503c042abb9448a393e983403fa0c1fe Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1774494082 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25d98f9b858449a0af6ed328aa334600 Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TaggedBootDevicesTest-1774494082-project Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f9a919bf-c110-4241-92bf-ecb73d8b8270'} Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.344446 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. Aug 21 01:20:09.348709 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:09.351912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] Returning 404 to user: Instance f9a919bf-c110-4241-92bf-ecb73d8b8270 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:09.353058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c082c341-6003-4a95-ae18-b089ae436825 tempest-TaggedBootDevicesTest-1774494082 tempest-TaggedBootDevicesTest-1774494082-project] 10.222.0.46 "GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270" status: 404 len: 111 microversion: 2.32 time: 0.049998 Aug 21 01:20:09.353837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1700/2935] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:09 2022] GET /compute/v2.1/servers/f9a919bf-c110-4241-92bf-ecb73d8b8270 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:20:09.360072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:09.361519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:09.368681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.369545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.370201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.371126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.372085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.372598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.450449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:09.465328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:09.467113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:09.470266 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-020af91a-f83b-4b55-b6e4-7b4169fa6b66 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.544826 Aug 21 01:20:09.475998 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1236/2936] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:08 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:09.702338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:09.713531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a90687d8-281e-4db9-bd4f-39b16e8a5f0d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.358319 Aug 21 01:20:09.714124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1701/2937] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:09 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:09.753418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:09.754248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:09.766973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.768579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.769054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:09.773031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:09.784325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:09.785000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.037107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:10.046333 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97ce3bf5-b3eb-436c-ba7b-7a7366d8a237 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1511 microversion: 2.1 time: 0.296635 Aug 21 01:20:10.047251 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1237/2938] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:09 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:10.321655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:10.322507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:10.335306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.337306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.338364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.340813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.341342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.342853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.506401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:10.507013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:10.515978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.516452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.516909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.520748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.521162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.523507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.622691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:10.635532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-081069d7-238c-428f-9ea0-dfb74b4ae943 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.318441 Aug 21 01:20:10.636081 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1702/2939] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:10 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:10.658735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4a7ce9-b4a1-4069-bf56-21ec641b0d88", "name": "network-vif-plugged", "status": "completed", "tag": "5bdfa04d-6fbc-4e8f-8528-ef1c840306a4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:10.699635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.700478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.704962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.719763 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] Creating event network-vif-plugged:5bdfa04d-6fbc-4e8f-8528-ef1c840306a4 for instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 on n-h1-master-1 Aug 21 01:20:10.726490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-682ff017-94b2-45a2-952c-fbc88abc5ba0 req-0a989779-b3ce-4708-b42c-47291ff19162 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075247 Aug 21 01:20:10.727639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1703/2940] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:10.742450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:10.743186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:10.761968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.762469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.762907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:10.763681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:10.764270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:10.764744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.059404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:11.073163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:11.079465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:11.080899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a59b501-94ce-43b8-b139-7fe37d38fb7e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.582517 Aug 21 01:20:11.082515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1238/2941] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:10 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:11.087385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:11.088309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:11.126639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.131741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.133612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.135529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.136204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.136849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.390774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:11.400193 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7d1b3d3-276a-4b27-b66e-3b89fa1076c0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1488 microversion: 2.1 time: 0.316598 Aug 21 01:20:11.407790 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1239/2942] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:11 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1488 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:11.439856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:11.443373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:11.473819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.474574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.494430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.495252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.495728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.501138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.867329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:11.879383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a467b1df-ed68-4b7c-a0c5-c9a2aae7d5b2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 1.142115 Aug 21 01:20:11.880263 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1704/2943] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:10 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:11.887993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:11.888855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:11.896180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.897254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.898079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.899015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.899837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.900505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.933317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69f35a4f-a595-4797-a088-4627f3471d7f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 200 len: 172 microversion: 2.1 time: 0.503790 Aug 21 01:20:11.935480 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1240/2944] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:11 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 172 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:11.949002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:11.950788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:11.970074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.970621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.971087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.971796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:11.972247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:11.972665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:11.994311 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:12.364665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:12.388396 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0148dd05-02f1-435b-a00e-79732bfa257c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.445750 Aug 21 01:20:12.411669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1241/2945] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:11 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:12.448018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:12.450725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:12.454667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:12.457141 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2469bfc1-4642-446e-a117-bfb26958fa31 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1316 microversion: 2.1 time: 0.573868 Aug 21 01:20:12.461530 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1705/2946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:11 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:12.470049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:12.471949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:12.480527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:12.482468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:12.483538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:12.484520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:12.489137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:12.491142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:12.514104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:12.521254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:12.521877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:12.522710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:12.527338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:12.528592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.035696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.046436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b83f62aa-2d97-47c7-a400-6242fc6d3194 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.581306 Aug 21 01:20:13.053848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1706/2947] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:12 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:13.064171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:13.064808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:13.096245 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:13.098212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.098866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.102902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.103881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.104534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.105228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.122935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.151547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.153077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.154261 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-500ffb36-4aed-49c8-b89b-629013f727e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.728080 Aug 21 01:20:13.154822 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1242/2948] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:12 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:13.181208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:13.185081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:13.229430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.231717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.239236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.243006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.243862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.250100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.468803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.479354 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eca19cfe-67dc-4fde-8a15-ef2e7f27902f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.424149 Aug 21 01:20:13.491874 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1707/2949] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:13 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:13.498829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:13.507643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:13.523612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.526789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.527510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.529004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.529834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.530546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.710396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.721133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0ecfcfa-85f0-42d6-bed7-628deef7599a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.564818 Aug 21 01:20:13.725514 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1243/2950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:13.746552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:13.755374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:13.769014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.769820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.771212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.773964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.774629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.776544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.907339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:13.922131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-240b2e18-5661-4191-b36d-4713b8901eaa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1466 microversion: 2.1 time: 0.427054 Aug 21 01:20:13.923475 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1708/2951] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:13 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1466 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:13.946271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:13.947281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:13.956197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.973606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.974376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:13.975351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:13.976474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:13.977240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.088464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:14.098702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ca10f8f-878a-4946-a4ce-cd1d237862bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.357316 Aug 21 01:20:14.100418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1244/2952] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:14.183299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:14.183924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:14.196642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.197163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.197592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.198292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.198734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.209371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.336579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa1dda95-1acf-4032-989a-9693608d38c0 tempest-ServersOnMultiNodesTest-1892594829 tempest-ServersOnMultiNodesTest-1892594829-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1617 microversion: 2.1 time: 0.394127 Aug 21 01:20:14.346240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1709/2953] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:13 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1617 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:14.359536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:14.360032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:14.378354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.378838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.379272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.386559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.387057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.387507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.424887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:14.560995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84ea06b5-ac3b-4516-9c0c-96fd6623f0a0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 204 len: 0 microversion: 2.1 time: 0.205355 Aug 21 01:20:14.561986 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1710/2954] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:14 2022] DELETE /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:14.572804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-28188959", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "4ec7abf5-e561-48e7-9db1-bc3c2f1218ae"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:14.655753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] validate_networks() for [('4ec7abf5-e561-48e7-9db1-bc3c2f1218ae', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:20:14.758122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:14.770957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:14.774724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:14.783909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12c1a04c-6b85-4c2c-a78a-accc086b1402 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.605471 Aug 21 01:20:14.784608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1245/2955] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:14 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:20:14.790616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:14.798713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:14.812992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.813441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.814465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:14.815229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:14.815726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:14.816205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.065302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:15.075473 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e669793e-b397-4721-bc0d-bd6b61f9a929 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.289478 Aug 21 01:20:15.090546 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1246/2956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:14 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:15.104113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:15.105226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:15.118198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:15.124564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:15.125520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.127148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:15.127856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:15.128506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.404976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:15.417866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c639ab24-6e11-482d-a5a0-2b02cc8d1009 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1472 microversion: 2.1 time: 0.325476 Aug 21 01:20:15.418765 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1247/2957] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:15 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:15.422308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:20:15.422809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:20:15.423418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:20:15.424118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:20:15.425013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:20:15.460188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:15.466360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:15.468887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.469932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:15.475442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:15.480488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.532196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:20:15.549602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:20:15.587093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:20:15.594290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:20:15.697740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9fd2acd7-d7aa-4b77-9203-ed98d3a60fd5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134230 Aug 21 01:20:15.698932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-323170399", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:15.704949 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1711/2958] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:20:15.716517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5", "name": "network-vif-plugged", "status": "completed", "tag": "f5eaf974-d899-4153-9703-36fb8c971b8a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:15.761734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:15.762207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:15.762639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:15.777658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] Creating event network-vif-plugged:f5eaf974-d899-4153-9703-36fb8c971b8a for instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 on n-h1-master-1 Aug 21 01:20:15.785924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-caba3d58-e00e-4441-a7d1-b9f8d2411ea3 req-ca727db8-d52f-4698-b6a2-84f139751b08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074004 Aug 21 01:20:15.791451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1712/2959] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:15.799412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcd2e745-cb09-456a-be6c-5c75f31f8d41 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:15.800325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcd2e745-cb09-456a-be6c-5c75f31f8d41 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:15.808565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:20:15.951206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bcd2e745-cb09-456a-be6c-5c75f31f8d41 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:15.965786 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcd2e745-cb09-456a-be6c-5c75f31f8d41 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1213 microversion: 2.1 time: 0.172417 Aug 21 01:20:15.966314 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1713/2960] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:15 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:16.001301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:16.005752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:16.052624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.055687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.062630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.069360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.070043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.072142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.722495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:20:16.722910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:20:16.723383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:20:16.723804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:20:16.724201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:20:16.736151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.736908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.737529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.738418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.739042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.739621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.766397 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:16.776949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:20:16.793827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:20:16.822474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:20:16.826051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:20:16.941129 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-82985cd8-c9c0-478b-b7db-a08ac11a9550 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520258 Aug 21 01:20:16.953089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1248/2961] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:20:16.958183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:16.958807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:16.967646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:16.977606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.978115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.978989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.981303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:16.983214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:16.984482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:16.984986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:16.989870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:16.993133 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f7f50e9-5485-4a75-9b28-fcbae1f218bb tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 1.014614 Aug 21 01:20:17.006148 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1714/2962] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:15 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:17.025117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:17.026929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:17.041929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:17.043172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:17.044293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:17.047627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:17.048343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:17.049294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:17.313358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:17.330347 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c58d5193-ae41-4522-b3c8-73ad50611e8c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1320 microversion: 2.1 time: 0.376031 Aug 21 01:20:17.330943 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1249/2963] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:16 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1320 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:17.347062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a46a6f6-912b-4b50-acb2-9ddb65784983 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:17.348230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a46a6f6-912b-4b50-acb2-9ddb65784983 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:17.494104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a46a6f6-912b-4b50-acb2-9ddb65784983 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:17.526364 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a46a6f6-912b-4b50-acb2-9ddb65784983 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1214 microversion: 2.1 time: 0.193850 Aug 21 01:20:17.526955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1250/2964] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:17 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:17.542189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:17.545330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:17.562763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:17.564224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:17.566722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:17.569366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:17.574275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:17.576429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:17.701720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:17.714899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b75f1e96-3d77-4335-b6b1-1f383ffe3734 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1217 microversion: 2.1 time: 0.186084 Aug 21 01:20:17.716493 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1251/2965] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:17 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:17.778379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:17.794279 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92c4b9f4-25d2-4eea-8506-a286835b3717 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1472 microversion: 2.1 time: 0.779563 Aug 21 01:20:17.809147 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1715/2966] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:17 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1472 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:17.851648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3039f082-a793-4be2-b9d4-90faa6e79f6e", "name": "network-vif-plugged", "status": "completed", "tag": "db592c0a-7268-4e4a-b8a7-c243e305a5ce"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:17.875426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:17.876233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:17.880087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:17.905050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] Creating event network-vif-plugged:db592c0a-7268-4e4a-b8a7-c243e305a5ce for instance 3039f082-a793-4be2-b9d4-90faa6e79f6e on n-h2-master-1 Aug 21 01:20:17.921950 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8bb55bd6-7053-4d1d-bc30-dfa1a94907a6 req-8c914b6f-20ac-403c-a884-15cc28eba512 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073921 Aug 21 01:20:17.924601 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1252/2967] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:18.020040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:18.021377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:18.035447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.040500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.041253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.042184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.042809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.049770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.353103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:18.353880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:18.376607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.380109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.380935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.381999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.384589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.385145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.734729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:18.750108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:18.750863 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f4e5f99-1608-4643-b68a-f3dbb7b177f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1511 microversion: 2.1 time: 0.402119 Aug 21 01:20:18.786689 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1253/2968] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:18 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:18.793612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:18.795264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:18.796592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9207d195-b96e-463f-89a3-0a70cbf08e1a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.780834 Aug 21 01:20:18.797349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:18.818653 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1716/2969] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:18 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:18.830647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:18.841916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:18.842569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:18.857792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.862849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.863551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.865371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.866996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.867661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.882407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.883207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.889417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:18.891909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:18.892553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:18.893179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.079175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:19.089635 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d00464ea-c88a-4ceb-b702-653470d5d5e0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1218 microversion: 2.1 time: 0.301666 Aug 21 01:20:19.093798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1254/2970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:18 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:19.118540 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea58aa8e-b1a5-434d-906b-b83250012539", "name": "network-vif-deleted", "tag": "ba8ceee1-3348-4d16-afa1-2fb58e7b3e43"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:19.153321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.165039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.165515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.221207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] Creating event network-vif-deleted:ba8ceee1-3348-4d16-afa1-2fb58e7b3e43 for instance ea58aa8e-b1a5-434d-906b-b83250012539 on n-h2-master-1 Aug 21 01:20:19.234526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-81753347-05ac-4822-8d30-828c63277044 req-3f435b12-7cf9-4759-bb80-59a93c242cf1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127966 Aug 21 01:20:19.235133 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1255/2971] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:19.239420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:19.253385 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:19.263669 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3eaf85d2-bdc4-4a25-bf87-907a55070368 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1217 microversion: 2.1 time: 0.443449 Aug 21 01:20:19.264533 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1717/2972] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:18 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1217 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:19.270710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:19.271358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:19.276403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:19.278819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:19.293815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.294300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.298738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.300575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.301084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.301517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.314230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.317685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.320243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.322876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.326280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.329350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.462533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.463683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.464441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.468809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lazy-loading 'fault' on Instance uuid ea58aa8e-b1a5-434d-906b-b83250012539 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:20:19.595341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:19.612929 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30c25046-b7f4-44ed-b6ca-dbff18d5fdc5 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1306 microversion: 2.1 time: 0.345991 Aug 21 01:20:19.615629 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1718/2973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:19 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1306 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:19.679012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:19.697260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d339d348-235e-4a35-8ff7-cd80f48ef9f2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1510 microversion: 2.1 time: 0.431308 Aug 21 01:20:19.721187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:19.722034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:19.723987 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1256/2974] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:19 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:19.734832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.735329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.741919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.746429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.750025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.750698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.844684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:19.845849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:19.859003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.860154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.860598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:19.861404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:19.861855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:19.862270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.235006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.249529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.251511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.253802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28b14d23-a454-4ef5-bdc4-9294ab49760a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.412832 Aug 21 01:20:20.254458 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1257/2975] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:19 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:20:20.294509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:20.301462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:20.308741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.309744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.310184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.311093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.315761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.316206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.445478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.459292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.469536 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e81e1df7-8176-411b-9bff-acb7a029595d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1266 microversion: 2.1 time: 0.197283 Aug 21 01:20:20.482808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1258/2976] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:20 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:20.482808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:20.482808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:20.487457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-efaea5d7-7429-42a8-98c3-192d32cff032 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1320 microversion: 2.1 time: 0.770565 Aug 21 01:20:20.491506 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1719/2977] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:19 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1320 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:20.504997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.509547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.510087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.513455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.514060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.516847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.640354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:20.641200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:20.658922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.659416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.662362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.663294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.665008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.665619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.681051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.693246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da16efd1-cf49-4b1b-96db-78c5bea1321e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1265 microversion: 2.1 time: 0.221605 Aug 21 01:20:20.698851 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1259/2978] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:20 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:20.752716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:20.753191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:20.753786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:20.754420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lazy-loading 'fault' on Instance uuid ea58aa8e-b1a5-434d-906b-b83250012539 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:20:20.826054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:20.834807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f324db35-38db-48ca-b177-8de6477f7706 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 200 len: 1306 microversion: 2.1 time: 0.202764 Aug 21 01:20:20.835392 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1720/2979] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:20 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 1306 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:21.277667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:21.278272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:21.290073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.290640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.291258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.292343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.293023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.293673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.490321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:21.492293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:21.504004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.509440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.511235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.518395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.519226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.519919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.765423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:21.770817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:21.779374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0c5827c-3a71-4be1-8a43-ac2f63d8af28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1274 microversion: 2.1 time: 0.293010 Aug 21 01:20:21.786441 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1721/2980] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:21 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:21.793204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:21.798565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:21.798977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:21.800570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1b9bf04-5b8a-43ec-a6f3-7f0ca92a05b7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.527021 Aug 21 01:20:21.813086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:21.816979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1260/2981] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:21 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:21.823350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:21.824183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:21.829427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.835204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.835935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.849916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.850801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.851477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.862368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.862871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.863325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.864035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:21.864485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:21.864950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:21.881946 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:22.158612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:22.166782 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1cd6ef19-0929-4ca7-89fc-09236fdf12f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1273 microversion: 2.1 time: 0.348489 Aug 21 01:20:22.189022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1261/2982] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:21 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:22.189022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:22.189022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: ea58aa8e-b1a5-434d-906b-b83250012539] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:22.196161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.196896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.197441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.198275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.199998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.205482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.224700 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 HTTP/1.1 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ea58aa8e-b1a5-434d-906b-b83250012539'} Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:22.226381 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance ea58aa8e-b1a5-434d-906b-b83250012539 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7526750-98b2-43ba-a1fa-63bc6526e728 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539" status: 404 len: 111 microversion: 2.1 time: 0.050839 Aug 21 01:20:22.233102 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1262/2983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:22 2022] GET /compute/v2.1/servers/ea58aa8e-b1a5-434d-906b-b83250012539 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:22.243056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:22.243600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:22.253423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.254165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.256430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.258097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.260047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.260966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.292721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:22.302628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f0197fe-f24c-4046-ba66-a96a32bf0c87 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1510 microversion: 2.1 time: 0.508357 Aug 21 01:20:22.312259 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1722/2984] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:21 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:22.339506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:22.344035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:22.350457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:22.351726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:22.380363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.381171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.381793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.382699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.384633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.385283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.531720 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca717098-f678-46aa-8120-ff26f3f9d3fe tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 204 len: 0 microversion: 2.1 time: 0.294545 Aug 21 01:20:22.535707 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1263/2985] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:22 2022] DELETE /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:22.543332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:22.544330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:22.560216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.564028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.567948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.569035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.569713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.570283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.629675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:22.783873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:22.797315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.800251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.801552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.916158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:22.931388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-970a3ffd-8630-4e38-83f4-51ba032a8078 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1471 microversion: 2.1 time: 0.393481 Aug 21 01:20:22.933222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1264/2986] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:22 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:22.947545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:22.948577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:22.962200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.965287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.965799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:22.966655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:22.967103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:22.967584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.095071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.113772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca25d0f8-4d72-445f-af57-1770130fe719 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1272 microversion: 2.1 time: 0.178890 Aug 21 01:20:23.115759 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1265/2987] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:22 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:23.119381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:23.120005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:23.143010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.156707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.157416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.158371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.159089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.159577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.330813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a3d3f37-9103-4737-9bb9-61c8f0c5b58b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.994924 Aug 21 01:20:23.331971 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1723/2988] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:20:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:23.338182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:23.339189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:23.359255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.359740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.360167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.360888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.361329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.363789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.788856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.799817 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93ca0bc1-33f5-4ad9-8ad6-6775ddd11521 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.466616 Aug 21 01:20:23.805213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1724/2989] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:23 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:23.811022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:23.822350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.851847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.853024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-632508991', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:23.859663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.863747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:23.865588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d0d2663-ba12-4378-94bd-6cd56cb2b1c7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.750181 Aug 21 01:20:23.866518 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1266/2990] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:23 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:23.871027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.871838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.873135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.874526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.875391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.877422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.958521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:23.959327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:23.979683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.981827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.982988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:23.990961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:23.991921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:23.992590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:24.119638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:24.283375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:24.301754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:24.305871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:24.306353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:24.484693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:24.495312 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b4c752c-41b3-4749-b5c7-8be4c0b8e94e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1471 microversion: 2.1 time: 0.543464 Aug 21 01:20:24.508878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1267/2991] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:23 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:24.513423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:24.514043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:24.525874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:24.527100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:24.527548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:24.528392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:24.528938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:24.529514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:24.932464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb29ac14-7615-4dda-bf7f-04e7a7f04577 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-632508991" status: 200 len: 1513 microversion: 2.1 time: 1.125704 Aug 21 01:20:24.945365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1725/2992] 10.222.0.46 () {58 vars in 1261 bytes} [Sun Aug 21 01:20:23 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-632508991 => generated 1513 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:24.945365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:24.945365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:24.961772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:24.962272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:24.962696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:24.963403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:24.963854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:24.964400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.094363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.113721 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c4d5b42-e072-4a4a-be5f-b02fdead7e87 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.616691 Aug 21 01:20:25.114597 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1268/2993] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:24 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:25.119571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:25.120396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:25.130596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.133461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.134127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.135023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.144496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.145534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.481226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.489813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-939d21b6-81fb-463e-b06e-c3029308c079 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.555261 Aug 21 01:20:25.492150 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1726/2994] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:24 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:25.508404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:25.515405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.515635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:25.526645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.527130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.527570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.528311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.528754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.529240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.653392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:25.756184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.767321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.767810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.768291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.913578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.930782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.935435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:25.937530 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4bb2a912-42d6-46c9-8393-fca0b5048dfc tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.821822 Aug 21 01:20:25.943346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1269/2995] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:25 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:25.953824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:25.954946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:25.966350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.966836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.967264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:25.968076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:25.968522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:25.969148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.116160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:26.123062 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac43820e-505a-46f1-88e3-3fb58f666af5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.619631 Aug 21 01:20:26.126773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1727/2996] 10.222.0.46 () {58 vars in 1173 bytes} [Sun Aug 21 01:20:25 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:26.134286 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad3a44a3-7717-4974-bb6c-5636465a48fa tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 200 len: 1429 microversion: 2.1 time: 0.187985 Aug 21 01:20:26.147232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:26.147979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:26.151264 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1270/2997] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:25 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 1429 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:26.156596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:26.161907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:26.162599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.servers [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Removing options 'limit' from query {{(pid=122483) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 21 01:20:26.163618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:26.164054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.167229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.167838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.168830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.169398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.170200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.170837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.171273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.172046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.172966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.173579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.174143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.295336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:26.317942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.321324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.321887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.640883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:26.651108 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7491e75b-7ede-4848-9728-aace16b67770 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.509452 Aug 21 01:20:26.656529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1728/2998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:26 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:26.662010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678c0d69-1450-4b11-9eed-2719cb7bcf9d", "name": "network-vif-deleted", "tag": "4dbc436c-6fe8-4fca-bd68-8f5a407c7934"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:26.685893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.693581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.697009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.732796 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] Creating event network-vif-deleted:4dbc436c-6fe8-4fca-bd68-8f5a407c7934 for instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d on n-h1-master-1 Aug 21 01:20:26.767368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8a96fed6-ca05-4eda-b294-189cd5ddcc78 req-073af19b-f763-49b0-9e3b-7c21999f78ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107050 Aug 21 01:20:26.769789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1729/2999] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:26.798750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:26.801412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:26.818997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.819500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.820734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:26.829487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:26.832112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:26.833186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.134112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38465acf-a810-43f2-91c4-46c06be6cf64 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.981348 Aug 21 01:20:27.135302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1271/3000] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:20:26 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:27.159285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c923fd-abe9-447e-81e9-84f40b5ae3f0", "tag": "da58a330-5698-41b8-979d-b3a8df711e9b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:27.186539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.191156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.191594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.212458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] Creating event network-changed:da58a330-5698-41b8-979d-b3a8df711e9b for instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 on n-h2-master-1 Aug 21 01:20:27.235489 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-afa10085-fcb5-43f4-971f-aa274f4820ca req-20a57839-30e4-4542-9c27-158bd6d8f765 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078045 Aug 21 01:20:27.236600 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1272/3001] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:27.250688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.255374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:27.271402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.276972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.277728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.278741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.282230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.282924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.486884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.499846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-323f1a33-9088-41c2-8d0b-8dceb00b70ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.727265 Aug 21 01:20:27.521642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1730/3002] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:26 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:27.526647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.527264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 678c0d69-1450-4b11-9eed-2719cb7bcf9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:27.543764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.544260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.545307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.549638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.550120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.550557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.579923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d HTTP/1.1 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '678c0d69-1450-4b11-9eed-2719cb7bcf9d'} Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:27.582860 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance 678c0d69-1450-4b11-9eed-2719cb7bcf9d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:27.587072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a35137e8-3191-465b-b373-ba2258fd5970 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d" status: 404 len: 111 microversion: 2.1 time: 0.061762 Aug 21 01:20:27.590485 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1731/3003] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:27 2022] GET /compute/v2.1/servers/678c0d69-1450-4b11-9eed-2719cb7bcf9d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:27.595597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.613860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.617454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:27.632128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.633084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.633762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.636155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.640277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.641383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.696057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:27.729465 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:27.740312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4af9607-422e-4b51-8d8d-3afbbf5cf1fe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.149770 Aug 21 01:20:27.741684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1732/3004] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:20:27 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:27.750509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.751704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:27.761588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.762893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.765012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.766027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.767220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.770705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.814064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:27.846496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.862615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.864995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.866955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-441cfdff-7e36-40b6-8f15-56f6156958e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.628745 Aug 21 01:20:27.881787 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1273/3005] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:27 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:27.894346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.895398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:27.905953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.906870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.908013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.913523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.914232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.914681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.965212 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ff0acfa-c29b-4c03-92fe-feb00df98388 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 204 len: 0 microversion: 2.1 time: 0.220492 Aug 21 01:20:27.965968 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1733/3006] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:27 2022] DELETE /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:27.971630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:27.977184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:27.977878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.servers [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Removing options 'limit' from query {{(pid=122482) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 21 01:20:27.978785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:27.985526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.986337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.986934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:27.987954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:27.988627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:27.989234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.020760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:28.053747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93b824d6-69c5-452a-9857-c8ac48a2f1e3 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.086308 Aug 21 01:20:28.054407 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1734/3007] 10.222.0.46 () {58 vars in 1150 bytes} [Sun Aug 21 01:20:27 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:28.059633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.060605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:28.067638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.068680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.068680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.069230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.069825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.070105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.226608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.234715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9db2096d-348a-4881-98be-0bf505a53564 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1471 microversion: 2.1 time: 0.179104 Aug 21 01:20:28.235226 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1735/3008] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:28.239736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.244599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.245100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:28.252697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.253206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.253631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.254341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.254783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.255194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.284102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.286748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:28.293397 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d274b044-b7dc-4fef-ada2-59e040c05c20 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.407042 Aug 21 01:20:28.293983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1274/3009] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:27 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:28.324501 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19db4146-c83d-44b6-a1a0-5c50fb48dcfa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.087995 Aug 21 01:20:28.326697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1736/3010] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers => generated 1009 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:28.339195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.345320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.346525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:28.358963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.359782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.360411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.361372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.362020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.362625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.451790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:28.520624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.521270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:28.523682 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:28.530360 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6e83605-8cf3-49c3-a122-4bfea956fb14 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.194612 Aug 21 01:20:28.539882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.539882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.540187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.540629 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1275/3011] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:28.540916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.541376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.541797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.547498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.553386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.554228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.servers [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Removing options 'limit' from query {{(pid=122483) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 21 01:20:28.555105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:28.560535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.561301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.561727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.562662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.563286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.564341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.590164 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1661459e-1982-4b6c-85f7-44fde1d97ffa tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.047809 Aug 21 01:20:28.598464 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1276/3012] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:28.603369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.614296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.616792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-632508991', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:28.641063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.642133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.642768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.643936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.644725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.645554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.778694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:28.785166 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:28.869350 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68306ae4-d189-47fa-9a0d-07a32f72b1d2 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-632508991" status: 200 len: 345 microversion: 2.1 time: 0.269289 Aug 21 01:20:28.871065 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1277/3013] 10.222.0.46 () {58 vars in 1240 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-632508991 => generated 345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:28.877950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d6ee5b-cb5b-4b7c-8712-71112533341d", "tag": "bec6bea7-c06c-43e1-b94e-784b60b77518"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:28.892344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.894387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.895026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.913323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] Creating event network-changed:bec6bea7-c06c-43e1-b94e-784b60b77518 for instance b9d6ee5b-cb5b-4b7c-8712-71112533341d on n-h2-master-1 Aug 21 01:20:28.920173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-22d38923-affb-4073-890b-f65f3fb77179 req-8c1fc14f-9019-47a3-b167-0003122c27ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046366 Aug 21 01:20:28.921716 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1278/3014] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:28.924233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:28.935559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:28.949026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.949521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.957728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.958999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b11a81d-9d79-4cd2-b151-bb908932de65 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.425585 Aug 21 01:20:28.958999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1737/3015] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:28.967733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:28.968601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:28.978829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.979517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.980173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.980994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:28.981563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:28.982232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:28.992641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Going to try to stop instance {{(pid=122483) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:20:29.048561 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e992ad9-aaf2-414e-a035-f907d8130f1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "POST /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88/action" status: 202 len: 0 microversion: 2.1 time: 0.124822 Aug 21 01:20:29.049542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1279/3016] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:28 2022] POST /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:20:29.061164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:29.062196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:29.071908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.072601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.073404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.074718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.075373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.076368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.383172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:29.397250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:29.399174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:29.400972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eca23b5f-4b07-4686-86a0-5f72598b4a88 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.446022 Aug 21 01:20:29.401877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1738/3017] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:28 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:29.407537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:29.408225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:29.414960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.415534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.416232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.417176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.417684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.418174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.503494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:29.512694 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb10bcd8-e92d-4eff-8f45-0b674c9a107a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.458148 Aug 21 01:20:29.513426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1280/3018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:29 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:29.531706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:29.532901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:29.542410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.543389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.544292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.545570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.546297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.547015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.607959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:29.617444 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8953ee11-63c1-49b8-b76f-b2f5a625213e tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1471 microversion: 2.1 time: 0.214496 Aug 21 01:20:29.618143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1739/3019] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:29 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:29.974625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:29.975233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:29.982790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.983312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.983838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:29.984607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:29.985092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:29.985512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.127734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.144910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e269d000-ef9d-490b-987a-4f9bb3907ee8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.174042 Aug 21 01:20:30.145791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1740/3020] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:29 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:30.235390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.250573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54a4feaa-c747-48f7-840d-873214a2d034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.735932 Aug 21 01:20:30.251161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1281/3021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:29 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:30.429575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:30.430493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:30.437206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.438003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.438536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.440657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.441325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.441933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.535734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:30.536309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:30.547134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.548176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.548933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.549878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.550527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.551146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.691581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.702731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.704548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.706055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d5eeb9f-f32e-4168-9656-4796d98af132 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.281137 Aug 21 01:20:30.721857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1741/3022] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:30 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:30.730335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:30.731286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:30.739703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.740566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.741300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.746006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:30.749279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:30.749954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:30.842445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:30.853484 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f308f36-88bf-4770-b77a-05e08960db67 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 200 len: 1429 microversion: 2.1 time: 0.129855 Aug 21 01:20:30.854476 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1742/3023] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:30 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 1429 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:30.993932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f9f5f4-1857-4827-a6f3-1217fc5e817d", "name": "network-vif-deleted", "tag": "eb4d40f5-fd04-4fea-b649-89d97d2d8558"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:31.013459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.013934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.014803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.035494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] Creating event network-vif-deleted:eb4d40f5-fd04-4fea-b649-89d97d2d8558 for instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d on n-h1-master-1 Aug 21 01:20:31.042514 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c005eebc-504a-4e1e-a25f-c63153c5ef06 req-e6e3b880-c051-46a6-b74c-c802108affe3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052037 Aug 21 01:20:31.043708 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1743/3024] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:20:31.123972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:31.142271 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6935d5d5-c8a5-47a0-8ce3-4b2d0c1b1b5f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.610381 Aug 21 01:20:31.143426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1282/3025] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:30 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:31.167003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:31.167648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:31.177428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.177918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.178341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.197910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.198672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.199420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.271947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:31.272558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:31.281160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.282964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.283406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.284109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.285053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.285473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.449493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:31.463965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da062297-b47c-4d62-97fb-4840af5826ad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.299737 Aug 21 01:20:31.464580 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1744/3026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:31 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:31.594630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:31.607323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4a9fda87-e4f2-4577-8147-6c8d896337a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.335416 Aug 21 01:20:31.608711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1283/3027] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:31 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:31.746648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:31.747238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:31.758206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.759045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.759830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.761137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.761604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.762022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.879395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:31.881131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: a0f9f5f4-1857-4827-a6f3-1217fc5e817d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:31.888427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.889485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.890197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.890806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.891247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.891717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.907616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d HTTP/1.1 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a0f9f5f4-1857-4827-a6f3-1217fc5e817d'} Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:31.909304 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance a0f9f5f4-1857-4827-a6f3-1217fc5e817d could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:31.914694 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ca6aca1-ea9d-4401-85f1-1d372504788c tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d" status: 404 len: 111 microversion: 2.1 time: 0.036032 Aug 21 01:20:31.915528 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1284/3028] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:31 2022] GET /compute/v2.1/servers/a0f9f5f4-1857-4827-a6f3-1217fc5e817d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:31.920273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:31.920806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:31.928285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.929223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.929350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.930432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:31.930800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:31.931443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:31.966525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:32.080908 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:32.098414 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e09bc1f-8a94-4d41-ae91-66b11cbcdeb8 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 204 len: 0 microversion: 2.1 time: 0.181450 Aug 21 01:20:32.102872 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1285/3029] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:31 2022] DELETE /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:32.111556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:32.113031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:32.118799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.125731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.126857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.127309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.128129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.128597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.129241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.158975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:32.159264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.160832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.162070 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06b51030-e115-422d-889e-b59c795a690c tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.429384 Aug 21 01:20:32.163173 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1745/3030] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:31 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:32.168862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:32.170817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:32.178558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.179128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.179575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.180286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.180736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.181189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.282847 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19388460-8e9b-4e3a-aebd-f7d22d79863a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 204 len: 0 microversion: 2.1 time: 0.177967 Aug 21 01:20:32.283784 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1286/3031] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:32 2022] DELETE /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:32.293068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:32.293682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:32.302641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.303271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.303712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.305187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.305446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.306143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.432219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.446911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1388c269-fb1c-4738-8763-22ef34b97aeb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.282196 Aug 21 01:20:32.447546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1746/3032] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:32 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:32.489722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:32.490323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:32.498426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.498976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.499400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.500094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.500533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.500981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.602394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.611679 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-370878a9-c84b-4fc3-9e2a-a0e7d4c15c5a tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1474 microversion: 2.1 time: 0.323652 Aug 21 01:20:32.612595 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1287/3033] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:32 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:32.631787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:32.632498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:32.639465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.640364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.641211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.642229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:32.642793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:32.643645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:32.653134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:32.657008 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:32.663109 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57d3b2dc-eb3e-4a99-a957-4b9bc21cd0e4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.177511 Aug 21 01:20:32.664600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1747/3034] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:32 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:32.996956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.005695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80fde246-751a-4c5d-8499-36cbbabc35fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.377857 Aug 21 01:20:33.019699 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1288/3035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:32 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:33.194192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:33.194950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:33.203528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.204562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.205234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.206178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.207213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.207840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.468274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:33.469820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:33.487125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.492033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.493332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.495082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.495959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.504729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.556552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.568557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.570361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.575200 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6810054-357b-4ba4-abe8-b86ad5106c9b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.387487 Aug 21 01:20:33.576617 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1748/3036] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:33 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:33.638455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:33.641063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:33.678506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.679025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.680372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.681674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.682138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.682561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.923198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.932759 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d92ad39-ae4c-418c-bb31-091007e4787a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.468900 Aug 21 01:20:33.933992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:33.943961 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a94fd943-f110-4b7b-a648-dc4b00087c48 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1474 microversion: 2.1 time: 0.314907 Aug 21 01:20:33.947896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1749/3037] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:33 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:33.948070 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1289/3038] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:33 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:33.951536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:33.952495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:33.959252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.959706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.960324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:33.961035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:33.961479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:33.961891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.026593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:34.027295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:34.034693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.035491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.035982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.036750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.037282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.037762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.172095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:34.180977 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12dda1fb-2c20-4029-97db-c088224b9c35 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.235350 Aug 21 01:20:34.181644 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1750/3039] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:33 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:34.376448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:34.384851 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8cd2e569-5317-4f7f-ba5b-c3a3ae909379 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.362071 Aug 21 01:20:34.386003 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1290/3040] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:34 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:34.600091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:34.600707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:34.608550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.609073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.609492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.610201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.610644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.611065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.886733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:34.905526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:34.910434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:34.911933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3abcdbbd-cd23-49a2-94c3-3503c2df0534 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.315866 Aug 21 01:20:34.917363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1751/3041] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:34 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:34.956482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:34.957865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:34.965930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:34.966909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:34.975770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.977884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.980205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.984508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.985249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.987106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.987726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.989302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:34.992022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:34.993728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:34.994351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.000960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.051414 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:35.398559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:35.412272 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fae776d-3698-4423-a820-025170eba9f4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.460893 Aug 21 01:20:35.428730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1291/3042] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:34 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:35.439050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:35.439890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:35.448881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.449454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.449963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.451412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.452122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.452681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.750069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:35.765309 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:35.785669 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e186f1b-725a-46ce-a0db-d2c807cfd74f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1474 microversion: 2.1 time: 0.824322 Aug 21 01:20:35.790407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:35.805152 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-787a12ac-e22e-4729-84ca-81a23c53def6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.372683 Aug 21 01:20:35.806228 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1292/3043] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:35 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:35.808652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1752/3044] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:34 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1474 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:35.814458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:35.816603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:35.818468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74ed2f83-2786-4c42-be00-b998554dbc32", "name": "network-vif-deleted", "tag": "3a575123-fe9c-4948-9cc5-485f77016f26"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:35.835550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.836415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.837060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.837775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.844605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.845424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.849450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.850132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.850786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.901947 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] Creating event network-vif-deleted:3a575123-fe9c-4948-9cc5-485f77016f26 for instance 74ed2f83-2786-4c42-be00-b998554dbc32 on n-h1-master-1 Aug 21 01:20:35.916154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-034f705b-4abd-4ae1-8ffa-26dd168d8a04 req-2422fb44-6950-417f-b11a-2b3ef37cc9a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106468 Aug 21 01:20:35.916969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1293/3045] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:35.952869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:35.953783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:35.961386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.962630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.963386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:35.964686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:35.965363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:35.967526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.274610 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:36.317581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:36.327875 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-654afd1b-a9a6-4dcb-b4fb-b3ee324b1043 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.517169 Aug 21 01:20:36.339480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1753/3046] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:35 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:36.359145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:36.369870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:36.371580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:36.373841 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cabd04f2-df00-4ad0-b68e-6c3deb76d75e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.434798 Aug 21 01:20:36.375144 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1294/3047] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:35 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:36.436227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:36.437368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:36.444375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.445172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.445600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.446449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.447310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.447730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.739199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:36.749212 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0d069b2-379e-46c3-8f69-b37f53c3a729 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.317080 Aug 21 01:20:36.753931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1754/3048] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:36 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:36.820431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:36.829603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:36.830577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:36.832576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:36.850241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.853282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.853544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.854854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.856247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.859912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.860379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.861942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.862671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.862920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.864655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.865304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.955567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:36.955906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:36.956719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:36.957574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lazy-loading 'fault' on Instance uuid 221bea62-a2f8-4fe6-a809-4fb25d34080d {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:20:37.013775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.024254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-52df90a9-c0de-45f6-9462-00e52d4193c7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 200 len: 1308 microversion: 2.1 time: 0.212355 Aug 21 01:20:37.037972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1295/3049] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:36 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:37.267684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.278359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2451329-bd5e-4092-a2bf-dec661cff4ac tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.455276 Aug 21 01:20:37.293677 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1755/3050] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:36 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:37.352236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:37.353484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:37.365813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.367100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.367979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.369534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.370176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.370754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.403029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:37.404884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:37.421999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.422765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.423419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.424363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.425039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.425621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.691844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.700805 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bba6d98f-d7fb-45c1-b25e-c5da2ba0db0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.353343 Aug 21 01:20:37.701685 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1296/3051] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:37 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:37.730007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.744100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.747118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:37.748638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-69452c58-85a7-4635-9ca6-1b20e06c1220 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.354964 Aug 21 01:20:37.749506 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1756/3052] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:37 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:20:37.776613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:37.777382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:37.783937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.784708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.785234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.786194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.786377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.787179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.962039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221bea62-a2f8-4fe6-a809-4fb25d34080d", "name": "network-vif-deleted", "tag": "8320a3de-b235-4251-b103-e33527aa3409"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:37.971770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:37.972236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:37.972864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:37.987089 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] Creating event network-vif-deleted:8320a3de-b235-4251-b103-e33527aa3409 for instance 221bea62-a2f8-4fe6-a809-4fb25d34080d on n-h2-master-1 Aug 21 01:20:37.994580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d9b96b91-068e-469e-a5df-dd7cf3accecb req-63ef8fda-e6f1-46a4-83ee-2b45618ebb2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035547 Aug 21 01:20:37.995202 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1757/3053] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:20:38.028974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:38.037895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf1228de-289e-4e47-af11-46a766922c70 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.266212 Aug 21 01:20:38.038890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1297/3054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:37 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:38.052566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.052566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 221bea62-a2f8-4fe6-a809-4fb25d34080d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.053252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.053735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.054161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.054855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.055294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.055704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.070877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d HTTP/1.1 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '221bea62-a2f8-4fe6-a809-4fb25d34080d'} Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:38.072725 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.078513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance 221bea62-a2f8-4fe6-a809-4fb25d34080d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:38.079963 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-59d8df5a-a1dc-4f8f-b092-7657e057d541 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d" status: 404 len: 111 microversion: 2.1 time: 0.036422 Aug 21 01:20:38.079963 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1758/3055] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/221bea62-a2f8-4fe6-a809-4fb25d34080d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:38.089570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.090103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74ed2f83-2786-4c42-be00-b998554dbc32] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.097966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.098454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.098887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.099593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.100042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.100468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.117277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 HTTP/1.1 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '74ed2f83-2786-4c42-be00-b998554dbc32'} Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:38.119021 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance 74ed2f83-2786-4c42-be00-b998554dbc32 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d42ec53a-3798-4c6a-9fd6-11db9ea4fdbc tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32" status: 404 len: 111 microversion: 2.1 time: 0.036534 Aug 21 01:20:38.124169 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1298/3056] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/74ed2f83-2786-4c42-be00-b998554dbc32 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:38.140838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0499d37e-ec46-4084-bb75-00ee3dfeebd2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.181469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0499d37e-ec46-4084-bb75-00ee3dfeebd2 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/ad9a89c8-9332-451b-acc3-314db318b9e0" status: 204 len: 0 microversion: 2.1 time: 0.055465 Aug 21 01:20:38.185237 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1759/3057] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:20:38 2022] DELETE /compute/v2.1/os-server-groups/ad9a89c8-9332-451b-acc3-314db318b9e0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:38.197463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.198499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.207226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.208614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.209155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.210531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.211111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.211637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.245914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:38.314555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.315820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.336380 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:38.339394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.340529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.341394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.347016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.348539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.349677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.356521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2217fecd-0de7-42ce-a0dc-26bc54d11554 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 204 len: 0 microversion: 2.1 time: 0.164258 Aug 21 01:20:38.357412 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1299/3058] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:38 2022] DELETE /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:20:38.367012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.368358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.380334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.381279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.382058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.382908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.384088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.384608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.412139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:38.496805 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90331f0c-73b0-4b3b-a691-4368b81767d0 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 204 len: 0 microversion: 2.1 time: 0.134580 Aug 21 01:20:38.497752 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1300/3059] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:38 2022] DELETE /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:38.506448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.507131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.513256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.513731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.514161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.514898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.515488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.515907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.669342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:38.678712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3959561a-01d7-4540-8e61-51106bdbffb3 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1474 microversion: 2.1 time: 0.176128 Aug 21 01:20:38.679755 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1301/3060] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1474 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:38.708021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:38.718279 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:38.719686 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4778e0da-f447-42fc-8741-e07e27cedfc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.419848 Aug 21 01:20:38.735393 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1760/3061] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:38.737453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.738135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.745700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.746126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.746591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.747278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.747712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.748145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.773299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:38.774122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:38.784905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.785804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.786520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.787837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:38.788749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:38.789409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:38.937382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:38.946731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9037fd2-d08a-445d-b64e-75d7f0fee6cc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.229306 Aug 21 01:20:38.947509 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1302/3062] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:38.988731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:38.999470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.000033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.000455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.013635 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] Creating event network-vif-plugged:eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:39.020053 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0653570d-a503-44fd-bfaf-5b4088bfd76f req-27094ed4-5062-4e8a-9839-05f0f655cfba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035528 Aug 21 01:20:39.020916 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1303/3063] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:39.060890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:39.061729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:39.068916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.069424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.069974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.070677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.071302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.072081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.147990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:39.161208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:39.166669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:39.169896 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb715048-93bb-4b76-98c3-2b2322f7446e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.401759 Aug 21 01:20:39.171429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1761/3064] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:38 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:39.296038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:39.304844 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb621fc0-d6aa-4c97-82a6-6389e685579e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.248470 Aug 21 01:20:39.325482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1304/3065] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:39 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:39.701406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:39.702130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:39.716647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.717166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.717657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.718366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.718918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.719352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.743819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:39.744531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:39.774059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.778016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.778547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:39.781820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:39.784685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:39.788365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.055550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.090227 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3864ad43-6976-4a0f-92dc-cd3f3e9d7eb7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.349541 Aug 21 01:20:40.091709 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1305/3066] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:39 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:40.099116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:40.100062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:40.109399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.110142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.110734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.112008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.112617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.156447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.164054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.177929 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-978eb871-f412-480a-85cd-a926247f0be9 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1474 microversion: 2.1 time: 0.478715 Aug 21 01:20:40.180719 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1762/3067] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:39 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:40.201563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:40.203060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:40.223148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.223650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.224086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.224917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.225405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.226534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.243449 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:40.442522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.452151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb804dd3-55ca-4a03-963f-21931e07f835 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.358543 Aug 21 01:20:40.453073 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1306/3068] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:40 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:40.472287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:40.473320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:40.481026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.481911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.483073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.484032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:40.484695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:40.485351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:40.570889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.582772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.596415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.602556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d252adb9-1b6e-44f9-aee0-cb64c9a377d7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.411450 Aug 21 01:20:40.610269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1763/3069] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:40 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:40.680214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:40.690348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2b27a99-3fbe-4ee3-a4fc-186b4d7acddf tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.222981 Aug 21 01:20:40.691186 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1307/3070] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:40 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:41.046013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "fe5c9337-719f-4457-a1d0-4be329e250ec"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "ee2defc2-fa33-496d-ade2-18c43587603e"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "836feede-bb0f-4bf4-aa52-925140922dbc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:41.073091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.073656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.074109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.097911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Creating event network-vif-plugged:fe5c9337-719f-4457-a1d0-4be329e250ec for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:41.099986 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Creating event network-vif-plugged:ee2defc2-fa33-496d-ade2-18c43587603e for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:41.102131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Creating event network-vif-plugged:67a6b508-cc48-43b4-aa6e-30b3cc6fd7e8 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:41.103454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] Creating event network-vif-plugged:836feede-bb0f-4bf4-aa52-925140922dbc for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:41.115509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:41.117392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:41.161221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1d1e2ca7-60d7-40ae-b244-950d321a7b0c req-c6f6323c-c175-454b-a077-3406cbba1f5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.111612 Aug 21 01:20:41.162462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.165467 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1764/3071] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:41.166801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.168540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.174102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.174887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.179204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.208495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:41.212704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:41.234480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.237100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.239953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.242364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.243336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.244355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.488935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:41.500955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8821f71-9351-49a7-8546-9ec15cac0a64 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1474 microversion: 2.1 time: 0.300885 Aug 21 01:20:41.504631 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1765/3072] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:41 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:41.551357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:41.553448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:41.562920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.564375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.564640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.565398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.565842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.566556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.746655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:41.747174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:41.756250 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41b86e03-9cb8-4b44-92b5-ddcbd3100e01 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.250162 Aug 21 01:20:41.768800 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1766/3073] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:41 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:41.768800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:41.768800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:41.777554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.778140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.778493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.779176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.779627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.780200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.792513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d8b08c0-a070-4ebb-9578-91ddf3277e58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.669641 Aug 21 01:20:41.793214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1308/3074] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:41 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:41.810479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:41.811298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:41.817736 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:41.833621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.834627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.835247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:41.837473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:41.838110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:41.841436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.102211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:42.116788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:42.118374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:42.119664 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68d27f29-79dc-4c27-9ce4-8d638b510afd tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.361271 Aug 21 01:20:42.137581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1767/3075] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:41 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:42.399350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:42.414426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a50e24d-ee11-4f12-8990-deea1a17895b tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.613857 Aug 21 01:20:42.432968 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1309/3076] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:41 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:42.526735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:42.527399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:42.541039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.543787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.544246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.545013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.545502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.545916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.578965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e98cac-7976-46ef-8708-58f0dc8198eb", "name": "network-vif-deleted", "tag": "6f0691fa-8e19-440b-89a6-5cd06624a3c8"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:42.601068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.606822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.607321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.639902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] Creating event network-vif-deleted:6f0691fa-8e19-440b-89a6-5cd06624a3c8 for instance 74e98cac-7976-46ef-8708-58f0dc8198eb on n-h1-master-1 Aug 21 01:20:42.645159 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-de04ac35-e29d-4218-8527-c043197e03bd req-2cbe1e46-707f-4e25-8739-632ec6b8984b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071104 Aug 21 01:20:42.646932 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1310/3077] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:20:42.751959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:42.762016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b81a8d85-4c8f-49f2-aa11-495d7a356182 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 200 len: 1432 microversion: 2.1 time: 0.240057 Aug 21 01:20:42.770103 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1768/3078] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:42 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 1432 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:42.803507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:42.803507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:42.815982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:42.817163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:42.821316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.825489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.828597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.828954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.829334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.829749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.833386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.833641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.833906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:42.834707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:42.835907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:42.836430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.031967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.040259 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19c4988b-06d7-4786-893e-9410bf7e71ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.255111 Aug 21 01:20:43.042206 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1311/3079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:42 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:43.148742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.149966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:43.168856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.170722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.171624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.180578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.198697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7bb92b9a-6a37-4532-b156-df409b8d9520 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.387015 Aug 21 01:20:43.199706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.200814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.203910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.209538 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1769/3080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:42 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:43.224275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "a0e520f1-9c2c-4d81-8968-f6843c1e140a"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "7a20a8ea-6567-42f9-94ca-f1db209ee871"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:43.243128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.243607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.244125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.299649 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Creating event network-vif-plugged:a0e520f1-9c2c-4d81-8968-f6843c1e140a for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:43.300241 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] Creating event network-vif-plugged:7a20a8ea-6567-42f9-94ca-f1db209ee871 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:43.312086 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9d88726c-6bda-4456-86a7-106be00c9620 req-b602bd7d-456a-4cc8-a244-e69590bd6837 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101186 Aug 21 01:20:43.312726 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1770/3081] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:43.442040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.444798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:43.457344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.462960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.466533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.467509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.468551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.473593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.653136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.674701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.676431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.677688 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c346796-9e7b-4066-a1af-4cc6fdcd8255 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.537623 Aug 21 01:20:43.681947 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1312/3082] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:43 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:43.797651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.797948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 74e98cac-7976-46ef-8708-58f0dc8198eb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:43.809617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.810144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.812809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.815943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.818610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.819235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.857864 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb HTTP/1.1 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '74e98cac-7976-46ef-8708-58f0dc8198eb'} Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:43.860167 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. Aug 21 01:20:43.864816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.866346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance 74e98cac-7976-46ef-8708-58f0dc8198eb could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:43.867469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95d79a33-5f80-4bd2-899d-2f7c8207c6f7 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb" status: 404 len: 111 microversion: 2.1 time: 0.077158 Aug 21 01:20:43.872749 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1313/3083] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:43 2022] GET /compute/v2.1/servers/74e98cac-7976-46ef-8708-58f0dc8198eb => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:20:43.882290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.883883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: eff1f14e-30e6-4660-9f1f-dc2276c62818] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:43.892253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.893036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.893622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.895142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.895807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:43.896525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:43.908367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:43.914138 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 HTTP/1.1 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: exception: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'eff1f14e-30e6-4660-9f1f-dc2276c62818'} Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:43.916053 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. Aug 21 01:20:43.921297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:43.922448 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11f55953-adc8-42e2-a7b9-0e7fc01326b4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.483052 Aug 21 01:20:43.922448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1771/3084] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:43 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:43.924206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance eff1f14e-30e6-4660-9f1f-dc2276c62818 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:43.925444 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9c6108be-e9ea-44d3-9a5c-9fcbb91a6c08 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818" status: 404 len: 111 microversion: 2.1 time: 0.049522 Aug 21 01:20:43.926004 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1314/3085] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:43 2022] GET /compute/v2.1/servers/eff1f14e-30e6-4660-9f1f-dc2276c62818 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:43.934035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97511faf-172b-4480-86ff-d3203ab0339f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.982548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97511faf-172b-4480-86ff-d3203ab0339f tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/23bc45c5-9d79-4154-8d3e-52c09266b97c" status: 204 len: 0 microversion: 2.1 time: 0.052194 Aug 21 01:20:43.983223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1772/3086] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:20:43 2022] DELETE /compute/v2.1/os-server-groups/23bc45c5-9d79-4154-8d3e-52c09266b97c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:20:43.991814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:43.992539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:43.999009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:43.999546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.000053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.000977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.001561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.001967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.031586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:44.064719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:44.065635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:44.081830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.083186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.084330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.086929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.089048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.090934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.523763 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5256579-66d1-4657-b9f5-10bcad8055df tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 204 len: 0 microversion: 2.1 time: 0.534956 Aug 21 01:20:44.525526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1315/3087] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:43 2022] DELETE /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:44.534093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:44.535143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:44.547376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:44.559670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.563248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.564252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.564689 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30ae4686-366c-49ef-9353-5d70901c272d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.502914 Aug 21 01:20:44.566238 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1773/3088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:44 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:44.568498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.569215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.572240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.580437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:44.581583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:44.597186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.599367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.599740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.600454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.603000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.603784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.819029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:44.826437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:44.828428 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ef3ce3c-c40c-4a51-a1f7-fad203051242 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.301409 Aug 21 01:20:44.829287 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1316/3089] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:44 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:44.833898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff1f14e-30e6-4660-9f1f-dc2276c62818", "name": "network-vif-deleted", "tag": "c880605c-ea4c-4827-8d31-201a9c606e58"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:44.834826 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7d27c74-fb47-4068-8e3e-daa52589ffde tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1472 microversion: 2.1 time: 0.267214 Aug 21 01:20:44.835583 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1774/3090] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:44 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:44.847265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.848418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.849122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.853464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:44.854279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:44.861243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.861942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.862530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.863385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.863986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.864558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.864906 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] Creating event network-vif-deleted:c880605c-ea4c-4827-8d31-201a9c606e58 for instance eff1f14e-30e6-4660-9f1f-dc2276c62818 on n-h1-master-1 Aug 21 01:20:44.873020 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7acb5bb1-5a54-4ed7-93a5-1209c313f6d6 req-a34775d3-a8d7-4480-b350-8d59ff5a3a84 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041542 Aug 21 01:20:44.874057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1317/3091] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:44.948754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:44.952627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:44.962312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.962806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.963238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:44.964613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:44.965092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:44.965515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.193223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:45.217302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:45.218881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:45.220099 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81f6600c-91ce-4469-8b8b-24676f0830f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.373961 Aug 21 01:20:45.220674 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1775/3092] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:44 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:45.532447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:45.546734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b3be9ac-e21f-44bb-a576-d2a69087efb4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.604270 Aug 21 01:20:45.548757 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1318/3093] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:44 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:45.585830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:45.586440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:45.599078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.599795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.600396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.601276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.601885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.602295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.851491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:45.853635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:45.856925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:45.863690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.864443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.865061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.866750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.867388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.867965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.878448 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c28c16d-e735-4e32-b13f-35dbed6c64fa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.296272 Aug 21 01:20:45.883478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1776/3094] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:45 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:45.897558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:45.898220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:45.917414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.918448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.919038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:45.920062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:45.920929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:45.921523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.139932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.155985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-460db142-510e-4b38-992e-cabff6db1169 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1472 microversion: 2.1 time: 0.271127 Aug 21 01:20:46.160227 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1777/3095] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:45 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:46.242303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.247057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:46.248635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:46.257546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.258436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.259165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.260182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.260305 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00d60b67-321e-424c-b5f1-4702ba3f869b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.411802 Aug 21 01:20:46.260834 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1319/3096] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:45 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:46.274004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.275118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.571718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:46.572331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:46.589555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.591940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.594187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.596707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.598969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.599444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.857002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.868283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.870831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.871989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33659872-043f-4531-86e9-aa2dd621f07a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1878 microversion: 2.42 time: 0.631343 Aug 21 01:20:46.888855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1778/3097] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:46 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1878 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:20:46.908841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:46.909840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:46.917556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.918883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.919542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.920537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:46.921629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:46.922277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:46.938047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:46.957034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c7ee971-683a-43b3-a4c2-2cb962596a49 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.388669 Aug 21 01:20:46.964431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1320/3098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:46 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:47.186071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:47.186715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:47.201197 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:47.213601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.218843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.219636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.221420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.226252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.227657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.251454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:47.265502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1f83fb4-f5de-4cbd-97ba-cf938b9319d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.357185 Aug 21 01:20:47.279716 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1779/3099] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:46 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:47.291543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:47.292544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:47.306576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.309922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.310708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.314371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.315803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.318328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.627069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:47.644392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8dad7850-da96-4361-bf70-8a6360505cba tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.360345 Aug 21 01:20:47.645990 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1780/3100] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:47 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:47.700355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:47.709202 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce67041b-2e31-4c49-adee-98ff83b5f34d tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1472 microversion: 2.1 time: 0.530454 Aug 21 01:20:47.712914 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1321/3101] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:47 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:47.896543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:47.897182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:47.899625 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:47.905002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.905858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.906298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.907030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.907441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:47.908209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:47.985590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:47.986203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:47.995721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:47.996205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.003261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.004233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.005613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.006236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.444979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:48.455279 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d871ed36-a127-43fb-9b30-ef4e78954a37 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.473395 Aug 21 01:20:48.456260 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1322/3102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:47 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:48.462530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:48.463498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:48.470979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.471676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.472258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.473251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.473849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.474418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.486493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:48.515182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:48.523381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:48.531855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2e9e875-db6c-4391-be5f-84e53fb66fe2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2832 microversion: 2.42 time: 0.639035 Aug 21 01:20:48.539075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1781/3103] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:20:47 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2832 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:48.551861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f732fd-f08f-4545-9ddd-111094e6b979", "name": "network-vif-deleted", "tag": "4d43ba82-7160-4ac1-86ef-6cab4b54268c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:48.575993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.576509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.578677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.607067 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] Creating event network-vif-deleted:4d43ba82-7160-4ac1-86ef-6cab4b54268c for instance 44f732fd-f08f-4545-9ddd-111094e6b979 on n-h2-master-1 Aug 21 01:20:48.619663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b5d6e0e4-3399-45b0-9609-d8d5a9ae2220 req-b29c17a9-7486-4ba3-ab37-de42600fe6a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078610 Aug 21 01:20:48.620205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1782/3104] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:48.629600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:48.633721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:48.646448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.646934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.647369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.648082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.648638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.648966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.741768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:48.744401 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:48.761933 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8de5687e-4f7c-4e3d-9fdf-9ddb704edef9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.304332 Aug 21 01:20:48.762520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1323/3105] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:48 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:48.774173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:48.775205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:48.799311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.802354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.802771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.803530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.803995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.804412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.899351 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ef88ec2-e17f-49ee-83af-3748b41bfaa5 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.277628 Aug 21 01:20:48.900328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1783/3106] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:20:48 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7/os-interface => generated 1829 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:20:48.906315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:48.906932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:48.935291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.936109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.936723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:48.937670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:48.938290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:48.939729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.010479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.016215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.017096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.018112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lazy-loading 'fault' on Instance uuid 44f732fd-f08f-4545-9ddd-111094e6b979 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:20:49.120120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0d38c6d9440e88565277af4433660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7a5bb4dadb4bfd80ab9793b96e8795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:49.132407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa1e7b80-efa1-46ed-80a2-3d43efbff6da tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 200 len: 1307 microversion: 2.1 time: 0.230648 Aug 21 01:20:49.132981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1784/3107] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:48 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:49.146367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d6ee5b-cb5b-4b7c-8712-71112533341d", "name": "network-vif-plugged", "status": "completed", "tag": "bec6bea7-c06c-43e1-b94e-784b60b77518"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:49.167028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.170768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.171577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.190240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] Creating event network-vif-plugged:bec6bea7-c06c-43e1-b94e-784b60b77518 for instance b9d6ee5b-cb5b-4b7c-8712-71112533341d on n-h2-master-1 Aug 21 01:20:49.195790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e6f4f4dc-ae49-4212-947e-94b4c0c27da0 req-11364572-c809-4abe-87e1-680314106202 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061544 Aug 21 01:20:49.197293 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1785/3108] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:49.477177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:49.477420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:49.490800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.491554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.491803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.492553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.493057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.493483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.808921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:49.821306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cc35562-fb02-4805-89e7-f0021ae2d33a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1520 microversion: 2.1 time: 0.349216 Aug 21 01:20:49.822769 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1786/3109] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:49 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:49.830617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:49.831531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:49.843041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.844468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.845120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.846011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:49.846638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:49.847621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:49.853561 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:49.940167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:49.953413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83f3c432-4d39-43cc-9051-3384e6ff0446 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 1.189397 Aug 21 01:20:49.977691 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1324/3110] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:48 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:50.091644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:50.103213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0d2baf7-653f-4cfb-bf99-fd6e98a947cf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.278821 Aug 21 01:20:50.104448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1787/3111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:49 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:50.158428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:50.159750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] [instance: 44f732fd-f08f-4545-9ddd-111094e6b979] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:50.167360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.168139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.168662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.169773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.170481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.170899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.186498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] HTTP exception thrown: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Request method failure captured: Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 HTTP/1.1 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeVKdr8YKh4WgQXT7OCtmtSzx4oTP1X-VKiOgRSN6pDY9BEABWeJgieV08y1OuYIp-hYt4UwTMhaQQsNIB81pTMZNP2fwfeH13xrCsB3Xais8j4zXpmLeDLmyzdcveCI7-sdPp3ZAD_y-FU3f7W8ge4kaLCSzJMRIajpTjq1BiW5Uo Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cf7a5bb4dadb4bfd80ab9793b96e8795", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cf7a5bb4dadb4bfd80ab9793b96e8795"}]}] Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cf7a5bb4dadb4bfd80ab9793b96e8795 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1329082307 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 01c0d38c6d9440e88565277af4433660 Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersOnMultiNodesTest-1329082307-project Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '44f732fd-f08f-4545-9ddd-111094e6b979'} Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:50.189098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. Aug 21 01:20:50.195069 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:50.196910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] Returning 404 to user: Instance 44f732fd-f08f-4545-9ddd-111094e6b979 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:50.197968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1fc199d3-4628-4a71-9722-084c8133ef28 tempest-ServersOnMultiNodesTest-1329082307 tempest-ServersOnMultiNodesTest-1329082307-project] 10.222.0.46 "GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979" status: 404 len: 111 microversion: 2.1 time: 0.044096 Aug 21 01:20:50.199089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1325/3112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:50 2022] GET /compute/v2.1/servers/44f732fd-f08f-4545-9ddd-111094e6b979 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:50.686672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "tag": "836feede-bb0f-4bf4-aa52-925140922dbc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:50.705778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.707371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.709571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.744688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] Creating event network-changed:836feede-bb0f-4bf4-aa52-925140922dbc for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:20:50.751335 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f81bab6e-05f1-418e-963b-5240064e252b req-e426ede8-5353-48c6-8405-e8743f63826c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068725 Aug 21 01:20:50.751947 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1788/3113] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:50.849461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:50.850304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:50.859115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.859596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.860029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.860754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.861222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.861633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.980154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:50.981054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:50.993382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.994181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.994773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:50.995997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:50.996628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:50.997212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.433423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:51.449439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec50d394-9216-440b-9b6d-11b1cb9e35ff tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1497 microversion: 2.1 time: 0.603554 Aug 21 01:20:51.450511 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1326/3114] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:50 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1497 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:51.463027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:51.466871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:51.484745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.485273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.485713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.490876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.493472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.494041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.586889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:51.599497 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd2b013e-8b48-41bd-8b12-c530e1b8a757 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1313 microversion: 2.1 time: 0.620844 Aug 21 01:20:51.614102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1789/3115] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:50 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:51.627554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c923fd-abe9-447e-81e9-84f40b5ae3f0", "name": "network-vif-plugged", "status": "completed", "tag": "da58a330-5698-41b8-979d-b3a8df711e9b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:51.640935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.641682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.642278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.656895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] Creating event network-vif-plugged:da58a330-5698-41b8-979d-b3a8df711e9b for instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 on n-h2-master-1 Aug 21 01:20:51.677491 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-19a7ab3d-964b-4699-9aa3-75215fd4a2bd req-54705336-98fb-4c79-b484-57c05c627ecb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057866 Aug 21 01:20:51.679253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1790/3116] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:51.688262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:51.694825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:51.695726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:51.702567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.703430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.704619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.706716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.707381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.708301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.757629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:51.805502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dcf920d6-6d64-48ae-bbcc-0a8d9aeaf942 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.122842 Aug 21 01:20:51.807321 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1791/3117] 10.222.0.46 () {58 vars in 1154 bytes} [Sun Aug 21 01:20:51 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:51.825783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:51.838710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:51.839575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:51.840414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:51.913408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Going to try to start instance {{(pid=122482) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 01:20:51.988246 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-70e2e605-fc72-433c-b58d-91dd9dc83334 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "POST /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88/action" status: 202 len: 0 microversion: 2.1 time: 0.171741 Aug 21 01:20:51.990192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1792/3118] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:51 2022] POST /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:20:52.019952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:52.021177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:52.031466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:52.032282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:52.032930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:52.033848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:52.034583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:52.035182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:52.232946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:52.245290 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26a99155-653f-407c-81af-24f6423a6f86 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.793237 Aug 21 01:20:52.249946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1327/3119] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:51 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:52.490559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:52.507528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ead469e6-0fc7-4aed-895f-e48e5a9b6c9e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1506 microversion: 2.1 time: 0.498808 Aug 21 01:20:52.508020 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1793/3120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:52 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:52.622130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:52.623680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:52.631142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:52.632032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:52.632697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:52.634601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:52.635491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:52.636049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.073714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:53.083426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e7ea537-3351-4040-b86f-01684590defa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1499 microversion: 2.1 time: 0.466890 Aug 21 01:20:53.084172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1328/3121] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:52 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1499 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:53.107168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:53.110641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:53.119585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.120638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.121266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.122220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.122878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.123373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.268626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:53.269495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:53.277153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.277797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.278329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.279188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.279965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.280512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.520754 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fcf9f0f1-28dc-4185-a856-c32f70ca1d50 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.416498 Aug 21 01:20:53.522510 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1794/3122] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:53 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:53.542600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:53.543342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:53.555065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.557151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.557808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.558737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:53.559379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:53.560080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:53.870467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:53.876129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:53.885550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87b3feaa-9dcd-4991-9eeb-8c57612ba2af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1314 microversion: 2.1 time: 0.621224 Aug 21 01:20:53.887043 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1329/3123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:53 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:53.887940 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9bcc6cc7-ff7f-4039-b1c3-a9434040a32e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1506 microversion: 2.1 time: 0.358230 Aug 21 01:20:53.900908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1795/3124] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:53 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:54.533606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:54.536592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:54.554141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.554865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.557916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:54.558876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.559791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.560883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:54.638236 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5cceb99e-5443-4732-a4d6-8ae8be8055af tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.109055 Aug 21 01:20:54.644378 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1330/3125] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:54 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:54.908116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:54.908904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:54.909325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:54.910009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:54.919627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.920147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.920568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.920898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:54.921100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.921525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:54.922007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.922500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.922903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:54.923026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:54.923602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:54.924693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.112863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:55.126818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c9674f2-d015-40ef-bee5-8a350161fc6e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1501 microversion: 2.1 time: 0.222879 Aug 21 01:20:55.128033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1796/3126] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:54 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1501 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:55.332850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:55.340712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21e2df36-6d69-4781-9dc5-2ed731da2f4a tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1510 microversion: 2.1 time: 0.435466 Aug 21 01:20:55.343640 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1331/3127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:54 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:55.354547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:55.355064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:55.372709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.373237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.374115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.375095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.375701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.376264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.411523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:20:55.504479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1931586711", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c2abf03d-8e55-4b5e-8d2e-ed8129184e54"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:55.561961 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad2c3da7-8047-44b2-8cf8-bcab11598b40 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 204 len: 0 microversion: 2.1 time: 0.216819 Aug 21 01:20:55.562979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1332/3128] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:20:55 2022] DELETE /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:20:55.573826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:55.587596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:55.588056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.servers [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Removing options 'limit' from query {{(pid=122483) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 21 01:20:55.588927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:55.590069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.590542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.591033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.591684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.592235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.594587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.602224 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d30f14a7-826b-4561-8834-090835d6ae1f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.035193 Aug 21 01:20:55.604469 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1333/3129] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:20:55 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:55.617321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:55.619922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:55.635538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.638861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.639490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.642836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] validate_networks() for [('c2abf03d-8e55-4b5e-8d2e-ed8129184e54', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:20:55.645950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.646235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.646668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.809751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:55.820614 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dda89a1a-9810-4b57-8446-54e0ff520707 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1507 microversion: 2.1 time: 0.207372 Aug 21 01:20:55.821739 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1334/3130] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:55 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:55.838974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:55.839849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:55.847118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.847507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.848114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:55.849330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:55.849784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:55.851062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.023016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:56.033116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8353eb0-231f-4527-805f-79945de27da8 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1510 microversion: 2.1 time: 0.210044 Aug 21 01:20:56.033999 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1335/3131] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:55 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:56.204396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:56.207145 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:56.207145 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:20:56.208581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.209262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.209738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.210482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.210935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.211354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.241151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ecfb6f5-1888-4b0f-bf7d-e70ef92d34f2 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.205787 Aug 21 01:20:56.241913 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1336/3132] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:20:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:56.247355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:56.250576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:56.256809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.257313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.257754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.258457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.258908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.259330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.348131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:20:56.348796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:20:56.349046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:20:56.349704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:20:56.350229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:20:56.361086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.361641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.362314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.363126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.363699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.364857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.385635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Getting quotas for project 16542ba8c29e4ed0a5565945c0f87334. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:20:56.396267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Getting quotas for user 302454d9f56c4899895e341b0ddc6e1a and project 16542ba8c29e4ed0a5565945c0f87334. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:20:56.411119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Going to run 2 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:20:56.413717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1360b7a0-7fc8-4d07-963e-1305080018cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:20:56.469936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=1360b7a0-7fc8-4d07-963e-1305080018cd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:20:56.556403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-001270e0-6780-4e69-ba54-89b488eb9151 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426842 Aug 21 01:20:56.557178 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1797/3133] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:20:56.568629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:56.573739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:56.587344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.588101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.595183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.595950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.596436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.597196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.775503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:56.792326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c20125e8-47fd-453b-b691-6d7f955b32fd tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1510 microversion: 2.1 time: 0.227539 Aug 21 01:20:56.797401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1798/3134] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:56 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:56.814701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:56.824168 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:56.824168 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:20:56.826255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.827491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.828146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.829375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.830454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.831499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.886360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8756ce45-2b31-4305-8f7d-19559299f114 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.084665 Aug 21 01:20:56.887744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1799/3135] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:20:56 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:56.896180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:56.902822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:56.903871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Searching by: {'deleted': False, 'project_id': '16542ba8c29e4ed0a5565945c0f87334'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:56.925597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.926535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.927597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.929710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:56.930557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:56.931271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:56.985303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7eb55efa-4b20-417c-9409-72b198c6a384 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.094600 Aug 21 01:20:56.987107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1800/3136] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:20:56 2022] GET /compute/v2.1/servers => generated 677 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:56.994458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:56.998162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:57.011782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.013003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.014120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.014739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-641b8fef-0164-4162-9cb2-d5df6f6cf2bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.770921 Aug 21 01:20:57.015773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1337/3137] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:56 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:57.016120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.016799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.017395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.023841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.024888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:57.036711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.037332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.038068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.038924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.039527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.040402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.283471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:57.295086 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0ffaba3-4559-4ffe-84af-2e51c43b6e00 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1511 microversion: 2.1 time: 0.306616 Aug 21 01:20:57.295855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1801/3138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:56 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:57.304446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.308417 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:57.308417 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:20:57.312686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.313768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.314426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.315434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.316373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.318185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.349274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8ae7809-dc55-461a-afe2-bce185f8e1a6 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050209 Aug 21 01:20:57.350014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1802/3139] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:57.355769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6217ab91-131a-4f76-8185-9b9e69603c94 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.356639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6217ab91-131a-4f76-8185-9b9e69603c94 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:57.448535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6217ab91-131a-4f76-8185-9b9e69603c94 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:57.459043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6217ab91-131a-4f76-8185-9b9e69603c94 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1220 microversion: 2.1 time: 0.107634 Aug 21 01:20:57.465843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1803/3140] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:57.480179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.486614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:57.499189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:20:57.543722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:57.559278 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6183d242-2ed8-4db7-9429-ee2e5a23ab06 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1507 microversion: 2.1 time: 0.540306 Aug 21 01:20:57.562075 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1338/3141] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1507 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:57.570194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.578112 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:57.578112 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:20:57.582446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.583165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.583768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.585650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.590048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.590676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.669362 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acdf04b6-f46c-4828-bf9d-b2efbb3737e5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.105793 Aug 21 01:20:57.673338 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1339/3142] 10.222.0.46 () {58 vars in 1194 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:57.694913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.698849 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:57.698849 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:20:57.700237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.704351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.704605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.705119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.705247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.705683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.705938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.706375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.706805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.706921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.707663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.708174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.767302 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50eaa404-6cbf-476b-b1f5-7a18e45cb1f5 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.083833 Aug 21 01:20:57.771378 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1340/3143] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:57.796107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:57.801733 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:57.801733 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:20:57.804004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.805069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.805823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.810436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:57.811363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:57.812541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:57.852946 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39fcea13-59ad-4537-a3ae-6c3f2f8316e3 tempest-ServicesAdminNegativeTestJSON-95320938 tempest-ServicesAdminNegativeTestJSON-95320938-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.067773 Aug 21 01:20:57.855278 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1341/3144] 10.222.0.46 () {58 vars in 1198 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:57.931242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:20:58.091762 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ed42155-fee3-456f-83c0-3ec3450e7a0f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.620164 Aug 21 01:20:58.096599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1804/3145] 10.222.0.46 () {58 vars in 1154 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:20:58.109655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:58.113344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:58.125054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-362cddb2-cc54-4fd4-b728-ddb0747c877b tempest-ServicesAdminNegativeTestJSON-840927092 tempest-ServicesAdminNegativeTestJSON-840927092-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:58.139643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.140538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.142698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.144480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.144740 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:20:58.144740 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:20:58.147274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.147794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.152833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-362cddb2-cc54-4fd4-b728-ddb0747c877b tempest-ServicesAdminNegativeTestJSON-840927092 tempest-ServicesAdminNegativeTestJSON-840927092-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7992efef4e984f01a1e0eda2eefe4b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455906e73f8b41e6be650330230baffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-362cddb2-cc54-4fd4-b728-ddb0747c877b tempest-ServicesAdminNegativeTestJSON-840927092 tempest-ServicesAdminNegativeTestJSON-840927092-project] Request method failure captured: Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYh2DrGwCyfKKOurfi89YUqxeie4J3gb-g79pg6h4mmNf-vjie1Mp2_uk_sL1bPwHC4nhrvzbm2j-dgKPF7OuvVsUONSQxS2OZEubQkS5Z32L2CvfJ0w8y4sxlIajRHxr24lESEip7GknFPSLeR7lFQyL4xa02X1Lqz_mTFlBT63OIc Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455906e73f8b41e6be650330230baffc Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-840927092 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455906e73f8b41e6be650330230baffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455906e73f8b41e6be650330230baffc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455906e73f8b41e6be650330230baffc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455906e73f8b41e6be650330230baffc"}]}] Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-840927092 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455906e73f8b41e6be650330230baffc Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-840927092 Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServicesAdminNegativeTestJSON-840927092-project Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7992efef4e984f01a1e0eda2eefe4b4e Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-840927092-project Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:20:58.172430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:20:58.181583 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:20:58.185630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-362cddb2-cc54-4fd4-b728-ddb0747c877b tempest-ServicesAdminNegativeTestJSON-840927092 tempest-ServicesAdminNegativeTestJSON-840927092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:20:58.187761 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-362cddb2-cc54-4fd4-b728-ddb0747c877b tempest-ServicesAdminNegativeTestJSON-840927092 tempest-ServicesAdminNegativeTestJSON-840927092-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.322373 Aug 21 01:20:58.212404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1342/3146] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:20:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 347 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:20:58.230917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:58.233096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:58.253528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.257287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.259157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.260424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.261249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b71868cf-ea5f-4e33-9927-f38208607c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.161339 Aug 21 01:20:58.266223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1805/3147] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:58 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:58.266432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.266432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.489993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:58.490608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:58.507237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.507753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.508488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.513299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.513835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.514346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.784936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:58.801903 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf5c0d89-e8c5-4d75-a922-d058980debc4 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1510 microversion: 2.1 time: 0.587523 Aug 21 01:20:58.802511 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1343/3148] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:58 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1510 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:58.819497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:58.820482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:58.840665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.841607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.841607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:58.843318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:58.845426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:58.850011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.139849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:59.159060 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0e0b41d-f032-4ab3-bf1a-8b6b56b370d9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1272 microversion: 2.1 time: 0.672389 Aug 21 01:20:59.160899 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1806/3149] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:58 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1272 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:20:59.171021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:59.171727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:59.188994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.190148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.205307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.207695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.208576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.209654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.498274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:59.504131 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:59.515539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27a2a956-ab36-46eb-bd0a-613c4d917ede tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1510 microversion: 2.1 time: 0.353275 Aug 21 01:20:59.516305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1807/3150] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:59 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:59.536477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:20:59.539023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:59.557398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.558074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.558518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.559297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.559751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.560846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.653324 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-933d5eef-7e17-420e-84ce-1fdb5092a0fa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.120671 Aug 21 01:20:59.657337 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1808/3151] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:20:59 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:20:59.669592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:20:59.670544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:20:59.691100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.694391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.694850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.695619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:20:59.696084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:20:59.703960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:20:59.957776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:20:59.965441 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:59.971485 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51184f10-f8cf-4cb8-8387-fd1f46eea6b0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 200 len: 1507 microversion: 2.1 time: 1.167867 Aug 21 01:20:59.979679 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1344/3152] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:58 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 1507 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:20:59.992682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:00.007738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d75cc4c-1fb4-4ca8-8f3b-7e7f6e6ac47d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1511 microversion: 2.1 time: 0.346246 Aug 21 01:21:00.008436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1809/3153] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:20:59 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:00.031473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:00.037401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:00.040141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:00.062881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c923fd-abe9-447e-81e9-84f40b5ae3f0", "name": "network-vif-deleted", "tag": "da58a330-5698-41b8-979d-b3a8df711e9b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:00.094445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.094962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.095412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.096178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.096703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.105539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.114913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.125474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.128588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.212478 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] Creating event network-vif-deleted:da58a330-5698-41b8-979d-b3a8df711e9b for instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 on n-h2-master-1 Aug 21 01:21:00.240954 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-24a5a0c8-e66e-4faf-b2dd-53925f2c6a9b req-2092d00d-943f-4cf9-8a20-3b028a59eebb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181524 Aug 21 01:21:00.243430 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1810/3154] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:00.279199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:00.281340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:00.303526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:00.309785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.310331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.310777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.316412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.318658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.319116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.461416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:00.470991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.472019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.472617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.494719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:00.505389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c8f1251-cdb4-49b5-bbbd-49e34b0ba15f tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1278 microversion: 2.1 time: 0.260592 Aug 21 01:21:00.506965 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1811/3155] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:00 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:00.664696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:00.667261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:00.676802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.677589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.678213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.678939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:00.679657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:00.680241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:00.775436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1c2ef229-860c-4a68-bb3c-17963e807d9c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.113863 Aug 21 01:21:00.777151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1812/3156] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:00 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:21:01.001536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:01.002288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:01.017432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:01.024597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:01.024597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:01.024597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:01.024597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:01.024597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:01.061790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 HTTP/1.1 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '79c923fd-abe9-447e-81e9-84f40b5ae3f0'} Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:01.074337 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:21:01.078719 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:01.082209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:01.083363 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de26d164-038f-499e-a3a2-1e8a71af3378 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 404 len: 111 microversion: 2.1 time: 0.088302 Aug 21 01:21:01.086837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1813/3157] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:00 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:21:01.255179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-971406183", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:01.348112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:21:01.531712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7061492-9751-4750-820e-a7fc6db6a0fb tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 1.505772 Aug 21 01:21:01.533363 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1345/3158] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:21:00 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:01.544684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:01.545622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:01.556734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:01.557269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:01.557714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:01.567038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:01.567767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:01.571981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:01.891714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:01.900331 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9da27a8f-024a-4051-be60-e7f2fa0999e8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1278 microversion: 2.1 time: 0.365694 Aug 21 01:21:01.904654 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1346/3159] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:01 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1278 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:01.917310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:01.925255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:01.933911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:02.000442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:21:02.001280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:21:02.001935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:21:02.002350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:21:02.002760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:21:02.023412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.023920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.024354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.025396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.025851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.026260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.075793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:21:02.103636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:21:02.139480 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:02.141245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:21:02.147669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:21:02.212715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c397234-31ce-42ad-8b7c-fa608c816ea4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961521 Aug 21 01:21:02.220220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1814/3160] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:21:02.221214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:02.228548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:02.241105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.241685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.245336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.249328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.250719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.251440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.412643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.413426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.414163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.415161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.416682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.417447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.434555 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6c35aa1-7935-422f-b857-29f3ef2864ea tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.218952 Aug 21 01:21:02.436156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1815/3161] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:02 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:21:02.444385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63c41c4e-d1f1-4bf8-96cd-72e47d40ddff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:02.451204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63c41c4e-d1f1-4bf8-96cd-72e47d40ddff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:02.602108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:02.640468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63c41c4e-d1f1-4bf8-96cd-72e47d40ddff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:02.649876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63c41c4e-d1f1-4bf8-96cd-72e47d40ddff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1214 microversion: 2.1 time: 0.211679 Aug 21 01:21:02.653277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1816/3162] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:02 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:02.709535 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cceda8e3-2623-43d9-a11a-15db8c9195e0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.802130 Aug 21 01:21:02.710022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1347/3163] 10.222.0.46 () {58 vars in 1150 bytes} [Sun Aug 21 01:21:01 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:02.726371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:02.737655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:02.738721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:02.747764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.748440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.749976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.751677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.752150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.752590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.930182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:02.930534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:02.931151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:02.940443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.940968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.941398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:02.942104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:02.942552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:02.942966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.002095 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fb9762c-4cc7-40e9-8541-edbce463af12 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.280282 Aug 21 01:21:03.010153 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1817/3164] 10.222.0.46 () {58 vars in 1212 bytes} [Sun Aug 21 01:21:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:03.015469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:03.021252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:03.021930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:03.027400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.027894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.028330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.030269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.030770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.031211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.167637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:03.205516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:03.222686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c8e6736-72c0-48a6-b81b-9cd50d2106f6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1278 microversion: 2.1 time: 0.295973 Aug 21 01:21:03.229387 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1348/3165] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:02 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1278 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:03.281770 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6478f7f0-22b5-42d0-b5fb-07c7ba0e250e tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.269856 Aug 21 01:21:03.283073 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1818/3166] 10.222.0.46 () {58 vars in 1196 bytes} [Sun Aug 21 01:21:03 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:03.296291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:03.303244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:03.304124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': '-632508991', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:03.313907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.316203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.316929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.318275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.319082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.319610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.489136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:03.572837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Action: 'update', calling method: .version_select at 0x7fc3f9df54c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:03.576000 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:03.576000 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:03.578871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.579594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.580271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.591244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.592402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.593514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.601414 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbf84d43-1943-4223-a9fc-8a69d5cfc98f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=-632508991" status: 200 len: 345 microversion: 2.1 time: 0.308456 Aug 21 01:21:03.604139 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] HTTP exception thrown: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.605703 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1349/3167] 10.222.0.46 () {58 vars in 1156 bytes} [Sun Aug 21 01:21:03 2022] GET /compute/v2.1/servers?name=-632508991 => generated 345 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Request method failure captured: Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c HTTP/1.1 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 56 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYh_IykK4UQxkiAazS1Om_8bMNrLCeeKLLJVCts1GxSlQxHSpSFrFZFoMsyT4LiQ6Zeg4tDzM_ymnJWA3IrbQimKvaCeQcpYU7ejByocsm4648JEKyJFvpbEkrN2KjhRnE3TEmL2-lLk0TbxME0qcwzonnrT_BKcAzB1hRu1z8lCNQA Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.53 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3db733b6fe74441cb1238ed1b58acff0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}] Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: de8d52caf8e746d9ba3a89a3d850e96a Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: exception: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9ba14f27-944e-43e9-ad15-9e9d19f4d63c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:21:03.607845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.615448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.617870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Returning 404 to user: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:03.618990 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b1b0bb1-3a2a-48da-b2ac-50d4a33cba93 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c" status: 404 len: 110 microversion: 2.53 time: 0.268944 Aug 21 01:21:03.624363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1819/3168] 10.222.0.46 () {62 vars in 1309 bytes} [Sun Aug 21 01:21:03 2022] PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c => generated 110 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:21:03.625909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:03.628250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:03.629013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:03.635208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:03.636141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:03.637978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.638802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.639782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.640838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.641815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.645413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.645567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.646306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.647619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.650557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.651752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.652380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.733891 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b334c6ec-d499-426c-b02c-e31852ae6828 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.124828 Aug 21 01:21:03.734925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1350/3169] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:03 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:21:03.742012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Action: 'update', calling method: .version_select at 0x7fc403122e50>, body: {"status": "disabled"} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:03.747232 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:03.747232 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:21:03.749565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.750350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.750782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.759644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.760248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.760676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.767216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:03.772288 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] HTTP exception thrown: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Request method failure captured: Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c HTTP/1.1 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 22 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYh_IykK4UQxkiAazS1Om_8bMNrLCeeKLLJVCts1GxSlQxHSpSFrFZFoMsyT4LiQ6Zeg4tDzM_ymnJWA3IrbQimKvaCeQcpYU7ejByocsm4648JEKyJFvpbEkrN2KjhRnE3TEmL2-lLk0TbxME0qcwzonnrT_BKcAzB1hRu1z8lCNQA Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.53 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3db733b6fe74441cb1238ed1b58acff0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}] Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: de8d52caf8e746d9ba3a89a3d850e96a Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: {"status": "disabled"} Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: exception: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '9ba14f27-944e-43e9-ad15-9e9d19f4d63c', 'body': {'status': 'disabled'}} Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:21:03.774345 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Returning 404 to user: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a64e7d0d-0b96-4836-87f9-a6ad5790032b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c" status: 404 len: 110 microversion: 2.53 time: 0.039977 Aug 21 01:21:03.778802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1351/3170] 10.222.0.46 () {62 vars in 1309 bytes} [Sun Aug 21 01:21:03 2022] PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c => generated 110 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:21:03.784119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:03.785443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:03.793459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.793953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.794594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.795517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.796268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.797023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.842185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26b194c5-a466-4486-af52-9300a355d699 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.221202 Aug 21 01:21:03.850865 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1820/3171] 10.222.0.46 () {58 vars in 1154 bytes} [Sun Aug 21 01:21:03 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:03.856118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Action: 'update', calling method: .version_select at 0x7fc3f8f7b5e0>, body: {"status": "enabled"} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:03.859619 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:03.859619 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:03.864223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.864790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.865265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.872997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.873615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.874050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.882246 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] HTTP exception thrown: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Request method failure captured: Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c HTTP/1.1 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 21 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYh_IykK4UQxkiAazS1Om_8bMNrLCeeKLLJVCts1GxSlQxHSpSFrFZFoMsyT4LiQ6Zeg4tDzM_ymnJWA3IrbQimKvaCeQcpYU7ejByocsm4648JEKyJFvpbEkrN2KjhRnE3TEmL2-lLk0TbxME0qcwzonnrT_BKcAzB1hRu1z8lCNQA Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.53 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3db733b6fe74441cb1238ed1b58acff0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3db733b6fe74441cb1238ed1b58acff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3db733b6fe74441cb1238ed1b58acff0"}]}] Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 3db733b6fe74441cb1238ed1b58acff0 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077 Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: de8d52caf8e746d9ba3a89a3d850e96a Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: {"status": "enabled"} Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: exception: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9ba14f27-944e-43e9-ad15-9e9d19f4d63c', 'body': {'status': 'enabled'}} Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:21:03.883996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Returning 404 to user: Service 9ba14f27-944e-43e9-ad15-9e9d19f4d63c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d2d09e1-e9c9-4229-9579-1399a6590c1c tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c" status: 404 len: 110 microversion: 2.53 time: 0.033494 Aug 21 01:21:03.889081 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1821/3172] 10.222.0.46 () {62 vars in 1309 bytes} [Sun Aug 21 01:21:03 2022] PUT /compute/v2.1/os-services/9ba14f27-944e-43e9-ad15-9e9d19f4d63c => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:21:03.891345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:03.897572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:03.898477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-63250899', 'deleted': False, 'project_id': '30ccb279d8144dd39f613a6b57f42067'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:03.909735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.910270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.910737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:03.911615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:03.912092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:03.912523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.026877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:04.047904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:04.069115 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d8d824a-fd2c-4771-8463-a0701bca15b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1266 microversion: 2.1 time: 0.291013 Aug 21 01:21:04.071300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1352/3173] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:03 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:04.083521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.087376 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.087376 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:21:04.090595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.095908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.096572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.097623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.102021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.102273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c52de258-5aad-4089-9f73-ff917938137c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-63250899" status: 200 len: 345 microversion: 2.1 time: 0.214537 Aug 21 01:21:04.102792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.103796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1822/3174] 10.222.0.46 () {58 vars in 1226 bytes} [Sun Aug 21 01:21:03 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-63250899 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:04.122698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.125114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:04.143910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.144428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.150717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.151732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.152208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.152636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.164810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6d31615-2173-4704-9604-f2d2387aa4ed tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.092057 Aug 21 01:21:04.165862 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1353/3175] 10.222.0.46 () {60 vars in 1178 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:04.178134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.180887 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.180887 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:21:04.182541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.183335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.183991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.184980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.185968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.187081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.195231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:04.216543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5556f32e-1b76-4ad7-ae72-de8fdff1242b tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041792 Aug 21 01:21:04.226681 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1354/3176] 10.222.0.46 () {60 vars in 1211 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:21:04.232734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.236313 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.236313 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:21:04.238295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.239093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.239786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.240875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.241701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.242377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.272339 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8e6881e4-a7f5-4483-8240-d082b5b67a2a tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044025 Aug 21 01:21:04.281318 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1355/3177] 10.222.0.46 () {60 vars in 1178 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:04.286942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.287731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:04.294710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.295555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.296341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.297402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.298117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.299083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.351449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ed728ae-dd3e-4eab-bf93-c4f7b211b93c tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 204 len: 0 microversion: 2.1 time: 0.238493 Aug 21 01:21:04.352061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1823/3178] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:04 2022] DELETE /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:04.357386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.360735 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.360735 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:04.361939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.362416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.362849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.363564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.364201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.364797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.391376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e05901b8-0da3-4ec1-9514-955d29020867 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.037799 Aug 21 01:21:04.392017 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1824/3179] 10.222.0.46 () {60 vars in 1235 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:04.396860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.397891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:04.404088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.404798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.405232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.405940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.406379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.406791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.555558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:04.565930 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f2375eb-3336-4297-a32c-8ad82547b91f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1517 microversion: 2.1 time: 0.172519 Aug 21 01:21:04.566871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1825/3180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:04.571924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.574684 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.574684 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:04.575929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.576687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.577276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.578010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.578458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.578875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.606175 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b33376ec-ea57-4e15-85c0-af3d1f6abca4 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038183 Aug 21 01:21:04.607016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1826/3181] 10.222.0.46 () {60 vars in 1178 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:04.619882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.622469 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.622469 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:04.623426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.624512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.625119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.625764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.626218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.626646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.652254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e51795d-59cd-473f-9ed8-4efe4a132b64 tempest-ServicesAdminNegativeV253TestJSON-47525077 tempest-ServicesAdminNegativeV253TestJSON-47525077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036774 Aug 21 01:21:04.653352 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1827/3182] 10.222.0.46 () {60 vars in 1239 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:04.775400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e7ffd54-62dd-4dc6-ad73-90a4057b371a tempest-ServicesAdminNegativeV253TestJSON-744514666 tempest-ServicesAdminNegativeV253TestJSON-744514666-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:04.777910 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:21:04.777910 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:21:04.778970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8e7ffd54-62dd-4dc6-ad73-90a4057b371a tempest-ServicesAdminNegativeV253TestJSON-744514666 tempest-ServicesAdminNegativeV253TestJSON-744514666-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '19660b367696400b98bb3b356039ab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7dad4a071034d3e940ee0a40771e14c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e7ffd54-62dd-4dc6-ad73-90a4057b371a tempest-ServicesAdminNegativeV253TestJSON-744514666 tempest-ServicesAdminNegativeV253TestJSON-744514666-project] Request method failure captured: Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYh9fA_Y7rmCxVMZj3a4L-2RcPVpdT9G7x_qM1pEQW7iRg_tQamuSBGnsgBQBSpvrDvd7CKxQ5t4C0y4Im82piswdeNgMtQuRRdDUGe9pIMfvmcxggLEUmc78-LMRUfs_swW8lQ9vOkwGnVxUAOUwdfCc-qoVFhpXWumAyHkANfqzpY Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.53 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: d7dad4a071034d3e940ee0a40771e14c Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-744514666 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d7dad4a071034d3e940ee0a40771e14c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d7dad4a071034d3e940ee0a40771e14c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d7dad4a071034d3e940ee0a40771e14c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d7dad4a071034d3e940ee0a40771e14c"}]}] Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-744514666 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: d7dad4a071034d3e940ee0a40771e14c Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-744514666 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServicesAdminNegativeV253TestJSON-744514666-project Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19660b367696400b98bb3b356039ab70 Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-744514666-project Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: action_args: {} Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise self.value Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 21 01:21:04.781473 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e7ffd54-62dd-4dc6-ad73-90a4057b371a tempest-ServicesAdminNegativeV253TestJSON-744514666 tempest-ServicesAdminNegativeV253TestJSON-744514666-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e7ffd54-62dd-4dc6-ad73-90a4057b371a tempest-ServicesAdminNegativeV253TestJSON-744514666 tempest-ServicesAdminNegativeV253TestJSON-744514666-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.121564 Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1828/3183] 10.222.0.46 () {60 vars in 1178 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 123 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:04.792495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:04.799457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.800071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.800467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.801186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:04.801797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:04.802054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:04.876092 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37a2d37f-ab10-438f-8875-229b1afbaaa1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.090884 Aug 21 01:21:04.879727 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1829/3184] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:04 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:21:04.926925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:04.940223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-621bd6d8-cf62-48c9-8db1-13d7d458cdd1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.657385 Aug 21 01:21:04.942502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1356/3185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:04 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:05.099808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:05.102636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:05.114815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.115744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.116372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.117270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.118418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.119895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.142166 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:05.262625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:05.276460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf461a20-2b85-4a23-9772-f116128799c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1272 microversion: 2.1 time: 0.184361 Aug 21 01:21:05.290428 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1830/3186] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:05 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:05.588391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:05.589292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:05.597528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.597983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.598951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.599492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.600110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.600594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.887976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:05.890569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:05.902541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.903055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.903980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.904833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:05.905975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:05.906403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:05.994097 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f0fb9d0-2f0a-4b80-a0f8-0f60bf784efc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 14 microversion: 2.1 time: 0.109707 Aug 21 01:21:06.002393 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1831/3187] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:05 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:21:06.015455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:06.016908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:06.027290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:06.027870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:06.028411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:06.029600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:06.030169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:06.030840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:06.285582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:06.298884 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d97155e6-874f-4dfa-9692-1e6707b4ec5a tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.295062 Aug 21 01:21:06.301023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1832/3188] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:06 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:06.308823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1360b7a0-7fc8-4d07-963e-1305080018cd", "tag": "0e1a297d-d8f7-4373-b560-c76966002320"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:06.325646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:06.326964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:06.328577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:06.354030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] Creating event network-changed:0e1a297d-d8f7-4373-b560-c76966002320 for instance 1360b7a0-7fc8-4d07-963e-1305080018cd on n-h1-master-1 Aug 21 01:21:06.362283 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f2496f70-bb92-4912-8b8b-5ab962b6cd11 req-ada1b5d5-0bc0-491d-928a-a193d0ba0a0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059390 Aug 21 01:21:06.363932 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1833/3189] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:06.372724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:06.377801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:06.386951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:06.388391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:06.389179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:06.390135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:06.391068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:06.392537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:06.493342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:06.508600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:06.536463 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a3c122d-fa51-445c-acce-f84e6c17ea8b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1272 microversion: 2.1 time: 0.170913 Aug 21 01:21:06.537090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1834/3190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:06 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:06.547722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dc0bd91-1b00-4974-9983-4fa1504c3882 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1517 microversion: 2.1 time: 0.949231 Aug 21 01:21:06.548472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1357/3191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:05 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1517 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:07.325279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:07.326979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:07.353181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.355568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.356287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.360993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.361939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.363385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.394910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:07.402062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:07.417797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.418562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.419187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.420646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.421583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.422196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.515035 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d6e587f-ae14-4af6-b36e-22b033b48d7c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action" status: 200 len: 16395 microversion: 2.1 time: 0.508299 Aug 21 01:21:07.521913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1835/3192] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:07 2022] POST /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d/action => generated 16395 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:21:07.532070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:07.533098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:07.547327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.548049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.548784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.550511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.554950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.554950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.874829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:07.888972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc31d6f6-2084-470d-8672-7d2772bdf4c2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.365146 Aug 21 01:21:07.891673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1836/3193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:07 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:07.897537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:07.898353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:07.907659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.909762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.910397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:07.911123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:07.911728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:07.912303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.183458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:08.203526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-793fa85c-fa36-4774-9736-bce9e0ee74b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.309705 Aug 21 01:21:08.206046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:08.217419 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1837/3194] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:07 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:08.221450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1caee859-7d48-4d43-ad47-0c70ab790515 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.899924 Aug 21 01:21:08.222961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:08.223693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1358/3195] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:07 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:08.224087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:08.239399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:08.240087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:08.247092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.248322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.249173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.250143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.250914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.251508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.252180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.256612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.257252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.258292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.258459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.263113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.353146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:08.364452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48b468be-ef1e-4e91-998e-026879a44582 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 200 len: 1475 microversion: 2.1 time: 0.145437 Aug 21 01:21:08.388452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lazy-loading 'services' on Instance uuid 3b529918-528f-4ae1-8f5b-552174a5c2e9 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:21:08.389414 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1838/3196] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:08 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:08.397487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:08.399172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:08.407722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.408919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.410318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.411497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.412111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.412674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.505857 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-436033ef-691a-4582-8861-f11077a3a7cd tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments/53532cd8-4dc7-440f-ba31-33a0144dff86" status: 202 len: 0 microversion: 2.1 time: 0.280006 Aug 21 01:21:08.506664 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1359/3197] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:21:08 2022] DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments/53532cd8-4dc7-440f-ba31-33a0144dff86 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:08.538120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a67d0-9b76-48e5-a439-0c89cf9a136b", "tag": "53644bab-c4dd-42be-9146-bb76d2599c4c"}, {"server_uuid": "2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5", "name": "network-vif-deleted", "tag": "f5eaf974-d899-4153-9703-36fb8c971b8a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:08.570775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.573850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.576514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.612988 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Creating event network-changed:53644bab-c4dd-42be-9146-bb76d2599c4c for instance 1f6a67d0-9b76-48e5-a439-0c89cf9a136b on n-h1-master-1 Aug 21 01:21:08.613868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] Creating event network-vif-deleted:f5eaf974-d899-4153-9703-36fb8c971b8a for instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 on n-h1-master-1 Aug 21 01:21:08.630637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e26136ac-73d3-42d3-89be-ca7f311c5c81 req-1b6f3b20-b3c5-43d5-8ea6-617131b3e7ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122158 Aug 21 01:21:08.631559 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1360/3198] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:08.759912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:08.771799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24bc3d42-f599-49b7-90ba-50379bfb6798 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.380498 Aug 21 01:21:08.772437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1839/3199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:08 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:08.798498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:08.799511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:08.810842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.814318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.815668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:08.817515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:08.818644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:08.819993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.230590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:09.231814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:09.254215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.257365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.258077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.260310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.264110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.267240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.394066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:09.427433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6acd6af2-579a-4819-ab7a-f674c09a9c0b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.634316 Aug 21 01:21:09.428733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1361/3200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:08 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:09.446513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:09.447744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:09.462660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.468711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.469510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.470416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.472553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.473187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.860404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:09.871842 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fcbd2bc8-6f84-4e47-9e4b-e9f43a1b3476 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.646152 Aug 21 01:21:09.874045 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1840/3201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:09 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:09.884947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:09.894961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:09.906835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.907614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.908228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.909199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.910145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:09.910784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:09.954883 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] HTTP exception thrown: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Request method failure captured: Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 HTTP/1.1 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYgyZX_EHvUCoToVaNDgOAnoE8Wicob4UJVZlW5AbcPbgDNj9bR6xUVzcEDVDZHT4KCQ9bqvM0mI4Ka6chX6okbL0comci1Hd8cLkUjEQRULJ5WHi2kiVtWsWx72S87easo1akQoWZ-UId4Mqnwsux3V0EkYH9WjBhPjeHzjDLXkLV4 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30ccb279d8144dd39f613a6b57f42067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}] Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 0c247647f8e34c638bec5e68826171e5 Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5'} Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:09.956999 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. Aug 21 01:21:09.961297 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:09.965716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Returning 404 to user: Instance 2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:09.969138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-78637761-d43f-4cd4-ae4f-f023a30ff6c5 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5" status: 404 len: 111 microversion: 2.1 time: 0.093788 Aug 21 01:21:09.970305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1841/3202] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:09 2022] GET /compute/v2.1/servers/2bfc98f7-5c8c-4a01-a471-6d5c0ce868a5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:21:09.975281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:09.979220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:09.995646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:09.999375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.000120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.001123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.002894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.003598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.293021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:10.308378 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2087c44-9c4d-4814-be9f-aa044216c0cf tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.333681 Aug 21 01:21:10.309216 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1842/3203] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:09 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:10.321970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:10.324833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:10.343681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.344746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.349447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.350736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.351581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.352362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.406956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:10.459827 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:10.521632 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ade94804-6981-481f-8384-0859dcd291c0 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 204 len: 0 microversion: 2.1 time: 0.209120 Aug 21 01:21:10.523134 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1843/3204] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:10 2022] DELETE /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:10.531477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:10.532300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:10.553375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.560272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.562589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.564146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.564829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.565564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.642223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Locking {{(pid=122482) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 21 01:21:10.692084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:10.700260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6c14f5d-4a54-4fde-a79b-2784e1180f27 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 1.268187 Aug 21 01:21:10.705382 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1362/3205] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:09 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:10.710418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:10.716681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:10.723761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.724571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.733873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.735051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.735679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.736280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.736412 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:10.742249 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:10.750031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3822b692-10ef-4d89-8d7b-db725e49aae3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.222471 Aug 21 01:21:10.752384 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1844/3206] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:10 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:10.771299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af65ae9b-2b7b-4c5e-875e-dc47908eb81c", "tag": "6316247a-e464-4d2e-8978-2e6b72d14277"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:10.818048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.818182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.819406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.853673 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] Creating event network-changed:6316247a-e464-4d2e-8978-2e6b72d14277 for instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c on n-h1-master-1 Aug 21 01:21:10.869482 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1b0f63f0-86f2-4386-b88d-b9b29ce64473 req-21f05bf6-c95b-482f-8a45-7c0af7e94512 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108109 Aug 21 01:21:10.870670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1845/3207] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:10.888913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:10.889878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:10.908355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.909090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.911710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:10.914780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:10.917520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:10.918034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.377482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:11.389131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c2c534b-dbf1-4e60-a621-995cb03be21c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.515113 Aug 21 01:21:11.391458 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1846/3208] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:10 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:11.405336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:11.408280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:11.419550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:11.421525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.422295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.422944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.424491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.425175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.425761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.438057 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8d91d4b0-caf0-4daf-affb-bce33c7e5134 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1516 microversion: 2.1 time: 0.731395 Aug 21 01:21:11.439241 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1363/3209] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:10 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1516 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:11.452582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:11.455036 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:11.469619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.470626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.471919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.562896 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action HTTP/1.1 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 15 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: {"os-stop": {}} Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a2fef0cb-cc28-4d9a-87b7-e9d315f3980b', 'body': {'os-stop': {}}} Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked Aug 21 01:21:11.565352 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:11.572031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 409 to user: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b is locked {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:11.573168 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2674fa53-62b9-44e8-aefe-0abf02db4644 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 409 len: 107 microversion: 2.1 time: 0.132658 Aug 21 01:21:11.574265 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1364/3210] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:11 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 107 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:21:11.584646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:11.585565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:11.595500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.596253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.596983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.597913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.598665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.600031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.690465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Unlocking {{(pid=122483) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 21 01:21:11.824692 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-836ea4af-cb20-4beb-93ef-3d68fc5a1dc8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.246011 Aug 21 01:21:11.826392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1365/3211] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:11 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:11.839300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:11.840315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:11.849893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.850807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.851242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.852229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:11.852749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:11.853252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:11.980022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:11.992459 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d17ee0f6-aa55-45a6-ac34-9671a50a0b96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.596666 Aug 21 01:21:11.993496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1847/3212] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:11 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:12.002080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:12.010490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:12.011386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:12.012043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:12.056200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:21:12.147496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c758801-bc44-4b92-ade7-0e7f75d71e28 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.149798 Aug 21 01:21:12.148877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1848/3213] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:11 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:12.164632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:12.166223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:12.199866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:12.203765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:12.204458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:12.209234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:12.209807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:12.210425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:12.352993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:12.364530 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97089c30-7aaa-465c-bbca-38b294537e17 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.535297 Aug 21 01:21:12.365155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1366/3214] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:11 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:12.469712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:12.470493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:12.485239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:12.485766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:12.490474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:12.491567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:12.492071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:12.492487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:12.543958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:12.554001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5084aa9-182b-4da7-aa44-ab840ae48152 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.396887 Aug 21 01:21:12.560021 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1849/3215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:12 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:12.986482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:12.999673 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8e0afcb2-2ea1-4b6d-a1d3-d906fc450c90 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1516 microversion: 2.1 time: 0.534663 Aug 21 01:21:13.001043 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1367/3216] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:12 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:13.018374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:13.019009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:13.029071 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=16 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:13.030983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.034067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.034616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:13.035420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.035833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.039204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:13.389186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:13.390587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:13.400268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.401395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.402302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:13.403429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.404118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.404884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:13.716303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:13.729207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b190d8a1-b3e1-4003-a2c1-7ded4549b139 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.347245 Aug 21 01:21:13.746065 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1368/3217] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:13 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:13.755939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:13.757455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:13.769625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.770692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.771705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:13.772732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:13.773538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:13.774933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.067480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:14.079141 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e044bc75-1977-4c50-bb68-07114604ee1c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.329600 Aug 21 01:21:14.080502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1369/3218] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:14.086008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1360b7a0-7fc8-4d07-963e-1305080018cd", "name": "network-vif-plugged", "status": "completed", "tag": "0e1a297d-d8f7-4373-b560-c76966002320"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:14.097072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.097866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.098448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.113417 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] Creating event network-vif-plugged:0e1a297d-d8f7-4373-b560-c76966002320 for instance 1360b7a0-7fc8-4d07-963e-1305080018cd on n-h1-master-1 Aug 21 01:21:14.122050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7339ed3b-8869-496d-8e3b-d2f036b48652 req-f02cdb02-d664-4a72-b5ae-ee4fcd866e9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039690 Aug 21 01:21:14.123410 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1370/3219] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:14.137659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:14.142360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:14.164438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.165385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.165828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.166559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.167043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.167403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.252865 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=22 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:14.301043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:14.315125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-41c867cd-241d-47b1-bdaa-9e9742cf7a97 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 200 len: 1474 microversion: 2.1 time: 0.182163 Aug 21 01:21:14.316380 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1371/3220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:14 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 1474 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:14.324689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3039f082-a793-4be2-b9d4-90faa6e79f6e", "name": "network-vif-deleted", "tag": "db592c0a-7268-4e4a-b8a7-c243e305a5ce"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:14.337336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.337828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.338249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.356999 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] Creating event network-vif-deleted:db592c0a-7268-4e4a-b8a7-c243e305a5ce for instance 3039f082-a793-4be2-b9d4-90faa6e79f6e on n-h2-master-1 Aug 21 01:21:14.365597 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-780e3f3c-924c-4c17-ad96-75d881a1d3ab req-a1a20ae2-6a8c-4348-8fbf-3a5c677c3367 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047301 Aug 21 01:21:14.367848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1372/3221] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:14.383963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:14.405227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9de6ee61-d2f7-4fed-ad68-b766ac8c1075 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 1.392896 Aug 21 01:21:14.409456 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1850/3222] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:13 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:14.756590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:14.758124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:14.776748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.777799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.778545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:14.779602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:14.780287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:14.781276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.109059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:15.109966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:15.128710 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=32 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:15.145613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.148156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.149428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.151711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.153857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.154604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.372025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:15.382200 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-986362bf-6545-4292-853f-a7fc59716eb6 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.630206 Aug 21 01:21:15.389761 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1373/3223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:14 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:15.404733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:15.405856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: 3039f082-a793-4be2-b9d4-90faa6e79f6e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:15.423985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.428002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.428855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.429963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.434240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.434978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.468197 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] HTTP exception thrown: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Request method failure captured: Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e HTTP/1.1 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYgyZX_EHvUCoToVaNDgOAnoE8Wicob4UJVZlW5AbcPbgDNj9bR6xUVzcEDVDZHT4KCQ9bqvM0mI4Ka6chX6okbL0comci1Hd8cLkUjEQRULJ5WHi2kiVtWsWx72S87easo1akQoWZ-UId4Mqnwsux3V0EkYH9WjBhPjeHzjDLXkLV4 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30ccb279d8144dd39f613a6b57f42067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}] Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c247647f8e34c638bec5e68826171e5 Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '3039f082-a793-4be2-b9d4-90faa6e79f6e'} Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:15.473837 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. Aug 21 01:21:15.478802 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:15.480380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Returning 404 to user: Instance 3039f082-a793-4be2-b9d4-90faa6e79f6e could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:15.485914 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6172e64-bac6-4cf8-9f01-96eafc50e242 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e" status: 404 len: 111 microversion: 2.1 time: 0.090337 Aug 21 01:21:15.486969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1374/3224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:15 2022] GET /compute/v2.1/servers/3039f082-a793-4be2-b9d4-90faa6e79f6e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:21:15.495777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:15.509695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:15.517223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.518226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.518930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.519961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.521021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.521899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.618971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:15.649639 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1c940bd5-68b6-49cb-8336-4da5985ba642 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.547449 Aug 21 01:21:15.656843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1851/3225] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:15 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:15.682795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:15.684541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:15.725078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.725645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.728435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.729241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:15.731667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:15.732148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:15.799232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:15.855913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:15.882573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-73d1a530-6b6b-4ee4-8364-65637eb047bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.391380 Aug 21 01:21:15.885942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1375/3226] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:15 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:15.981600 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:15.998843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca616732-948f-4356-922a-293237bbeb09 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "DELETE /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 204 len: 0 microversion: 2.1 time: 0.338052 Aug 21 01:21:15.999654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1852/3227] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:15 2022] DELETE /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:16.008122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:16.008749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:16.018301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.023886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.026038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.026979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.027491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.030901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.409804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:16.410963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:16.433555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.449378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.456477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.457666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.458297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.458744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.820539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:16.834753 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-792b04a7-7446-4185-96d8-284da256551d tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1516 microversion: 2.1 time: 0.830379 Aug 21 01:21:16.835901 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1376/3228] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:16 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1516 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:16.844597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:16.845811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:16.857335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.858543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.860384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.863737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.865547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:16.866553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:16.897664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:16.930450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a282de54-5585-42a9-b0af-a39546dc38a3 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.525435 Aug 21 01:21:16.945854 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1853/3229] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:16 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:16.965176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:16.966525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:16.985155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:16.989184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.002652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.005197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.005886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.006886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.355056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:17.365546 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0edd8657-871e-4e42-9667-6829a854f65a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.528098 Aug 21 01:21:17.366197 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1377/3230] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:16 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:17.469321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:17.490215 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-481c7e58-fd9e-4564-b65c-0794fbd5adaf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.539120 Aug 21 01:21:17.491714 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1854/3231] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:16 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:17.579892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:17.593060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.594674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.595135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.639901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Going to try to stop instance {{(pid=122483) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:21:17.687096 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:17.714881 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-299542c0-303b-4e46-b31f-1f078293b846 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action" status: 202 len: 0 microversion: 2.1 time: 0.139934 Aug 21 01:21:17.718191 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1378/3232] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:17 2022] POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:17.727909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:17.729132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:17.743156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.744047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.744760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.747635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.748985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.750506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.863380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:17.864864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:17.879089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.881583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.882326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:17.883400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:17.884163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:17.885171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.131374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:18.151075 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8da8540-77ca-4dcd-8b85-e62c1147aa72 tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1516 microversion: 2.1 time: 0.295205 Aug 21 01:21:18.154661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1379/3233] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:17 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1516 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:18.164392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:18.169009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:18.183225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.183928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.185130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.186124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.186692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.187269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.334955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:18.345268 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fb1fe4e-b034-464b-942e-8fcaec05c648 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.622901 Aug 21 01:21:18.346509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1855/3234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:17 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:18.354166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a67d0-9b76-48e5-a439-0c89cf9a136b", "name": "network-vif-plugged", "status": "completed", "tag": "53644bab-c4dd-42be-9146-bb76d2599c4c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:18.368678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.369440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.370522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.396754 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] Creating event network-vif-plugged:53644bab-c4dd-42be-9146-bb76d2599c4c for instance 1f6a67d0-9b76-48e5-a439-0c89cf9a136b on n-h1-master-1 Aug 21 01:21:18.406570 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e43431ac-0ab1-47b9-bbc1-b19321c0a004 req-2153a19c-1c3a-47d7-9b8c-890c62b93814 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057427 Aug 21 01:21:18.407648 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1856/3235] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:18.428285 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:18.431855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:18.468757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.469797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.472119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.473224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.473937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.474902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.635697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:18.652897 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bf8e0f1-28b6-4c5a-9d48-853007d06d78 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.496390 Aug 21 01:21:18.654922 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1380/3236] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:18 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:18.663146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:18.664167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:18.680379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.682676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.684643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.686044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.689950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.690599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.825304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:18.874705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5fcdc94f-2d71-4c93-9011-ba4ad5bc7ca2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.464774 Aug 21 01:21:18.876045 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1857/3237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:18 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:18.882431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4a7ce9-b4a1-4069-bf56-21ec641b0d88", "name": "network-vif-deleted", "tag": "5bdfa04d-6fbc-4e8f-8528-ef1c840306a4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:18.904610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:18.908690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:18.910516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:18.929330 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] Creating event network-vif-deleted:5bdfa04d-6fbc-4e8f-8528-ef1c840306a4 for instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 on n-h1-master-1 Aug 21 01:21:18.963584 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a9e591e2-77b0-4804-97d3-a04397f3a5c5 req-900ba67b-20bc-492f-87e6-7eb16290a41a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074849 Aug 21 01:21:18.988857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1858/3238] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:19.119016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:19.129585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8b700d9-a1b4-4e93-a2e4-673c328be4a5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.471375 Aug 21 01:21:19.134910 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1381/3239] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:18 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:19.175810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:19.176987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:19.192453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.193046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.194926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.196243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.198053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.198518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.259165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.260270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.261944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.262677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lazy-loading 'fault' on Instance uuid df4a7ce9-b4a1-4069-bf56-21ec641b0d88 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:21:19.370117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:19.371066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:19.384649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.385487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.386090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.386983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.393568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.394517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.552834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c247647f8e34c638bec5e68826171e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ccb279d8144dd39f613a6b57f42067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:19.573586 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68401356-58aa-4db9-83c8-fbedce30961f tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 200 len: 1310 microversion: 2.1 time: 0.402466 Aug 21 01:21:19.576548 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1859/3240] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:19 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:19.675327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:19.675959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:19.713341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.713931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.715079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.719731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:19.720286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:19.720969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:19.819671 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:19.957710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:19.978038 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13fabbb9-7bfb-4481-9240-23dba73355b4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.606740 Aug 21 01:21:19.981320 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1382/3241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:19 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:19.999879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:20.003138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:20.044940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.045939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.047162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.052138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.054345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.054998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.281854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:20.291538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b056920-9bee-46da-b50a-5b3434dc1374 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1320 microversion: 2.1 time: 0.621173 Aug 21 01:21:20.304374 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1860/3242] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:19 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:20.322948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:20.324144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:20.336803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.337312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.337753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.338476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.343592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.344079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.385888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:20.411066 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de205837-0735-4944-aaa2-06d5b178f3e8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.428658 Aug 21 01:21:20.411986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1383/3243] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:19 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:20.602002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:20.603522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] [instance: df4a7ce9-b4a1-4069-bf56-21ec641b0d88] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:20.613570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.614609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.615289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.616281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:20.616981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:20.617476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:20.633307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] HTTP exception thrown: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Request method failure captured: Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 HTTP/1.1 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYgyZX_EHvUCoToVaNDgOAnoE8Wicob4UJVZlW5AbcPbgDNj9bR6xUVzcEDVDZHT4KCQ9bqvM0mI4Ka6chX6okbL0comci1Hd8cLkUjEQRULJ5WHi2kiVtWsWx72S87easo1akQoWZ-UId4Mqnwsux3V0EkYH9WjBhPjeHzjDLXkLV4 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30ccb279d8144dd39f613a6b57f42067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30ccb279d8144dd39f613a6b57f42067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30ccb279d8144dd39f613a6b57f42067"}]}] Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 30ccb279d8144dd39f613a6b57f42067 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-652220042 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c247647f8e34c638bec5e68826171e5 Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServerFiltersTestJSON-652220042-project Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: exception: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'df4a7ce9-b4a1-4069-bf56-21ec641b0d88'} Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:20.635349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. Aug 21 01:21:20.641002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:21:20.642632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] Returning 404 to user: Instance df4a7ce9-b4a1-4069-bf56-21ec641b0d88 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:20.643734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-78605f27-714a-4d17-932f-cc1cc0ecbcbe tempest-ListServerFiltersTestJSON-652220042 tempest-ListServerFiltersTestJSON-652220042-project] 10.222.0.46 "GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88" status: 404 len: 111 microversion: 2.1 time: 0.049906 Aug 21 01:21:20.644391 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1384/3244] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:20 2022] GET /compute/v2.1/servers/df4a7ce9-b4a1-4069-bf56-21ec641b0d88 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:21:20.661714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:20.673115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92b8261f-70ed-43d3-9698-36d96aa8a4bb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.366973 Aug 21 01:21:20.674261 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1861/3245] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:20 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:21.000464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:21.001119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:21.015524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.016026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.016470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.017225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.017690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.018124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.323687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:21.324570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:21.345375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.346114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.346732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.347474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.347935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.348359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.495049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:21.514932 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e4145345-eb10-4c7b-9eb1-2108d800caa7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.515937 Aug 21 01:21:21.515806 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1385/3246] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:20 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:21.570395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:21.571461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:21.582619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.583018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.583470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.584184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.585494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:21.588190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.590464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.597705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0e8dd03-f096-4f52-92a6-b7183f4b163b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 200 len: 1508 microversion: 2.1 time: 0.277871 Aug 21 01:21:21.601389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1862/3247] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:21 2022] GET /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:21.620435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:21.621975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1360b7a0-7fc8-4d07-963e-1305080018cd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:21.637805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.639555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.640213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.641527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.642202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.642863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.846450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:21.859808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b27aa10-2810-40ba-b37c-1305da317d77 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/1360b7a0-7fc8-4d07-963e-1305080018cd" status: 200 len: 1509 microversion: 2.1 time: 0.244857 Aug 21 01:21:21.860699 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1863/3248] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:21 2022] GET /compute/v2.1/servers/1360b7a0-7fc8-4d07-963e-1305080018cd => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:21.865863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:21.866668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:21.877515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.878226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.879655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.881142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:21.881766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:21.882797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:21.979663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:21.997629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4a449592-9616-45e8-9b7f-a9ce4bc20ab3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.468539 Aug 21 01:21:22.013727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1386/3249] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:21 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:22.027702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:22.030441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1360b7a0-7fc8-4d07-963e-1305080018cd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:22.049553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.053560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.054653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.055666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.056397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.060418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.128887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:22.130238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1360b7a0-7fc8-4d07-963e-1305080018cd] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:22.141870 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-299b5be2-4f1c-4437-bdc8-d8b21e3f3a6a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.279073 Aug 21 01:21:22.143035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1864/3250] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:21 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:22.155378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af65ae9b-2b7b-4c5e-875e-dc47908eb81c", "name": "network-vif-plugged", "status": "completed", "tag": "6316247a-e464-4d2e-8978-2e6b72d14277"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:22.169043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.170852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.171653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.195819 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] Creating event network-vif-plugged:6316247a-e464-4d2e-8978-2e6b72d14277 for instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c on n-h1-master-1 Aug 21 01:21:22.204184 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-edbbb167-ef52-4e7b-912e-3841a9582aa3 req-5441f72a-d14a-4318-919b-7dbc1b3890ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055534 Aug 21 01:21:22.205247 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1865/3251] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:22.324470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b4ac983-61ec-41b5-806f-cde999cbd3f2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1360b7a0-7fc8-4d07-963e-1305080018cd" status: 204 len: 0 microversion: 2.1 time: 0.308265 Aug 21 01:21:22.325996 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1387/3252] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:22 2022] DELETE /compute/v2.1/servers/1360b7a0-7fc8-4d07-963e-1305080018cd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:22.335182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:22.336345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:22.343418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.344522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.345511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.346996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.347716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.348473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.392189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 1f6a67d0-9b76-48e5-a439-0c89cf9a136b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:22.543333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:22.544098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:22.554928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.555434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.555859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.559949 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcf05c48-9495-4d2c-bdd7-47b406240c8b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b" status: 204 len: 0 microversion: 2.1 time: 0.227635 Aug 21 01:21:22.560627 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1866/3253] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:22 2022] DELETE /compute/v2.1/servers/1f6a67d0-9b76-48e5-a439-0c89cf9a136b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:22.561961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:22.562724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:22.564353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:22.764511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-598278684", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c2abf03d-8e55-4b5e-8d2e-ed8129184e54"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:22.883744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] validate_networks() for [('c2abf03d-8e55-4b5e-8d2e-ed8129184e54', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:21:22.999175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:23.011341 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2a5c6d9d-8667-4d89-9c8d-3d542fefcb3a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.476804 Aug 21 01:21:23.012587 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1388/3254] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:22 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:23.031308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:23.032993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:23.045060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:23.045908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:23.046561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:23.047480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:23.048128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:23.048705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:23.299037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:23.313757 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-47578b8d-c66b-41ac-a5b7-913cb98dfb02 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.288192 Aug 21 01:21:23.327678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1389/3255] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:23 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:23.327678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:23.327678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:23.332608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:23.333416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:23.334100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:23.335231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:23.336051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:23.336730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:23.560314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:23.575679 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b20e61ea-6725-4d57-8d64-30a3a3e131d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.259187 Aug 21 01:21:23.576363 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1390/3256] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:23 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:23.999464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:21:24.003775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:21:24.004321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:21:24.004736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:21:24.005929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:21:24.018798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.020325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.020799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.021539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.024004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.024421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.034386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:24.035110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:24.048694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.049477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.050096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.051180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.052079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.052724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.093124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Getting quotas for project 16542ba8c29e4ed0a5565945c0f87334. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:21:24.107716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Getting quotas for user 302454d9f56c4899895e341b0ddc6e1a and project 16542ba8c29e4ed0a5565945c0f87334. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:21:24.152946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Going to run 2 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:21:24.161851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:21:24.221761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=391b011b-5fa4-48f3-8e92-6887c4a0217d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:21:24.324355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a65c274a-95bd-4d33-90c4-33d095f9ab93 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.565274 Aug 21 01:21:24.325616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1867/3257] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:21:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1567 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:21:24.334926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:24.343838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:24.344630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Searching by: {'deleted': False, 'project_id': '16542ba8c29e4ed0a5565945c0f87334'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:21:24.420727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.422269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.422989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.427655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.428807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.429859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.523981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:21:24.604119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e7307f9-5013-4c52-9ab4-cea311a4de91 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.272595 Aug 21 01:21:24.604429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:24.606209 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1868/3258] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:21:24 2022] GET /compute/v2.1/servers => generated 1335 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:24.612158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:24.613361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:24.633010 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6e3d4ec-3cda-4d8e-bd2d-04be651dee28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.604022 Aug 21 01:21:24.636710 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1391/3259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:24 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:24.641214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.642045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.642641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.643560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.644219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.645009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.663881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:24.664637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:24.730619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.745665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.746316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.749991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:24.753399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:24.754193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:24.927548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:24.937989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d346e96-36f7-4cb5-a952-ed3da6f9492a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1654 microversion: 2.1 time: 0.329772 Aug 21 01:21:24.948890 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1869/3260] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:24 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1654 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:24.948890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81c166b0-1584-4501-93ac-d1d46d0cc3b7 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:24.948890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81c166b0-1584-4501-93ac-d1d46d0cc3b7 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:25.019046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81c166b0-1584-4501-93ac-d1d46d0cc3b7 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:25.028512 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81c166b0-1584-4501-93ac-d1d46d0cc3b7 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1217 microversion: 2.1 time: 0.087144 Aug 21 01:21:25.031845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1870/3261] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:24 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:25.104703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:25.117350 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13e3908c-e56a-4804-948f-fae72b1434f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1314 microversion: 2.1 time: 0.475541 Aug 21 01:21:25.118371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1392/3262] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:24 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:25.124394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:25.131700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:25.135677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:25.136356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:25.201773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Going to try to start instance {{(pid=122483) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 01:21:25.257627 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:25.328151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f4b4fb7-3a34-4a91-aaa3-31ba41d200c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.207471 Aug 21 01:21:25.331719 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1393/3263] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:25 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:25.353193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:25.357431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:25.375581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:25.376197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:25.377389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:25.383803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:25.384736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:25.386260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:25.488387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1485992887", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:25.635369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:21:25.635782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:21:25.636291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:21:25.641490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:21:25.641923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:21:25.671438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:25.674077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:25.674570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:25.675475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:25.675967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:25.676496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:25.734826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Getting quotas for project 641b7e2d0207464b97bbbbe212fb605b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:21:25.754561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Getting quotas for user 8fc0387bfa7d476594a8e57da5340ef7 and project 641b7e2d0207464b97bbbbe212fb605b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:21:25.797707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:21:25.800505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:21:25.960912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55d6b211-b94b-4589-a2eb-f2ff70db5884 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.922920 Aug 21 01:21:25.968299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1871/3264] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:21:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:21:25.976527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:25.980548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:25.998420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.000842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.003387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:26.007498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.008321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.009251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:26.484944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:26.499054 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-540724d1-93c1-4db7-9a9c-ce31fa7c1d1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 1.158257 Aug 21 01:21:26.520549 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1394/3265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:25 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:26.533695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:26.534857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:26.682465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:26.692435 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-454243b7-6147-4669-ba9d-3f723ca4cf9c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 0.721985 Aug 21 01:21:26.712793 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1872/3266] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:25 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:26.727702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:26.732035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:26.761596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.765886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.767444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:26.770673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.773449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.774823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:26.810931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:26.826433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:26.830313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:26.832834 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2b15c359-ebb8-4e20-8232-29a17290bed4 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1281 microversion: 2.47 time: 0.310772 Aug 21 01:21:26.835627 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1395/3267] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:26 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:26.849393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:26.850638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:26.878706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.882216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.884115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:26.888420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:26.893140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:26.895177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:27.284953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:27.299894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d341f5a2-64d7-44fa-a9e3-b51807a437d2 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1269 microversion: 2.1 time: 0.590924 Aug 21 01:21:27.302688 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1873/3268] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:26 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1269 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:27.529143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:27.530270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:27.559604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:27.560205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:27.560740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:27.564144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:27.564696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:27.567425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:28.054425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:28.072031 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-478374b7-28be-454e-a72e-16ae9f76c761 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1502 microversion: 2.1 time: 1.234081 Aug 21 01:21:28.080155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1396/3269] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:26 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1502 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:28.139303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:28.145659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:28.187033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:28.195489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:28.198517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:28.201192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:28.205270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:28.206045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.097061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:29.106528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31f1adc2-2bf6-4b93-857e-0edcfb16d80b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 1.582796 Aug 21 01:21:29.111740 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1874/3270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:27 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:29.146328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a67d0-9b76-48e5-a439-0c89cf9a136b", "name": "network-vif-unplugged", "status": "completed", "tag": "53644bab-c4dd-42be-9146-bb76d2599c4c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:29.191956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.194700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.195774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.258774 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] Creating event network-vif-unplugged:53644bab-c4dd-42be-9146-bb76d2599c4c for instance 1f6a67d0-9b76-48e5-a439-0c89cf9a136b on n-h1-master-1 Aug 21 01:21:29.284190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-54b6c616-6c71-4c10-9ac0-ac62cc8422c1 req-6dbeff01-5dc5-451d-9580-39668da04ea4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164487 Aug 21 01:21:29.287284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1875/3271] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:29.316504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:29.319282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:29.340531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.344512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.346582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.349406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.351193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.355549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.447716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:29.460632 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5812e0d-dfa2-4e10-bc81-3e5a6423b941 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1676 microversion: 2.1 time: 1.367240 Aug 21 01:21:29.461306 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1397/3272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:28 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1676 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:29.486692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:29.493139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:29.530772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.531330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.531700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.532463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.543260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.544124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.726841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:29.737993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94cd02c0-5ca5-4c43-a19f-16f00ba869bf tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1275 microversion: 2.1 time: 0.275535 Aug 21 01:21:29.761060 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1398/3273] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:29 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:29.766084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a67d0-9b76-48e5-a439-0c89cf9a136b", "name": "network-vif-deleted", "tag": "53644bab-c4dd-42be-9146-bb76d2599c4c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:29.804675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:29.805209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:29.805652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:29.847320 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] Creating event network-vif-deleted:53644bab-c4dd-42be-9146-bb76d2599c4c for instance 1f6a67d0-9b76-48e5-a439-0c89cf9a136b on n-h1-master-1 Aug 21 01:21:29.867251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-85616b50-bdd0-4fac-bb6e-0b3b43b32103 req-45afe090-eb2e-4d1b-ae2b-b4d075d30ad1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104984 Aug 21 01:21:29.868008 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1399/3274] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:29.901664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:29.954266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:29.999843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:30.003600 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af2cd56b-e9da-40d2-b56d-5baffa1745dd tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1339 microversion: 2.47 time: 0.711634 Aug 21 01:21:30.005043 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1876/3275] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:29 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1339 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:30.136415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:30.148443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:30.182614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:30.183111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:30.183550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:30.202306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:30.206462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:30.211122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:30.483785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:30.485375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:30.508385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:30.509011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:30.509460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:30.510192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:30.510652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:30.511081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.172905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:31.191241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1f9cf4b-5c77-4abe-808a-ed6296f6b95a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 1.059290 Aug 21 01:21:31.209685 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1400/3276] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:30 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:31.216467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:31.218160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:31.230016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.235344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.237851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.240457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.241786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.242408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.477224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:31.494422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9351c987-7af5-4d7d-bb89-7264df8bee97 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1653 microversion: 2.1 time: 1.013354 Aug 21 01:21:31.500616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1877/3277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:30 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1653 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:31.512201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:31.514785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:31.531000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.531909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.534992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.536154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.537218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.538071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.811781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:31.815182 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:31.838847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:31.861188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:31.862643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f26ee08-203b-4275-9745-d4a4d5fc2244 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1339 microversion: 2.47 time: 0.360208 Aug 21 01:21:31.876797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1878/3278] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:31 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1339 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:31.876797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a81009d6-906a-4d81-852d-f9f1bb3473c2"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:31.877889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:31.892750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.892893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.893312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:31.894039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:31.894545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:31.895020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.310442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:32.323290 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a46a2db-5a84-4138-85dc-957c56f63ecd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 1.112011 Aug 21 01:21:32.324401 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1401/3279] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:31 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:32.333596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:32.341256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.342116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.343586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.378685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Going to try to start instance {{(pid=122483) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 01:21:32.472067 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c774056a-b4a4-4010-a84f-40ed1a6c0b03 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action" status: 202 len: 0 microversion: 2.1 time: 0.129246 Aug 21 01:21:32.473999 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1402/3280] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:32 2022] POST /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:32.489665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1360b7a0-7fc8-4d07-963e-1305080018cd", "name": "network-vif-deleted", "tag": "0e1a297d-d8f7-4373-b560-c76966002320"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:32.536215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.538028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.538681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.579338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bdbfd958-d274-41ea-988e-1d89494d922d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714310 Aug 21 01:21:32.583745 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1879/3281] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:21:31 2022] POST /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:32.587434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] Creating event network-vif-deleted:0e1a297d-d8f7-4373-b560-c76966002320 for instance 1360b7a0-7fc8-4d07-963e-1305080018cd on n-h1-master-1 Aug 21 01:21:32.602134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:32.602134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:32.605107 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-369f471e-ed48-4bb7-b0b8-9948e3cca835 req-2e7b2a7a-940a-455d-b6fe-547bb669c567 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127776 Aug 21 01:21:32.606845 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1403/3282] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:32.618410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:32.621315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:32.632883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.633401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.633922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.634448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.635108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.636210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.638280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.638968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.641289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:32.642090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:32.642573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:32.643012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.160178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.177777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10664799-333e-4a9b-ab18-64de56a5436d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.590849 Aug 21 01:21:33.178386 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1880/3283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:32 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:33.188018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:33.191087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:33.204187 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:33.206880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.209551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.210286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.211213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.213849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.214467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.310168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.320233 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-427e97f0-c1d0-4232-9569-a0351b732cd2 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1662 microversion: 2.1 time: 0.710089 Aug 21 01:21:33.324988 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1404/3284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:32 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1662 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:33.340898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:33.341903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:33.361928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.362612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.363240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.374017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.374506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.374944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.426693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.447408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.450113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.452352 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a702545-4e06-434c-bf0e-7b5d7d8f6e7c tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1339 microversion: 2.47 time: 0.272785 Aug 21 01:21:33.453381 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1881/3285] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:33 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:33.458681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:33.459518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:33.468492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.469319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.470277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.471279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:33.472253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:33.472873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:33.958981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:33.971732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff3f45d4-180e-4b6a-8905-ffefdcd6b7fc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.516896 Aug 21 01:21:33.976812 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1882/3286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:33 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:34.316294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:34.325577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-443b77f8-73d5-466a-a53f-e0b3ae6b9cd0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.996365 Aug 21 01:21:34.326368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1405/3287] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:33 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:34.346178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:34.347072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:34.364324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:34.365096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:34.365656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.366347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.367204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.369190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.369831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.370442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.378808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.380148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.381402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.382466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.383089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.383715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.468801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Unlocking {{(pid=122483) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 21 01:21:34.538548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39f34803-259b-479b-8310-1839b7c80d6d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.189739 Aug 21 01:21:34.539870 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1406/3288] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:34 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:34.550914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:34.551765 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:34.558431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.559251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.559934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.560990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.561874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.562531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.740949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:34.755871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:34.757542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:34.758803 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cfdc3b7e-39c5-4d37-a735-8fab6188b4f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1360 microversion: 2.47 time: 0.217728 Aug 21 01:21:34.759384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1407/3289] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:34 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1360 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:34.774066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:34.774610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:34.794429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.795130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.795730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:34.797458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:34.798274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:34.798874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.083946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:35.095885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86e760d9-eeb5-49a6-9178-fd3313ce4329 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1662 microversion: 2.1 time: 0.754492 Aug 21 01:21:35.113961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1883/3290] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:34 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1662 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:35.123739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-943570934"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:35.136524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:35.147245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.147758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.148198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.148955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.149414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.149841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.492451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bdd79e9-a469-4a3e-a194-ce6f2279bc9d tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "POST /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8/action" status: 202 len: 52 microversion: 2.47 time: 0.376324 Aug 21 01:21:35.500040 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1884/3291] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:21:35 2022] POST /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8/action => generated 52 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:21:35.513682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:35.514758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:35.533800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.534383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.534837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.535796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.536456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.537091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.625318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:35.628109 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:35.641267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b22fefe-713e-411a-b241-9a721030e8c8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.871331 Aug 21 01:21:35.664470 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1408/3292] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:34 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:35.680962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:35.681497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:35.691632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.692124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.692569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.693328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.696733 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:35.701075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.702554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.768749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:35.780395 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:35.902185 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:35.941024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-733aa448-b1fc-406f-9b65-225175d9f8be tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 204 len: 0 microversion: 2.47 time: 0.274980 Aug 21 01:21:35.942063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1409/3293] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:21:35 2022] DELETE /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:21:35.947970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:35.951348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:35.954314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:35.963482 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a2112e3-4181-4a4f-912a-9bada0a52ac5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.457747 Aug 21 01:21:35.964732 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1885/3294] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:35 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:35.978733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.979340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.979785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.980586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.980987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:35.981149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.981572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:35.981696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:35.996369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:35.998276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:35.999255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.000028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.003473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.004215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.221957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:36.233664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:36.252526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:36.255872 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9558bdeb-9ca8-477b-810b-e90e1ccb0e7a tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.287975 Aug 21 01:21:36.274616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1886/3295] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:35 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:36.274616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391b011b-5fa4-48f3-8e92-6887c4a0217d", "tag": "3f2e167c-e819-490a-b633-b4083866f0f5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:36.297601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.298607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.298908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.325965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] Creating event network-changed:3f2e167c-e819-490a-b633-b4083866f0f5 for instance 391b011b-5fa4-48f3-8e92-6887c4a0217d on n-h2-master-1 Aug 21 01:21:36.342345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-80a584a4-8c32-4211-86f7-bd51e4cf5f6a req-9dc3be46-3b77-45af-b3ee-460fa6cdcad0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076871 Aug 21 01:21:36.343789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1887/3296] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:36.354487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:36.355628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:36.364326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.365260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.365923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.366916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.367593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.368232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.500744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:36.540238 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6413d2b3-676c-40e0-9880-bd64545f20c7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.596759 Aug 21 01:21:36.541542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1410/3297] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:35 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:36.562227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:36.564218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:36.605949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.607569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.608324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.609288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:36.611388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:36.612096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:36.821911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:36.822669 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:36.833985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d596f130-27c2-45ae-93cf-0c404328fe6b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1662 microversion: 2.1 time: 0.488327 Aug 21 01:21:36.834866 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1888/3298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:36 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1662 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:36.991023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:36.991882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:37.005966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.006746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.008193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.009607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.012157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.012829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.311180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:37.328701 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc9f58a2-668e-432b-a67b-20d2ca16e724 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.343222 Aug 21 01:21:37.333498 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1889/3299] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:36 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:37.344950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:37.353327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:37.369134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.372137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.373098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.375480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.376141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.379436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.525573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:37.539487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:37.541041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:37.542312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d1df626-297a-45dc-b3f8-6dfb113f395b tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.205247 Aug 21 01:21:37.559102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1890/3300] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:37 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:37.817768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:37.838504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d345ba5-d7f2-4702-b3b1-1c80d8aefab4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 1.280324 Aug 21 01:21:37.853097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1411/3301] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:36 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:37.863764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:37.866774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:37.882430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.885291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.888822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.889876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.890147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:37.890340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.890750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.893407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:37.902135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.903430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.904343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:37.905615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:37.906258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:37.907136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.034116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40418851-a4e3-41e7-9725-296ec27ccc9f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.163554 Aug 21 01:21:38.036986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1412/3302] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:37 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:38.044139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:38.051689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:38.072748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.073317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.073771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.074536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.075018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.075458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.448144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:38.457108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa09a7fa-cc83-4d65-bd43-95130f7184b7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1672 microversion: 2.1 time: 0.417429 Aug 21 01:21:38.462829 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1413/3303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:38 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1672 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:38.469245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:38.474017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:38.494276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.495169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.495781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.498465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.499166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.501321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.759932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:38.769723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee8b919d-be32-4d1e-a7d9-4d0e9a95e4c8 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.305342 Aug 21 01:21:38.770650 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1414/3304] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:38 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:38.781529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e842df77-9f2d-4179-afe1-0027c9317f99", "tag": "521507ed-5f40-4ef0-9bdb-7bb26dc1a04e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:38.803976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.805137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.805752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.835572 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] Creating event network-changed:521507ed-5f40-4ef0-9bdb-7bb26dc1a04e for instance e842df77-9f2d-4179-afe1-0027c9317f99 on n-h2-master-1 Aug 21 01:21:38.842646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:38.843811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7fcb6ecd-ed33-4790-bb7e-ac676c236302 req-d5d96261-7e0a-4472-8340-04c536ff7307 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071752 Aug 21 01:21:38.845092 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1415/3305] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:38.851135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:38.852126 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95dfdeed-3ce2-436a-b111-6ed4c66d5db7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1666 microversion: 2.1 time: 1.000381 Aug 21 01:21:38.852367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:38.861653 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1891/3306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:37 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1666 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:38.871256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.871898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.872673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:38.873818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:38.874459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:38.875006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:39.103926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:39.119936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:39.125153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:39.126829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8174c381-6cbf-4139-86f4-0814fa8d02f2 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.280407 Aug 21 01:21:39.147100 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1416/3307] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:38 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:39.484960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:39.485613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:39.493824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:39.494442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:39.494877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:39.495700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:39.496068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:39.496460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:39.791824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:39.792729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:39.809845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:39.810785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:39.812137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:39.813410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:39.814040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:39.814635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:39.962584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:39.978724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1d20cc2-3808-4348-80f0-c42dcd76cf1b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1652 microversion: 2.1 time: 0.497651 Aug 21 01:21:39.981379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1892/3308] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:39 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1652 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:40.010630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:40.015071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:40.032043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.035168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.038925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.046138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.047662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.048922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.112033 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:40.360975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e9329f8-3632-40f7-8be1-a37d8ec9d85e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.356016 Aug 21 01:21:40.364089 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1893/3309] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:21:39 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:21:40.401245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:40.402102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:40.428501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:40.443194 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a37a98b-445d-46b7-9369-cf2f6edcfaff tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.655568 Aug 21 01:21:40.449152 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1417/3310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:39 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:40.460325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:40.460596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.460959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.462835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:40.463790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.464654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.465121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.465640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.480292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.485470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.486385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.488914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:40.489718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:40.490365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:40.770555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:40.787191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:40.793821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:40.799356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-67edd70b-a51f-4533-9674-1b026c9bf188 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.427953 Aug 21 01:21:40.801055 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1894/3311] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:40 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:40.914173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:40.927516 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29e436d6-ecea-461f-8e84-039ec8d2fa1d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1659 microversion: 2.1 time: 0.476924 Aug 21 01:21:40.930383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1418/3312] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:40 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1659 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:41.468803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:41.469451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:41.479809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:41.485935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:41.488573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:41.491142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:41.492494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:41.494266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:41.833393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:41.836300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:41.848216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:41.849837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:41.850369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:41.851506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:41.852205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:41.852880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.034234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.068270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.070606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.072367 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23ac5904-ef55-4f28-baaf-a21f3c226943 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.243153 Aug 21 01:21:42.073631 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1419/3313] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:41 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:42.082021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:42.083242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:42.095048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.096033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.097080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.098636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.099193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.099704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.138199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.144259 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 01:21:42.144259 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 01:21:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b (ip 10.222.0.46) !!! Aug 21 01:21:42.167054 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd93b039-27cd-44fd-a3c9-51af8c9e3f18 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.705075 Aug 21 01:21:42.178566 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1895/3314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:41 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:42.415829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.428112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3547fd4d-61ca-44a7-83d7-6c0ceb76abb5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.353106 Aug 21 01:21:42.431111 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1420/3315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:42 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:42.456602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:42.457523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:42.473818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.478800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.479518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.482099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.482820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.485876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.821481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:42.844249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c53edd9f-9471-4bee-aaaf-281a965b27f2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.391389 Aug 21 01:21:42.845199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1896/3316] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:42 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:42.877788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:42.879281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:42.894853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.900320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.901094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:42.902023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:42.902638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:42.903244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:43.103156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:43.103778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:43.123461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:43.123873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:43.124319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:43.157628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:43.160405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:43.163530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:43.537435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:43.557350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:43.559508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:43.564935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56f17a9e-583d-49df-ab15-5af2a32eebc3 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.465742 Aug 21 01:21:43.573360 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1897/3317] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:43 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:43.588443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:43.589146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:43.635447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:43.635932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:43.642194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:43.659205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:43.668963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:43.678774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.022527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.041308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-544fdf01-c27d-42d0-a7fa-e763da05e5c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 1.167678 Aug 21 01:21:44.046153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1421/3318] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:42 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:44.070114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:44.070776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:44.083925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.085700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.086198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.087006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.087465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.087890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.244601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.264234 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a2bd539-9f23-449f-8eb6-2ac1594e5f32 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.689025 Aug 21 01:21:44.264783 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1898/3319] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:43 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:44.285858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:44.286523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:44.302977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.303474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.303980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.304861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.313634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.314084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.551150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.564724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.566422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.570592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4d43fc6-8024-4916-95fc-76be0a1603e8 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2950 microversion: 2.42 time: 0.523237 Aug 21 01:21:44.573824 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1422/3320] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:44 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2950 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:44.605085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:44.606077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:44.622208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.622857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.623475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.627032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.627528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.627962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.673854 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:44.807946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.819119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.821054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fc0387bfa7d476594a8e57da5340ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b7e2d0207464b97bbbbe212fb605b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.822432 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c93279a-e8c6-48c8-b2cf-96eee6c00a14 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 200 len: 1366 microversion: 2.47 time: 0.222849 Aug 21 01:21:44.834257 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1423/3321] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:44 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:44.841121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:44.841922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:44.845323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:44.856210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.857611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.858267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.858939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b4cce20-da8a-4b87-a32a-189d4957f1ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.592796 Aug 21 01:21:44.859356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.859588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1899/3322] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:44 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:44.860176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.860839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.882087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:44.882994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:44.891955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.892738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.893421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:44.894382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:44.895040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:44.895682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:45.129241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eac4eb73-bd37-4697-b88b-1c8edc58abb9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.293432 Aug 21 01:21:45.136844 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1424/3323] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:21:44 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7/os-interface => generated 1829 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:21:45.294230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:45.295164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:45.304292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:45.306358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:45.309285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:45.310481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:45.311684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:45.312340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:45.411245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:45.423542 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19b35b62-2da8-4a76-af53-9b8d613f562a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.545384 Aug 21 01:21:45.435498 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1900/3324] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:44 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:45.465968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:45.467055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:45.474502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:45.475406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:45.476048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:45.477035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:45.478845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:45.480303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:46.244928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:46.308657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04167a47-ee2b-47f7-b37c-51643d1622e9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.849326 Aug 21 01:21:46.313597 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1901/3325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:45 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:46.320106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:46.321168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] [instance: 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:46.329396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:46.330106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:46.330827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:46.331718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:46.332359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:46.333028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:46.357820 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] HTTP exception thrown: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Request method failure captured: Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 HTTP/1.1 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYiUlJ8vzWSbVwF2BQcXJidAw57DnB1epnUv02koSSjJ0mIkrW3Q_x4hAFwj_wZajK73jC73fOhLIkVBD-Gf-Qs1Vpf8sTygqkwGOd3xY1BZZJirboJb7Z-cnTSAQsojGxHF-80o7XpSJDZWbeQrdN0PIdFcnu4BUVLhC2ZZiz58KEA Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.47 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 641b7e2d0207464b97bbbbe212fb605b Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAaction247Test-256237631 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/641b7e2d0207464b97bbbbe212fb605b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_641b7e2d0207464b97bbbbe212fb605b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/641b7e2d0207464b97bbbbe212fb605b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/641b7e2d0207464b97bbbbe212fb605b"}]}] Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAaction247Test-256237631 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 641b7e2d0207464b97bbbbe212fb605b Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAaction247Test-256237631 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAaction247Test-256237631-project Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 8fc0387bfa7d476594a8e57da5340ef7 Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAaction247Test-256237631-project Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8'} Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:46.361890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. Aug 21 01:21:46.367981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:46.370835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] Returning 404 to user: Instance 73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:46.373912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9066a977-aa3c-4336-a11e-caf60aeebbf6 tempest-ServersAaction247Test-256237631 tempest-ServersAaction247Test-256237631-project] 10.222.0.46 "GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8" status: 404 len: 111 microversion: 2.47 time: 0.057047 Aug 21 01:21:46.377038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1902/3326] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:21:46 2022] GET /compute/v2.1/servers/73f04bb5-fc2c-4ee4-8ae3-98dc6d17bab8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:21:46.602312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:46.637305 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e411d3ac-3e49-4048-80c2-8da6faac45ae tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 1.347021 Aug 21 01:21:46.652830 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1425/3327] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:45 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:47.670344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:47.672244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:47.686792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:47.687611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:47.689904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:47.690817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:47.691445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:47.692328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:48.144389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:48.155945 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-979e96c3-0442-4188-83d8-ac93f526a78b tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.491332 Aug 21 01:21:48.180849 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1903/3328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:47 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:48.685850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:48.686590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:48.710391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:48.711128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:48.711759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:48.712654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:48.713392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:48.715699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:48.766944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:48.985360 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c19932b9-3e2c-4a99-be2b-b664e9f331ae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 204 len: 0 microversion: 2.1 time: 0.302892 Aug 21 01:21:48.986611 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1426/3329] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:48 2022] DELETE /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:48.999560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:49.000251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:49.016920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:49.017487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:49.017934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:49.021113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:49.021783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:49.022290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:49.201433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:49.202239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:49.224435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:49.229298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:49.229851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:49.230810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:49.231963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:49.232487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:49.484917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:49.500426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2503a3d5-7c74-4a8d-98a1-ec102cfe0bbc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.305944 Aug 21 01:21:49.511014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1427/3330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:49 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:49.520517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391b011b-5fa4-48f3-8e92-6887c4a0217d", "name": "network-vif-plugged", "status": "completed", "tag": "3f2e167c-e819-490a-b633-b4083866f0f5"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:49.529175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:49.534181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:49.535123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:49.535763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:49.540808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3530a5e8-5baf-49c8-9ed4-64f3c96d74c5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1554 microversion: 2.1 time: 0.547569 Aug 21 01:21:49.550870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] Creating event network-vif-plugged:3f2e167c-e819-490a-b633-b4083866f0f5 for instance 391b011b-5fa4-48f3-8e92-6887c4a0217d on n-h2-master-1 Aug 21 01:21:49.558291 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f06954cc-d57c-4202-a9b4-364ff180c8b2 req-612c68c0-7ce2-40b1-94a3-de69d5f86c43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044654 Aug 21 01:21:49.559223 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1428/3331] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:49.574467 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1904/3332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:48 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1554 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:50.525783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:50.527541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:50.540908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:50.541781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:50.543858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:50.545281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:50.548012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:50.548952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:50.583533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:50.585072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:50.596392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:50.601935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:50.602727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:50.604988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:50.605772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:50.607856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:51.045949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:51.057533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f6d81d8-a8e0-4897-b05e-58fa1bc5e82b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1554 microversion: 2.1 time: 0.479336 Aug 21 01:21:51.058400 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1905/3333] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:50 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1554 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:51.094508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:51.106621 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e5ba79f-aa1e-4e64-bc34-4ae9e992c6dc tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.586913 Aug 21 01:21:51.108126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1429/3334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:50 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:52.012377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af65ae9b-2b7b-4c5e-875e-dc47908eb81c", "name": "network-vif-deleted", "tag": "6316247a-e464-4d2e-8978-2e6b72d14277"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:52.035262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.035751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.036182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.087668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:52.088437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:52.125431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.126030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.126479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.129561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.139101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] Creating event network-vif-deleted:6316247a-e464-4d2e-8978-2e6b72d14277 for instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c on n-h1-master-1 Aug 21 01:21:52.141262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.141796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.168031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5d5e6f32-61c9-4604-b62a-210dd7085b42 req-09b2395a-c358-4e0c-b06c-1cd0687d4aee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160976 Aug 21 01:21:52.175434 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1906/3335] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:21:52.194048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:52.194838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:52.240480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.241005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.241450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.242177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.250945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.251812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.739184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:52.752545 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1cd24bcf-766a-41b0-a37c-848f9a7f4ec8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.670050 Aug 21 01:21:52.763105 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1430/3336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:52 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:52.769319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e842df77-9f2d-4179-afe1-0027c9317f99", "name": "network-vif-plugged", "status": "completed", "tag": "521507ed-5f40-4ef0-9bdb-7bb26dc1a04e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:52.793128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:52.796090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:52.796833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:52.827099 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] Creating event network-vif-plugged:521507ed-5f40-4ef0-9bdb-7bb26dc1a04e for instance e842df77-9f2d-4179-afe1-0027c9317f99 on n-h2-master-1 Aug 21 01:21:52.845991 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a1d979ba-069d-4acd-bd8c-9856483cb947 req-77214330-e202-4bd1-bfe7-dabcda804f24 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084157 Aug 21 01:21:52.851272 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1431/3337] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:21:53.103318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:53.114868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb22a6d2-79c3-429b-aa27-428a7cda5b7e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.937441 Aug 21 01:21:53.128999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1907/3338] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:52 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:53.788088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:53.788858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:53.813499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:53.814219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:53.814665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:53.815428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:53.815885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:53.820377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:54.019553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:54.028677 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-89c5ce3f-3180-4c28-8201-cefea6ff40d1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.246399 Aug 21 01:21:54.034632 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1432/3339] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:53 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:54.145318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:54.146019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:54.173980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:54.174576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:54.174989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:54.175727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:54.176174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:54.176592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:54.806161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:54.820993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71014bc7-6f23-4534-9166-e2f707489b65 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1317 microversion: 2.1 time: 0.679625 Aug 21 01:21:54.834224 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1908/3340] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:54 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:55.053412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:55.054873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:55.071245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:55.072135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:55.073288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:55.075902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:55.078600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:55.079230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:55.298328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:55.308301 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-06e2df3f-bb00-4064-9ed9-9eb6562ad201 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.259208 Aug 21 01:21:55.314811 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1433/3341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:55 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:55.844626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:55.845270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:55.861360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:55.861858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:55.862313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:55.866170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:55.866653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:55.869128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:56.335408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:56.336674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:56.346304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:56.350121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:56.353114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:56.354021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:56.354648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:56.356420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:56.474521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:56.488490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53d2d1a2-dc75-49ff-abca-fb8fc3d39abd tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1506 microversion: 2.1 time: 0.648398 Aug 21 01:21:56.512002 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1909/3342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:55 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:56.518435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:56.527454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-618d1462-c86e-46e9-8269-1bd682eec78f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.196097 Aug 21 01:21:56.528037 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1434/3343] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:56 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:56.535998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:56.538024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:56.562078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:56.568636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:56.571881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:56.593344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:56.595252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:56.597883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:56.684561 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:57.053753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:57.074361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a930806-7469-4a7d-8f32-1a65082788da tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 200 len: 1505 microversion: 2.1 time: 0.558787 Aug 21 01:21:57.075805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1910/3344] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:56 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:57.102006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:57.103699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:57.115729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.121138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.121840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.123239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.128963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.129632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.206562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:57.469379 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-58f983fa-0b99-4fe5-b0d1-f1d1b6ac4020 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 204 len: 0 microversion: 2.1 time: 0.371131 Aug 21 01:21:57.471168 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1435/3345] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:57 2022] DELETE /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:57.479527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:57.480355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:57.498169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.509828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.510858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.511797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.512430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.513073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.553839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:57.554991 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:57.567755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.570430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.571183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.572182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.574284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.579553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:21:57.586100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.765147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e8bedfb-43df-4b5b-acc4-5b476dcb622e tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 204 len: 0 microversion: 2.1 time: 0.289248 Aug 21 01:21:57.766165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1911/3346] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:21:57 2022] DELETE /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:21:57.775105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:57.779172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:57.793705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.796337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.797889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.801220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:57.802098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:57.804359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:57.914192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:57.932802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-844e9d86-aae8-4ff6-b647-ec6d13a54a4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.381388 Aug 21 01:21:57.947664 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1436/3347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:57 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:58.215065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:58.223510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8ea6d04-5e85-4f1f-8b1b-1ebb56ce53a9 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 200 len: 1511 microversion: 2.1 time: 0.452983 Aug 21 01:21:58.226992 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1912/3348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:57 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:21:58.960264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:58.962906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:58.986671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:58.992543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:59.006052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:59.014561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:59.015889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:59.032040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:59.193985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:59.203999 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b13932f-ae23-48ea-bb37-0b4873e78b2a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.252248 Aug 21 01:21:59.210054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1437/3349] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:58 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:21:59.249437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:59.250070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:21:59.274257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:59.274993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:59.278518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:59.279464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:21:59.279950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:21:59.280383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:21:59.380889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Action: 'create', calling method: .version_select at 0x7fc3f9e90c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:21:59.422884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Getting quotas for project 7e6168828fb949408d66c24c38352a85. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:21:59.426443 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:59.452289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Getting quotas for user 2c4c1382b0174bf3a4123806bef8d01e and project 7e6168828fb949408d66c24c38352a85. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:21:59.571017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Getting quotas for project 7e6168828fb949408d66c24c38352a85. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:21:59.578907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Getting quotas for user 2c4c1382b0174bf3a4123806bef8d01e and project 7e6168828fb949408d66c24c38352a85. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:21:59.597656 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eff6e3a8-c834-4f63-af0d-2fba89b6325d tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.371333 Aug 21 01:21:59.606469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1913/3350] 10.222.0.46 () {62 vars in 1214 bytes} [Sun Aug 21 01:21:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:21:59.613572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3c64711-dd27-4b19-b7fb-de251fa3d3a6 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:59.633905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3c64711-dd27-4b19-b7fb-de251fa3d3a6 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.025026 Aug 21 01:21:59.644024 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1914/3351] 10.222.0.46 () {60 vars in 1193 bytes} [Sun Aug 21 01:21:59 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:21:59.654116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d9164f6-2709-4061-a97a-370935e3def0 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:59.674188 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:21:59.679075 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d9164f6-2709-4061-a97a-370935e3def0 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2" status: 200 len: 235 microversion: 2.64 time: 0.033237 Aug 21 01:21:59.679960 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1915/3352] 10.222.0.46 () {60 vars in 1304 bytes} [Sun Aug 21 01:21:59 2022] GET /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2 => generated 235 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:21:59.695433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24f26a95-0483-4660-bc6b-ec94c3da8916 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:59.765768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24f26a95-0483-4660-bc6b-ec94c3da8916 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2" status: 204 len: 0 microversion: 2.64 time: 0.075747 Aug 21 01:21:59.770942 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1916/3353] 10.222.0.46 () {60 vars in 1307 bytes} [Sun Aug 21 01:21:59 2022] DELETE /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:21:59.779510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080ce36e-d128-44b7-ac04-6685273dfc78 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:21:59.798777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-080ce36e-d128-44b7-ac04-6685273dfc78 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] HTTP exception thrown: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080ce36e-d128-44b7-ac04-6685273dfc78 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Request method failure captured: Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2 HTTP/1.1 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYi3N0kthU4Dk6nwIxXtUT4Q6B4-7X1swMdHjc97ECeblRmQBpD-drcvghiQEjCgB1JQ7xhFSaH_mqA5nloU17fZ6CXgKVZUNzCt2qr-7D8lsxkMKVi2hCPmpyXHCfMS2t_kfYcDP_1OFxA2LxIPD32lbjtfVqtD5o4RL_FLHJdQaTk Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.64 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7e6168828fb949408d66c24c38352a85 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroup264TestJSON-1818724005 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e6168828fb949408d66c24c38352a85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e6168828fb949408d66c24c38352a85", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e6168828fb949408d66c24c38352a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e6168828fb949408d66c24c38352a85"}]}] Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroup264TestJSON-1818724005 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7e6168828fb949408d66c24c38352a85 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1818724005 Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroup264TestJSON-1818724005-project Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 2c4c1382b0174bf3a4123806bef8d01e Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroup264TestJSON-1818724005-project Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: exception: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '076dea66-6a1f-48a7-8027-ac7ad8507dc2'} Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:59.810640 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. Aug 21 01:21:59.816534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:21:59.821061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080ce36e-d128-44b7-ac04-6685273dfc78 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] Returning 404 to user: Instance group 076dea66-6a1f-48a7-8027-ac7ad8507dc2 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:21:59.821859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-080ce36e-d128-44b7-ac04-6685273dfc78 tempest-ServerGroup264TestJSON-1818724005 tempest-ServerGroup264TestJSON-1818724005-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2" status: 404 len: 117 microversion: 2.64 time: 0.049479 Aug 21 01:21:59.822790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1917/3354] 10.222.0.46 () {60 vars in 1307 bytes} [Sun Aug 21 01:21:59 2022] DELETE /compute/v2.1/os-server-groups/076dea66-6a1f-48a7-8027-ac7ad8507dc2 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:21:59.842387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:21:59.850906 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7c9cca2-aae1-4b5c-b8d9-83c3a0fa7a24 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 200 len: 1511 microversion: 2.1 time: 0.606395 Aug 21 01:21:59.861562 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1438/3355] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:21:59 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:00.233283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:00.235509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:00.249382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:00.252099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:00.255298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:00.257703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:00.260593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:00.261314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:00.643172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:00.655292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac97152d-aa58-4ace-8c1c-31869a3c25af tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.427480 Aug 21 01:22:00.673894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1918/3356] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:00 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:00.897253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:00.898729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:00.934055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:00.934831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:00.935315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:00.936667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:00.938858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:00.939460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:01.681398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:01.682204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:01.700881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:01.702026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:01.704216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:01.707953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:01.709611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:01.710644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:01.981506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:01.995381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2631a0ef-ffba-43c2-bdc4-8ba1e81a5e62 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1345 microversion: 2.1 time: 0.317827 Aug 21 01:22:02.019562 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1919/3357] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:01 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1345 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:02.275551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:02.292503 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbf57d07-d125-4c82-ab32-dc2018fe09c1 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 200 len: 1469 microversion: 2.1 time: 1.413222 Aug 21 01:22:02.292503 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1439/3358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:00 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 1469 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:02.850545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391b011b-5fa4-48f3-8e92-6887c4a0217d", "name": "network-vif-deleted", "tag": "3f2e167c-e819-490a-b633-b4083866f0f5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:02.922655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:02.923994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:02.924520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.001608 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] Creating event network-vif-deleted:3f2e167c-e819-490a-b633-b4083866f0f5 for instance 391b011b-5fa4-48f3-8e92-6887c4a0217d on n-h2-master-1 Aug 21 01:22:03.019009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:03.019803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:03.040941 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4e0fee26-ad1c-41d9-9cf0-c00b997e1481 req-2965973c-bc5b-4018-aa4e-4f8a1e76a9e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.447858 Aug 21 01:22:03.044530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.045102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.045654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.049567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.050493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.052399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.053250 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1920/3359] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:03.171216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.173249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.173895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.174513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lazy-loading 'fault' on Instance uuid af65ae9b-2b7b-4c5e-875e-dc47908eb81c {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:22:03.330462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:03.332382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:03.353664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.354874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.356098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.357726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.359589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.362126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.474632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:03.475155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:03.475579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:03.476224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lazy-loading 'fault' on Instance uuid 391b011b-5fa4-48f3-8e92-6887c4a0217d {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:22:03.674901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:03.687442 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1be533f6-33cf-4445-81a5-0ca9b3dfa4c7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 200 len: 1304 microversion: 2.1 time: 0.674041 Aug 21 01:22:03.694507 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1440/3360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:03 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 1304 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:03.709440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:03.721808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17f5ebb7-0f1f-4ac4-81be-4d5ecb3acb98 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 200 len: 1307 microversion: 2.1 time: 0.398862 Aug 21 01:22:03.744537 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1921/3361] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:03 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:04.721699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:04.722361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:04.747636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:04.749294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: 391b011b-5fa4-48f3-8e92-6887c4a0217d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:04.767770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.771771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.774128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.776914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.782713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.783558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.789436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.797951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.800702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.806912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.809061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.809531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.837908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] HTTP exception thrown: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Request method failure captured: Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d HTTP/1.1 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYh2GApwFQVRknv8lmyjNR1eN1HOVugk0VF3PZhFwBF-e6JFSc6co3CB468wvdvbE7MEDqvL4cz-DY9S9Hvikr7DVsw_LKzE7VFfcbKwNvkN4GnkMtefjfq9ez7uX1wDWloZAaE97XUpQXe9VPaEjnZFzsr7viD6lPAT0NjO1ToW1Tw Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 16542ba8c29e4ed0a5565945c0f87334 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16542ba8c29e4ed0a5565945c0f87334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_16542ba8c29e4ed0a5565945c0f87334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/16542ba8c29e4ed0a5565945c0f87334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16542ba8c29e4ed0a5565945c0f87334"}]}] Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 16542ba8c29e4ed0a5565945c0f87334 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateTestJSON-2020258545-project Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 302454d9f56c4899895e341b0ddc6e1a Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateTestJSON-2020258545-project Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '391b011b-5fa4-48f3-8e92-6887c4a0217d'} Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:04.850864 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. Aug 21 01:22:04.855537 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.861976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Returning 404 to user: Instance 391b011b-5fa4-48f3-8e92-6887c4a0217d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:04.869339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dfb48d8c-3747-4665-ba02-4b0fd8568091 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d" status: 404 len: 111 microversion: 2.1 time: 0.125582 Aug 21 01:22:04.872730 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1922/3362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:04 2022] GET /compute/v2.1/servers/391b011b-5fa4-48f3-8e92-6887c4a0217d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:04.887071 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:04.887796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:04.893483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c HTTP/1.1 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af65ae9b-2b7b-4c5e-875e-dc47908eb81c'} Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:04.894806 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:04.899056 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b51e49ba-58c3-471c-80ec-da353d41f526 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 404 len: 111 microversion: 2.1 time: 0.185678 Aug 21 01:22:04.905622 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1441/3363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:04 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:04.915476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.919427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.920487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.922991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:04.925454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:04.926711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:04.999535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:05.000560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:05.003177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:05.004069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lazy-loading 'fault' on Instance uuid e842df77-9f2d-4179-afe1-0027c9317f99 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:22:05.157394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '302454d9f56c4899895e341b0ddc6e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16542ba8c29e4ed0a5565945c0f87334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:05.169273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ab98972-b916-4b41-8c96-0b40f21d6c20 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 200 len: 1307 microversion: 2.1 time: 0.292565 Aug 21 01:22:05.173847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1923/3364] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:04 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:05.258428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e842df77-9f2d-4179-afe1-0027c9317f99", "name": "network-vif-deleted", "tag": "521507ed-5f40-4ef0-9bdb-7bb26dc1a04e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:05.260753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:05.265851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:05.283999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:05.284513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:05.288686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:05.289453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:05.291279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:05.291966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:05.292150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:05.292643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:05.293232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:05.319824 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] Creating event network-vif-deleted:521507ed-5f40-4ef0-9bdb-7bb26dc1a04e for instance e842df77-9f2d-4179-afe1-0027c9317f99 on n-h2-master-1 Aug 21 01:22:05.332696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c/os-volume_attachments HTTP/1.1 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: exception: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': 'af65ae9b-2b7b-4c5e-875e-dc47908eb81c'} Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:05.334811 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:22:05.339425 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:05.340249 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c993c4c2-6e1b-4c04-9e87-1fa4e1c4fbee req-dc9ee7a2-459d-4ad1-9582-36e542365b56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089318 Aug 21 01:22:05.340358 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1442/3365] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:05.342406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:05.344206 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db955c02-d92d-40ed-b2f9-22559f4729f6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092114 Aug 21 01:22:05.345277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1924/3366] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:22:05 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:05.672180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-684496535", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:05.779837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:06.055456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:06.058792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:06.076796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.084496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.088580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.089602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.090228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.090668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.315920 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab0f4e16-2101-4d1a-b1e9-7a19ca48a7ff tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.264403 Aug 21 01:22:06.320872 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1925/3367] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:22:06 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:22:06.328893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:06.329975 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] [instance: e842df77-9f2d-4179-afe1-0027c9317f99] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:06.337849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.338614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.339413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.340590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.341363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.342037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.380510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] HTTP exception thrown: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Request method failure captured: Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 HTTP/1.1 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYh2GApwFQVRknv8lmyjNR1eN1HOVugk0VF3PZhFwBF-e6JFSc6co3CB468wvdvbE7MEDqvL4cz-DY9S9Hvikr7DVsw_LKzE7VFfcbKwNvkN4GnkMtefjfq9ez7uX1wDWloZAaE97XUpQXe9VPaEjnZFzsr7viD6lPAT0NjO1ToW1Tw Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 16542ba8c29e4ed0a5565945c0f87334 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16542ba8c29e4ed0a5565945c0f87334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_16542ba8c29e4ed0a5565945c0f87334", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/16542ba8c29e4ed0a5565945c0f87334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/16542ba8c29e4ed0a5565945c0f87334"}]}] Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 16542ba8c29e4ed0a5565945c0f87334 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2020258545 Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-MultipleCreateTestJSON-2020258545-project Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 302454d9f56c4899895e341b0ddc6e1a Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-MultipleCreateTestJSON-2020258545-project Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: exception: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e842df77-9f2d-4179-afe1-0027c9317f99'} Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:06.382732 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] Returning 404 to user: Instance e842df77-9f2d-4179-afe1-0027c9317f99 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51e872b7-f2b0-401c-bcaf-5a20b5dcf5e5 tempest-MultipleCreateTestJSON-2020258545 tempest-MultipleCreateTestJSON-2020258545-project] 10.222.0.46 "GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99" status: 404 len: 111 microversion: 2.1 time: 0.060970 Aug 21 01:22:06.388695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1926/3368] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:06 2022] GET /compute/v2.1/servers/e842df77-9f2d-4179-afe1-0027c9317f99 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:06.402474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:06.403882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:06.416332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.416860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.417297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.417998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.418450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.422857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.748160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:06.750100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:06.751033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:06.751815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:06.756016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:06.766999 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:06.814329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.815650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.816281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.817462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:06.818783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:06.819701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:06.854464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:06.861600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:06.884156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:06.892122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:07.001082 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-145a71d9-b3a4-47b3-a7f4-a02bd2f6332a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334787 Aug 21 01:22:07.009525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1443/3369] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:07.027422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78d8dfd9-093c-4fd2-913b-fd550bc23290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:07.030347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-78d8dfd9-093c-4fd2-913b-fd550bc23290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:07.117844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:07.134811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e30629fc-1b34-46a6-9154-1a2af1b1033d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1669 microversion: 2.1 time: 0.738973 Aug 21 01:22:07.135730 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1927/3370] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:06 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1669 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:07.340392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-78d8dfd9-093c-4fd2-913b-fd550bc23290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:07.354348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-78d8dfd9-093c-4fd2-913b-fd550bc23290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515" status: 200 len: 1214 microversion: 2.1 time: 0.337500 Aug 21 01:22:07.354986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1444/3371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:07 2022] GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 => generated 1214 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:07.375458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f93bf7d9-9db8-4f37-9e5b-2f867e624df4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:07.376227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f93bf7d9-9db8-4f37-9e5b-2f867e624df4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:07.418324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f93bf7d9-9db8-4f37-9e5b-2f867e624df4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:22:07.789065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f93bf7d9-9db8-4f37-9e5b-2f867e624df4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515" status: 204 len: 0 microversion: 2.1 time: 0.414718 Aug 21 01:22:07.789970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1928/3372] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:22:07 2022] DELETE /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:22:07.798585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:07.800345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:07.836363 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 HTTP/1.1 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd3c30fdb-885d-4e63-ad53-c14d3b6a5515'} Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2919, in _get_instance Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2931, in _get_instance Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:07.846376 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:22:07.850666 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:07.854527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:07.855742 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a779e892-8eb8-4bb9-8552-7df6ce07282d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515" status: 404 len: 111 microversion: 2.1 time: 0.061556 Aug 21 01:22:07.856976 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1445/3373] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:07 2022] GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:07.969060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-796013149", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:08.097103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:08.163690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:08.166912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:08.199805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:08.200498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:08.202401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:08.204572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:08.211382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:08.215797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:09.459803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:09.468500 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8306b3b-3f23-4a01-be95-1612a29c3ed6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1669 microversion: 2.1 time: 1.308761 Aug 21 01:22:09.469148 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1446/3374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:08 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1669 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:10.050761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:10.051935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:10.052580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:10.053186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:10.054550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:10.074682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:10.077038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:10.079597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:10.080542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:10.081185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:10.083649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:10.118575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:10.150087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:10.187110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:10.192460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:10.292603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c8a0046c-f1d9-40aa-8eac-89aa3ceeb04d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325779 Aug 21 01:22:10.298922 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1929/3375] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:10.305973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed50e63b-66ae-4785-8d29-458743198c82 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:10.306835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed50e63b-66ae-4785-8d29-458743198c82 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:10.426578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed50e63b-66ae-4785-8d29-458743198c82 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:10.445118 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed50e63b-66ae-4785-8d29-458743198c82 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1214 microversion: 2.1 time: 0.141279 Aug 21 01:22:10.446266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1447/3376] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:10 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:10.491724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:10.492985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:10.508704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:10.509326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:10.513617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:10.516801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:10.517543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:10.518166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:11.189636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:11.218232 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4bbdd89-050f-45b6-a27f-b1f8823bb862 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1674 microversion: 2.1 time: 0.731449 Aug 21 01:22:11.241149 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1930/3377] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:10 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1674 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:11.467772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:11.468960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:11.545235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:11.551846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:11.556590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:11.557972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:11.558826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:11.577213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:11.677418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:11.698081 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-103cc74a-f893-4320-997a-f9c37c9d7e10 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1218 microversion: 2.1 time: 0.234485 Aug 21 01:22:11.716386 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1448/3378] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:11 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1218 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:12.249345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:12.251028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:12.264653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.265514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.266778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.269316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.270004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.271009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.551458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1500915508", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:12.691000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:12.692393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:12.693157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:12.693793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:12.694454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:12.720485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.721256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.721791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.723313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.724036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.724696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.771375 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Getting quotas for project 1b9ebbd02c41420083631ba591536d53. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:12.792843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Getting quotas for user 6f1301aa097942a2a4309911a00bf511 and project 1b9ebbd02c41420083631ba591536d53. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:12.805912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:12.824360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f4da7f6-7247-449d-a5c0-9b88f413ccaa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1674 microversion: 2.1 time: 0.576974 Aug 21 01:22:12.826567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1931/3379] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:12 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1674 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:12.837018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:12.839602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:12.860481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:12.865302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:12.889691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.890204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.890739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.891644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:12.892279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:12.898913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:12.948346 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0929d939-f782-4f30-840e-097cea1479b8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.636039 Aug 21 01:22:12.956083 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1449/3380] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:22:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:22:12.975222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:12.980531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:13.183550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:13.196493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:13.198203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:13.199378 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd79704c-e2ce-454f-8a59-fede58bd9448 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1278 microversion: 2.57 time: 0.238326 Aug 21 01:22:13.201869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:13.215898 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1450/3381] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:12 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:13.217424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23c2e274-66c5-4245-aa70-b9620447a8fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1218 microversion: 2.1 time: 0.389380 Aug 21 01:22:13.234593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1932/3382] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:12 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1218 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:13.847683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:13.849065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:13.862040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:13.864981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:13.866549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:13.869803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:13.870447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:13.872826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:14.223023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:14.225494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:14.236477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:14.238491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:14.239191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:14.239785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:14.246148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:14.247710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:14.249769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:14.251810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bdfbe638-884a-44cc-90ed-6f7bcc1fd01f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1674 microversion: 2.1 time: 0.408066 Aug 21 01:22:14.260860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1451/3383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1674 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:14.263869 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:14.271105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:14.274072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:14.292789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:14.297524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:14.298189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:14.299168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:14.299910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:14.302507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:14.422061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:14.452235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:14.462841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:14.465656 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-88fd482b-c66b-47bd-bf38-f64f240ed8d2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1282 microversion: 2.57 time: 0.246751 Aug 21 01:22:14.480864 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1933/3384] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:14 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1282 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:14.614844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:14.634433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3dc5e8a5-b6b9-4e0c-b511-287b5d803a96 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1218 microversion: 2.1 time: 0.380873 Aug 21 01:22:14.636433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1452/3385] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:14 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:15.281620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:15.282845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:15.298850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.299582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.300215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:15.301125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.307054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.307740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:15.493528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:15.495239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:15.507584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.508386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.509061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:15.509975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.510591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.511257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:15.690728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:15.703314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:15.704240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:15.707274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:15.712644 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8818f7f-ae7e-4baf-be0b-4eb1d0ce7847 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1330 microversion: 2.57 time: 0.223198 Aug 21 01:22:15.720723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96f3a04a-c8f8-40da-a3d2-a860a1b896e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.443903 Aug 21 01:22:15.723385 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1934/3386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:15 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:15.736740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:15.737089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1453/3387] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:15 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1330 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:15.737942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:15.759887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.761502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.762276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:15.763382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:15.764308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:15.764746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:16.199107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:16.220109 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a081a23-b596-4d76-935b-e766634cf0d0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1266 microversion: 2.1 time: 0.490038 Aug 21 01:22:16.222762 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1935/3388] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:15 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1266 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:16.749291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:16.749920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:16.757460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:16.758317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:16.759006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:16.759725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:16.760170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:16.760677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:16.861574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:16.870842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:16.874294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:16.875654 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13976738-49ad-47e8-9bde-1349be827dbf tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1336 microversion: 2.57 time: 0.131310 Aug 21 01:22:16.876570 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1454/3389] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:16 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1336 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:17.243921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:17.244566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:17.259268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:17.259832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:17.260283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:17.262231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:17.264948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:17.268222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:17.439376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:17.455385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c543c216-5a9d-4a49-8dd5-903013c6d290 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1272 microversion: 2.1 time: 0.212302 Aug 21 01:22:17.456701 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1936/3390] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:17 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:17.901217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:17.902021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:17.915287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:17.915877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:17.916289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:17.917036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:17.917491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:17.917915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:17.926319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1566241656", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:17.986967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:17.987671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:17.988323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:17.988932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:17.989519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:17.999770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.000584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.001207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.002768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.003668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.004354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.026740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Getting quotas for project f08ff6e2e16345dc9f733f6fc859aca1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:18.032967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Getting quotas for user 78818dfe8e5b42dd84c49fc5bb2804b1 and project f08ff6e2e16345dc9f733f6fc859aca1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:18.049386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:18.052358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:18.110879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.112179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-247c2f93-8534-4ecd-a9e5-00e8c8efe911 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.366235 Aug 21 01:22:18.113426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1455/3391] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:22:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:22:18.142617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.153349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.158188 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb46aff5-b5df-4b69-83ce-6b2ed81edafd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1336 microversion: 2.57 time: 0.262558 Aug 21 01:22:18.185523 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1937/3392] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:17 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1336 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:18.203232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:18.204970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:18.367221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.379819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-187c34e3-72f9-4e47-a70b-6e77fa663343 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Action: 'create', calling method: .version_select at 0x7fc3fdec8040>, body: {"keypair": {"name": "tempest-keypair-1831691022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMBM+BSDkSp7niN5w8BypCBdAvDigwZ7HGSNacLmTCAyFhkFYopoOkVVw4tgWRS34WmSlAsitJAU+eYvl6T0eO9gQuuYVrz84jVd6HFZSgYQlP4dMbjvV4WEcVlf1kNJw=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:18.380728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.382335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.383508 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d24a189-90e4-438a-a8d7-9b7911d1565c tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 200 len: 1278 microversion: 2.47 time: 0.196228 Aug 21 01:22:18.384065 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1938/3393] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:18 2022] GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:18.458828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-187c34e3-72f9-4e47-a70b-6e77fa663343 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Getting quotas for project 6b90eb2eef7c45398a821324472a6429. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:18.480219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:18.481064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:18.483851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-187c34e3-72f9-4e47-a70b-6e77fa663343 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Getting quotas for user 722940af11854f0687e7c99fae3650a2 and project 6b90eb2eef7c45398a821324472a6429. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:18.495604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.500609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.501223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.505003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.506447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.513602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.563151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-187c34e3-72f9-4e47-a70b-6e77fa663343 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446820 Aug 21 01:22:18.570984 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1456/3394] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:22:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:18.574280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-32051052", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:18.669185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:18.669889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:18.671495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:18.672242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:18.673122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:18.685807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.686740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.686896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.688041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:18.688529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:18.689020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:18.712705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Getting quotas for project f08ff6e2e16345dc9f733f6fc859aca1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:18.719206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Getting quotas for user 78818dfe8e5b42dd84c49fc5bb2804b1 and project f08ff6e2e16345dc9f733f6fc859aca1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:18.736517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:18.739034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:18.755905 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:18.796359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:18.807549 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16587603-a9bf-4d65-a866-5d6e05ce60f5 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.241123 Aug 21 01:22:18.808549 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1457/3395] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:22:18.820688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0dd46115-c821-4b15-81f3-7b6bad407ea7 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:18.825174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0dd46115-c821-4b15-81f3-7b6bad407ea7 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:18.829314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6c33f5c-157e-4d95-af2b-20d43fbdd093 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.353394 Aug 21 01:22:18.830303 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1939/3396] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:18 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:18.993013 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0dd46115-c821-4b15-81f3-7b6bad407ea7 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "PUT /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 990 microversion: 2.47 time: 0.176340 Aug 21 01:22:18.994251 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1458/3397] 10.222.0.46 () {62 vars in 1297 bytes} [Sun Aug 21 01:22:18 2022] PUT /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 990 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:22:19.014538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:19.015073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.185554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:19.187947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.203729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.204827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.217276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.218189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.218677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.219107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.332456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.343884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.345968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.350227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.358797 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc4f5bb2-0907-4e6c-9154-42b4370683a6 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1357 microversion: 2.57 time: 0.181154 Aug 21 01:22:19.360919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1459/3398] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:19 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:19.363274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.365230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.374538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4eb55af-fd5d-42d6-b6ff-1171bbb4c513 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1276 microversion: 2.47 time: 0.362518 Aug 21 01:22:19.377245 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1940/3399] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:19 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1276 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:19.399374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:19.402895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.411721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.412599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.413180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.413919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.414623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.415320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.538646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:19.539342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:19.540153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:19.540568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:19.541005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:19.628932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.639703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.640271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.640840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.641500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.642556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.642769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.717916 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c376dc0b-32b3-44c9-a94a-51ef992eac34 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "POST /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347/action" status: 202 len: 1138 microversion: 2.57 time: 0.319581 Aug 21 01:22:19.718303 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1460/3400] 10.222.0.46 () {62 vars in 1320 bytes} [Sun Aug 21 01:22:19 2022] POST /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347/action => generated 1138 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 21 01:22:19.739990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:19.740800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.750769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.751455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.752190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.753462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.754147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.754878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.853742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:19.854741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:19.866096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.867262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.868498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.869751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.870336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.870842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:19.922407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.935722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.939541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:19.941127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6d1159c-5deb-4f6b-ab11-8ae8712ee2ba tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.206304 Aug 21 01:22:19.942896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1941/3401] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:19 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:19.950719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d", "tag": "7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:19.997543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:19.999292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:19.999921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:20.025564 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] Creating event network-changed:7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b for instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d on n-h1-master-1 Aug 21 01:22:20.045983 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a51ac560-5699-43a1-aba6-bb2043fb4b4c req-5ffd5cc9-4ec3-4e53-9c0a-19631e8a2072 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100768 Aug 21 01:22:20.047062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1942/3402] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:20.131541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:20.152460 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53688f1a-4762-4070-a1be-6ca4efc30056 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.305921 Aug 21 01:22:20.172726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1461/3403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:19 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:20.410685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:20.412316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:20.419453 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:20.429667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:20.430309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:20.431101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:20.432327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:20.432882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:20.433319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:20.565567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:20.591206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:20.593290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:20.595197 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e57168e8-bd61-4c9b-86a8-4df3630e38fc tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1328 microversion: 2.47 time: 0.191241 Aug 21 01:22:20.597015 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1943/3404] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:20 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:20.969525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:20.970149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:20.986079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:20.986563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:20.987002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:20.987707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:20.988153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:20.988574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:21.072203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.074354 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:21.084800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.086317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.087514 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e17cd36c-d03f-45f7-9124-4fd59c6b3faa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.122198 Aug 21 01:22:21.088061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1462/3405] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:20 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:21.174035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:21.174751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:21.182571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:21.183134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:21.184144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:21.185243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:21.186585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:21.187111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:21.455276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.468824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a770e60-d572-4c5b-b94f-ed7c37a6bc35 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.298915 Aug 21 01:22:21.470721 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1944/3406] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:21 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:21.621066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:21.622681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:21.632739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:21.635807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:21.636575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:21.637814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:21.638499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:21.652390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:21.780029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-678217312", "imageRef": "72ca37e7-c3be-4394-8f9d-306f3728cb7c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ccc8fb16-fb7a-4206-b7c2-45fdc871b158"}], "security_groups": [{"name": "tempest-securitygroup--300095005"}], "key_name": "tempest-keypair-1831691022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:21.780393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.795456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.797643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:21.799083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ce58c8b-1df4-40c3-97d1-2598f00bbff4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1346 microversion: 2.47 time: 0.183481 Aug 21 01:22:21.799921 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:21.808697 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1463/3407] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:21 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1346 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:21.961637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] validate_networks() for [('ccc8fb16-fb7a-4206-b7c2-45fdc871b158', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:22.111762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:22.112412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:22.119857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.120361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.121091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.121973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.124082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.124731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.433132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:22.433556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:22.434030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:22.434437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:22.435199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:22.445157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.445640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.446076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.446798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.447249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.447702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.453063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.462550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.464298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.465512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86d1603a-a0bf-490b-92c3-acfbef2c5df0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.357808 Aug 21 01:22:22.466125 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1464/3408] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:22 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:22.471895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Getting quotas for project 6b90eb2eef7c45398a821324472a6429. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:22.478854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Getting quotas for user 722940af11854f0687e7c99fae3650a2 and project 6b90eb2eef7c45398a821324472a6429. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:22.491365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:22.492307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:22.494724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:22.497798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='72ca37e7-c3be-4394-8f9d-306f3728cb7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:22.499624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.500111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.500548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.501739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.502192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.502808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.561216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83aee369-7b73-42b7-98e7-f8932f7c067d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785677 Aug 21 01:22:22.569042 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1945/3409] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:22.574738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cbd67294-c409-4196-b4ce-2dda3fede0ca tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:22.576804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cbd67294-c409-4196-b4ce-2dda3fede0ca tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:22.635575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cbd67294-c409-4196-b4ce-2dda3fede0ca tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.642872 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cbd67294-c409-4196-b4ce-2dda3fede0ca tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1245 microversion: 2.1 time: 0.072611 Aug 21 01:22:22.644906 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1946/3410] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:22 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:22.807577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.824367 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8cd92d60-305a-4444-9a50-dea3e6e62a42 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.336816 Aug 21 01:22:22.827258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:22.828250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:22.837792 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1465/3411] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:22 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:22.839113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.839897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.840517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.842838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:22.844315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:22.844315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:22.948787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.963273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.964796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:22.967301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8d4babc-f98a-4f42-8ab7-c64f7f4a3df6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1334 microversion: 2.47 time: 0.144912 Aug 21 01:22:22.980592 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1947/3412] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:22 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:23.487842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:23.488442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:23.495398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.496600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.497154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.498404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.498863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.499337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.578267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:23.601969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:23.607344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:23.610785 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1736a491-9677-4907-8c3e-ad4945be1832 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.126595 Aug 21 01:22:23.612569 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1466/3413] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:23 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:23.664363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:23.674291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:23.682263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.683692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.684234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.685269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.686180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.686705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.777408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:23.788216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef55ad0e-785e-4516-b0b9-f2bcc177f5e6 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1305 microversion: 2.1 time: 0.129048 Aug 21 01:22:23.801124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1948/3414] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:23 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:23.849336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:23.851638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:23.860258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.862491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.863009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.864032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:23.864733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:23.865373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:23.993628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:23.994575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:24.022379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.023306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.023923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:24.025698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.027683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.028291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:24.123477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.133439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.136374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.137547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfb9b72d-9cae-4b23-94bb-4cccfdf2f1d0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1334 microversion: 2.47 time: 0.151074 Aug 21 01:22:24.138667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1949/3415] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:23 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:24.166039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.174851 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fcbbf27-1fc9-4d19-a68a-274181300642 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.330737 Aug 21 01:22:24.175802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1467/3416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:23 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:24.636256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:24.637386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:24.653825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.654439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.654953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:24.655776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.656284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.656708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:24.811897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:24.817102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:24.847228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.857343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.858051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.858590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.860334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:24.860818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:24.861569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:24.862196 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5c117ba-fe90-4d8c-9d88-e7e2db9a31fa tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.231227 Aug 21 01:22:24.863228 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1950/3417] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:24 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:24.871000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:24.871587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.163467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:25.164204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:25.181568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.182376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.182975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.184705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.185519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.186203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.378367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:25.392052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:25.394951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:25.396575 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f1a6b3b-070b-4e3f-96f2-9b3393386c47 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1334 microversion: 2.47 time: 0.237495 Aug 21 01:22:25.415594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1951/3418] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:25 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1334 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:25.422713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:25.425834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:25.433856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.435055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.436241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.437174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.438265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.438912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.452250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:25.466874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0afbad9c-54a0-452f-9775-d014b58ab76d tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.657863 Aug 21 01:22:25.492199 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1468/3419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:24 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:25.703445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:25.711530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4644d6e9-eb74-464f-97d1-851a149ee500 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.294900 Aug 21 01:22:25.714915 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1952/3420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:25 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:25.852106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d", "name": "network-vif-plugged", "status": "completed", "tag": "7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:25.877822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.880698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.884070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.891454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:25.892712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:25.906347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.907120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.908418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.910984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:25.915139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:25.915817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:25.923094 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] Creating event network-vif-plugged:7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b for instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d on n-h1-master-1 Aug 21 01:22:25.932502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-fa612896-56cb-43c3-aa0a-1e7cfa7dcbda req-2db221b5-8641-434c-ba1c-350ee9a44024 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384330 Aug 21 01:22:25.935713 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1469/3421] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:26.022039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.031724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.034964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.036358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-959c78af-61f1-4002-9d17-fe1214a23c50 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.150209 Aug 21 01:22:26.037126 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1953/3422] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:25 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:26.423690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:26.424415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:26.439691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.441282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.442088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.443159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.443959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.444881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.492662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:26.493322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:26.503180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.505745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.508419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.509419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.512139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.513191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.563854 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:26.573626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.586630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.588166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.589354 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-56402c86-6210-451a-b82d-db4aaf57e822 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1334 microversion: 2.47 time: 0.171769 Aug 21 01:22:26.589948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1470/3423] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:26 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:26.629827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9259b75a-8593-4138-977b-c5df39c439fa", "tag": "b975328f-e347-4c17-add5-c5ffe85fee97"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:26.640512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.641449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.642116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.663926 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] Creating event network-changed:b975328f-e347-4c17-add5-c5ffe85fee97 for instance 9259b75a-8593-4138-977b-c5df39c439fa on n-h1-master-1 Aug 21 01:22:26.670520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-aa1f2689-756b-4265-a45b-8c2264a5c138 req-8654d53c-fdbb-41a4-b28c-7e69f2495b1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044529 Aug 21 01:22:26.672035 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1471/3424] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:26.737422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:26.738561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:26.745941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.746758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.747723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.748865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:26.749597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:26.750263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:26.771839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:26.782450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e205ca7-e639-4efd-bb6d-d2a9f4ad4581 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.294025 Aug 21 01:22:26.796797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1954/3425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:26 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:26.992528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.003267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7296963-7059-42b8-8aa1-f97a7b1286c0 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.270719 Aug 21 01:22:27.004637 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1472/3426] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:26 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:27.065961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:27.068032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:27.076509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.078370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.078870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:27.079590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.080042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.080513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:27.189807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.205334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.217551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.218808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c78412cc-8cae-414a-a53a-b6f10437cfea tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.159016 Aug 21 01:22:27.221282 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1955/3427] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:27 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:27.616114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:27.617094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:27.624971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.628580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.629292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:27.630372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.630995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.631655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:27.727935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.738362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.740207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:27.741593 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71fe8104-89e1-4991-81c4-70ecda916c7e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1334 microversion: 2.47 time: 0.129702 Aug 21 01:22:27.751087 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1473/3428] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:27 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1334 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:27.820149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:27.821238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:27.832369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.833959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.835569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:27.836743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:27.837525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:27.838187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.025349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:28.026590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:28.040455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.041045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.041491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.042232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.042688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.043114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.066044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.075865 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-812996ae-2931-4c89-9411-b92bfd8c0916 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.268947 Aug 21 01:22:28.090110 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1956/3429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:27 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:28.248857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:28.249637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:28.261978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.262677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.263418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.264431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.265139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.265625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.305187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.315292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95830753-3ccc-467c-ae93-baa2c8fb6bc2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.294095 Aug 21 01:22:28.316590 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1474/3430] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:28 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:28.399923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.410004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.412532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.414038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ccaf41e-47e9-4085-aa2c-da3cbef8cb68 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.170863 Aug 21 01:22:28.414642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1957/3431] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:28 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:28.768441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:28.769557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:28.775791 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:28.776734 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=34 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:28.783606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.784078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.784735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.785611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.785934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.786532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.867741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.881157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.882761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:28.883966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d988f76-5cba-4141-b014-a5791bf4a790 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1355 microversion: 2.47 time: 0.121943 Aug 21 01:22:28.884525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1475/3432] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:28 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1355 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:28.913693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:28.916706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:28.924395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.928194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.928194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:28.928194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:28.928194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:28.928194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.047881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:29.048322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:29.048835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:29.049238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:29.049697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:29.103886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:29.105783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:29.152572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.154065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.156108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.157679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.158748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.159664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.187919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:29.203872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.205349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.205968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.211894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.213551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.214004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.275642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1482894-04bc-43e7-a93c-baf3e7c353df tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "POST /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544/action" status: 202 len: 1077 microversion: 2.47 time: 0.366484 Aug 21 01:22:29.280805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1958/3433] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:22:28 2022] POST /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544/action => generated 1077 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 21 01:22:29.297093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:29.297951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:29.306474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.306968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.307412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.310042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.310909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.311521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.469423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.484647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.486339 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05549b19-0de4-4313-b413-2d0a342fb051 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.385072 Aug 21 01:22:29.487636 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1476/3434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:29 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:29.492477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:29.493431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:29.508817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.509150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.510451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.511245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.513242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.513888 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.514634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.514786 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d720aa4a-971e-4d5b-8a51-10dfadbefdf2 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.223730 Aug 21 01:22:29.515497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.516707 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1959/3435] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:29 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:29.521773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:29.522625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:29.543962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.545609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.546346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.547539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:29.548244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:29.548858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:29.758416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.769221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1bc7335-f85a-4a97-9ed8-9ff5b20b9eec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.280265 Aug 21 01:22:29.786876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.787425 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1477/3436] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:29 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:29.798457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.801495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:29.806213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93dea476-f154-4fe0-b05f-bfeb98cb24bc tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.288384 Aug 21 01:22:29.807516 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1960/3437] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:29 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:30.512434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:30.513872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:30.523627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.524541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.528197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.530033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.530839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.531750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.548007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:30.549234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:30.563283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.564939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.566647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.569748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.570812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.571483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.675223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:30.686098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:30.688245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:30.689702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-483163e8-cec8-4020-ad4a-8736acb22087 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.147371 Aug 21 01:22:30.690803 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1961/3438] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:30 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:30.794387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:30.795012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:30.808348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.808871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.809318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.810092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.810639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.811077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.830265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:30.841576 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c25f9c2f-3727-4d5b-a89a-840860ad65e2 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.337586 Aug 21 01:22:30.846089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1478/3439] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:30 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:30.852216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:30.852913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:30.869417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.870199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.870946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:30.871948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:30.872607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:30.873265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:31.012997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.023723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.030944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.032559 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0aa1afae-7bb4-414e-b261-1b8ab086db56 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.185503 Aug 21 01:22:31.033647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1479/3440] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:30 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:31.094294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.106209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e2d36c88-93ee-4d8e-bb6f-65a9237c8823 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.315855 Aug 21 01:22:31.118423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1962/3441] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:30 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:31.716649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:31.717547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:31.735213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:31.736348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:31.737856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:31.739020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:31.739569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:31.740157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:31.836803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.839550 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:31.849060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.850645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:31.852622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f651cce9-2045-4882-8211-6ee181fd5da0 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.140772 Aug 21 01:22:31.853562 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1480/3442] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:31 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:31.867067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:31.867829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:31.877989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:31.878689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:31.879211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:31.880112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:31.880629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:31.881300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.066435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:32.067106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:32.082845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.085097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.089956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.089956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.089956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.091407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.124267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.153399 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-004d618b-0978-4b00-bed3-4ff16c980b92 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.290975 Aug 21 01:22:32.155026 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1963/3443] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:31 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:32.164450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:32.165396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:32.187268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.203964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.204923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.207187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.208551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.209404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.294858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.308429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.310504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.313891 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c835f81e-25d1-40c3-9455-28aa2eeb8ddd tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.252326 Aug 21 01:22:32.315317 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1481/3444] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:32 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:32.451591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.455244 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:32.461884 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f35124d8-4a1f-49e8-8725-7e74211d29bf tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.303978 Aug 21 01:22:32.475649 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1964/3445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:32 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:32.878326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:32.878941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:32.886008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.886505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.886938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.887699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:32.888369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:32.888943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:32.965077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.973873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.975397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:32.976569 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19afa476-3d30-43ee-84c5-9979b826f180 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.102419 Aug 21 01:22:32.977175 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1482/3446] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:32 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:33.174502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:33.175190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:33.178335 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=28 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:33.183404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.183881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.184370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.185220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.185738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.186097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.323024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:33.336397 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5163633-7420-40cf-8a3c-3d529357f08b tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.165714 Aug 21 01:22:33.338631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:33.339240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:33.341977 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1965/3447] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:33 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:33.345763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.346438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.346870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.347558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.348007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.348507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.434786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:33.444200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:33.445732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:33.446902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09f0d977-0859-40d0-be5b-ffee2f53345f tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.112283 Aug 21 01:22:33.447928 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1483/3448] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:33 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:33.484751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:33.485549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:33.494823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.495078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.495450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.496177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:33.496714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:33.497488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:33.655744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:33.664852 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f4b31e0-20a7-4af6-b19a-13888fb92f4b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1314 microversion: 2.1 time: 0.185433 Aug 21 01:22:33.665501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1966/3449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:33 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:34.005633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:34.006655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:34.016352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.016884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.017336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.018016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.018514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.018964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.129777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.148850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.152970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.156004 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcfd5ae8-494d-4855-974b-9c7f02c61112 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.159246 Aug 21 01:22:34.157268 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1484/3450] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:33 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:34.364521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:34.365359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:34.373444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.373925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.374350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.375291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.375738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.376119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.473186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:34.474120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:34.480363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.480874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.481287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.482033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.482474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.482926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.579003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.587558 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28eaea54-09e4-4cec-8739-e3e7972147e5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.228077 Aug 21 01:22:34.588249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1967/3451] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:34 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:34.690921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:34.691707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:34.701475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.702974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.704038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.705052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.705865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.706471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.789198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.798151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.800112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.801567 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62fd655f-ce2f-4300-b75b-1f3cbe6328e1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.332939 Aug 21 01:22:34.802221 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1485/3452] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:34 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:34.925668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:34.930643 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:34.942619 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d70ed81-7b0e-4fbf-894b-4d9b1d11c805 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1501 microversion: 2.1 time: 0.255625 Aug 21 01:22:34.943541 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1968/3453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:34 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:34.964327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:34.964964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:34.988130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.988628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.989084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:34.989798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:34.990258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:34.992127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.064226 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a808759-bdc4-43a5-adaf-c06196d7cdf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d/action" status: 202 len: 0 microversion: 2.1 time: 0.103711 Aug 21 01:22:35.068033 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1486/3454] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:22:34 2022] POST /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:22:35.073388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.074136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.081843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.082303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.082733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.083456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.083892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.084319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.188477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.189312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.196292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.197119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.197763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.198690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.199352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.200003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.228434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.237151 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12311146-9e03-4fce-b067-4b1451d05253 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1506 microversion: 2.1 time: 0.167633 Aug 21 01:22:35.237980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1969/3455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:35.272748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.281346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.282832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.284014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66bfa287-1d2e-481c-8f35-c09910748247 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.105221 Aug 21 01:22:35.284970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1487/3456] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:35.597451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.599909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.608624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.609279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.615802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.616342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.616474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.616839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.616994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.617286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.617548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.618006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.618176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.618394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.618676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.619056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.649895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34ad4d68-0430-4b84-a226-f669288451f0 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056592 Aug 21 01:22:35.650471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1970/3457] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:22:35.729302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.729816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.736165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.736666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.737138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.737842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.738302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.738727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.764554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:22:35.783300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.793177 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-993add73-3137-4a3d-8812-a08713a14312 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.188504 Aug 21 01:22:35.807988 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1488/3458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:35.831286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.832141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.838783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.839479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.840093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.841063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.841669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.842220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.860495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8405316-3848-425f-9fc5-9bf2fa57472a tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 204 len: 0 microversion: 2.1 time: 0.134812 Aug 21 01:22:35.861302 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1971/3459] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:22:35 2022] DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:22:35.870200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:35.871213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:35.877513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.878313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.878886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.879669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:35.880200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:35.880761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:35.912011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.923343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.925154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:35.926506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bacc63d2-78b2-439e-aebf-1ccbcc279828 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.100543 Aug 21 01:22:35.927064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1489/3460] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:36.045042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.053103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2366897-0e4d-4f29-9759-658d0a660b28 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1672 microversion: 2.1 time: 0.187314 Aug 21 01:22:36.053706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1972/3461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:35 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:36.258021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.258879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.267170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.267746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.268265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.269108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.269567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.269988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.307919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.308693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.315407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.315960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.316462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.317481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.317976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.318451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.389892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.398869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.400574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.401974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0643d18-1bee-4fd5-87cb-3750fc7a12f4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.098123 Aug 21 01:22:36.413162 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1973/3462] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:36 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:36.415938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.424137 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-731871d5-7c19-4b63-9188-d133f816bb02 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1486 microversion: 2.1 time: 0.170164 Aug 21 01:22:36.424722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1490/3463] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:36 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1486 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:36.444690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.445229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.451384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.451860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.452296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.453030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.453506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.453936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.480256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:22:36.568890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae199e7a-3343-42e2-ac2d-8d969687f034 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 204 len: 0 microversion: 2.1 time: 0.127760 Aug 21 01:22:36.569559 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1974/3464] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:22:36 2022] DELETE /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:22:36.579709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.580330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.587112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.587581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.588017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.588725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.589178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.589603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.743064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:36.751153 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fb20d8e-32c2-4f8c-a975-14b29a911b5e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1492 microversion: 2.1 time: 0.175749 Aug 21 01:22:36.751777 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1491/3465] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:36 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1492 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:36.817137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.817137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.824364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.824888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.826015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.826726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.827181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.827603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.951099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:36.951831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:36.958211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.959021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.959451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:36.960149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:36.960589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:36.961041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.033633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.044486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.046027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.047238 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-79763258-0593-4412-b945-e5c02ed69af2 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.100283 Aug 21 01:22:37.047890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1492/3466] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:36 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:37.074913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:37.075584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:37.082300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.082790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.083222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.083930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.084378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.084818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.240562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.250135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05303fa3-64d0-4f6c-a01d-eb3ffb2e9bd4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1672 microversion: 2.1 time: 0.179079 Aug 21 01:22:37.253004 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1493/3467] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:37 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:37.270579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.279199 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-633603f1-e700-4b15-9ebf-ad9cb8624dcb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.467328 Aug 21 01:22:37.287431 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1975/3468] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:36 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:37.425038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:37.425654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:37.434135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.435028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.435738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.436603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.437132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.438160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.515039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.524022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.525784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.526959 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e434eff-e28f-4d32-919e-ba2156a0d5dd tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.106265 Aug 21 01:22:37.527684 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1494/3469] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:37 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:37.771897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:37.772736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:37.781211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.782086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.782745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.783708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:37.784510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:37.785366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:37.941099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:37.950414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f207ece2-8314-483c-96e2-8cf5be290937 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1492 microversion: 2.1 time: 0.182232 Aug 21 01:22:37.951652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1976/3470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:37 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:38.071560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:38.072161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:38.078774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.079250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.079674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.080361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.081167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.081614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.163665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.172994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.174694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.176020 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b08e36fd-f4fb-4229-8974-5e5046288958 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.108550 Aug 21 01:22:38.176800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1495/3471] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:38 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:38.282442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:38.284494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:38.291123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.293084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.293662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.294833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.300482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:38.301448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:38.304462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.304986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.314866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.315797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.316483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.317698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.318517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.319279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.343194 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:38.456378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.465822 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85e9ba9d-7a5f-4225-890f-d25ca813bb4e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1672 microversion: 2.1 time: 0.195108 Aug 21 01:22:38.467436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1977/3472] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:38 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:38.551475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:38.551980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:38.555137 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:38.561681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.562167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.563232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.564792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:38.565446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:38.565863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:38.645465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.654974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.656706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.657926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec0ef424-5baf-4d0f-b1ba-b57e30bffbef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.110888 Aug 21 01:22:38.658643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1978/3473] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:38 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:38.707642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:38.718786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-82c4e8c4-7274-4ebb-88eb-35a5fe69ed88 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.422135 Aug 21 01:22:38.719366 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1496/3474] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:38 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:38.976820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:38.977577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:39.007077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.007576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.008018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.008735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.009221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.009636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.094020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.102507 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ecc213f5-04e4-4149-b422-2b28fdc5e511 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 200 len: 1450 microversion: 2.1 time: 0.130090 Aug 21 01:22:39.103871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1979/3475] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:38 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 1450 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:39.175376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d", "name": "network-vif-deleted", "tag": "7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:39.199618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:39.200519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:39.209445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.211837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.212529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.212994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.213678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.213914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.214146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.214569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.214959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.230941 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] Creating event network-vif-deleted:7d91ea2d-cf1b-428d-b4b1-9bd62fd04b9b for instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d on n-h1-master-1 Aug 21 01:22:39.239485 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1cac2f93-3599-4b79-9571-9b229eb70560 req-a2329956-c81d-4abb-a2b3-e10492596c5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072273 Aug 21 01:22:39.240754 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1497/3476] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:39.329122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.346345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.347962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.349425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3a5df26-3946-4321-acad-de8ac1ab59c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.153946 Aug 21 01:22:39.350153 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1980/3477] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:39 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:39.489469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:39.490584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:39.502521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.503338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.504019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.505007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.505830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.506831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.536814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9259b75a-8593-4138-977b-c5df39c439fa", "name": "network-vif-plugged", "status": "completed", "tag": "b975328f-e347-4c17-add5-c5ffe85fee97"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:39.555519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.558324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.558837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.611083 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] Creating event network-vif-plugged:b975328f-e347-4c17-add5-c5ffe85fee97 for instance 9259b75a-8593-4138-977b-c5df39c439fa on n-h1-master-1 Aug 21 01:22:39.616642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-65e9b8a4-1f03-4b06-bcc3-5afe9092ff6a req-359f6132-937d-4c41-b138-19c0e5f43486 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084594 Aug 21 01:22:39.617925 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1981/3478] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:39.683435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:39.685214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:39.692614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.693056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.693491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.694396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.695018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.695604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.708015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.724939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da10444e-cfbf-4058-b4d5-04294f494505 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 200 len: 1605 microversion: 2.1 time: 0.236513 Aug 21 01:22:39.726814 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1498/3479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:39 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:39.746693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:39.755436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:39.788345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.788888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.789339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.790183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:39.790627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:39.791073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:39.803552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.806316 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:39.820844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.822802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:39.824363 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6340442b-4f57-4c05-be57-5d14f5146940 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.145462 Aug 21 01:22:39.826245 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1982/3480] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:39 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:40.124308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:40.124992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:40.136633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.149076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.149663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.150611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.151189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.151657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.178115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d HTTP/1.1 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d'} Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:40.183279 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.190794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:40.192089 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adaf3205-147e-4f61-ad30-799935eaadef tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 404 len: 111 microversion: 2.1 time: 0.069968 Aug 21 01:22:40.205184 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1983/3481] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:40 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:22:40.230571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:40.239959 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d24a7e6-94f2-4a0a-a45c-ff9b27cbd3d9 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.497460 Aug 21 01:22:40.244823 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1499/3482] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:39 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:40.319300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-639600922", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:40.373994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:40.374619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:40.385562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:40.386018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.387592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.388341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.389596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.390360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.390883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.471294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:40.481760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:40.483943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:40.485710 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f850f541-3172-4c25-b048-1ddfef151a03 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.116407 Aug 21 01:22:40.487221 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1500/3483] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:40 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:40.759225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:40.760701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:40.769971 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:40.772178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.773669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.776017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.778335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.779456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.780714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.807349 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 HTTP/1.1 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '3b529918-528f-4ae1-8f5b-552174a5c2e9'} Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:40.809472 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:40.815236 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0da3e8e9-fc59-4acd-8483-7f1acb1274aa tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 404 len: 111 microversion: 2.1 time: 0.057814 Aug 21 01:22:40.817209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1501/3484] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:40 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:22:40.824872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:40.825387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:40.826084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:40.826704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:40.827582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:40.835417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-116179bd-1816-4506-ba5e-48e7d9dae5d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '.version_select at 0x7fc3fdac0790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:40.845729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.845729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.846024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.846575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.847131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.851138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.878265 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-116179bd-1816-4506-ba5e-48e7d9dae5d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124134900" status: 202 len: 0 microversion: 2.1 time: 0.058810 Aug 21 01:22:40.890119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:40.894338 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1502/3485] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124134900 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:22:40.899989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:40.900702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:40.901467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:40.911023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.911710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.912357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.913339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:40.914027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:40.914689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:40.919652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:40.927644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:41.018069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.028519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.031528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17cdac96-43a1-4689-96a8-d9300d46ac4e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716854 Aug 21 01:22:41.032574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.033003 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1984/3486] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:41.034159 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0c4b30c-2746-42b6-8a69-05792c013d62 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.138423 Aug 21 01:22:41.034858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1503/3487] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:40 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:41.068859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-75b21ed6-8e60-4ab4-b04b-85be108d85dd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:41.069575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-75b21ed6-8e60-4ab4-b04b-85be108d85dd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:41.175198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-75b21ed6-8e60-4ab4-b04b-85be108d85dd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.186965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-75b21ed6-8e60-4ab4-b04b-85be108d85dd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1214 microversion: 2.1 time: 0.136481 Aug 21 01:22:41.188558 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1985/3488] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:41 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:41.262376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:41.263159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:41.268746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b529918-528f-4ae1-8f5b-552174a5c2e9", "name": "network-vif-deleted", "tag": "5c277213-83ec-41af-8143-213b4e1b5301"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:41.275579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:41.276074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:41.279245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:41.280045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:41.280521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:41.282493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:41.284420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:41.285061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:41.285370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:41.304530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] Creating event network-vif-deleted:5c277213-83ec-41af-8143-213b4e1b5301 for instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 on n-h2-master-1 Aug 21 01:22:41.314859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a7a39e0e-c1c5-4085-8d2b-458fe95a4d88 req-6b8ee707-a913-4dec-8c95-3e42caa6c2a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049605 Aug 21 01:22:41.315901 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1986/3489] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:41.518366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:41.519557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:41.529448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:41.530631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:41.543865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:41.545147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:41.546344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:41.547242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:41.629177 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.639912 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0357fab-4593-4385-983a-e95d56297e7e tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1370 microversion: 2.1 time: 0.381445 Aug 21 01:22:41.658509 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1504/3490] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:41 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:41.677381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.701766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.713896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:41.715338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf2c3eb4-c495-4daa-af56-56ac41269ca0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.204952 Aug 21 01:22:41.734537 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1987/3491] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:41 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:42.001826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5b60494-1215-4155-ab69-62f9e88786d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: .version_select at 0x7fc3fe2a65e0>, body: {"keypair": {"name": "tempest-keypair-1695378294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH13m7Nr1DtJRxoYWy4JX68jQK+sCSxPijI/psd9JnV8H3YQXoarePb6yiQ4MYXNtT3EKTHERYehVLg1sgG2t0LEPoLx8YFRcnTAxBEO3r7pbIZX3oy9YUz1uIF2St5r3g=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:42.019326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e5b60494-1215-4155-ab69-62f9e88786d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for project fe917515a56c4577b45df3eb16642a2d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:42.025703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e5b60494-1215-4155-ab69-62f9e88786d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for user 3338f52621ec4501b2f0b88ff5cb36fb and project fe917515a56c4577b45df3eb16642a2d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:42.049286 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5b60494-1215-4155-ab69-62f9e88786d4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051809 Aug 21 01:22:42.049883 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1505/3492] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:22:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:42.072103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:42.074350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:42.084746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.085282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.085893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.086670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.087293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.087710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.189052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.209246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.211660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.217338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98555c19-5530-474d-9de5-abda91d3244f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.158480 Aug 21 01:22:42.217581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:42.218876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:42.229561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.229989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.230422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.231126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.231744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.232178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.235047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1988/3493] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:42 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:42.330386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.341893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db3f47b9-62ee-43aa-892a-7f2e29fdea28 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1266 microversion: 2.1 time: 0.127834 Aug 21 01:22:42.342846 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1506/3494] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:42 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:42.666189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:42.667154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:42.675360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.676179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.676815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.677766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.678212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.678807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.742736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:42.743550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:42.750760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.751248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.751746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.752707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.753181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.753764 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.873961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.895252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.897574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.898750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ee71fd7-02dd-4296-b804-bd31bb460994 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.161628 Aug 21 01:22:42.899312 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1507/3495] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:42 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:42.932311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:42.942196 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff5a4546-35ae-4931-8ca7-3aef06cbbec5 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1557 microversion: 2.1 time: 0.280388 Aug 21 01:22:42.943105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1989/3496] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:42 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1557 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:42.967204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:42.968146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:42.975785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.976672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.977330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:42.978250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:42.978926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:42.979542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.176343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6707f7f-fcf8-42df-aa28-e5b1f882a2bf tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212868 Aug 21 01:22:43.179711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1508/3497] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:22:42 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:43.242609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:43.244374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:43.257823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.258737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.259756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.260864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.281176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.285118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.368545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:43.370130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:43.381561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.382184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.382727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.383520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.384102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.384528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.462841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:43.473820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:43.475942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:43.477733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f92ee7b1-efb4-4059-b563-8b2b9be8b7ef tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.240950 Aug 21 01:22:43.479109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1990/3498] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:43 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:43.562797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:43.573319 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1652b736-b77f-4098-83fc-c158091e03c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1272 microversion: 2.1 time: 0.213281 Aug 21 01:22:43.585517 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1509/3499] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:43 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:43.922622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:43.927685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:43.961338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.962876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.968045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:43.974134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:43.975287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:43.975736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:44.091831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.108130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.110341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.113821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-421dd510-c1bc-45fa-92f0-cf54855a32f8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.196034 Aug 21 01:22:44.117667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1991/3500] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:43 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:44.438898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-964345351", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa556953-a792-46d3-9fb5-d1fa66df1f0f"}], "security_groups": [{"name": "tempest-securitygroup--981949008"}], "key_name": "tempest-keypair-1695378294", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:44.504860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:44.505974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:44.522564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:44.523062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:44.525053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:44.525998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:44.526634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:44.527221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:44.619605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.636754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.640236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:44.642746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bbfef76-b5b0-4f50-a574-3c09cbae0cb4 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.144059 Aug 21 01:22:44.644359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1992/3501] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:44 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:44.661880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] validate_networks() for [('fa556953-a792-46d3-9fb5-d1fa66df1f0f', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:44.662121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:44.662601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:44.674977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:44.678952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:44.679477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:44.682176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:44.682829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:44.683479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.331923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.346944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e9560ff-3f3b-488d-b4ac-15d0ae4dd25c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.700445 Aug 21 01:22:45.347567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1993/3502] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:44 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:45.385351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:45.387939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:45.398227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.398895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.399332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.400409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.400889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.401628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.491371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.505723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.507452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.508716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2aef09f-cc25-489d-93f9-5b1cfb5804d4 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.159455 Aug 21 01:22:45.520357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1994/3503] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:45 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:45.646267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:45.646737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:45.647613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:45.647881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:45.648295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:45.666020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.667005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.670410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.678864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.679555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.690842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9259b75a-8593-4138-977b-c5df39c439fa", "tag": "b975328f-e347-4c17-add5-c5ffe85fee97"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:45.693386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.701944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.702700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.703301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.727114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for project fe917515a56c4577b45df3eb16642a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:45.735002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Getting quotas for user 3338f52621ec4501b2f0b88ff5cb36fb and project fe917515a56c4577b45df3eb16642a2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:45.739123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] Creating event network-changed:b975328f-e347-4c17-add5-c5ffe85fee97 for instance 9259b75a-8593-4138-977b-c5df39c439fa on n-h1-master-1 Aug 21 01:22:45.745428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-540f68b9-b29b-4bb8-af9e-8cb39e915cd8 req-d0966ca2-555c-410a-b3d3-3c50975efe76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226997 Aug 21 01:22:45.749805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1995/3504] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:45.761943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:45.767976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:45.768432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87775b07-5ca8-42d0-9f0e-59632cdd3649", "tag": "f92d8e35-0cd9-4476-8721-42ccbdb81662"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:45.781551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.782126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.782707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.801527 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] Creating event network-changed:f92d8e35-0cd9-4476-8721-42ccbdb81662 for instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 on n-h1-master-1 Aug 21 01:22:45.809135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c75e6e19-aea2-4684-977a-d3261f6c65d0 req-54da0fdf-2fc9-4648-82df-016485b9f029 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057154 Aug 21 01:22:45.810268 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1996/3505] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:45.817829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:45.818793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:45.827160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.827889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.828696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.833640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:45.834278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:45.834890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:45.854258 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db3461ee-a4c3-4ac6-a069-e9619427065e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.420916 Aug 21 01:22:45.866660 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1510/3506] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:45.877789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86634465-ccc5-44c6-ae80-ea9fb2a4ebaf tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:45.880955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86634465-ccc5-44c6-ae80-ea9fb2a4ebaf tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:45.949698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.960353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.962492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:45.964946 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64f9d8be-4dfc-4f19-bb8d-6082cb7fd1ff tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.152684 Aug 21 01:22:45.966201 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1997/3507] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:45 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:46.017336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86634465-ccc5-44c6-ae80-ea9fb2a4ebaf tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:46.030021 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86634465-ccc5-44c6-ae80-ea9fb2a4ebaf tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1237 microversion: 2.1 time: 0.160888 Aug 21 01:22:46.030911 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1511/3508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:45 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1237 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:46.369976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:46.371610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:46.390830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.391780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.392455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:46.393598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.394794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.395859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:46.539512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:46.540135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:46.568428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.568969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.569405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:46.570120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.570571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.571773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:46.646698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:46.658733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41c81274-f676-4c83-8931-0044b922af64 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.294338 Aug 21 01:22:46.659868 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1998/3509] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:46 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:46.710308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:46.723534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:46.726855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:46.731044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d83db701-49d2-4606-804b-5e92c59d695b tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.196532 Aug 21 01:22:46.744166 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1512/3510] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:46 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:46.987937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:46.988600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:46.995984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.996485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.997354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:46.998275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:46.998744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:46.999368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.051667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:47.052207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:47.063214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.063696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.064130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.064851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.065304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.065719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.070157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.079500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.082214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.083723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-978a07ee-ebe2-4435-bea9-af977b580620 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.099933 Aug 21 01:22:47.084285 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 1999/3511] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:46 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:47.143266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.151397 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4e1addb-80f2-4c20-ae2d-3c3358f29113 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1289 microversion: 2.1 time: 0.103953 Aug 21 01:22:47.151973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1513/3512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:47 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:47.681624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:47.682454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:47.698177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.699066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.699877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.701047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.702476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.703112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.777481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:47.799960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:47.824827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.825773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.826282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.827077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.827732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.828491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.953951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.963715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a973691a-887c-4909-a9b5-103bdd8a25b4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.286147 Aug 21 01:22:47.964820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2000/3513] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:47 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:47.973968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.981741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:47.982402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:47.984504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.986502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:47.987713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbd88c50-fbf9-40f7-93f2-270882f1ce24 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.232084 Aug 21 01:22:47.991138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.991625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.992057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:47.993947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:47.994422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:47.994843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.001705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1514/3514] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:47 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:48.108111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.109371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:48.116265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.116750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.117236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.117924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.118662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.119134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.146232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.158173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6073f62d-1177-4135-8b84-ab8f3fbf5bce tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.192205 Aug 21 01:22:48.159454 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2001/3515] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:47 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:48.177691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.177691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:48.183569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.184067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.185341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.186094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.186697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.187482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.219130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.231053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.234717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.236328 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de26e846-8b21-4b8d-b2c6-9e0f945b9771 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.132686 Aug 21 01:22:48.237189 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1515/3516] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:48.243167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.244156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:48.251486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.252301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.252752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.253611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.254246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.254850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.295044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.305167 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f826348-9f55-4788-93af-ad7e54de9b61 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1295 microversion: 2.1 time: 0.134268 Aug 21 01:22:48.306788 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2002/3517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:48.627163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.637478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-119e7aaa-cde9-4d03-9786-11f99d946413 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.398981 Aug 21 01:22:48.638641 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1516/3518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:48.659304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.660621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:48.667022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.667828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.668198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.668961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.669404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.669978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.817286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:48.820794 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:48.827994 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79a353a3-6c82-45a3-837a-226a3a7402bd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.172601 Aug 21 01:22:48.828581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2003/3519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:48.848409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.849034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:48.856107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.856753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.857405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.858093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:48.858532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:48.858943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:48.988232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:48.989701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:49.005225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.008751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.009576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.011085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.012175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.013294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.145089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.155509 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c8e6ecf-5a4b-4f5e-ba34-14bc9c2962d5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.311098 Aug 21 01:22:49.156759 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1517/3520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:49.163112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:49.164052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:49.185586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.186243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.186950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.189422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.190289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.190720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.192469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.209994 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5d0dcbc-aa58-42cd-b7bb-c932cf9fc39b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.227112 Aug 21 01:22:49.211143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2004/3521] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:48 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:49.224073 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:49.265323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:49.266385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:49.273322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.274142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.274907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.275842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.276729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.278655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.357242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.380173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.383617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.385582 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8133bc91-51e9-45ae-9bc3-56499f5ac03d tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.125467 Aug 21 01:22:49.397809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2005/3522] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:49 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:49.411318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:49.413184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:49.421066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.421984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.422648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.423629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:49.425141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:49.425822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:49.593143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.602962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.613986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.616155 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eb19e881-e3cb-4e39-ac95-a2db0c1c717e tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1366 microversion: 2.57 time: 0.458188 Aug 21 01:22:49.625533 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1518/3523] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:49 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:49.634422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1894384630", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "4ec7abf5-e561-48e7-9db1-bc3c2f1218ae"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:49.648828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:49.660068 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0c3e394-9e2d-45b5-a052-e1bf3c3422af tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.260390 Aug 21 01:22:49.665277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2006/3524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:49 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:49.732676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] validate_networks() for [('4ec7abf5-e561-48e7-9db1-bc3c2f1218ae', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:22:50.232464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:50.233195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:50.241151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.241617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.242289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.243072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.243522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.243933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.395023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.405673 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bc2858b-3e20-411d-a508-6a193fd7ad88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.177243 Aug 21 01:22:50.408362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2007/3525] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:50 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:50.413298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3458856f-60c0-41af-8823-196f07d19424", "tag": "6da4140c-4449-410e-a199-fb188843130e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:50.423289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.424022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.424591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.437976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] Creating event network-changed:6da4140c-4449-410e-a199-fb188843130e for instance 3458856f-60c0-41af-8823-196f07d19424 on n-h2-master-1 Aug 21 01:22:50.443876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8880ea61-c434-4c39-8503-f4b91e9d45cc req-ec2d10a9-9e26-496a-b44f-e1481e7f0ac2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 21 01:22:50.444589 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2008/3526] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:50.452349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:50.453089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:50.459637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.460124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.460560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.461284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.461729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.462333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.518310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:22:50.519525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:22:50.520244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:22:50.520912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:22:50.521607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:22:50.531999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.532878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.533559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.534626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.535423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.536148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.543617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.556356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.557798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:22:50.558615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.560027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6faaa3f0-346e-4fcc-afba-970d12b4f74b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.113885 Aug 21 01:22:50.560863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2009/3527] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:50 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:50.564910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:22:50.578456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:22:50.581346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:22:50.643255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:50.644283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:50.650883 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fdacd12-5e46-4d87-b4d2-3f4a77c3d10a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032714 Aug 21 01:22:50.653271 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1519/3528] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:22:50.663181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.663687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.664131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.667060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a762aa9c-057b-47ff-8baf-f8bb20beeb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:50.668613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a762aa9c-057b-47ff-8baf-f8bb20beeb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:50.669944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.670467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.671547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.794930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a762aa9c-057b-47ff-8baf-f8bb20beeb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.806575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a762aa9c-057b-47ff-8baf-f8bb20beeb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1215 microversion: 2.1 time: 0.146296 Aug 21 01:22:50.808682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1520/3529] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:50 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:50.817898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:50.818285 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.819142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:50.830295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.831155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.831895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.832915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:50.833599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:50.834804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:50.842033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.851052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:50.852377 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17abad90-aa61-4441-86df-845876c366d0 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1372 microversion: 2.57 time: 0.213325 Aug 21 01:22:50.853333 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2010/3530] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:50 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:51.357344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.369413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50dbcecf-f6ce-4019-9b3c-54a69e79d790 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.557054 Aug 21 01:22:51.370463 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1521/3531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:50 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:51.432965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:51.434428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:51.440443 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:51.441848 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:51.445232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.445989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.446818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.447747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.448397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.449197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.525800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87775b07-5ca8-42d0-9f0e-59632cdd3649", "name": "network-vif-plugged", "status": "completed", "tag": "f92d8e35-0cd9-4476-8721-42ccbdb81662"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:51.537629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.538171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.538606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.559577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] Creating event network-vif-plugged:f92d8e35-0cd9-4476-8721-42ccbdb81662 for instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 on n-h1-master-1 Aug 21 01:22:51.565030 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6d22270f-6772-499c-9960-35c9e30b43fb req-23dd0526-8e1e-464a-ad81-d7c01016c8a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042941 Aug 21 01:22:51.566001 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1522/3532] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:51.586629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:51.587368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:51.601878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.602399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.605146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.605977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.606683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.607308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.642026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.652940 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c34668e4-c469-4e0c-abda-8333d574182b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.223656 Aug 21 01:22:51.664316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2011/3533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:51 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:51.726390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.737280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.739242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.740989 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-779045b9-cf07-4798-9719-c62ac9fde098 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.159102 Aug 21 01:22:51.752205 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1523/3534] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:51 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:51.836121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:51.836797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:51.851445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.854636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.858586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.861643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.863794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.864312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.877492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:51.878532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:51.888645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.889274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.889947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.891001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:51.891757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:51.892253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:51.948119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.956340 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6748191a-4339-4822-9da2-c40b26922afc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1267 microversion: 2.1 time: 0.127866 Aug 21 01:22:51.956997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2012/3535] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:51 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:51.976229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.986376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.988063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:51.989986 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ee0ef02-07f7-44e5-8de7-2220014ae727 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1357 microversion: 2.57 time: 0.116735 Aug 21 01:22:51.990752 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1524/3536] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:51 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:22:52.017712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.018417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.024803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.025380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.025875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.026623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.027145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.027633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.053674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:22:52.155037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f506af05-b265-4687-be9d-08d1d78f23ca tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 204 len: 0 microversion: 2.57 time: 0.141091 Aug 21 01:22:52.155897 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2013/3537] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:22:52 2022] DELETE /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:22:52.167970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.169252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.177448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.178277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.179195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.181001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.182437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.183093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.269251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.277592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.279152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.280310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ee3a306-1482-4e1a-974d-93a5ac048359 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1363 microversion: 2.57 time: 0.117647 Aug 21 01:22:52.280906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1525/3538] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:52 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1363 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:52.393927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.394875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.403628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.404037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.404470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.405298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.405752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.408034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.556231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.565345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-918b84ba-05d4-4f2d-a848-0f014f158a6d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.178018 Aug 21 01:22:52.565964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2014/3539] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:52 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:52.676363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.677065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.683627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.684442 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.684944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.685762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.686211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.686623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.765412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.766456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.775334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.776047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.782264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.784223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.784837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.785554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.861017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.870817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.874484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:52.876016 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16a2fd63-2a14-4411-9c05-c5049515f366 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.115810 Aug 21 01:22:52.876598 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2015/3540] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:52 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:52.978262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:52.979146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:52.986955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.988099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.989239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:52.990106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:52.990771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:52.991327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.035669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.045434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4f00fb3-65ce-42f6-a33a-4f7ab3a44f3f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1314 microversion: 2.1 time: 0.372626 Aug 21 01:22:53.046580 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1526/3541] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:52 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:53.088358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.097415 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2a47516-1990-422f-ba05-3344b20d8dfc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1273 microversion: 2.1 time: 0.123809 Aug 21 01:22:53.097996 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2016/3542] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:52 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:53.304441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:53.305161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:53.311854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.312676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.313149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.313882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.314304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.314937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.394478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.404020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.405776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.407181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-27202b47-cc23-40af-bb0b-09b43563c3c8 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1363 microversion: 2.57 time: 0.106981 Aug 21 01:22:53.407739 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1527/3543] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:53 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1363 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:53.587555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:53.588316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:53.592203 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:53.598144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.598710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.599392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.600192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.600716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.601412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.754756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:53.766124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7aba7f6-c354-49d6-8b59-74e993e48700 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.182973 Aug 21 01:22:53.767108 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2017/3544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:53 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:53.900382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:53.901016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:53.904361 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:53.917031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.917854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.918463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:53.919626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:53.920658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:53.921418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.052328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.068211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:54.068470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.068796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.079531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.080032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.081252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.081405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.082708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.083174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.084392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-348d6825-a3c3-433b-a38e-c986dcef156e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.188586 Aug 21 01:22:54.084932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.086198 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1528/3545] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:53 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:54.119696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:54.120369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.154091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.154938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.155729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.158500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.158976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.159404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.351995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.360328 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa32c00d-a606-438d-80dc-a3bf1cdad17e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1501 microversion: 2.1 time: 0.296631 Aug 21 01:22:54.361295 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2018/3546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:54 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:54.380881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:54.381565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.387960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.389703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.389703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.390429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.390867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.391401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.411374 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:54.442008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lazy-loading 'flavor' on Instance uuid 87775b07-5ca8-42d0-9f0e-59632cdd3649 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:22:54.692422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.702406 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bef16bf3-42ab-4ad3-9a17-fd0781162116 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.586691 Aug 21 01:22:54.706268 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1529/3547] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:54 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:54.717391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:54.718254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.751163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.751818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.752324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.753147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.753747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.754247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.770072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a83f20ca-c117-41cc-b6e5-c3758481288a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649/action" status: 202 len: 0 microversion: 2.1 time: 0.392855 Aug 21 01:22:54.774298 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2019/3548] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:22:54 2022] POST /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:22:54.780254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:54.782904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.791219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.792117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.792910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.794919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.795659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.796015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.796391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.797324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lazy-loading 'fault' on Instance uuid cb02de04-e06b-47e3-b8aa-8a7fe9edc347 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:22:54.797564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.798471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.896098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.912595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.915262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f1301aa097942a2a4309911a00bf511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9ebbd02c41420083631ba591536d53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:54.918226 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64b96364-9fe7-4a35-9d8e-fe7115907292 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 200 len: 1368 microversion: 2.57 time: 0.210743 Aug 21 01:22:54.918813 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1530/3549] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:54 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:54.933476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:54.936441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:54.949732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.951207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.951930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.953117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:54.953573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:54.954179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:54.991315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.014095 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f46360c3-424c-4a3f-a198-f082100b2547 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.235918 Aug 21 01:22:55.017070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2020/3550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:54 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:55.109297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:55.110701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:55.117307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.118597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.119396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.120077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.120555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.121005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.203654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.218501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.220319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.221831 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31156c41-52f1-4254-a535-c70a33933d44 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.116804 Aug 21 01:22:55.222921 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2021/3551] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:55 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:55.271757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.287513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f03ea70-1299-4fb2-831b-d7c50a7ce8c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.364462 Aug 21 01:22:55.303930 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1531/3552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:54 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:55.527367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6058b8-2543-431b-a408-2054dc24b51a", "tag": "0581badc-ef75-4087-842b-4bbc65b29902"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:55.539361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.539981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.540705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.555024 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] Creating event network-changed:0581badc-ef75-4087-842b-4bbc65b29902 for instance ca6058b8-2543-431b-a408-2054dc24b51a on n-h1-master-1 Aug 21 01:22:55.579909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a66df700-e6ae-40bd-b33a-165d3001c0b9 req-7731fec4-a9ac-42be-8938-24f4e80c2212 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056233 Aug 21 01:22:55.580600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2022/3553] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:55.732003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:55.733031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:55.739444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.739921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.740340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.741052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.741485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.742105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.946027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:55.947399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] [instance: cb02de04-e06b-47e3-b8aa-8a7fe9edc347] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:55.954810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.955543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.956184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.957073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:55.957568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:55.958131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:55.968598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:55.974921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] HTTP exception thrown: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Request method failure captured: Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 HTTP/1.1 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYjExqO1JnYasjNPanmuxKUpgf1HsqEEX21fWBFtD_TYVIrk0-067RREsO0EO62_12DZbpjdqoU1zuJiKePBkqGo4JOpSxyH4ulXbJQDPp4_eLptxB4NiM9u-H4Ac468Mv8Q_77QlpD23GhZZ7iwDUL7hwIrx99gPKF0J9Ygq2gHkks Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.57 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1b9ebbd02c41420083631ba591536d53 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerShowV257Test-870424563 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b9ebbd02c41420083631ba591536d53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1b9ebbd02c41420083631ba591536d53", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1b9ebbd02c41420083631ba591536d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1b9ebbd02c41420083631ba591536d53"}]}] Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerShowV257Test-870424563 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1b9ebbd02c41420083631ba591536d53 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerShowV257Test-870424563 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerShowV257Test-870424563-project Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 6f1301aa097942a2a4309911a00bf511 Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerShowV257Test-870424563-project Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: exception: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'cb02de04-e06b-47e3-b8aa-8a7fe9edc347'} Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:22:55.976707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] Returning 404 to user: Instance cb02de04-e06b-47e3-b8aa-8a7fe9edc347 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb21c7d6-3939-42ed-9365-4df51febdfc1 tempest-ServerShowV257Test-870424563 tempest-ServerShowV257Test-870424563-project] 10.222.0.46 "GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347" status: 404 len: 111 microversion: 2.57 time: 0.038010 Aug 21 01:22:55.982144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2023/3554] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:55 2022] GET /compute/v2.1/servers/cb02de04-e06b-47e3-b8aa-8a7fe9edc347 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:22:55.984495 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69195787-c819-43e2-b14a-fc625e900a6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.256537 Aug 21 01:22:55.985443 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1532/3555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:55 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:56.041777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:56.042547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:56.052245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.053061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.053664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.056312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.057861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.059227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.224556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:56.233535 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ced9bf1-c054-4336-97b4-32283c9f83d7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.198965 Aug 21 01:22:56.234359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2024/3556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:56 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:56.248594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:56.249236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:56.258569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.259473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.259994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.260845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.261386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.262055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.313128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:56.313745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:56.320153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.320644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.321403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.322271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:56.322271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:56.322646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:56.343347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:56.356341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:56.359815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:56.362173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c338fa0-08f3-49af-a0c0-2fb97ecdce30 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.119994 Aug 21 01:22:56.362773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1533/3557] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:56 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:56.519611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:56.528989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c70cc72-ac06-4a8d-90b8-4313d3aa9e7d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.220230 Aug 21 01:22:56.544989 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2025/3558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:56 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:57.021144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.026770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:57.041587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.043936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.044646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.045660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.046300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.047172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.256117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.256714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:57.265272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.265688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.266137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.266840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.267494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.268068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.288164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.302138 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7795993d-2065-4e83-a3b3-0c185d0cbc81 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.300106 Aug 21 01:22:57.303200 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1534/3559] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:57.387008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.387771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:57.396085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.396664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.397179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.397949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.398461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.399101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.425067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.434805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d81e9fc9-6953-46c5-a94f-b5feb3499c50 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.183531 Aug 21 01:22:57.436090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2026/3560] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:22:57.498121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.507300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.509115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.510502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2f583600-875c-4f9d-af18-bfd27d40000e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.127884 Aug 21 01:22:57.511567 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1535/3561] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:57.553931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.554556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:57.561888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.562699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.563123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.564225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:57.564682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:57.565132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:57.721651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:57.750287 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3278fb8e-44b0-4dee-8056-11cd03b0abc7 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.196396 Aug 21 01:22:57.750287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2027/3562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:57.790741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f960810a-acb1-45e3-8539-415dd96f131b tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Calling method '.version_select at 0x7fc3fd9d4b80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.879479 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f960810a-acb1-45e3-8539-415dd96f131b tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af/defaults" status: 200 len: 371 microversion: 2.1 time: 0.251971 Aug 21 01:22:57.880147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1536/3563] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af/defaults => generated 371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:57.892156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9eb3c230-deee-4f55-9740-6ae613bc2ee2 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Calling method '.version_select at 0x7fc3f929dc10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:57.976798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9eb3c230-deee-4f55-9740-6ae613bc2ee2 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af" status: 200 len: 371 microversion: 2.1 time: 0.088784 Aug 21 01:22:57.977853 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2028/3564] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:57.992286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-891cb770-8099-4527-a9fe-da2247d232e6 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Calling method '.version_select at 0x7fc3fd9d45e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.016664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3458856f-60c0-41af-8823-196f07d19424", "name": "network-vif-plugged", "status": "completed", "tag": "6da4140c-4449-410e-a199-fb188843130e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:22:58.038795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.039427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.039984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.066604 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-891cb770-8099-4527-a9fe-da2247d232e6 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af/defaults" status: 200 len: 371 microversion: 2.1 time: 0.078495 Aug 21 01:22:58.067875 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1537/3565] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:22:57 2022] GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af/defaults => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:58.070368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] Creating event network-vif-plugged:6da4140c-4449-410e-a199-fb188843130e for instance 3458856f-60c0-41af-8823-196f07d19424 on n-h2-master-1 Aug 21 01:22:58.078764 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5e520991-cd67-4bcb-bb9f-84effbba6906 req-5a68c0c5-0ea8-45bd-a313-d13034fb61a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066010 Aug 21 01:22:58.079620 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2029/3566] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:22:58.086101 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15eb299c-e6e5-4c85-a2b6-d3403fdd5289 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Calling method '.version_select at 0x7fc3fd9b6dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.172437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15eb299c-e6e5-4c85-a2b6-d3403fdd5289 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af" status: 200 len: 371 microversion: 2.1 time: 0.094898 Aug 21 01:22:58.176074 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1538/3567] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:58.185936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-678e8bee-bb72-426b-817a-abed73f85c00 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] Calling method '.version_select at 0x7fc3fa5abc10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.272428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-678e8bee-bb72-426b-817a-abed73f85c00 tempest-QuotasTestJSON-1101610546 tempest-QuotasTestJSON-1101610546-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af?user_id=b93ff1af776847d2ad9311618e50be24" status: 200 len: 371 microversion: 2.1 time: 0.091475 Aug 21 01:22:58.281448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2030/3568] 10.222.0.46 () {58 vars in 1323 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/os-quota-sets/01d13d94447a4903b680412bf56041af?user_id=b93ff1af776847d2ad9311618e50be24 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:22:58.323596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.324217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:58.330708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.331197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.331639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.332340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.332804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.333235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.460121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.461492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:58.472627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.473578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.474385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.475666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.477045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.478099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.507588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:58.519337 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66ecf8c2-f464-4d1c-97cb-9ed598038423 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.199327 Aug 21 01:22:58.521164 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1539/3569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:58.535761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.536669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:58.545943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.546584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.547239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.548055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.548640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.549365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.552492 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:22:58.637227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:58.646815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:58.648310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:58.650231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b329b16d-f819-44bd-9000-11b02ec4b4bb tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.118828 Aug 21 01:22:58.650810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1540/3570] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:58.656752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:58.665409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c133942-9c71-4848-a0b2-651dea4d5106 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.211063 Aug 21 01:22:58.665996 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2031/3571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:58.771998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:58.772613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:58.779476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.779974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.780373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.781110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:58.781782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:58.782175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:58.991346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.000688 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-821ab866-87e5-43c2-be2b-c7fafc25a2a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1362 microversion: 2.1 time: 0.232717 Aug 21 01:22:59.001472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1541/3572] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:58 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:59.545325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:59.547488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:59.556069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.556999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.557631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.558387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.558853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.559303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.690767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:59.691619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:59.710804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.711766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.712391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.713800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.714434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.715705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.718577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.730058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d62665c-0db8-436c-89f9-dbeb892d8bc4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.191677 Aug 21 01:22:59.731041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2032/3573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:59 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:22:59.736526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:22:59.737182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:22:59.744246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.745099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.745920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.747014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:22:59.747495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:22:59.747922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:22:59.835478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.844730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.846600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.847993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-951a812e-95fb-4191-be8d-0a148defd5cf tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.167623 Aug 21 01:22:59.848709 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1542/3574] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:22:59 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:22:59.894490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:22:59.904027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7463f342-8dbd-4108-9289-cd9242a028b3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.171206 Aug 21 01:22:59.905186 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2033/3575] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:22:59 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:00.023933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:00.025436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:00.032131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.033304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.036024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.038287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.041204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.041395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.233491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:00.245847 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68f73b8c-af9a-4b54-916b-b70c370ab494 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1548 microversion: 2.1 time: 0.227515 Aug 21 01:23:00.254348 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1543/3576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:00 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:00.267545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:00.268076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:00.274869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.275382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.275814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.276882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.277351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.277772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.372403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb054545-5668-46f5-b0db-f053b0924776 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109499 Aug 21 01:23:00.376820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2034/3577] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:23:00 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:00.685933 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:00.751738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:00.753088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:00.759892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.760585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.761263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.762179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:00.762970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:00.764015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:00.834488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15765db6-e882-4482-9617-f9a1c895b5ba tempest-ComputeTenantNetworksTest-1463830743 tempest-ComputeTenantNetworksTest-1463830743-project] Calling method '.version_select at 0x7fc3fd9c2160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:01.010904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:01.022859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-077db244-83aa-4f01-9778-56dd1bc292c4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.276084 Aug 21 01:23:01.024115 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2035/3578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:00 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:01.030978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:01.031982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:01.044331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:01.044854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:01.045479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:01.046194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:01.046640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:01.047056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:01.138327 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15765db6-e882-4482-9617-f9a1c895b5ba tempest-ComputeTenantNetworksTest-1463830743 tempest-ComputeTenantNetworksTest-1463830743-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.457072 Aug 21 01:23:01.139616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1544/3579] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:23:00 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:01.148647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:01.150231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:01.163325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:01.163811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:01.164249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:01.165001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:01.165623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:01.166203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:01.195030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:01.204372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:01.206237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:01.207630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf3ca512-fe43-48a3-b842-03b8b6085ead tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1364 microversion: 2.47 time: 0.181964 Aug 21 01:23:01.225735 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2036/3580] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:01 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:01.230893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2e0d72c-e710-4534-8dbb-95002d637d69 tempest-ComputeTenantNetworksTest-1463830743 tempest-ComputeTenantNetworksTest-1463830743-project] Calling method '.version_select at 0x7fc3f950d3a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:01.338931 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2e0d72c-e710-4534-8dbb-95002d637d69 tempest-ComputeTenantNetworksTest-1463830743 tempest-ComputeTenantNetworksTest-1463830743-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks/e9ca0da4-cc54-47c1-9c5a-2e6d7c224aa1" status: 200 len: 140 microversion: 2.1 time: 0.111741 Aug 21 01:23:01.339517 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2037/3581] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:23:01 2022] GET /compute/v2.1/os-tenant-networks/e9ca0da4-cc54-47c1-9c5a-2e6d7c224aa1 => generated 140 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:01.472093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:01.487254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-122b5e2e-895f-4a7c-a8a6-098f21d589b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.345962 Aug 21 01:23:01.502616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1545/3582] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:01 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:01.714286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6058b8-2543-431b-a408-2054dc24b51a", "name": "network-vif-plugged", "status": "completed", "tag": "0581badc-ef75-4087-842b-4bbc65b29902"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:01.734728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:01.735876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:01.736583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:01.755034 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] Creating event network-vif-plugged:0581badc-ef75-4087-842b-4bbc65b29902 for instance ca6058b8-2543-431b-a408-2054dc24b51a on n-h1-master-1 Aug 21 01:23:01.767440 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d8eeb038-7851-4634-9851-0afa61eb7034 req-5d464cfe-d428-4366-ad79-4c0362f502a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057541 Aug 21 01:23:01.769442 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2038/3583] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:02.048087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:02.049331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:02.069936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.089510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3458856f-60c0-41af-8823-196f07d19424", "tag": "6da4140c-4449-410e-a199-fb188843130e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:02.090127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.090720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.091531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.091970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.092388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.112371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.112943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.113386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.140803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] Creating event network-changed:6da4140c-4449-410e-a199-fb188843130e for instance 3458856f-60c0-41af-8823-196f07d19424 on n-h2-master-1 Aug 21 01:23:02.162316 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d88389a2-af71-47b2-ac19-219ae8ce7d20 req-88984662-7a75-4b31-8b63-530b820bedf6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077046 Aug 21 01:23:02.163694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2039/3584] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:02.235543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:02.236597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:02.250260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.250811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.251262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.255040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.255640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.256042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.424359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:02.428711 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:02.443254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:02.446118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:02.448139 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f05633c-a055-421f-b997-24e9ce7e2b29 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1370 microversion: 2.47 time: 0.217645 Aug 21 01:23:02.453576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2040/3585] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:02 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:23:02.470084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:02.480793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1aa48d69-d747-4e40-8a43-e488257f3d6e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1315 microversion: 2.1 time: 0.437535 Aug 21 01:23:02.499764 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1546/3586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:02 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:02.512234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:02.513221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:02.523976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.524464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.524971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.525678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:02.526738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:02.527167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:02.766738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:02.779435 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-330b41aa-0dab-4d81-a121-76654ea38ee9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.271198 Aug 21 01:23:02.783896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2041/3587] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:02 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:03.476987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:03.478314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:03.487854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.488921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.489796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.491714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.492640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.493407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.504302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:03.505168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:03.514320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.514991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.515612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.516348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.518969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.523916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.605442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:03.618225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:03.620665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:03.623060 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e81a993a-a030-453f-912a-e4541552969b tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1370 microversion: 2.47 time: 0.150689 Aug 21 01:23:03.625026 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1547/3588] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:03 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:03.762990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:03.772761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d46bd9d4-6b19-4c8c-9a95-3f7a89c3b7c5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1501 microversion: 2.1 time: 0.271897 Aug 21 01:23:03.774342 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2042/3589] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:03 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1501 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:03.795507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:03.796063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:03.803449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.803960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.810297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:03.810844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:03.816225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.817160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.817632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.818065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.822014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.822496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.822927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:03.827052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:03.827813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:03.828420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.046008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:04.059281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Removing security group 757c0f26-7beb-498a-a829-a93873572aea from port 0581badc-ef75-4087-842b-4bbc65b29902 Aug 21 01:23:04.070217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f13717e-e9a6-460c-b2d5-7c1a423dbb89 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.264604 Aug 21 01:23:04.071421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2043/3590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:03 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:04.594178 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f81be519-f9de-47a1-961a-8dedfdb8076b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a/action" status: 202 len: 0 microversion: 2.1 time: 0.803056 Aug 21 01:23:04.594810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1548/3591] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:23:03 2022] POST /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:23:04.604932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:04.610005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6058b8-2543-431b-a408-2054dc24b51a", "tag": "0581badc-ef75-4087-842b-4bbc65b29902"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:04.613617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:04.628301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.628812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.632933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.633671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.634129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.634546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.643370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.643833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.653547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.669702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] Creating event network-changed:0581badc-ef75-4087-842b-4bbc65b29902 for instance ca6058b8-2543-431b-a408-2054dc24b51a on n-h1-master-1 Aug 21 01:23:04.679852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8e57bc97-325a-4ff3-8795-58b46288a698 req-b963feb1-7f9a-42d3-bc97-b9ac8a27da26 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071998 Aug 21 01:23:04.683841 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1549/3592] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:04.699148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:04.699985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:04.716530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.718834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.719521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.727576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.728060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.728660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.802761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:04.818372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56f6ab94-4564-4702-a2e0-0d5e3741bbdc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1459 microversion: 2.1 time: 0.218045 Aug 21 01:23:04.819187 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2044/3593] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:04 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1459 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:04.844994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:04.846480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:04.859450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.860474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.861623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.862611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:04.863301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:04.863972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:04.950748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:04.961138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:04.963053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:04.975596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-420ff0bd-38e0-4988-8000-14d84d84edec tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1370 microversion: 2.47 time: 0.287104 Aug 21 01:23:04.976206 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1550/3594] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:04 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:05.098657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:05.099257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:05.110540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.116210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.116949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.120725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.121394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.124858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.127694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:05.141553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60acb94c-af77-4acf-a229-673ad31c525e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.305411 Aug 21 01:23:05.143300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2045/3595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:04 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:05.169231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:05.171109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:05.187477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.188405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.189185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.193089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.194015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.194671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.358141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:05.368039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16de02f4-f6b5-4ca0-90be-7f16848dc49d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.203455 Aug 21 01:23:05.368984 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2046/3596] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:05 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:05.392173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:05.393023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:05.400928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.401622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.402234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.403014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.403623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.404189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.520200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:05.534853 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-01315f52-ad79-4c01-b7e0-feb31bf8e02c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.440905 Aug 21 01:23:05.535446 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1551/3597] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:05 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:05.604876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:05.614378 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b35e1dbf-dd74-4770-b0b1-00aa8f9b0653 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.228235 Aug 21 01:23:05.615397 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2047/3598] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:05 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:05.634259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:05.635453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:05.645284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.645993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.646591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.647457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:05.648078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:05.648657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:05.949279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:05.959575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce337ffb-e970-4d1c-8012-e286955979d1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.329104 Aug 21 01:23:05.960605 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1552/3599] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:05 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:06.002814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:06.003629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:06.011665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.019659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.020202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.021077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.021676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.022295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.105796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1388010500", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "4ec7abf5-e561-48e7-9db1-bc3c2f1218ae"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:06.109957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.133729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.138270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.139789 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a60452a6-3789-49d7-a091-23e365d1a41e tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1355 microversion: 2.47 time: 0.142982 Aug 21 01:23:06.143713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2048/3600] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:05 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1355 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:06.170692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:06.177183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.182802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Searching by: {'deleted': False, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:23:06.194586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.196396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.196913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.197659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.197813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] validate_networks() for [('4ec7abf5-e561-48e7-9db1-bc3c2f1218ae', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:23:06.198122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.198540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.368507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:23:06.486140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.495174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.496024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.496606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.511250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.513959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.602228 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41b6e3f7-c37e-4660-9eae-d2b66bd88635 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.436317 Aug 21 01:23:06.603029 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2049/3601] 10.222.0.46 () {60 vars in 1187 bytes} [Sun Aug 21 01:23:06 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:23:06.607873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:06.608495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:06.614992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.615483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.615917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.616648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.617125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.617546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.842439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:06.852687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ab13e0d-8fa6-45c8-9ce8-c08a5244366d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.248761 Aug 21 01:23:06.853347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2050/3602] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:06 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:06.859462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:06.859462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:06.865478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.865978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.866421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.867139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:06.867571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:06.867968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:06.901880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:23:07.007258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f330961-c2c5-48cd-aa8f-ea9a13170e54 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 204 len: 0 microversion: 2.47 time: 0.152338 Aug 21 01:23:07.009965 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2051/3603] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:23:06 2022] DELETE /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:23:07.023668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:07.024663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:07.031439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.031975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.032415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:07.033136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.033591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.034001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:07.139427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:07.153322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:07.155577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:07.157250 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f68f3e27-767e-44ca-b21b-ece5050b7f07 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1361 microversion: 2.47 time: 0.139416 Aug 21 01:23:07.159213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2052/3604] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:07 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:07.246566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:23:07.247194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:23:07.247663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:23:07.248090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:23:07.248583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:23:07.259765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.260248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.260675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:07.261461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.261912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.262326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:07.282255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:23:07.289877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Getting quotas for user 3fbef527355e40f3af441a57cd5807be and project 9027d7cd75f84b11a4b8846a9769e356. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:23:07.304467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:23:07.307114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:23:07.358747 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3cb662a2-f9b9-4593-9820-eaf1555befa0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257015 Aug 21 01:23:07.365806 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1553/3605] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:23:07.373455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b424ad46-3e06-4311-a6c5-8b7144a95d59 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:07.381376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b424ad46-3e06-4311-a6c5-8b7144a95d59 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:07.462410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b424ad46-3e06-4311-a6c5-8b7144a95d59 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:07.471568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b424ad46-3e06-4311-a6c5-8b7144a95d59 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1215 microversion: 2.1 time: 0.102418 Aug 21 01:23:07.472154 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2053/3606] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:07 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:07.878239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:07.879370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:07.887157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.887952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.888840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:07.890385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:07.891088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:07.891895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:08.082032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:08.091758 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19006b19-0258-4a03-8e23-d3478b5cfa1f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.220426 Aug 21 01:23:08.092974 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1554/3607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:07 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:08.182464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:08.183078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:08.197877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:08.198676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:08.199266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:08.200230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:08.200872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:08.201454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:08.282861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:08.291703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:08.293992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:08.295460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74a74938-124a-4448-b777-79e9280c9788 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1361 microversion: 2.47 time: 0.117821 Aug 21 01:23:08.296179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2054/3608] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:08 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1361 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:08.493104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:08.494069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:08.504506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:08.506340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:08.508497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:08.509375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:08.515529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:08.516245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:08.724189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:08.752717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcc5272c-40e5-4797-a559-1011d2e5aae6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1267 microversion: 2.1 time: 0.261842 Aug 21 01:23:08.753894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1555/3609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:08 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:09.116358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:09.119214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:09.146376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.147232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.147874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.148601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.149092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.149513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.321285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:09.323155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:09.339890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:09.340864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.341723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.342594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.343346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.343810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.344232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.351798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47a42a81-48c3-4da5-a070-ce7149b9a44a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.240041 Aug 21 01:23:09.365791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2055/3610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:09 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:09.402753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.403810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.404262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.404718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lazy-loading 'fault' on Instance uuid 48036f69-9b78-4fc4-b39d-ad0f300c6544 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:23:09.466722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:09.503045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:09.507733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:09.509254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70bea16c-5710-4746-9aac-b2f555dafa38 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 200 len: 1366 microversion: 2.47 time: 0.194033 Aug 21 01:23:09.510554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1556/3611] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:09 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:23:09.775987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:09.776622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:09.795491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.796177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.796625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.797462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:09.798191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:09.798648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:09.807616 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:09.888015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:09.896012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85ea1d23-a306-487a-bf24-cc58713273cc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1273 microversion: 2.1 time: 0.124803 Aug 21 01:23:09.896931 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2056/3612] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:09 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:10.374163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:10.375022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:10.386258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.391639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.392206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.392939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.393785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.394453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.535624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:10.536239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 48036f69-9b78-4fc4-b39d-ad0f300c6544] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:10.554580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.555401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.556003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.556712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.557178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.557598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.572794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] HTTP exception thrown: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Request method failure captured: Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 HTTP/1.1 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYjJBVGoFBzIk6sLGrHgJ3pwspdKKrcGML_t1P7JOHXcq_b-h-ZYkMav9QSqQtt6r6fJPoexziBLDdi1sCE1QYg8bwWjgf1KeoVuWOBTgCHtJrrPywkS_U8W65f0cnDpdwtdaEp8PbyqW7OUR0kW7xxKINiiBT5DEafMVCDkgS08d_E Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.47 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: f08ff6e2e16345dc9f733f6fc859aca1 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f08ff6e2e16345dc9f733f6fc859aca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f08ff6e2e16345dc9f733f6fc859aca1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f08ff6e2e16345dc9f733f6fc859aca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f08ff6e2e16345dc9f733f6fc859aca1"}]}] Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: f08ff6e2e16345dc9f733f6fc859aca1 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerShowV247Test-1082346956-project Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 78818dfe8e5b42dd84c49fc5bb2804b1 Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerShowV247Test-1082346956-project Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '48036f69-9b78-4fc4-b39d-ad0f300c6544'} Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:23:10.575853 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. Aug 21 01:23:10.580901 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:23:10.582918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Returning 404 to user: Instance 48036f69-9b78-4fc4-b39d-ad0f300c6544 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:23:10.583995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c79c07c-0428-4489-8051-de79e64d54e6 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544" status: 404 len: 111 microversion: 2.47 time: 0.052392 Aug 21 01:23:10.584807 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2057/3613] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:10 2022] GET /compute/v2.1/servers/48036f69-9b78-4fc4-b39d-ad0f300c6544 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:23:10.594911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:10.595864 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:10.602748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.603570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.604415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.605404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.606488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.607267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.638915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:23:10.738546 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:10.758217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb45746b-afe2-4f31-81fb-374ff309bf0f tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "DELETE /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 204 len: 0 microversion: 2.47 time: 0.168709 Aug 21 01:23:10.759094 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2058/3614] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:23:10 2022] DELETE /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 21 01:23:10.770528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:10.771509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:10.780524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.781415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.782070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.783035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.783581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.784293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.899516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:10.908915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:10.910974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:10.912253 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1aa6674-b7f5-4af9-ba80-dcbe202e3894 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 200 len: 1363 microversion: 2.47 time: 0.148165 Aug 21 01:23:10.913361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2059/3615] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:10 2022] GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:23:10.919616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:10.920241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:10.926639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.927511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.928171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:10.929134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:10.929848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:10.930328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:11.014491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:11.032977 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b9f6aa5-339f-4aa4-9e8f-f83b399924aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.663034 Aug 21 01:23:11.041972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1557/3616] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:10 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:11.182998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:11.192726 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-243a4ea4-1bb2-4c53-998e-23cd8b30606b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.277521 Aug 21 01:23:11.193611 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2060/3617] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:10 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:11.941590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:11.941590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:11.959202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:11.960369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:11.960823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:11.961639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:11.961977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:11.962394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.064663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:12.065289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:12.068553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:12.074431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:12.075416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:12.076147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.077317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:12.078190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:12.079225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.086054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:12.089192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:12.093169 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4b93de1-812b-49ec-9be9-6c3d2f8afd7a tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 200 len: 1363 microversion: 2.47 time: 0.158412 Aug 21 01:23:12.099696 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1558/3618] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:11 2022] GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:12.137192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df331a77-ed66-4a3e-854e-f40ccc679407", "tag": "d92f3956-8999-4805-a5f4-e111d22a0f10"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:12.166412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:12.167742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:12.169374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.197492 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:12.202649 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] Creating event network-changed:d92f3956-8999-4805-a5f4-e111d22a0f10 for instance df331a77-ed66-4a3e-854e-f40ccc679407 on n-h1-master-1 Aug 21 01:23:12.217114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1473d0b7-bb0f-48c4-b401-55c56950a83c req-e4b9e81c-cd10-4c94-9ad3-cbac8a14a553 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088618 Aug 21 01:23:12.219383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1559/3619] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:23:12.232515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:12.235726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:12.251923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:12.252406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:12.253973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.254930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:12.255372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:12.257366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:12.283065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:12.298922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7014f54-8c3b-48b5-9cb3-de683f1d7136 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.237680 Aug 21 01:23:12.299852 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2061/3620] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:12 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:12.554528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:12.567856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91033198-1450-4507-9722-ba5e1570bc8c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.345716 Aug 21 01:23:12.568867 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1560/3621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:12 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:13.120868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:13.121931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:13.133458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.134073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.134701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.135712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.136475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.143356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.220090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:13.234049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:13.235832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78818dfe8e5b42dd84c49fc5bb2804b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f08ff6e2e16345dc9f733f6fc859aca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:13.237038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f69d9a56-83a8-4723-a7c3-801e9afbd168 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 200 len: 1363 microversion: 2.47 time: 0.121310 Aug 21 01:23:13.237767 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2062/3622] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:13 2022] GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:13.323072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:13.324354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:13.335749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.336460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.337109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.338534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.339267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.339917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.581958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:13.589866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:13.590932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:13.601460 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb11e44e-a927-4ee6-932b-e07ef2f90f3d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.283499 Aug 21 01:23:13.602688 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1561/3623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:13 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:13.604842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.605319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.605749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.609537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:13.610013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:13.610444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:13.776444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:13.786532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-45c05736-c6de-4a07-b140-713235c4e7c9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.200964 Aug 21 01:23:13.787559 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2063/3624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:13 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:14.261198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:14.262091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] [instance: 43ba1bf1-e6ab-48db-afa5-8c0e12069f66] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:14.271629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.272649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.273705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.274734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.275468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.275993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.299303 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] HTTP exception thrown: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Request method failure captured: Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 HTTP/1.1 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYjJBVGoFBzIk6sLGrHgJ3pwspdKKrcGML_t1P7JOHXcq_b-h-ZYkMav9QSqQtt6r6fJPoexziBLDdi1sCE1QYg8bwWjgf1KeoVuWOBTgCHtJrrPywkS_U8W65f0cnDpdwtdaEp8PbyqW7OUR0kW7xxKINiiBT5DEafMVCDkgS08d_E Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.47 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: f08ff6e2e16345dc9f733f6fc859aca1 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f08ff6e2e16345dc9f733f6fc859aca1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f08ff6e2e16345dc9f733f6fc859aca1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f08ff6e2e16345dc9f733f6fc859aca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f08ff6e2e16345dc9f733f6fc859aca1"}]}] Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: f08ff6e2e16345dc9f733f6fc859aca1 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerShowV247Test-1082346956 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerShowV247Test-1082346956-project Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 78818dfe8e5b42dd84c49fc5bb2804b1 Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerShowV247Test-1082346956-project Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '43ba1bf1-e6ab-48db-afa5-8c0e12069f66'} Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:23:14.301270 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] Returning 404 to user: Instance 43ba1bf1-e6ab-48db-afa5-8c0e12069f66 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c238ff14-475a-4281-8e76-24cf9fc7e983 tempest-ServerShowV247Test-1082346956 tempest-ServerShowV247Test-1082346956-project] 10.222.0.46 "GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66" status: 404 len: 111 microversion: 2.47 time: 0.048001 Aug 21 01:23:14.306635 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1562/3625] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:14 2022] GET /compute/v2.1/servers/43ba1bf1-e6ab-48db-afa5-8c0e12069f66 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:23:14.622770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:14.624127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:14.632354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.633235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.633996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.643316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.649103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.649788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.808863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:14.809586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:14.822650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.823156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.823594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.824308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:14.824778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:14.825280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:14.835885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:14.849000 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6bce3b42-0145-436a-b7a1-99ea465d1db9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.229880 Aug 21 01:23:14.850166 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2064/3626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:14 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:15.089713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:15.104754 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3dfd682a-f0f1-4929-aa40-40953147161f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.299728 Aug 21 01:23:15.120135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1563/3627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:14 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:15.870376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:15.871974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:15.880357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:15.881254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:15.881919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:15.882913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:15.884021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:15.884445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:16.041542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:16.050047 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-82ced689-27ec-476e-9782-659ac71303eb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.183621 Aug 21 01:23:16.050703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2065/3628] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:15 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:16.131642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:16.132803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:16.143581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:16.149219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:16.149713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:16.150487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:16.150959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:16.151405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:16.332467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:16.340009 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54e66eba-0a99-4494-a546-df48b5448459 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.216429 Aug 21 01:23:16.340788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1564/3629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:16 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:17.071684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:17.072970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:17.078593 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:17.094867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:17.095560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:17.096179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:17.097663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:17.098366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:17.099167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:17.361306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:17.361937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:17.364919 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:17.365594 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=28 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:17.383073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:17.383757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:17.384386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:17.385314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:17.387545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:17.388404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:17.467944 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:17.503628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:17.513890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba293517-c25b-4c37-9d21-79dffd2a7311 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.445610 Aug 21 01:23:17.528218 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2066/3630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:17 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:17.630912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:17.647678 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04a7defd-c83f-46b6-94fc-4480ec09db75 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.290591 Aug 21 01:23:17.648528 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1565/3631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:17 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:18.063195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df331a77-ed66-4a3e-854e-f40ccc679407", "name": "network-vif-plugged", "status": "completed", "tag": "d92f3956-8999-4805-a5f4-e111d22a0f10"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:18.073613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:18.075439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:18.076127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:18.093153 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] Creating event network-vif-plugged:d92f3956-8999-4805-a5f4-e111d22a0f10 for instance df331a77-ed66-4a3e-854e-f40ccc679407 on n-h1-master-1 Aug 21 01:23:18.100061 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-fd406a61-a309-408f-bcca-55b54012acf2 req-fe3e44b2-a5de-48ee-b4e3-9ea3cf03d84a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041386 Aug 21 01:23:18.101175 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2067/3632] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:23:18.534882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:18.535693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:18.548858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:18.549551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:18.553646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:18.554690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:18.555730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:18.557383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:18.671148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:18.672025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:18.685035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:18.693452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:18.694986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:18.696162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:18.697061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:18.697696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:18.770716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:18.779551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-480e1079-949d-47ab-83cf-c54e6e24fb88 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.248639 Aug 21 01:23:18.780849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1566/3633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:18 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:18.960142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:18.975262 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14413b93-f8c4-4e0b-a2cf-42aed1a35921 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1315 microversion: 2.1 time: 0.308737 Aug 21 01:23:18.976848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2068/3634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:18 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:19.804243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:19.804960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:19.817050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:19.820527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:19.821263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:19.825342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:19.826008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:19.829150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.002107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:20.003407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:20.025107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.025711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.026163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.026904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.027352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.027922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.135122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:20.161320 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0457c677-0ec2-4b92-bc01-e271c0d2846b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.361941 Aug 21 01:23:20.161962 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1567/3635] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:19 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:20.365476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:20.380892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0211818-538f-4787-9ada-a6acb70c2c89 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1502 microversion: 2.1 time: 0.378499 Aug 21 01:23:20.382333 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2069/3636] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:19 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:20.404940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:20.405484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:20.412482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.413030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.414271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.415149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.415768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.416355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.525192 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-806c25f4-32dc-414e-b8cd-6b33c0d66cf5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407/action" status: 202 len: 0 microversion: 2.1 time: 0.121600 Aug 21 01:23:20.529978 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1568/3637] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:23:20 2022] POST /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:23:20.544130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:20.544761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:20.565469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.566086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.566528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.567263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:20.567717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:20.568133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:20.874030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:20.887118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0750489b-aa16-4304-a01e-b8b030f37066 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1507 microversion: 2.1 time: 0.353782 Aug 21 01:23:20.889840 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2070/3638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:20 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:21.189735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:21.191567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:21.210327 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:21.213186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:21.214093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:21.214627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:21.215736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:21.224189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:21.228571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:21.702382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:21.713974 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd8299ca-6bb4-4317-afb6-ab3c7e5808aa tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.533156 Aug 21 01:23:21.724108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1569/3639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:21 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:21.911872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:21.914317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:21.934817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:21.936894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:21.939231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:21.940957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:21.942052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:21.942495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.349309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:22.363190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7784989c-f8e9-4341-8bdf-34710a727819 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1487 microversion: 2.1 time: 0.455156 Aug 21 01:23:22.365457 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2071/3640] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:21 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1487 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:22.393841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:22.395036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:22.409571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.410273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.410880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.413740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.414498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.415210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.456603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lazy-loading 'flavor' on Instance uuid df331a77-ed66-4a3e-854e-f40ccc679407 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:23:22.748806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:22.749536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:22.756523 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93ebd599-f419-4049-a750-81e3e31a6636 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407/action" status: 202 len: 0 microversion: 2.1 time: 0.366194 Aug 21 01:23:22.759345 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1570/3641] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:23:22 2022] POST /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:23:22.764071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.766590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.769497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.770276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.772269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.774204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.789347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:22.794394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:22.812068 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:22.814252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.815401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.817049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:22.822261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:22.822938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:22.829065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:23.219888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:23.243261 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a12dda6-9410-4b5f-8b9f-6a625a194d94 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1493 microversion: 2.1 time: 0.478225 Aug 21 01:23:23.244185 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1571/3642] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:22 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1493 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:23.272600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:23.289089 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ce82c8d-86c2-4e9c-a047-325ab9e6d108 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.539861 Aug 21 01:23:23.292938 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2072/3643] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:22 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:23.939574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a5c7b22-fe9f-4013-ace9-eea66abcd388"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:23.942231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:23.950315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:23.951355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:23.951960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:23.952678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:23.953224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:23.953708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:24.213240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1388781568", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:24.285021 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d142c200-c1df-4373-a8dd-a2aaa1005282 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "POST /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351295 Aug 21 01:23:24.287459 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2073/3644] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:23:23 2022] POST /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:24.302163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] validate_networks() for [('30a6b423-e11b-48a2-bd1e-1788a7209058', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:23:24.307471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:24.307471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:24.337612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:24.338396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:24.340021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:24.340839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:24.341472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:24.341907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:24.575207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:24.591180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95b98c58-2eeb-4d97-900a-005514dd837c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1514 microversion: 2.1 time: 0.299544 Aug 21 01:23:24.593296 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2074/3645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:24 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:24.608951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:24.609984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:24.618236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:24.623163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:24.623891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:24.624863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:24.625502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:24.626158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:24.958733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:24.975027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a241a1d6-50b0-410b-893d-9a9c71eecc1e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1507 microversion: 2.1 time: 0.380446 Aug 21 01:23:24.978496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2075/3646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:24 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:25.054535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:23:25.054970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:23:25.055443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:23:25.055963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:23:25.056375 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:23:25.071410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:25.071898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:25.072334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:25.081647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:25.082191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:25.082638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:25.120103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Getting quotas for project 6d9f6cf1c2694e7099cff8757420b421. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:23:25.136609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Getting quotas for user fe0e970187b548d0878f3cbfc89f25fc and project 6d9f6cf1c2694e7099cff8757420b421. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:23:25.165706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:23:25.173425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:23:25.285457 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8a4ea163-f052-4129-8659-45478a72e1e1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446529 Aug 21 01:23:25.287359 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1572/3647] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:23:25.300596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9a1f327-e307-48d7-aa01-5e2a8614ca92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:25.301582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9a1f327-e307-48d7-aa01-5e2a8614ca92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:25.384447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9a1f327-e307-48d7-aa01-5e2a8614ca92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:25.392242 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9a1f327-e307-48d7-aa01-5e2a8614ca92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1217 microversion: 2.1 time: 0.097250 Aug 21 01:23:25.394867 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2076/3648] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:25 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:25.625074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:25.625817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:25.642490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:25.647389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:25.647878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:25.649999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:25.654386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:25.654867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:25.997442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:25.998471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:26.031362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:26.033178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:26.033580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:26.040362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:26.042433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:26.042895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:26.202189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:26.219047 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f1d67b79-e49a-4c06-b581-0012836dfd42 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.605363 Aug 21 01:23:26.221770 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1573/3649] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:25 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:26.343060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:26.360310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f12ce012-971c-4c58-8d23-d669a50f44a4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1528 microversion: 2.1 time: 0.367883 Aug 21 01:23:26.361403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2077/3650] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:25 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1528 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:26.422223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:26.423712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:26.432662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:26.433456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:26.438464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:26.439979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:26.440833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:26.441785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:26.598974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:26.602924 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:26.620885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88cbb076-f7ed-4ce1-9454-907c05396315 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1213 microversion: 2.1 time: 0.208930 Aug 21 01:23:26.622383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1574/3651] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:26 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1213 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:27.246147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:27.247730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:27.263396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.270062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.288121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:27.289504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.295441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.296800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:27.388930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:27.390647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:27.408735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.410011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.414090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:27.416324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.420836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.421760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:27.799296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:27.808737 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4c71c05-68e4-45c1-a0cf-b633b7352a58 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.568564 Aug 21 01:23:27.814734 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2078/3652] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:27 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:27.828497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:27.832578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:27.848887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.849632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.850790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:27.851859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:27.854618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:27.855268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:28.031031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:28.045515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a48c1239-f00c-4677-b9fb-9ebb427f5715 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1275 microversion: 2.1 time: 0.228770 Aug 21 01:23:28.060667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2079/3653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:27 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:28.828307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df331a77-ed66-4a3e-854e-f40ccc679407", "name": "network-vif-plugged", "status": "completed", "tag": "d92f3956-8999-4805-a5f4-e111d22a0f10"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:28.859148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:28.861419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:28.864059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:28.911149 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] Creating event network-vif-plugged:d92f3956-8999-4805-a5f4-e111d22a0f10 for instance df331a77-ed66-4a3e-854e-f40ccc679407 on n-h1-master-1 Aug 21 01:23:28.945534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-974ebf86-894e-403b-a457-34503aaee87d req-bd3e9a97-5046-495f-b0ff-84725b436d19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120400 Aug 21 01:23:28.948988 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2080/3654] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:28.957857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:28.967531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:28.976315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2a3d9c0-c0cd-4bd5-bafb-45e76fe9150c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1528 microversion: 2.1 time: 1.593352 Aug 21 01:23:28.997922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:29.009993 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1575/3655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:27 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1528 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:29.030470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:29.045791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:29.046388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:29.052192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:29.056394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:29.059309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:29.069943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:29.075898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:29.098878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:29.105685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:29.106940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:29.111468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:29.114523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:29.118678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:29.547692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:29.562093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc5db0b5-c343-47d6-85c8-58919715f66c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.610782 Aug 21 01:23:29.564625 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2081/3656] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:28 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:29.640003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:29.658383 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dae00246-cfd0-43c5-b13b-0075a9cb3a4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1275 microversion: 2.1 time: 0.589360 Aug 21 01:23:29.661960 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1576/3657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:29 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1275 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:30.023589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:30.027507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:30.042409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.045691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.046288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:30.048143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.048743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.051807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:30.375779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:30.392976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-446a46d8-2faa-4221-b8f8-1af0431a9f0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.374237 Aug 21 01:23:30.407228 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2082/3658] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:30 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:30.591354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:30.595154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:30.637967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.638936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.640676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:30.642939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.644651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.646052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:30.682044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:30.682542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:30.693358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.700558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.701576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:30.705291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:30.705774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:30.706202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:31.067518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:31.084461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64871ba8-7a7a-4a04-b9a0-b0fcc496d08a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.493719 Aug 21 01:23:31.086093 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1577/3659] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:30 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:31.098243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87775b07-5ca8-42d0-9f0e-59632cdd3649", "name": "network-vif-plugged", "status": "completed", "tag": "f92d8e35-0cd9-4476-8721-42ccbdb81662"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:31.160709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:31.163618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:31.164338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:31.209234 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] Creating event network-vif-plugged:f92d8e35-0cd9-4476-8721-42ccbdb81662 for instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 on n-h1-master-1 Aug 21 01:23:31.229336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c16d15d3-4ec6-46ed-ae33-782078228ed5 req-57244049-338a-4104-a533-8a8d2f82725a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135058 Aug 21 01:23:31.234552 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1578/3660] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:31.249572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:31.266631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9371aac-efcd-495e-a097-547b82d4172c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.583327 Aug 21 01:23:31.286347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2083/3661] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:30 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:31.420491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:31.421405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:31.448818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:31.453727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:31.458668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:31.461680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:31.462226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:31.462769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:32.111659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:32.112444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:32.149820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:32.152879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:32.155824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:32.157524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:32.158501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:32.159445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:32.206232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:32.216098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d46585a8-452c-4db5-a501-754322fe45fb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.801238 Aug 21 01:23:32.225473 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1579/3662] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:31 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:32.297949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:32.298911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:32.311229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:32.315741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:32.316423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:32.317421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:32.321354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:32.322570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:32.847181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:32.850354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:32.861273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-184e409d-a425-4a87-b753-d555d688f3d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.571456 Aug 21 01:23:32.866162 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6eb61721-d9f1-451a-991a-6e93c0956516 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.762686 Aug 21 01:23:32.866820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2084/3663] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:32 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:32.867601 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1580/3664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:32 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:33.250938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:33.251577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:33.267325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.269525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.270157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.272319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.273165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.275886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.370109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:33.423941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.424876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.427015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.484710 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] Creating event network-changed:ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18 for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be on n-h2-master-1 Aug 21 01:23:33.493734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cf9fbf5a-b01c-4d5f-b42e-e00a63c95394 req-9c87ec74-c744-419d-b9de-312dde788221 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127001 Aug 21 01:23:33.496285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1581/3665] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:33.788179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:33.815619 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3dd3fe32-0442-4b18-b960-cb1b01fe0593 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.566009 Aug 21 01:23:33.824075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2085/3666] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:33 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:33.902433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:33.903914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:33.905545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:33.908529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:33.930258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.930755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.942260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.947623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.950753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.952096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.956294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.964618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.967389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:33.978201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:33.981610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:33.984263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:34.570303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:34.594009 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b25469e4-ba39-440f-9bdb-b78c8c3485e9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.701467 Aug 21 01:23:34.597219 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2086/3667] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:33 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:34.678957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:34.690982 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4307719f-bfb9-4db5-b877-6150ca9171ca tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.799144 Aug 21 01:23:34.691972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1582/3668] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:33 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:34.846178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:34.847513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:34.858852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:34.861547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:34.862315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:34.863886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:34.865329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:34.867738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:35.316497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:35.338330 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30d3aa9e-de98-4cc4-8b80-310793ab7dab tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.494251 Aug 21 01:23:35.355807 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2087/3669] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:34 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:35.631074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:35.633275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:35.650306 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:35.654031 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:35.694975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:35.697422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:35.698207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:35.700846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:35.702990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:35.707217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:35.726105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:35.728918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:35.750849 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:35.758410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:35.759357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:35.759852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:35.761627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:35.762351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:35.762969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:36.252332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:36.287594 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d7ee0eb-08aa-4a88-8a26-00495536927f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.568202 Aug 21 01:23:36.289022 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2088/3670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:35 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:36.340730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:36.364178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:36.365620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:36.366592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fd35e8d-ccd8-4ddd-89c7-733327cfa4ae tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.741208 Aug 21 01:23:36.369545 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1583/3671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:35 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:36.396937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:36.397687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:36.398439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:36.399342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:36.399960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:36.400579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:36.420483 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:36.779435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:36.789528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b14eb75-96d3-4587-84d9-b35d788b9bae tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.430425 Aug 21 01:23:36.795366 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2089/3672] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:36 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:37.312683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:37.313453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:37.355070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.356111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.357287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:37.360231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.365748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.367977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:37.392904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:37.394311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:37.415646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.419973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.422411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:37.424412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.428599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.429114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:37.744231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:37.761792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5e54b62a-1de3-4013-a1aa-1d8a8f18670a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.373158 Aug 21 01:23:37.770157 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2090/3673] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:37 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:37.813159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:37.814327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:37.830419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.831349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.832063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:37.833060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:37.833732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:37.834382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:38.161889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:38.184275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7b9d01b-6b53-4d0d-8987-b6bea718eaf3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.370901 Aug 21 01:23:38.187987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2091/3674] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:37 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:38.213121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:38.251549 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95bb7df9-ed74-41f0-acdb-8528024e89e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.943422 Aug 21 01:23:38.253650 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1584/3675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:37 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:38.786381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:38.787001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:38.803187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:38.805064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:38.805774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:38.809654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:38.810945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:38.814058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:39.207679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:39.209024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:39.229505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:39.230394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:39.231123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:39.232033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:39.232681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:39.233322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:39.255210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:39.274210 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74fb096e-67c4-4c2f-a632-e12053d5135f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.492318 Aug 21 01:23:39.291766 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2092/3676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:38 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:39.313939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:39.318365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:39.326510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:39.327476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:39.328130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:39.329071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:39.329808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:39.330432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:39.673488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:39.686571 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ced61fc-39b3-4065-9843-835dc82629f9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.482502 Aug 21 01:23:39.687766 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1585/3677] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:39 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:39.701736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:39.716081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fca56b01-cfe4-4095-ad28-d85ea91156a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.415499 Aug 21 01:23:39.719449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2093/3678] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:39 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:40.300138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:40.300752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:40.318785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.325215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.326119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:40.327853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.332979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.334005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:40.678343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:40.690764 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-579b8985-f669-4982-bdde-348431b32d0f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.394734 Aug 21 01:23:40.694684 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1586/3679] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:40.716416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:40.717190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:40.735194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.740294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:40.740865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:40.741014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.741396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:40.742166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.742612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.743449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:40.750211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.750963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.751603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:40.753155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:40.753842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:40.754429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:41.116581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:41.157592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:41.159659 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b06a08c1-2dd1-4b1d-924f-65e41a08b512 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.448263 Aug 21 01:23:41.160480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2094/3680] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:40 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:41.192637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a4ccd93-6ff3-4d93-a5cf-662c5f2dd8bb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.456235 Aug 21 01:23:41.209141 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1587/3681] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:40 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:41.297946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "name": "network-vif-plugged", "status": "completed", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:41.317377 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:41.322822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:41.323689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:41.324523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:41.352250 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] Creating event network-vif-plugged:ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18 for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be on n-h2-master-1 Aug 21 01:23:41.358550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9e4bfc08-ed7f-4006-a266-39d5a943dc82 req-7c7bec8e-46a1-4649-a582-a846cd95085e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064774 Aug 21 01:23:41.359246 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2095/3682] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:41.722089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:41.727340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:41.762063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:41.776256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:41.789009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:41.790256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:41.791426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:41.798264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:42.145559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:42.171588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4a55c10-ded4-41a4-9d5d-30c68bd4862b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1317 microversion: 2.1 time: 0.451379 Aug 21 01:23:42.174476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1588/3683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:41 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:42.207517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:42.209167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:42.225601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:42.229767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:42.232964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:42.238913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:42.239899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:42.242483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:42.245595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:42.248377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:42.255972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:42.256482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:42.256947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:42.258160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:42.260265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:42.267937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:42.622968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:42.635111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3dd0d1a9-b136-4394-948f-88e7b3ea7db4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.431627 Aug 21 01:23:42.637156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2096/3684] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:42 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:42.684593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:42.698070 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b4ae45f-fd9a-4d67-a54a-9c8747041b7d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.474193 Aug 21 01:23:42.708893 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1589/3685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:42 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:43.195755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:43.196382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:43.238533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.240602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.241114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.241818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.242317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.253390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.545696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:43.548380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:43.582378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.582861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.598174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.600886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.602894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.603338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.723167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:43.733994 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-435185be-939a-4583-abfe-9c4e78619cd0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.543180 Aug 21 01:23:43.735713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2097/3686] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:43 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:43.752823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:43.756585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-876ad22e-69f1-4a8f-9819-b08467f14472 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215114 Aug 21 01:23:43.757664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:43.761046 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1590/3687] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:23:43 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:23:43.784455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:43.788878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.791412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:43.795470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.797634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.804615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.806504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.813275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.825462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.832227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.833666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:43.834699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:43.839768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:43.841153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:44.160141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:44.174607 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-caeb4ef0-3d22-4356-b706-eb200f8d268d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.435875 Aug 21 01:23:44.175786 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2098/3688] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:43 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:44.191074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:44.192463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:44.210273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:44.218391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:44.220178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:44.222278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:44.224699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:44.226000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:44.446313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lazy-loading 'services' on Instance uuid 9259b75a-8593-4138-977b-c5df39c439fa {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:23:44.567665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:44.582618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8dbbfd5d-1a84-4723-86be-fbca0b62671a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.814211 Aug 21 01:23:44.588856 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1591/3689] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:43 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:44.605904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286539704", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:44.639044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e8010ea-0d4b-4549-ac0b-02d701e6c10f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments/9a5c7b22-fe9f-4013-ace9-eea66abcd388" status: 202 len: 0 microversion: 2.1 time: 0.440847 Aug 21 01:23:44.643158 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2099/3690] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:23:44 2022] DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments/9a5c7b22-fe9f-4013-ace9-eea66abcd388 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:23:45.199324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:45.200100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:45.214323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:45.214826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:45.215336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:45.216098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:45.216553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:45.217014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:45.729787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:45.743259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58d55a6f-3d4d-48bb-a1e6-6813be160345 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.548333 Aug 21 01:23:45.758062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2100/3691] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:45 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:45.764017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:45.764966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:45.773200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:45.785079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:45.787110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:45.791838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:45.792738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:45.793697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:46.816820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:46.826828 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71ab8f8c-b3ce-457e-a53f-64f89b2be30d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 1.067456 Aug 21 01:23:46.829469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2101/3692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:45 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:46.845360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:46.848338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:46.873895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:46.874641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:46.875370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:46.876348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:46.884487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:46.885479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:47.323122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:47.341305 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-767ee9db-3b8e-4cb4-a5c9-4a9b3f7a410e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.509513 Aug 21 01:23:47.342079 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2102/3693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:46 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:47.859770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:47.860749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:47.875545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:47.876761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:47.880497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:47.883255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:47.883851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:47.884387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:48.261587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:48.272432 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f787359-fbda-4ced-b206-0ba2953b8fa3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1509 microversion: 2.1 time: 0.426795 Aug 21 01:23:48.273614 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2103/3694] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:47 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:48.362247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:48.362890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:48.381474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:48.384374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:48.385086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:48.387624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:48.388339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:48.390712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:48.596964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] validate_networks() for [('30a6b423-e11b-48a2-bd1e-1788a7209058', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:23:48.748162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:48.759932 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f46ac73-2351-4f11-9058-082213b2837d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.401396 Aug 21 01:23:48.761137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2104/3695] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:48 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:49.298201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:49.300253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:49.311507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:49.313063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:49.313739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:49.314829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:49.315526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:49.316553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:49.569876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:49.586696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3776d9b-9874-43a3-9c21-37eb9001c631 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1506 microversion: 2.1 time: 0.295248 Aug 21 01:23:49.597574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2105/3696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:49 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:50.053501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:50.053982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:50.071763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.072251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.072883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:50.074681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.075125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.075543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:50.184759 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:50.208638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:23:50.383801 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd51d3ca-cfc2-4844-bf79-734276530f8e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 204 len: 0 microversion: 2.42 time: 0.772533 Aug 21 01:23:50.384904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2106/3697] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:23:49 2022] DELETE /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:23:50.418569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:50.420452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:50.440007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.441669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.443170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:50.444235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.444876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.449091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:50.821258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:50.832350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6cb2d760-3d3e-42b5-92da-570bfdc73e26 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.438207 Aug 21 01:23:50.835891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2107/3698] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:50 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:50.841385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:50.849034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:50.859689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.861798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.862433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:50.863423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:50.864076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:50.864791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.045139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:23:51.045683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:23:51.046245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:23:51.046925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:23:51.047437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:23:51.070122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.084815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.087181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.088399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.090933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.093473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.208272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Getting quotas for project 6d9f6cf1c2694e7099cff8757420b421. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:23:51.228620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Getting quotas for user fe0e970187b548d0878f3cbfc89f25fc and project 6d9f6cf1c2694e7099cff8757420b421. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:23:51.274493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:51.281830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:23:51.284139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:51.288843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:23:51.295704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:51.297046 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93ab9526-8609-4e58-bf2a-9adf57a3f7f7 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2956 microversion: 2.42 time: 0.459951 Aug 21 01:23:51.297959 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2108/3699] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:50 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2956 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:51.314042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:51.314978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:51.323690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.329643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.331362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.332712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.333413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.334333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.359618 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:51.399601 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-982badea-6ae4-420e-8530-c19ef47275b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.808177 Aug 21 01:23:51.400587 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1592/3700] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:23:51.419218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e47b3df-b749-41df-8e71-02a6762c0ebe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:51.420828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e47b3df-b749-41df-8e71-02a6762c0ebe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:51.595193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e47b3df-b749-41df-8e71-02a6762c0ebe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:51.606998 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e47b3df-b749-41df-8e71-02a6762c0ebe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1216 microversion: 2.1 time: 0.199449 Aug 21 01:23:51.608675 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1593/3701] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:51 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:51.804217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:51.821222 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-88605a0d-0dbe-46f1-bf80-5ea86832e7e1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1506 microversion: 2.1 time: 0.521058 Aug 21 01:23:51.822746 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2109/3702] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:51 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:51.859405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:51.860360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:51.875701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.877362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.877834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.878572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:51.881632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:51.882113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:51.923749 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:52.012502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df331a77-ed66-4a3e-854e-f40ccc679407", "name": "network-vif-unplugged", "status": "completed", "tag": "d92f3956-8999-4805-a5f4-e111d22a0f10"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:52.044932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.050056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.051767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.124009 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] Creating event network-vif-unplugged:d92f3956-8999-4805-a5f4-e111d22a0f10 for instance df331a77-ed66-4a3e-854e-f40ccc679407 on n-h1-master-1 Aug 21 01:23:52.140026 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-42d30d56-c49e-4012-89ef-1831d0695a4f req-f004f1cb-c6c9-4299-9083-46fbb75da77b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132930 Aug 21 01:23:52.145001 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2110/3703] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:23:52.212462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:52.226536 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4aa0f17-8308-40df-9d35-854d0b4483de tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.371150 Aug 21 01:23:52.227441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1594/3704] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:51 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:52.325885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:52.326779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:52.341379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.341943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.342427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.343813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.344269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.344687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.628363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:52.629251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:52.639891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.641983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.642586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.643478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.645305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.646075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.830647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:52.856664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:52.858448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:52.864783 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f11448c3-7ac7-4731-ae65-3e6e8a4ddf79 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2956 microversion: 2.42 time: 0.541786 Aug 21 01:23:52.866908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2111/3705] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:52 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2956 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:52.881303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:52.884025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:52.915498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:52.915769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.922759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.925447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.927532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:52.930575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:52.933695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:52.946001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d358788-08d3-484e-8416-ee33dd85754c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1220 microversion: 2.1 time: 0.322030 Aug 21 01:23:52.963371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1595/3706] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:52 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1220 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:53.216860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:53.235856 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bc43c05-f5e1-40ad-9c7c-9362479daf38 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1506 microversion: 2.1 time: 0.366076 Aug 21 01:23:53.236717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2112/3707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:52 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.271276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.272513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:53.619227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:53.642337 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f3e464f4-56c0-4226-8a48-a73d040542cb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.398507 Aug 21 01:23:53.644505 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1596/3708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:53 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:53.893990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:53.895428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:53.911752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.912657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.913131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:53.913892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.914331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.914754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:53.969992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:53.970610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:53.983928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.989991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.990714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:53.993622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:53.994333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:53.994967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.220550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.237488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40ee3131-8dd4-4dc1-851c-a7d23e17f39d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1286 microversion: 2.1 time: 0.271655 Aug 21 01:23:54.238855 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1597/3709] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:53 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:54.262922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:54.263920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:54.281367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.282651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.283342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.284268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.285023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.285714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.364199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.380071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.382066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.383580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec85c921-cad4-4112-af93-a6cb1b079b1b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2956 microversion: 2.42 time: 0.493794 Aug 21 01:23:54.386380 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2113/3710] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:53 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2956 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:54.667823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:54.669546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:54.681042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.685246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.686356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.688611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.689353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.690321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.848323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.863461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2065081-2cac-4ffd-835c-dbf06a6f12c1 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 200 len: 1449 microversion: 2.1 time: 0.602774 Aug 21 01:23:54.866899 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1598/3711] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:54 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 1449 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:54.891565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:54.892691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:54.900905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.901829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.902844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.903879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:54.904566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:54.905625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:54.929704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:54.942968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ccc576d3-e582-4cea-b3a5-5d71714e3fca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1523 microversion: 2.1 time: 0.281977 Aug 21 01:23:54.944109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2114/3712] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:54 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:55.171482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.174050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.188661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.189354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.189794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.192098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.192598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.193033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.257532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-32892e4a-dd9d-489d-b78a-75238356f16c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089929 Aug 21 01:23:55.258616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2115/3713] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:23:55.266574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.267440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.275763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.276614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.277388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.278694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.279380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.280228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.376399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.387298 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89ef5f1d-4e33-4e33-8fb7-982972f63022 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1274 microversion: 2.1 time: 0.126763 Aug 21 01:23:55.388335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2116/3714] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:55.395684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.399510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.407970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.408462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.408950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.410487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.411117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.411713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.424794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.446128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-baeab6de-9b54-4e32-93a6-66eb6cc521f7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.561979 Aug 21 01:23:55.460648 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cea1778-3d2c-4a0f-a792-ce95abdbb65f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069587 Aug 21 01:23:55.463232 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2117/3715] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:23:55.468733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1599/3716] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:54 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:55.482255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.482862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.492419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.493108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.495456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.495930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.498370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.499294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.501382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.502020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.508633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.509754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.515687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.516454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.516960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.517398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.792214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.814317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.819037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.822913 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5508d4d1-1e45-46c5-9781-82ae00f800e9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2956 microversion: 2.42 time: 0.357441 Aug 21 01:23:55.830739 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2118/3717] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2956 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:55.836166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.836806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:55.862910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:55.901244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:23:55.963274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:55.972183 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c999b1c2-3c2f-4240-9bac-efb14a030c7a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.494175 Aug 21 01:23:55.987938 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1600/3718] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:55.994135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:55.994538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.007135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.007658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.008144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.009027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.009670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.010885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.012545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d021db0-b601-4ddc-80d7-ad86822f7f4f tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 204 len: 0 microversion: 2.1 time: 0.179932 Aug 21 01:23:56.014982 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2119/3719] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:23:55 2022] DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:23:56.024045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.025188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.032341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.033280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.033938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.034969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.035656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.036293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.041454 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:23:56.206761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:56.215765 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87cf8326-d320-4939-80e8-a836b566389c tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.198680 Aug 21 01:23:56.216747 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2120/3720] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:56.221555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.222374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.228704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.229409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.230104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.231045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.231790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.232364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.506625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:56.520850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4626e84-6060-4f6e-8718-3014ab492e52 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1682 microversion: 2.1 time: 0.302695 Aug 21 01:23:56.524962 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2121/3721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1682 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:56.538009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.538700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.548364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.549493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.550515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.551657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.552373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.553055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.645941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:56.657254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68871b6b-19ca-404c-9868-008d7539c82f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1505 microversion: 2.1 time: 0.668075 Aug 21 01:23:56.657965 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1601/3722] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:55 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:56.665662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.672328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.687258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.688007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.688866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.690044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.690949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.691529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.791532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:56.803657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b917e15f-1a30-4597-8461-2dc514c763ec tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.275800 Aug 21 01:23:56.805715 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2122/3723] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:56.827641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:56.837695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.838631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.839846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.873923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:23:56.894734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:56.908269 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a9166f8-816c-464e-8fa3-d9f5004655e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.249443 Aug 21 01:23:56.908980 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1602/3724] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:56.914118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.916360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.930049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.931888 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad3349fd-c656-471a-abb3-0b362c25dbcc tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.108949 Aug 21 01:23:56.933075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2123/3725] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:23:56 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:23:56.937342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.937342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.937342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.937342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.937342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.945104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:56.946526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:56.965377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.967146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.969019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:56.969990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:56.970645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:56.971262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.282259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:57.292459 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-29cac346-7f94-44bd-bf22-fa232781ede6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.351862 Aug 21 01:23:57.293306 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2124/3726] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:57.300322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:57.328928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.329650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.330238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.363784 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] Creating event network-vif-unplugged:eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:57.381336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3064948a-ee05-44ab-b185-1b9a8c7c4132 req-1b4158c9-deba-4856-992f-8aedd88bf37d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077587 Aug 21 01:23:57.382545 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2125/3727] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:57.547472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:57.548384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:57.558514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.562792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.563495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.564453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.565465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.567717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.577019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:57.594195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:57.597592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:57.606780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00b2a272-3f19-4a87-8fa0-e44f806fc76b tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2914 microversion: 2.42 time: 0.696182 Aug 21 01:23:57.614302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1603/3728] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:56 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2914 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:57.684972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:57.686675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:57.695995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.697012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.697769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.700351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.702231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.703969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.827407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:57.838541 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50ac973d-3bc4-4897-9c71-3a0e9e037ecb tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1682 microversion: 2.1 time: 0.294475 Aug 21 01:23:57.843877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2126/3729] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:57 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1682 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:57.928944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:57.929651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:57.943587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.944178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.944877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:57.946022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:57.946705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:57.947094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.137554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:58.155752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12583f11-3629-4912-9619-896388a90e87 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.228459 Aug 21 01:23:58.156397 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2127/3730] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:57 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:58.315352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:58.316012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:58.328891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.329375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.331178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.332684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.333324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.334351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.547153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:58.556177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:58.557874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-509bc1c7-0542-4f4a-ba84-e4399b9f2735 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1505 microversion: 2.1 time: 0.882477 Aug 21 01:23:58.561603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1604/3731] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:57 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:58.566239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cba37d36-0fc2-440a-be43-d938844e9a31 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.255365 Aug 21 01:23:58.567412 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2128/3732] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:58 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:23:58.642529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:58.643197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:58.650832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.651561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.652549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.653710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.654565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.655679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.868254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:58.869958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:58.880751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.882568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.883216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:58.885649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:58.887017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:58.888530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.132889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.150822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.152397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.153817 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4cd11bbb-e78f-440c-8485-fa3d6b99403f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2914 microversion: 2.42 time: 0.515436 Aug 21 01:23:59.155494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1605/3733] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:23:58 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2914 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:23:59.178603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:59.179309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:59.192841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.193093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.193513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.193954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.194715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.195168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.195588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.206404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1c51691c-d6aa-46c5-aa73-5c6a7becae99 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1682 microversion: 2.1 time: 0.346090 Aug 21 01:23:59.221242 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2129/3734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:58 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:59.411990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "fe5c9337-719f-4457-a1d0-4be329e250ec"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "836feede-bb0f-4bf4-aa52-925140922dbc"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e520f1-9c2c-4d81-8968-f6843c1e140a"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "7a20a8ea-6567-42f9-94ca-f1db209ee871"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:59.425840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.427074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.427927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.444645 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Creating event network-vif-unplugged:fe5c9337-719f-4457-a1d0-4be329e250ec for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:59.445320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Creating event network-vif-unplugged:836feede-bb0f-4bf4-aa52-925140922dbc for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:59.445877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Creating event network-vif-unplugged:a0e520f1-9c2c-4d81-8968-f6843c1e140a for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:59.446553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] Creating event network-vif-unplugged:7a20a8ea-6567-42f9-94ca-f1db209ee871 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:59.453446 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-65669427-2bdd-4c22-9cc7-7a8ca1b60777 req-c43c9b98-3988-4c72-be6a-976249432941 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.045536 Aug 21 01:23:59.455141 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2130/3735] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:59.462154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-deleted", "tag": "eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:23:59.472190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.473010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.473665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.488417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] Creating event network-vif-deleted:eb2dc93a-cfe0-4ae3-92a0-52f6983d1f68 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:23:59.495274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5ec30f7c-1983-4596-9a75-d36e35a803c9 req-eea099c5-9c23-48c1-a804-b2739bea66b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038126 Aug 21 01:23:59.497142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2131/3736] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:23:59.586183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:59.586889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:59.593886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.594879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.595566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.596510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.597209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.598110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.708117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.720383 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bb8104b-dc66-40f5-83b7-bfa6048bb987 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.546560 Aug 21 01:23:59.723857 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1606/3737] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:59 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:23:59.739435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:23:59.740611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:23:59.751159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.751636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.755817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.759676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:23:59.760376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:23:59.763824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:23:59.851762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:23:59.864694 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a90366d8-3198-4011-bd9c-a6ef5b90245a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1505 microversion: 2.1 time: 0.281891 Aug 21 01:23:59.865802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2132/3738] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:59 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:00.182845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:00.183737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:00.201077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.201567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.212488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.213700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.218005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.218497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.258909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:00.273584 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-443ebef0-3421-4dc6-bd4e-a39b319881f5 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.547456 Aug 21 01:24:00.274202 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1607/3739] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:23:59 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:00.285185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:00.286236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:00.300912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.301635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.305377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.306331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.306961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.307549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.462957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722940af11854f0687e7c99fae3650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b90eb2eef7c45398a821324472a6429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:00.479135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0f435d0-78a4-4122-bf74-33e0ec561093 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 200 len: 1615 microversion: 2.1 time: 0.203826 Aug 21 01:24:00.480115 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1608/3740] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:00 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 1615 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:00.528987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:00.540117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:00.542322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:00.544388 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d449491-1e33-4712-a72b-e558bc32066a tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2753 microversion: 2.42 time: 0.365751 Aug 21 01:24:00.546016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2133/3741] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:00 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2753 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:00.743400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:00.744364 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:00.750980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.751473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.752105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.752822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.753273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.753863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.893147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:00.893732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:00.911286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.917058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.917676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:00.918788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:00.919695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:00.920357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:01.171735 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:01.193783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:01.210587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-143c2584-14ba-4212-963a-05714fd30a2e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 200 len: 1448 microversion: 2.1 time: 0.326461 Aug 21 01:24:01.217917 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2134/3742] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:00 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 1448 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:01.233467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:01.234123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:01.241802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:01.242294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:01.242722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:01.243418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:01.243859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:01.244270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:01.283747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:01.294093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Working on deleting snapshot b9257d32-fba4-458f-b6f7-007b2e149155 from shelved instance... Aug 21 01:24:01.608618 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:01.793495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:01.807172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fbd31f6-8d63-4af4-9688-ec0f5c9c1630 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 1.067857 Aug 21 01:24:01.809461 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1609/3743] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:00 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:01.819868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:01.827740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:01.845571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:01.846248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:01.846867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:01.847944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:01.848554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:01.849160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.523742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:02.535477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eef3c860-c4b7-488d-aeea-cebd5179084a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.724916 Aug 21 01:24:02.538234 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1610/3744] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:01 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:02.551792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9259b75a-8593-4138-977b-c5df39c439fa", "name": "network-vif-unplugged", "status": "completed", "tag": "b975328f-e347-4c17-add5-c5ffe85fee97"}, {"server_uuid": "87775b07-5ca8-42d0-9f0e-59632cdd3649", "name": "network-vif-unplugged", "status": "completed", "tag": "f92d8e35-0cd9-4476-8721-42ccbdb81662"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:02.591623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.591897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.592322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.614273 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:02.628155 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Creating event network-vif-unplugged:b975328f-e347-4c17-add5-c5ffe85fee97 for instance 9259b75a-8593-4138-977b-c5df39c439fa on n-h1-master-1 Aug 21 01:24:02.628678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.server_external_events [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] Unable to find a host for instance 87775b07-5ca8-42d0-9f0e-59632cdd3649. Dropping event network-vif-unplugged {{(pid=122483) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 01:24:02.643153 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-91c91cf3-b577-4648-98dd-50bf19c5ba74 req-5d578c94-d02b-44af-9ff9-c7731eaad42b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 355 microversion: 2.1 time: 0.102033 Aug 21 01:24:02.643301 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1611/3745] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 355 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 01:24:02.649059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:02.649751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:02.661126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Doing local delete in cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122482) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 21 01:24:02.661701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.661858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.661970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.662314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.662457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.663058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.663509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.663930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.666028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.666507 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 21 01:24:02.677335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] deallocate_for_instance() {{(pid=122482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 21 01:24:02.697338 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] HTTP exception thrown: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Request method failure captured: Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa HTTP/1.1 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYiRHHfePCRPZFnYp2hgoCba-HYC58jl9-7SDdhiuQ4t5vIAkKSxH6wiSUMKJvtBVj1Img-VulszuBYZVhC0eZ0PAx3J3KUyGE6n0Lhz0HMptuFzIliDhAFK1OuDVxW3flnliTkLyDgqgAjIB5J4rAX5uTYXiHNF46zPrAxR7dQIbZ0 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6b90eb2eef7c45398a821324472a6429", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}] Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 722940af11854f0687e7c99fae3650a2 Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '9259b75a-8593-4138-977b-c5df39c439fa'} Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:02.699211 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Returning 404 to user: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0fa0978-5c58-4b30-84ca-f352515f0fc3 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 404 len: 111 microversion: 2.1 time: 0.056321 Aug 21 01:24:02.706657 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1612/3746] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:02 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:02.721732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88517872-9d13-4fe4-a69d-f943c9b1f67c", "tag": "415866aa-f34e-4d87-bf8d-d0726d79f8bc"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-deleted", "tag": "fe5c9337-719f-4457-a1d0-4be329e250ec"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:02.750790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.756049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.757245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.790345 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Creating event network-changed:415866aa-f34e-4d87-bf8d-d0726d79f8bc for instance 88517872-9d13-4fe4-a69d-f943c9b1f67c on n-h1-master-1 Aug 21 01:24:02.791092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] Creating event network-vif-deleted:fe5c9337-719f-4457-a1d0-4be329e250ec for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:24:02.809669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1f4bee6c-02b6-4ef1-aefb-fa25e6b6473a req-79dbd120-abd2-415c-a6dd-7dca164e46ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102202 Aug 21 01:24:02.810276 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1613/3747] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:02.822031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:02.822733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:02.841246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.841899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.842559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:02.843680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:02.844358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:02.845695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:03.166632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:03.177097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:03.179457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:03.181070 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-46bcb0d1-a285-4614-baf2-2460cf51b153 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2659 microversion: 2.42 time: 0.369063 Aug 21 01:24:03.181947 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1614/3748] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:02 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2659 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:03.188400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-99b63f8f-2d35-4a16-8d59-8a5046ed0c7c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '.version_select at 0x7fc3fd18c310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:03.220422 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-99b63f8f-2d35-4a16-8d59-8a5046ed0c7c tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831691022" status: 202 len: 0 microversion: 2.1 time: 0.036502 Aug 21 01:24:03.221625 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1615/3749] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831691022 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:24:03.246885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:03.247523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:03.262715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:03.263163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:03.263600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:03.264818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:03.264818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:03.265173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:03.666947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Updating instance_info_cache with network_info: [] {{(pid=122482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:24:03.681807 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:03.874954 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:04.036180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:04.047884 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6133d583-9cc0-4907-aba6-8e5bc0e3f22a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.824756 Aug 21 01:24:04.048506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1616/3750] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:03 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:04.057319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:04.057939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:04.080409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.080933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.081367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.082140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.090649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.090935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.408615 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a66d79f0-8c96-4736-9b16-55f3f74fbd4f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 204 len: 0 microversion: 2.1 time: 3.180305 Aug 21 01:24:04.409635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2135/3751] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:01 2022] DELETE /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 0 bytes in 3182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:24:04.414813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87775b07-5ca8-42d0-9f0e-59632cdd3649", "name": "network-vif-deleted", "tag": "f92d8e35-0cd9-4476-8721-42ccbdb81662"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:04.428686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.429205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.429849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.449924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_external_events [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] Unable to find a host for instance 87775b07-5ca8-42d0-9f0e-59632cdd3649. Dropping event network-vif-deleted {{(pid=122482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 01:24:04.453813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-21b9ae27-73ee-4ddd-88b3-54454d2587be req-199b4f38-d287-4b90-9ba3-7f462dfb2338 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.042574 Aug 21 01:24:04.454418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2136/3752] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 01:24:04.459734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:04.460343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:04.467124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.467826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.468265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.468994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.469443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.469863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.629474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:04.640565 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-852e39b4-7695-4162-b4e7-b9c1724bd55b tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.590959 Aug 21 01:24:04.645534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1617/3753] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:04 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:04.655661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:04.665309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:04.689535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.690418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.695434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.696621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.697485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.698140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.727627 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 HTTP/1.1 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '87775b07-5ca8-42d0-9f0e-59632cdd3649'} Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:04.730338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:24:04.735900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:04.742968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:04.747356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f7044bb-ccae-4936-841a-fc60659ebc7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 404 len: 111 microversion: 2.1 time: 0.096583 Aug 21 01:24:04.754234 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1618/3754] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:04 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:04.778371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:04.791894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:04.794219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:04.795980 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de28bf1c-e09c-4297-a3bb-21dd7c87d00f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2545 microversion: 2.42 time: 0.340490 Aug 21 01:24:04.797179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2137/3755] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:04 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2545 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:04.859924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9259b75a-8593-4138-977b-c5df39c439fa", "name": "network-vif-deleted", "tag": "b975328f-e347-4c17-add5-c5ffe85fee97"}, {"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-deleted", "tag": "7a20a8ea-6567-42f9-94ca-f1db209ee871"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:04.873501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:04.874239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:04.874838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:04.918601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-237078802", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:04.919218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Creating event network-vif-deleted:b975328f-e347-4c17-add5-c5ffe85fee97 for instance 9259b75a-8593-4138-977b-c5df39c439fa on n-h1-master-1 Aug 21 01:24:04.919941 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] Creating event network-vif-deleted:7a20a8ea-6567-42f9-94ca-f1db209ee871 for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:24:04.939728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e9855d4b-ebe6-4feb-afc5-55e3b96eb95c req-9c679da0-5298-4afa-8c70-8b339678d069 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083642 Aug 21 01:24:04.941480 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1619/3756] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:05.014563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:24:05.073256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:05.074209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:05.085925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:05.086415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:05.086847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:05.087552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:05.088000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:05.088421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:05.445305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:05.477560 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-639e894d-9ba9-4fad-87fb-af6d5381c6a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.409603 Aug 21 01:24:05.482024 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1620/3757] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:05 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:05.667275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:05.668629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:05.709427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:05.711224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:05.712341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:05.715304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:05.716651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:05.717169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:05.981466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:24:05.982024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:24:05.982364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:24:05.983010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:24:05.983624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:24:05.999485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.005497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.006222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.007223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.008067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.008694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.053849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:24:06.066553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:24:06.087339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:06.099827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:24:06.105597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:24:06.115399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-904868d5-930a-401b-b3cc-54bfdb5c5ecd tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.452026 Aug 21 01:24:06.117135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1621/3758] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:05 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:06.122743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:06.124046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:06.157011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.157793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.158405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.159283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.159924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.161106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.237604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9adaea0c-f0b5-494c-82b6-3a32dc7c27d6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323614 Aug 21 01:24:06.246723 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2138/3759] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:24:06.256658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88517872-9d13-4fe4-a69d-f943c9b1f67c", "name": "network-vif-plugged", "status": "completed", "tag": "415866aa-f34e-4d87-bf8d-d0726d79f8bc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:06.287062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.287758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.288238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.302445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] Creating event network-vif-plugged:415866aa-f34e-4d87-bf8d-d0726d79f8bc for instance 88517872-9d13-4fe4-a69d-f943c9b1f67c on n-h1-master-1 Aug 21 01:24:06.310071 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-36784cc9-84d9-45b0-bbd7-2cb7556c26a9 req-3d55425e-78c2-428f-a3c8-30aa1e7a2c3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061558 Aug 21 01:24:06.311822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2139/3760] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:06.333818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e029012-b2ad-4028-9267-fabd882c91ee tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:06.336116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e029012-b2ad-4028-9267-fabd882c91ee tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:06.446527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8e029012-b2ad-4028-9267-fabd882c91ee tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:06.455547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e029012-b2ad-4028-9267-fabd882c91ee tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1214 microversion: 2.1 time: 0.141489 Aug 21 01:24:06.471740 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2140/3761] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:06 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:06.504835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:06.505788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:06.522787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.523883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.524322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.527344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:06.527903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:06.528345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:06.831148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:06.840676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebf7bc2c-6073-463c-b566-6d77c95d19e5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.341030 Aug 21 01:24:06.841721 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2141/3762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:06 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:07.139626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:07.142068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:07.153847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.155633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.160800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.162678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.163168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.163605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.395864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:07.411179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:07.416902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:07.418363 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8a7d6cd-9172-43ab-98db-484fce749283 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 2341 microversion: 2.42 time: 1.299716 Aug 21 01:24:07.420746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1622/3763] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:06 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 2341 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:07.426048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-deleted", "tag": "a0e520f1-9c2c-4d81-8968-f6843c1e140a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:07.453015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.457261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.458782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.477256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:07.486681 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74700bad-e631-4952-a44c-d284248f7839 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1677 microversion: 2.1 time: 0.350932 Aug 21 01:24:07.488649 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] Creating event network-vif-deleted:a0e520f1-9c2c-4d81-8968-f6843c1e140a for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:24:07.498603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-18df6b76-6d8e-4eca-bc0a-a96549bcb751 req-5e9ff59a-b67c-4716-a14f-12526307992b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076310 Aug 21 01:24:07.501146 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2142/3764] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:07 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:07.502300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1623/3765] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:07.517053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:07.517720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:07.529431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.529924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.530362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.531106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.531544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.531978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.707880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:07.718735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33918743-2492-4e15-8b0a-bafb2ec9849d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1266 microversion: 2.1 time: 0.215860 Aug 21 01:24:07.719411 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2143/3766] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:07 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:07.863024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:07.863718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:07.883328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.884051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.884487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:07.885243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:07.886056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:07.886627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.448865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:08.450209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:08.471193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:08.482360 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e33e35d3-7f3c-4adb-ac8e-c7fd6559862a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1316 microversion: 2.1 time: 0.623473 Aug 21 01:24:08.488776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.490357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.491594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.493161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.493759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.494379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.497502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1624/3767] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:07 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:08.513895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:08.514546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:08.532124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.532618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.533086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.533795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.534248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.534668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.706591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:08.728810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:08.734193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:08.739333 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8763b025-0d58-49d7-9e4e-ece2b05bca03 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.294432 Aug 21 01:24:08.744996 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2144/3768] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:08 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:08.756710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:08.757573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:08.779842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.781506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.782508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.786813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:08.787563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:08.788173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:08.924226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:08.932501 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-774ac98a-c01e-41db-a949-6dde45ebea32 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1272 microversion: 2.1 time: 0.186090 Aug 21 01:24:08.941843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2145/3769] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:08 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:09.419917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:09.434185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a20c41a8-d358-4406-9691-4ea535cde480 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1654 microversion: 2.1 time: 0.924036 Aug 21 01:24:09.438873 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1625/3770] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:08 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1654 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:09.456216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:09.462868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.464014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.464014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:09.508915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:09.509561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:09.517916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Going to try to start instance {{(pid=122482) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 01:24:09.521230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.522918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.524859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:09.525915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.526602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.529718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:09.622881 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8484b1a-f4dc-4c4a-a45d-9997fe7258e6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.168511 Aug 21 01:24:09.628904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2146/3771] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:09 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:24:09.642254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5121c14d-ec0b-45b8-8251-14462a7f1bd7", "name": "network-vif-deleted", "tag": "836feede-bb0f-4bf4-aa52-925140922dbc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:09.670176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.670995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.671519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:09.702666 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] Creating event network-vif-deleted:836feede-bb0f-4bf4-aa52-925140922dbc for instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 on n-h2-master-1 Aug 21 01:24:09.711446 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ad0cf741-fbed-4752-a47b-9a94af902d1c req-dfe0261a-ee2d-4a6d-85c2-5c41a59f1c08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080721 Aug 21 01:24:09.715716 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2147/3772] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:09.730171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:09.733078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:09.758304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.760002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.763333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:09.764504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:09.767342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:09.767986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.033450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.042065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4ffb733-4916-45e9-a67c-8ff7c0238195 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 0.324070 Aug 21 01:24:10.042939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2148/3773] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:09 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:10.078715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:10.079350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:10.090660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.091161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.091753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.093580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.093580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.097918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.269626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.286804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.288293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.289534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de22b23f-fe9b-4b0a-9500-1f8f6d79d356 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.225002 Aug 21 01:24:10.297481 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2149/3774] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:10 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:10.302590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:10.303213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:10.319144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.319538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.319995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.323512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.323689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.324078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.359011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.374115 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c68efb1-6847-440c-97db-b900a7ac6616 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1504 microversion: 2.1 time: 0.869291 Aug 21 01:24:10.382418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1626/3775] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:09 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1504 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:10.398755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:10.399604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:10.415409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.421158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.421885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.425125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.425851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.426892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.497136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:10.503093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.507960 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:UPDATE=15,nova_cell1:RELEASE=1,nova_cell1:SELECT=81,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:10.517042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5f62c52-dc47-42a7-a790-abd41820386f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1272 microversion: 2.1 time: 0.223719 Aug 21 01:24:10.523253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2150/3776] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:10 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:10.663002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50f9f4d5-c0de-46b8-a04f-a5a958aee242 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 204 len: 0 microversion: 2.1 time: 0.267497 Aug 21 01:24:10.663954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1627/3777] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:10 2022] DELETE /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:10.673043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:10.673973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:10.692517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.693406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.694086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.695017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:10.695918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:10.696683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:10.970688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:10.981598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21cf67f0-53c8-400c-af3a-72b4655649fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1510 microversion: 2.1 time: 0.313034 Aug 21 01:24:10.982220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2151/3778] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:10 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:11.071818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:11.072914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:11.079268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.080070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.080722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:11.081692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.082358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.082993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:11.315943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:11.316699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:11.331295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.332433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.334655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:11.335603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.338658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.340469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:11.364966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:11.379990 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c14d9386-39ee-4879-8889-988351328330 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 0.309622 Aug 21 01:24:11.384913 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1628/3779] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:11 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:11.456704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:11.470156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:11.472011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:11.473500 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9c86b32-45e0-4125-ac99-bdb6577212ad tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.161923 Aug 21 01:24:11.474275 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2152/3780] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:11 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:24:11.545419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:11.546143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:11.554386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.554989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.555868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:11.557680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:11.558220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:11.558736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.005288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:12.006572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:12.021970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.022929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.025191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.026125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.027667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.029236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.156710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:12.167675 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afb63f26-2da1-4128-aea0-66153488a459 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.628298 Aug 21 01:24:12.186662 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1629/3781] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:11 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:12.333713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:12.353628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7c0d43c-fdeb-49c2-8d62-4ece5ee99d96 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1510 microversion: 2.1 time: 0.346425 Aug 21 01:24:12.356249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2153/3782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:11 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:12.371392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:12.371739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:12.391896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.394083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.394636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.402333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.403298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.404180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:12.404809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:12.405873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.415122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.418779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.419279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.421553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.422026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.422448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.451059 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] HTTP exception thrown: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Request method failure captured: Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa HTTP/1.1 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYiRHHfePCRPZFnYp2hgoCba-HYC58jl9-7SDdhiuQ4t5vIAkKSxH6wiSUMKJvtBVj1Img-VulszuBYZVhC0eZ0PAx3J3KUyGE6n0Lhz0HMptuFzIliDhAFK1OuDVxW3flnliTkLyDgqgAjIB5J4rAX5uTYXiHNF46zPrAxR7dQIbZ0 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6b90eb2eef7c45398a821324472a6429", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}] Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 722940af11854f0687e7c99fae3650a2 Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '9259b75a-8593-4138-977b-c5df39c439fa'} Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:12.452973 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Returning 404 to user: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:12.458862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54a768b5-8c13-4d32-ac7c-eb286006fd14 tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 404 len: 111 microversion: 2.1 time: 0.091968 Aug 21 01:24:12.460530 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1630/3783] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:12 2022] DELETE /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:12.467519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:12.468806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] [instance: 9259b75a-8593-4138-977b-c5df39c439fa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:12.491650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.492247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.492796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.493635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.494250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.494731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.530756 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] HTTP exception thrown: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Request method failure captured: Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa HTTP/1.1 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYiRHHfePCRPZFnYp2hgoCba-HYC58jl9-7SDdhiuQ4t5vIAkKSxH6wiSUMKJvtBVj1Img-VulszuBYZVhC0eZ0PAx3J3KUyGE6n0Lhz0HMptuFzIliDhAFK1OuDVxW3flnliTkLyDgqgAjIB5J4rAX5uTYXiHNF46zPrAxR7dQIbZ0 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6b90eb2eef7c45398a821324472a6429", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6b90eb2eef7c45398a821324472a6429"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6b90eb2eef7c45398a821324472a6429"}]}] Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6b90eb2eef7c45398a821324472a6429 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242843846 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 722940af11854f0687e7c99fae3650a2 Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242843846-project Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '9259b75a-8593-4138-977b-c5df39c439fa'} Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:12.534673 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] Returning 404 to user: Instance 9259b75a-8593-4138-977b-c5df39c439fa could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:12.541416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8525d485-a5c4-4950-8fcf-9b700f6c44fe tempest-AttachSCSIVolumeTestJSON-242843846 tempest-AttachSCSIVolumeTestJSON-242843846-project] 10.222.0.46 "GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa" status: 404 len: 111 microversion: 2.1 time: 0.074529 Aug 21 01:24:12.542834 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1631/3784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:12 2022] GET /compute/v2.1/servers/9259b75a-8593-4138-977b-c5df39c439fa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:12.549901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:12.556826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:12.572417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.573044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.573541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.574347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:12.574870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:12.575353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:12.607371 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:12.886539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:12.895052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a769b6a-0827-4279-81d7-f1037ec8bdeb tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1663 microversion: 2.1 time: 0.495341 Aug 21 01:24:12.899350 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2154/3785] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:12 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1663 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:13.192945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:13.194353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:13.204105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.213043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.213863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:13.216878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.217692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.218345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:13.266513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:13.279239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:13.292692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:13.294581 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69a3bb97-97e4-4900-8378-b2bf20c40229 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.748955 Aug 21 01:24:13.303776 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1632/3786] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:12 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:13.380722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:13.381614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:13.396380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.396883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.397316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:13.408451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.408969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.409403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:13.806309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:13.821405 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa107df4-d870-4d17-809c-2021afd6d99e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.632150 Aug 21 01:24:13.826168 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2155/3787] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:13 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:13.923619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:13.925335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:13.940006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.942228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.943771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:13.945817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:13.949535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:13.951577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.010951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.053584 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4b2f9ad-d79b-4455-ae0f-76dc54dbee0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1510 microversion: 2.1 time: 0.670311 Aug 21 01:24:14.054712 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1633/3788] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:13 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1510 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:14.330285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:14.331322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:14.339024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.343957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.348784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.349380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.350576 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0cecdc0e-8d53-40ee-a832-fc9eeb5f0ffa tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.434777 Aug 21 01:24:14.352185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.352576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2156/3789] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:13 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:14.353779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.354650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.377726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:14.378621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:14.384975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.385743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.386518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.387423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.388052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.388639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.648234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.675999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.679213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.683347 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04df6b7e-a38d-47db-8af1-8ffec4084ed9 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.357554 Aug 21 01:24:14.686040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1634/3790] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:14 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:14.695111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88517872-9d13-4fe4-a69d-f943c9b1f67c", "name": "network-vif-deleted", "tag": "415866aa-f34e-4d87-bf8d-d0726d79f8bc"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:14.716237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.718742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.719188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.743040 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] Creating event network-vif-deleted:415866aa-f34e-4d87-bf8d-d0726d79f8bc for instance 88517872-9d13-4fe4-a69d-f943c9b1f67c on n-h1-master-1 Aug 21 01:24:14.758296 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b2ffc4af-1640-4393-8b17-493ad5c2b203 req-0372da32-3f61-48f1-82d6-2957997f3526 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070467 Aug 21 01:24:14.762635 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1635/3791] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:14.785451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:14.804777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4e46c64-f524-4d1b-8009-330b78836aad tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.426275 Aug 21 01:24:14.807125 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2157/3792] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:14 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:14.837020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:14.838147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:14.856417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:14.857452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:14.871041 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:14.872558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.874393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.875439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.875903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.877324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.878363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.879310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.879702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.881393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:14.882549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:14.883188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:14.884627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.203515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:15.213385 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-639af6ae-8b33-4f54-a53b-e21d61fc0ca9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.381883 Aug 21 01:24:15.214228 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1636/3793] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:14 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:15.237223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:15.243568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:15.244677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:15.248414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89ee8473-87cd-4d97-913b-73ea055f54d4 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.397071 Aug 21 01:24:15.254070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2158/3794] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:14 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:15.268086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:15.270118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:15.270546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.283377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.284135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.285133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.285788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.286377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.298093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.299326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.300062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.303911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.304956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.305877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.408922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.409471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.409835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.425133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lazy-loading 'fault' on Instance uuid 88517872-9d13-4fe4-a69d-f943c9b1f67c {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:15.648009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:15.661144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b129006f-a2aa-4c5c-a22c-37c17ddb73d8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 200 len: 1306 microversion: 2.1 time: 0.422458 Aug 21 01:24:15.663354 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1637/3795] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:15 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:15.713821 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:15.714718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:15.733034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.733736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.735798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.736910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:15.739766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:15.740867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:15.997100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.017171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.019233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.020266 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-213c323a-d593-4159-a01b-a89f12845370 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.311381 Aug 21 01:24:16.032794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1638/3796] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:15 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:16.040151 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:16.103646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.112499 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1cdb0404-ad54-43e5-9dad-918ebf61e5be tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.856345 Aug 21 01:24:16.117302 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2159/3797] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:15 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:16.149473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:16.150324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.158986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.159687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.160277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.161213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.161903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.162592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.275521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:16.286017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.300361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.300885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.301329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.302044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.306279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.310880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.451209 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:16.470871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.484678 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60a2c0e8-4f48-4930-a005-51c929020917 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.350400 Aug 21 01:24:16.485303 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1639/3798] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:16 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:16.504902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:16.505440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.513493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.518070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.518692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.519554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.520254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.522123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.562240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lazy-loading 'flavor' on Instance uuid a2fef0cb-cc28-4d9a-87b7-e9d315f3980b {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:16.590355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:16.601213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eda64ae3-e093-43ed-93b2-89ffe059bd5b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.333213 Aug 21 01:24:16.601937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2160/3799] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:16 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:16.684485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:16.686445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.695808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.697508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.698475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.699605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.700870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.701622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.724589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e973a9bc-ee86-4924-ae08-bc102b7196b3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.223260 Aug 21 01:24:16.727190 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1640/3800] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:16 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:24:16.728528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c HTTP/1.1 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '88517872-9d13-4fe4-a69d-f943c9b1f67c'} Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:16.730555 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:24:16.737380 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:16.739886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:16.740959 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf122892-612f-468b-af2e-9467c62560a3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 404 len: 111 microversion: 2.1 time: 0.061441 Aug 21 01:24:16.742347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2161/3801] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:16 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:16.747982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:16.747982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.763175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.767665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.768312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.769199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.772166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.772616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.807178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:16.812061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:16.832625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.834426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.836815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:16.838479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:16.839104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:16.842754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.104993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:17.120144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05820d9e-a59f-4740-8509-bb338b09a0d2 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1675 microversion: 2.1 time: 0.387094 Aug 21 01:24:17.121515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1641/3802] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:16 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1675 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:17.144125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf49931-ea3b-410c-b07d-1f9ae44f6a8b", "tag": "c0ec1ded-7412-4d70-b328-c94711713ad4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:17.168177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.168880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.169386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.200486 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] Creating event network-changed:c0ec1ded-7412-4d70-b328-c94711713ad4 for instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b on n-h1-master-1 Aug 21 01:24:17.228686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2d4121d8-40c4-4999-9f86-9276a5116e9c req-4ea03cc3-8aba-4d29-a8ae-195d4556a16e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099549 Aug 21 01:24:17.232082 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1642/3803] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:17.247759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:17.248933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:17.281242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.281972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.283423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.284788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.285431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.286035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.417295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:17.432424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-713fd14a-9789-47d5-b339-5aaf5bd26a93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.656023 Aug 21 01:24:17.438594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2162/3804] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:16 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:17.459059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:17.481261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:17.486288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:17.488605 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebf0a32a-fc2e-46a9-a6a4-de0ab31b0902 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.253397 Aug 21 01:24:17.489588 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1643/3805] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:17 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:17.622410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:17.623171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:17.641011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.641575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.642036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.651200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.651727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.653314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.693717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e86ec8e1-543f-42d8-a574-ddd20a66c0a9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e86ec8e1-543f-42d8-a574-ddd20a66c0a9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 163 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": 12345, "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 12345 Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:24:17.697945 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:17.703955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e86ec8e1-543f-42d8-a574-ddd20a66c0a9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:17.721343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e86ec8e1-543f-42d8-a574-ddd20a66c0a9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019266 Aug 21 01:24:17.723706 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1644/3806] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:24:17.741136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:17.741757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:17.771816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.772241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.772688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:17.779300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:17.779792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:17.780222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.173995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:18.188968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd6aa188-1350-4cbc-b107-0739b7d4596b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.567970 Aug 21 01:24:18.196852 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2163/3807] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:17 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:18.219798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:18.220685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:18.232904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.233492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.234054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.234708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.235220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.235681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.306393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef126830-d31c-4dd0-9054-694b71b31661 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/ips" status: 200 len: 146 microversion: 2.1 time: 0.106444 Aug 21 01:24:18.306994 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2164/3808] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:24:18 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/ips => generated 146 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:18.321032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:18.322097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:18.336462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.338816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.340732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.348072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.348760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.349405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.547463 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:18.554362 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-46daa4b5-aee0-4c0f-91e3-1b84f4755e27 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.826681 Aug 21 01:24:18.563605 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1645/3809] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:17 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:18.577101 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:18.578230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:18.614607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.621372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.623112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:18.623974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:18.624519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:18.626736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.038735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:19.068417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:19.070537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:19.080035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-abbf75cc-323e-4242-a589-572a2f522a61 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.515206 Aug 21 01:24:19.083256 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1646/3810] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:18 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:19.102181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:19.106444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:19.133870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.134668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.136415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.141317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.142072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.144213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.287743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:19.315486 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbcc4a02-a9bc-4882-9fc0-dbc1407b08f6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1658 microversion: 2.1 time: 1.001296 Aug 21 01:24:19.323173 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2165/3811] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:18 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1658 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:19.343763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:19.344995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:19.352508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.353416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.354019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.355587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.356355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.357215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.520341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:19.541380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ecb1896-8982-474e-9cf9-6a4263886bcb tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.202415 Aug 21 01:24:19.543988 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2166/3812] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:19 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:19.567776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:19.568637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:19.589445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.590238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.590855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.591789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.593411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.596113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.773303 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:19.833150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-624a9df6-56db-431f-b6d5-361b3cfb8a76 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action" status: 202 len: 0 microversion: 2.1 time: 0.286894 Aug 21 01:24:19.833962 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2167/3813] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:19 2022] POST /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:24:19.849044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:19.856710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:19.872604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.873204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.873754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:19.876661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:19.877951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:19.878975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.338263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:20.351504 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7177c8e0-ffa4-4d1e-a550-41dc588798e3 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1664 microversion: 2.1 time: 0.513147 Aug 21 01:24:20.358518 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2168/3814] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:19 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1664 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:20.384452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:20.388064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:20.390610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:20.401916 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ded94aff-1e73-4082-9d52-5566f1f61319 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.316671 Aug 21 01:24:20.405201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:20.406006 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1647/3815] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:19 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:20.406612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:20.407719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.411570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:20.412332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:20.413146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.486809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf49931-ea3b-410c-b07d-1f9ae44f6a8b", "name": "network-vif-plugged", "status": "completed", "tag": "c0ec1ded-7412-4d70-b328-c94711713ad4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:20.503099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:20.503632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:20.504026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.529863 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] Creating event network-vif-plugged:c0ec1ded-7412-4d70-b328-c94711713ad4 for instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b on n-h1-master-1 Aug 21 01:24:20.540491 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-099b6eff-646d-4f35-88d2-5e418e51b83a req-c79b3b04-d453-4539-b902-6e344d6ae6cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058921 Aug 21 01:24:20.541389 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1648/3816] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:20.565034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:20.566020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:20.582363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:20.583213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:20.583917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.585687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:20.587269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:20.588985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:20.628996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:20.657626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:20.660499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:20.662595 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2315b774-1e5d-4483-b8b9-83a3fa5b792f tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.302467 Aug 21 01:24:20.676082 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2169/3817] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:20 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:21.197464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:21.223647 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7084187-3bb7-4cd2-8c23-0bf6cf35a226 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.663192 Aug 21 01:24:21.250260 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1649/3818] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:20 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:21.277911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12462a2d-7cc5-423c-84ed-df573586929c"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:21.281387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:21.293688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.294402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.294836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.295538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.295986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.296401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.380484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:21.381426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:21.388837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.390003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.390670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.391921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.392600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.393312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.398136 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:21.742097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:21.756514 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c72c5a3-acc1-4c6a-8223-17c60a775ba8 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1664 microversion: 2.1 time: 0.375134 Aug 21 01:24:21.778799 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1650/3819] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:21 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1664 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:21.783910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:21.784534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:21.811909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.812401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.812868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.813578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:21.814021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:21.814437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:21.983602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:21.999395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:22.001856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:22.005120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc6b61d1-9753-42b2-b287-3eeeb2698136 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.225128 Aug 21 01:24:22.017877 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1651/3820] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:21 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:22.263431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:22.264060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:22.282418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:22.282914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:22.283352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:22.284066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:22.284518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:22.285250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:22.295648 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14aba237-46b4-4757-8d51-cba97faac8d8 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.019461 Aug 21 01:24:22.304188 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2170/3821] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:24:21 2022] POST /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:22.643687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:22.674749 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04e094b8-bc41-4763-aabf-05ab7a66cd9e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1314 microversion: 2.1 time: 0.415701 Aug 21 01:24:22.680090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1652/3822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:22 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:22.786487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:22.787476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:22.809785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:22.816153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:22.816612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:22.817978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:22.818449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:22.818882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.045250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:23.046538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:23.058384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:23.061442 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:23.062090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.064881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:23.065526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:23.066309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.195697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:23.212876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:23.214714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:23.216655 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e305c09-7660-4f8e-a15a-77e44c03a17e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.175678 Aug 21 01:24:23.218097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1653/3823] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:23 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:23.269594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:23.300361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80d05274-b092-471d-8ba7-4dfcccdc54d0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1664 microversion: 2.1 time: 0.521555 Aug 21 01:24:23.302197 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2171/3824] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:22 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1664 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:23.701308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:23.702431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:23.710560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:23.711260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:23.711853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.712744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:23.713372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:23.714093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.923842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:23.933277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3517c3d4-2d5e-4bf8-907e-2778596173ff tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1501 microversion: 2.1 time: 0.238360 Aug 21 01:24:23.950022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1654/3825] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:23 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:23.957240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:23.968057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:23.968578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:23.969048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:23.998944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:24:24.065469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5989be68-1976-49f3-8791-d4fa21424064 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b/action" status: 202 len: 0 microversion: 2.1 time: 0.112494 Aug 21 01:24:24.075664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:24.076164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:24.079705 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2172/3826] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:23 2022] POST /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:24:24.083933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.084960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.085609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.086671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.087298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.087883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.248072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:24.249315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:24.263089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.263891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.264487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.268131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.269677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.270143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.299422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.309804 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-029072aa-68a5-474e-b5a5-3d6414f7080f tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.239155 Aug 21 01:24:24.324918 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1655/3827] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:24 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:24.333488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:24.337831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:24.353353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.353974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.354530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.356616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.357617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.358117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.388348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.409953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.417230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.418491 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28d54aef-1af5-4b1d-8b19-71ec0e870908 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.175922 Aug 21 01:24:24.422848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2173/3828] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:24 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:24:24.617167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.629585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b807a1f8-c3d4-4ef9-9cdd-d7e0eda9c573 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.298632 Aug 21 01:24:24.630198 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1656/3829] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:24 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:24.655634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:24.656233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:24.662397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.663090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.663713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.664583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.665265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.665841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.902892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:24.911928 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c055db2-e1ed-4620-9399-62ccdb56df2d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1667 microversion: 2.1 time: 0.260104 Aug 21 01:24:24.925960 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2174/3830] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:24 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1667 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:24.937465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:24.938735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:24.959160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.960031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.960723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.961730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:24.962441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:24.963089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:24.994586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:25.002388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.api [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Working on deleting snapshot 405ae9b6-aa12-45e0-b5ab-b21d27c991ab from shelved instance... Aug 21 01:24:25.336028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:25.336653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:25.351990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:25.355339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:25.356078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:25.358788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:25.360994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:25.362813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:25.684076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:25.706634 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61fd0f82-1c5e-40d2-8012-aa3f0dfdcfe1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.369547 Aug 21 01:24:25.708445 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2175/3831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:25 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:25.729572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:25.730465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:25.738968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:25.739699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:25.740297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:25.741555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:25.742327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:25.742975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:25.852023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:25.867395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:25.870690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:25.872309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0106eab-530d-493c-9722-70a1e57b40c4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.162116 Aug 21 01:24:25.876240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2176/3832] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:25 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:25.977625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Doing local delete in cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) {{(pid=122483) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 21 01:24:25.979063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:25.980041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:25.980711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:25.981416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.api [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 21 01:24:25.985726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] deallocate_for_instance() {{(pid=122483) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 21 01:24:26.729211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:26.730466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:26.733470 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:26.738813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:26.739570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:26.740374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:26.741268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:26.741884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:26.742489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.112330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:27.114206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Updating instance_info_cache with network_info: [] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:24:27.127545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b6f101c-b138-47a3-b139-1dec736f02a6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.400690 Aug 21 01:24:27.135837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2177/3833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:26 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:27.148335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:27.150938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:27.168682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.169512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.171274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.173674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.175355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.176528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.501459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:27.514599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:27.516088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:27.527676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc885db5-388d-49e9-81e6-4713760064e1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.385194 Aug 21 01:24:27.528711 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2178/3834] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:27 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:27.544856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df331a77-ed66-4a3e-854e-f40ccc679407", "name": "network-vif-deleted", "tag": "d92f3956-8999-4805-a5f4-e111d22a0f10"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:27.561198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.561942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.563826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.597358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_external_events [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] Unable to find a host for instance df331a77-ed66-4a3e-854e-f40ccc679407. Dropping event network-vif-deleted {{(pid=122482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 01:24:27.598248 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e3f9fe61-f80e-4a4f-883b-ff21aedaa081 req-9b669e65-1d93-4088-884a-b198d553a22d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.068239 Aug 21 01:24:27.603199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2179/3835] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 01:24:27.829197 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71473657-5578-4988-96e9-d43b0f31912f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 204 len: 0 microversion: 2.1 time: 2.896190 Aug 21 01:24:27.832859 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1657/3836] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:24 2022] DELETE /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 0 bytes in 2899 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:27.841391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:27.843258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: df331a77-ed66-4a3e-854e-f40ccc679407] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:27.867652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.869985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.873629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.874635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.875308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.876976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.924131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 HTTP/1.1 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: exception: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'df331a77-ed66-4a3e-854e-f40ccc679407'} Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:27.925847 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 404 to user: Instance df331a77-ed66-4a3e-854e-f40ccc679407 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:27.932292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ccac7b6-e129-411d-ae22-7cd4ed87eba6 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407" status: 404 len: 111 microversion: 2.1 time: 0.095402 Aug 21 01:24:27.934720 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2180/3837] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:27 2022] GET /compute/v2.1/servers/df331a77-ed66-4a3e-854e-f40ccc679407 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:27.943319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:27.944088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:27.953145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.953714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.954213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.954989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:27.955687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:27.956446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:27.990257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:28.075143 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:28.113333 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bb313d4-4f4c-493b-89a5-0ece1991f025 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 204 len: 0 microversion: 2.1 time: 0.174843 Aug 21 01:24:28.115285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1658/3838] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:27 2022] DELETE /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:28.126512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:28.127455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:28.138995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.140041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.141020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.145459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.145993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.147832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.157113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:28.158003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:28.169322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.169802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.172245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.174055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.175739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.179648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.279239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:28.289289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33e17fe8-18eb-4d9a-b4eb-1fca26e01d0a tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1465 microversion: 2.1 time: 0.169436 Aug 21 01:24:28.290180 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2181/3839] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:28 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1465 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:28.422626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:28.433381 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b69161e1-77a3-4605-bc18-62d393ca2994 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.282135 Aug 21 01:24:28.435092 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1659/3840] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:28 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:28.561942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:28.563911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:28.576169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.576937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.578041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.579509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:28.580757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:28.581590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:28.657441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:28.668093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:28.670346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:28.671738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ad7daa4-2bbe-49c8-a946-56daeb1b1cb1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.120302 Aug 21 01:24:28.673049 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2182/3841] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:28 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:29.312335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:29.313645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:29.324801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.325561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.326009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.329037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.329227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.329618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.444886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:29.454483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:29.455486 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f2a11827-5220-40b9-9c5f-e8fca6f3413e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1465 microversion: 2.1 time: 0.147890 Aug 21 01:24:29.455618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:29.457633 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1660/3842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:29 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:29.463944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.464465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.464973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.470288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.472416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.473100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.481185 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:29.696237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:29.697026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:29.706387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.720889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.721369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.722564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:29.733530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:29.734330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:29.754864 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:29.763714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3dca162-5e5d-4ccf-a773-cf0a31c22071 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.312969 Aug 21 01:24:29.769953 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2183/3843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:29 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:29.863179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:29.881273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:29.883239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:29.885006 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68a36791-2880-4cce-9c08-fbaf2d128efe tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.192220 Aug 21 01:24:29.885652 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1661/3844] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:29 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:24:30.193243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6058b8-2543-431b-a408-2054dc24b51a", "name": "network-vif-deleted", "tag": "0581badc-ef75-4087-842b-4bbc65b29902"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:30.222393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.227087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.228443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.259485 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] Creating event network-vif-deleted:0581badc-ef75-4087-842b-4bbc65b29902 for instance ca6058b8-2543-431b-a408-2054dc24b51a on n-h1-master-1 Aug 21 01:24:30.269954 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f38a7b0d-21d8-44ce-94f9-38888467c635 req-c36f56f1-3f4c-4623-86c2-9617f4d39373 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081206 Aug 21 01:24:30.278650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2184/3845] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.392793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d3dbea1-453b-47bf-bd15-710883d92f49 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.403095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d3dbea1-453b-47bf-bd15-710883d92f49 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.199694 Aug 21 01:24:30.403683 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1662/3846] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.424594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf3896af-5fe0-42c6-a6c0-b0aa077a9e45 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.456563 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf3896af-5fe0-42c6-a6c0-b0aa077a9e45 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.042058 Aug 21 01:24:30.458216 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2185/3847] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:30.472098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2667da01-e8ef-4264-b1a6-0835eedd9d45 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.480182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.481007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:30.488102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2667da01-e8ef-4264-b1a6-0835eedd9d45 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020117 Aug 21 01:24:30.488781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.489591 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1663/3848] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.497110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.497618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.498362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.499050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.499810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.502974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19d24189-b60c-4dc3-b44e-026845f2bd8a tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.511291 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19d24189-b60c-4dc3-b44e-026845f2bd8a tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013419 Aug 21 01:24:30.512423 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1664/3849] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.524374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf8bc5cb-20d5-4c55-984d-4b0eb6cf7ebe tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.542173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.542763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.543358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.543815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lazy-loading 'fault' on Instance uuid ca6058b8-2543-431b-a408-2054dc24b51a {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:30.554542 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf8bc5cb-20d5-4c55-984d-4b0eb6cf7ebe tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034989 Aug 21 01:24:30.555230 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1665/3850] 10.222.0.46 () {58 vars in 1165 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:30.578712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-297988a9-aa9a-459a-9f2c-1c5a43429129 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.587791 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-297988a9-aa9a-459a-9f2c-1c5a43429129 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014197 Aug 21 01:24:30.588897 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1666/3851] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.600030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f48190dd-1cdf-467e-9db3-f35293fb5ec0 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.607642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:30.616158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e59e6393-73f7-4341-8e0e-140f320b927e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 200 len: 1305 microversion: 2.1 time: 0.141524 Aug 21 01:24:30.621520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2186/3852] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:30.630284 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f48190dd-1cdf-467e-9db3-f35293fb5ec0 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033751 Aug 21 01:24:30.631293 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1667/3853] 10.222.0.46 () {58 vars in 1169 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:30.653098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02dbc079-17e4-487a-b344-b6f47d3aa9de tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.673385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02dbc079-17e4-487a-b344-b6f47d3aa9de tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029239 Aug 21 01:24:30.674443 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2187/3854] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.688977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ea3a933-29ee-41aa-9a1f-f98792976d31 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.700575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ea3a933-29ee-41aa-9a1f-f98792976d31 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017177 Aug 21 01:24:30.701432 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1668/3855] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.713793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5bab81e2-81a9-4f2f-9386-2f68f0be3fed tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.766768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5bab81e2-81a9-4f2f-9386-2f68f0be3fed tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.057066 Aug 21 01:24:30.767363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2188/3856] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:30.785647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-232d5563-64c6-41d2-b9a2-d969fa8002cd tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.800116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-232d5563-64c6-41d2-b9a2-d969fa8002cd tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020415 Aug 21 01:24:30.801767 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1669/3857] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:24:30.801899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.802346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:30.813897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb601ac4-15c3-48a9-90dc-723ae594fdbd tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.815609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.816110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.816541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.819164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.821395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.822054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.852680 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb601ac4-15c3-48a9-90dc-723ae594fdbd tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042984 Aug 21 01:24:30.857020 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1670/3858] 10.222.0.46 () {58 vars in 1144 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:30.882415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7277965a-b214-4246-9d25-ceba20b01d80 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.891938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7277965a-b214-4246-9d25-ceba20b01d80 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024176 Aug 21 01:24:30.893235 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1671/3859] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:30.907121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-07e1c0c7-fa16-40a6-8adc-e88e1f5e815b tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.928277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-07e1c0c7-fa16-40a6-8adc-e88e1f5e815b tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024899 Aug 21 01:24:30.929315 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1672/3860] 10.222.0.46 () {58 vars in 1148 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:30.934652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:30.935677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:30.947301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.947790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.948325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:30.950104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:30.950620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:30.951087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.027615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:31.029996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:31.041869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f326cc5-4dbf-4e34-8e79-b9117fd55b1d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.250802 Aug 21 01:24:31.042392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:31.043315 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2189/3861] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:31.044210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:31.045547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b15cd41-c525-4fca-9d49-eb022b29f5d2 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.114977 Aug 21 01:24:31.046096 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1673/3862] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:30 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:31.049159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b6a4301-6804-401f-911f-514a57d73991 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.062165 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b6a4301-6804-401f-911f-514a57d73991 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017154 Aug 21 01:24:31.063205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2190/3863] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:31.085284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a60477e5-202d-4e38-afbc-e81f376f5e71 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.094024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a60477e5-202d-4e38-afbc-e81f376f5e71 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013874 Aug 21 01:24:31.094589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1674/3864] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:31.109058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46706885-7e61-4cda-9a9d-e0c4877d0b46 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.146311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46706885-7e61-4cda-9a9d-e0c4877d0b46 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.043054 Aug 21 01:24:31.146908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2191/3865] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:31.162954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ff15041-3722-45b9-8eb8-af1cde639186 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.191520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ff15041-3722-45b9-8eb8-af1cde639186 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033693 Aug 21 01:24:31.192931 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1675/3866] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:31.211255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd2ca7d4-0eb9-46b8-b9af-836715065b18 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.226000 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd2ca7d4-0eb9-46b8-b9af-836715065b18 tempest-FlavorsV2TestJSON-534505958 tempest-FlavorsV2TestJSON-534505958-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019560 Aug 21 01:24:31.226523 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2192/3867] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:24:31.645155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.645796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: ca6058b8-2543-431b-a408-2054dc24b51a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:31.655148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.655895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.656703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.658147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.658926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.659348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.677866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a HTTP/1.1 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ca6058b8-2543-431b-a408-2054dc24b51a'} Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:31.679741 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 404 to user: Instance ca6058b8-2543-431b-a408-2054dc24b51a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:31.745946 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14f901b6-a1f9-4955-9fd4-f04e10adebd7 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a" status: 404 len: 111 microversion: 2.1 time: 0.041195 Aug 21 01:24:31.746827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.746827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:31.748246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1676/3868] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/servers/ca6058b8-2543-431b-a408-2054dc24b51a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:31.748322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.748322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.748322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.749664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.750505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.750895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.790183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:31.912989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e6f2b30-ec95-4a4e-aa0a-838b164780a9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 204 len: 0 microversion: 2.1 time: 0.225281 Aug 21 01:24:31.914357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2193/3869] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:31 2022] DELETE /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:31.924701 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:31.925600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:31.931931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.937463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.940208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:31.942885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:31.944660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:31.945818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:32.089103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:32.090121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:32.103068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:32.103959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:32.104906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:32.106775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:32.107465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:32.108089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:32.182605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:32.193146 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-75a1a4ab-72bb-42b5-8a56-807187173f51 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1505 microversion: 2.1 time: 0.274277 Aug 21 01:24:32.207729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1677/3870] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:31 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:32.221611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:32.222330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:32.230558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:32.231090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:32.231558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:32.232313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:32.232832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:32.233307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:32.350789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:32.359993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e4ff3fe-8554-4f08-8b46-9b7f3072d060 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.276065 Aug 21 01:24:32.360606 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2194/3871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:32 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:32.415260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:32.426385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:32.428406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:32.429781 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e9beb4a-0d00-4351-b918-b13ac712e2e4 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1603 microversion: 2.42 time: 0.219674 Aug 21 01:24:32.430469 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1678/3872] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:32 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:33.215314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:33.216805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:33.220249 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:33.236448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.238567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.240753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.242238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.242802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.243272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.273651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1169655488", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:33.367477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:24:33.430787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:33.441267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-75178c81-0b7b-4849-bb3e-202217e0db62 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1505 microversion: 2.1 time: 0.230754 Aug 21 01:24:33.442157 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1679/3873] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:33 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:33.447472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:33.448072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:33.460943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.461561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.461990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.462674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.463235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.463649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.625557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:33.637669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bfe1916-807b-49c0-b4d0-54b2d8192df1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.194459 Aug 21 01:24:33.638252 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1680/3874] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:33 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:33.659673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:33.660347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:33.667896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.668377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.668819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.670028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.670480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.671091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.713761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:33.714369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:33.714753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:33.715130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lazy-loading 'fault' on Instance uuid 5121c14d-ec0b-45b8-8251-14462a7f1bd7 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:33.781631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:33.800734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:33.805796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5437fbb8d7fa4c6b8dca85efdc8fc694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d702749939d4b8cb8471857ba668f07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:33.808300 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6e307ab-b50b-4018-bc96-082f8c8093d1 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 200 len: 1608 microversion: 2.42 time: 0.157555 Aug 21 01:24:33.809609 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1681/3875] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:33 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 1608 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:24:34.029000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6bf4c108-6b08-4b1b-9f58-89c45548d6a5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2106473927", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:34.110661 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6bf4c108-6b08-4b1b-9f58-89c45548d6a5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6bf4c108-6b08-4b1b-9f58-89c45548d6a5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 358 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2106473927", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: exception: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2106473927', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f'}], 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:34.118349 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6bf4c108-6b08-4b1b-9f58-89c45548d6a5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Block Device 85c5e35b-dd1c-4ea9-b8bb-d5495b5a381f is not bootable. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6bf4c108-6b08-4b1b-9f58-89c45548d6a5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.096946 Aug 21 01:24:34.125241 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1682/3876] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:34 2022] POST /compute/v2.1/servers => generated 110 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:24:34.130973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:34.131799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:34.138623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.139154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.139588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.140416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.142295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.142745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.350509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:24:34.352294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:24:34.353366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:24:34.353942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:24:34.354855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:24:34.378676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.379509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.381730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.383217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.384168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.385203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.407819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Getting quotas for project fb877dddfba14fe3929b1267dee0e256. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:24:34.416258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Getting quotas for user ea86632bc35148a68dc7a10e194e184d and project fb877dddfba14fe3929b1267dee0e256. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:24:34.423578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:34.435836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54c4ffac-893b-4bba-a55e-e3ed5a1052cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.309611 Aug 21 01:24:34.437830 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1683/3877] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:34 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:34.438510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:24:34.441857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:24:34.462081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:34.462776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:34.473188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.475630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.475896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.476904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.479181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.479758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.532747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef20d550-9b87-422c-b04f-c9107e1ce622 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.468404 Aug 21 01:24:34.538892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2195/3878] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:24:34.546760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:34.547393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:34.558159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.558658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.559133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.562666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.564692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.564840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.805968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:34.823674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5276a88-4556-439b-bb84-6721c077d13c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.361416 Aug 21 01:24:34.833956 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1684/3879] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:34 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:34.839943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8625e1b-365a-427c-b4a8-d4018982e8d0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:34.840830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8625e1b-365a-427c-b4a8-d4018982e8d0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:34.894541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:34.908630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b7a6b9f-d7f1-477e-817c-ba8c524e9f67 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 200 len: 1505 microversion: 2.1 time: 0.371609 Aug 21 01:24:34.910887 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2196/3880] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:34 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:34.924648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:34.926183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:34.942269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.944255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.944858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:34.946377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:34.948134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:34.952640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.034526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8625e1b-365a-427c-b4a8-d4018982e8d0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:35.059566 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8625e1b-365a-427c-b4a8-d4018982e8d0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1217 microversion: 2.1 time: 0.230703 Aug 21 01:24:35.076743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1685/3881] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:34 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1217 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:35.087824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:35.088454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:35.120184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:35.124580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:35.127483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.148637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:35.149362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:35.159366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.208560 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] HTTP exception thrown: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Request method failure captured: Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 HTTP/1.1 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYem7UEl9LkUK5cl-jl9nZFFAJBWdm4cJsWJIZnyI3yxQf9GAzKupLBp4_ggnGLgL0rlPB_gmjW1k-C5b2-TAaq-GVw8C6HlrONRlFGZyhFmruHSUhy24fwR3holCLJTZKDjtZJ9pnrC18L7rHecDY8Ep4rjczdh31p7KKnRsvF-YOU Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.42 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d702749939d4b8cb8471857ba668f07", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}] Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 5437fbb8d7fa4c6b8dca85efdc8fc694 Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5121c14d-ec0b-45b8-8251-14462a7f1bd7'} Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.214814 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:35.217895 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.223673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Returning 404 to user: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:35.227137 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab8e2a67-a7bf-4345-96fb-75e0ff4bf832 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 404 len: 111 microversion: 2.42 time: 0.146857 Aug 21 01:24:35.228074 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1686/3882] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:35 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:35.246016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d6ee5b-cb5b-4b7c-8712-71112533341d", "name": "network-vif-deleted", "tag": "bec6bea7-c06c-43e1-b94e-784b60b77518"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:35.279395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:35.282147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:35.283645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.316720 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] Creating event network-vif-deleted:bec6bea7-c06c-43e1-b94e-784b60b77518 for instance b9d6ee5b-cb5b-4b7c-8712-71112533341d on n-h2-master-1 Aug 21 01:24:35.332149 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ea6c5ed9-eb26-4d80-842b-9caa3814ee14 req-8a92318d-6556-4b69-9b8f-c8076e3755bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100340 Aug 21 01:24:35.333301 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1687/3883] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:35.352009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7c885f67-415c-4d43-8cf6-b3255dd6112e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '.version_select at 0x7fc3fd0c9a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:35.402308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7c885f67-415c-4d43-8cf6-b3255dd6112e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543659224" status: 204 len: 0 microversion: 2.42 time: 0.064441 Aug 21 01:24:35.406293 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1688/3884] 10.222.0.46 () {60 vars in 1259 bytes} [Sun Aug 21 01:24:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543659224 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:24:35.450313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:35.462688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f8006ea-ac00-4ec3-ae07-a3feecf364a3 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.550174 Aug 21 01:24:35.463912 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2197/3885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:34 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:35.931981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:35.932977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: b9d6ee5b-cb5b-4b7c-8712-71112533341d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:35.940191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:35.940672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:35.941130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.941818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:35.942260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:35.942673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:35.978321 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d HTTP/1.1 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b9d6ee5b-cb5b-4b7c-8712-71112533341d'} Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:35.980058 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 404 to user: Instance b9d6ee5b-cb5b-4b7c-8712-71112533341d could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:35.984118 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0648bceb-29c8-4188-9f29-dd678b616918 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d" status: 404 len: 111 microversion: 2.1 time: 0.053472 Aug 21 01:24:35.986735 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1689/3886] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:35 2022] GET /compute/v2.1/servers/b9d6ee5b-cb5b-4b7c-8712-71112533341d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:35.990454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:35.990959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:36.002345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.002946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.003395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.008750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.012165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.013119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.064311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:36.083930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:36.084707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:36.095125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.095604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.096029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.101421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.101889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.102314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.250301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6cf04657-f7ef-4e41-86d8-15636f75ed3d tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 204 len: 0 microversion: 2.1 time: 0.263741 Aug 21 01:24:36.251987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2198/3887] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:35 2022] DELETE /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:24:36.262867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:36.264670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:36.271878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.272587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.273178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.277214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:36.281290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.281766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.282514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.291469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a6a9de1-6551-406b-944b-4d07aec407df tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1269 microversion: 2.1 time: 0.209873 Aug 21 01:24:36.293203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1690/3888] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:36 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:36.485173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:36.485784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:36.492063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.492541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.493009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.494105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:36.494756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:36.495458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:36.728647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:36.742705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1d1646f-50b2-4e88-98d4-ae0d05704a54 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.262028 Aug 21 01:24:36.745806 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1691/3889] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:36 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:36.763728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:36.783793 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57e1bd9a-2925-453a-bc9d-d31a56d86f06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1494 microversion: 2.1 time: 0.526579 Aug 21 01:24:36.797420 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2199/3890] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:36 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1494 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:37.326018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:37.330247 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:37.355954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.359112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.360203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:37.361449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.363084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.364813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:37.766811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:37.768178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:37.784887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.786182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.787000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:37.788949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.791700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.792481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:37.827854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:37.845764 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f1ec4c8b-67b4-43a7-92ae-69559d2f8648 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1275 microversion: 2.1 time: 0.531532 Aug 21 01:24:37.847431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1692/3891] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:37 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1275 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:37.860832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:37.862872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:37.881271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.882048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.882688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:37.883539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:37.885309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:37.888432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:38.471190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:38.474124 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:38.508086 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-929a77f7-7952-47a8-8059-9bb16bc63e3f tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1494 microversion: 2.1 time: 0.659144 Aug 21 01:24:38.509588 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1693/3892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:37 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1494 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:38.532819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-053ed082-fe56-41ec-8edb-fa3a36dd603d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1521337429", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "64873b6f-4787-4a40-b75c-af37e7532ab1", "destination_type": "local"}, {"source_type": "volume", "uuid": "16409345-7799-42cb-97cb-8adb424128d1", "destination_type": "invalid"}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-053ed082-fe56-41ec-8edb-fa3a36dd603d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 495 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1521337429", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "64873b6f-4787-4a40-b75c-af37e7532ab1", "destination_type": "local"}, {"source_type": "volume", "uuid": "16409345-7799-42cb-97cb-8adb424128d1", "destination_type": "invalid"}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1521337429', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '16409345-7799-42cb-97cb-8adb424128d1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'invalid' Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:38.546808 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-053ed082-fe56-41ec-8edb-fa3a36dd603d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:38.550383 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-053ed082-fe56-41ec-8edb-fa3a36dd603d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.038264 Aug 21 01:24:38.552257 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1694/3893] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:38 2022] POST /compute/v2.1/servers => generated 155 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:38.560073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:38.564853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:38.586707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:38.588241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:38.589088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:38.589697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:38.590152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:38.590574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:38.617843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:38.633885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7068e363-4ea1-44d8-85b8-d4c906579b8a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.871203 Aug 21 01:24:38.637449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2200/3894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:37 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:38.877101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:38.878452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:38.886183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:38.887075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:38.887969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:38.889433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:38.890039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:38.890597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:38.968953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:38.985080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38900182-5b79-4b35-b94c-0800960ef7b5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.425049 Aug 21 01:24:38.986579 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1695/3895] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:38 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:39.007741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:39.008503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:39.022820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.023492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.029551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.030346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.030808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.031218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.040299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:39.052573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bb0b1b2-9221-4846-b3da-1cdf36d74609 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1275 microversion: 2.1 time: 0.180442 Aug 21 01:24:39.053847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2201/3896] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:38 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:39.534290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:39.534956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:39.559606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.562183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.562854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.568996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.573441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.573880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.693842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:39.706642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a4d3e14-9f8b-42c6-b37a-db55ae3f2915 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1452 microversion: 2.1 time: 0.178228 Aug 21 01:24:39.722349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2202/3897] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:39 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:39.731775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:39.733263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:39.736209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:39.745760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.746308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.746748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.747459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.747904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.748320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.749927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3051f921-6c19-476a-89fe-f699aa6e9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.746568 Aug 21 01:24:39.751047 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1696/3898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:39 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:39.808809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2209cb63-15f9-488c-803f-c2c15bd81fd6", "name": "network-vif-deleted", "tag": "1443add1-5d7b-414c-9555-12edbf5f3c07"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:39.829905 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:39.865491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:39.867895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:39.871040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:39.904547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] Creating event network-vif-deleted:1443add1-5d7b-414c-9555-12edbf5f3c07 for instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 on n-h2-master-1 Aug 21 01:24:39.919456 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3ac17f08-68ec-44ae-8add-c71a878100b7 req-ef86722c-1c1a-4945-bfc2-c20bc97852aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118187 Aug 21 01:24:39.920711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1697/3899] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:40.000391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-681b35ed-8189-40fa-8013-b19307505187 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-651529500", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-681b35ed-8189-40fa-8013-b19307505187 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 491 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-651529500", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-651529500', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.005778 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 21 01:24:40.008105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:40.013999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-681b35ed-8189-40fa-8013-b19307505187 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:40.015228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-681b35ed-8189-40fa-8013-b19307505187 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022479 Aug 21 01:24:40.016606 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1698/3900] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:39 2022] POST /compute/v2.1/servers => generated 624 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:40.027467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:40.028668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:40.040574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.041657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.042557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.076636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.080114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.080872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.275722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:40.286603 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7153314-9e9e-4050-a8ac-03ce61d4aa0e tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.560153 Aug 21 01:24:40.301535 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2203/3901] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:39 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:40.308720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:40.309386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:40.330547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.331127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.331523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.332262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.341340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.341887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.641036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:40.657085 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a581dd8c-d6a2-4170-84db-d38b02ab45fa tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.636193 Aug 21 01:24:40.661504 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1699/3902] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:40.667246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:40.683460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc46c02d-dd07-4663-bdd2-0b383b469142 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1275 microversion: 2.1 time: 0.379667 Aug 21 01:24:40.684474 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2204/3903] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:40 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1275 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:40.703661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:40.704686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:40.731971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.732523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:40.733387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:40.734690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.735377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.739846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.742026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.745159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.745424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.747897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.749275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.751454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.752651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.753780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.836197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:40.837017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:40.837623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:40.838246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lazy-loading 'fault' on Instance uuid 2209cb63-15f9-488c-803f-c2c15bd81fd6 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:40.958252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:40.969360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-106cf77d-9e24-45c1-9339-c50e188277f0 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 200 len: 1305 microversion: 2.1 time: 0.240168 Aug 21 01:24:40.973491 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2205/3904] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:40 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:41.280008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:41.290372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3032428-c223-4110-9683-f2295d478e4f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.609765 Aug 21 01:24:41.290971 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1700/3905] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:41.334704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:41.336176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:41.352822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:41.359581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:41.360038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:41.360805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:41.361276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:41.361710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:41.581954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbfc1893-5e46-4e60-82a2-291f79ae3b56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbfc1893-5e46-4e60-82a2-291f79ae3b56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 416 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.585882 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbfc1893-5e46-4e60-82a2-291f79ae3b56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbfc1893-5e46-4e60-82a2-291f79ae3b56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009450 Aug 21 01:24:41.589087 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1701/3906] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:41 2022] POST /compute/v2.1/servers => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:41.634537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:41.635206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:41.669754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:41.670264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:41.670706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:41.671429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:41.671884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:41.672311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.073050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:42.085921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a9b8470-9522-4c3e-9e13-e4936f4a9777 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.771682 Aug 21 01:24:42.100321 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2206/3907] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:41 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:42.109788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:42.121798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:42.128879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.129663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.130318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.131222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.131868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.132486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.190994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:42.205902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0122bfed-f7b5-46be-94b2-c06d2c9f13fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.598851 Aug 21 01:24:42.207593 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1702/3908] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:41 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:42.221872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:42.223120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: 2209cb63-15f9-488c-803f-c2c15bd81fd6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:42.242574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.243277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.243842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.244703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.248391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.249000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.272569 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 HTTP/1.1 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2209cb63-15f9-488c-803f-c2c15bd81fd6'} Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:42.274739 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. Aug 21 01:24:42.279301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:42.281643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 404 to user: Instance 2209cb63-15f9-488c-803f-c2c15bd81fd6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:42.282998 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4a21ee1c-fa72-49f9-9b40-9975ff72baf4 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6" status: 404 len: 111 microversion: 2.1 time: 0.073959 Aug 21 01:24:42.287358 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1703/3909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:42 2022] GET /compute/v2.1/servers/2209cb63-15f9-488c-803f-c2c15bd81fd6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:42.293766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:42.294798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:42.316353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.319623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.321470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.324208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.325962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.326631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.541838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:42.563746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-248bea91-b70a-453a-94c9-f059da865a30 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.461945 Aug 21 01:24:42.564343 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2207/3910] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:42 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:42.577127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:42.577939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:42.594901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.595406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.595849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.598012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.598491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.598930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.663698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:42.780100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:42.794521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a29d59a-7181-49a0-9924-11b70f57aab0 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.505566 Aug 21 01:24:42.795123 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1704/3911] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:42 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:42.808864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:42.808864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:42.864331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.869805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.871048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.871824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:42.872324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:42.872752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:42.972223 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:42.984274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40068796-3119-4650-834a-96d9ab116759 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 204 len: 0 microversion: 2.1 time: 0.417738 Aug 21 01:24:42.985227 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2208/3912] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:42 2022] DELETE /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:42.994426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b05434b-b079-43e5-8913-02f6f4e38fb5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940371437", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": -1, "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:43.022832 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7b05434b-b079-43e5-8913-02f6f4e38fb5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Flavor -1 could not be found. Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b05434b-b079-43e5-8913-02f6f4e38fb5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 206 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940371437", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": -1, "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor -1 could not be found. Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1940371437', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': -1, 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:43.030053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 21 01:24:43.033401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:43.037989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b05434b-b079-43e5-8913-02f6f4e38fb5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:43.044078 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b05434b-b079-43e5-8913-02f6f4e38fb5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.057256 Aug 21 01:24:43.045132 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2209/3913] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:42 2022] POST /compute/v2.1/servers => generated 73 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:43.054552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:43.058037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:43.080194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.081078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.081725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.082655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.083330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.083979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.425344 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30a21122-d0f5-4863-8628-61d05d350a0c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.627304 Aug 21 01:24:43.431954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1705/3914] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:24:42 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 197 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:43.433407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:43.433908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:43.441260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.441922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.442360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.443222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.443804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.444382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.766216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:43.781112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-697be961-6962-41f9-85b2-9f44ca209961 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.352701 Aug 21 01:24:43.781936 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1706/3915] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:43 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:43.786658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:43.787251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:43.801250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.801746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.802228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.804499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.804994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.805414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.896672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:43.910368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e3fc890-9b1f-4891-b8be-eec18b6cdb06 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1673 microversion: 2.1 time: 0.863128 Aug 21 01:24:43.919461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2210/3916] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:43 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1673 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:43.929583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:43.930095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:43.936665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.937258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.937697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.938398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:43.939586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:43.940024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:43.986409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bba2dcde-0e82-4863-b3b1-0138aecda58c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c" status: 200 len: 194 microversion: 2.1 time: 0.065723 Aug 21 01:24:43.988399 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2211/3917] 10.222.0.46 () {58 vars in 1413 bytes} [Sun Aug 21 01:24:43 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:43.994912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:43.996007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.004165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.005427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.006007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.006854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.007572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.008220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.159943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:44.174092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1f2a52f-b46e-4765-963a-0097b100c612 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.390972 Aug 21 01:24:44.174690 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1707/3918] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:43 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:44.195981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:44.196604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.203472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.203934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.204362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.205086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.205528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.205936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.397287 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:44.430461 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:44.448840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:44.458008 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf6e2335-8399-4a40-a918-a2292829a580 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.468345 Aug 21 01:24:44.461365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2212/3919] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:43 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:44.470936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:44.494993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.497438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.498800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.518455 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] Creating event network-changed:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:24:44.529658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5678ccab-ac06-4a87-bdd0-524575db4657 req-3973eb94-44a6-45d7-85d9-eb2cc58bbac4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062630 Aug 21 01:24:44.530358 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2213/3920] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:44.536824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:44.537547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.557735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.562898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.563457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.564282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.564967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.566639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.594815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:44.605359 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-24dcb2bd-17d9-45dd-95dd-e010451a4c0e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.417597 Aug 21 01:24:44.606152 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1708/3921] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:44 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:44.606255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] HTTP exception thrown: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Request method failure captured: Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 HTTP/1.1 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYem7UEl9LkUK5cl-jl9nZFFAJBWdm4cJsWJIZnyI3yxQf9GAzKupLBp4_ggnGLgL0rlPB_gmjW1k-C5b2-TAaq-GVw8C6HlrONRlFGZyhFmruHSUhy24fwR3holCLJTZKDjtZJ9pnrC18L7rHecDY8Ep4rjczdh31p7KKnRsvF-YOU Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.42 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d702749939d4b8cb8471857ba668f07", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}] Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 5437fbb8d7fa4c6b8dca85efdc8fc694 Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5121c14d-ec0b-45b8-8251-14462a7f1bd7'} Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:44.617596 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.620870 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.626760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Returning 404 to user: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:44.627962 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6efddab2-a7e3-4b8d-a201-ae517ce2c7b6 tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 404 len: 111 microversion: 2.42 time: 0.096164 Aug 21 01:24:44.635154 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2214/3922] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:24:44 2022] DELETE /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:44.643066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:44.643690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] [instance: 5121c14d-ec0b-45b8-8251-14462a7f1bd7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.658130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.658629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.659046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.659750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.660192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.660603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.706443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] HTTP exception thrown: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.706795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-531bf308-153f-4e6a-b35b-1655db7c7893 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064403982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Request method failure captured: Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 HTTP/1.1 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYem7UEl9LkUK5cl-jl9nZFFAJBWdm4cJsWJIZnyI3yxQf9GAzKupLBp4_ggnGLgL0rlPB_gmjW1k-C5b2-TAaq-GVw8C6HlrONRlFGZyhFmruHSUhy24fwR3holCLJTZKDjtZJ9pnrC18L7rHecDY8Ep4rjczdh31p7KKnRsvF-YOU Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.42 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d702749939d4b8cb8471857ba668f07", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d702749939d4b8cb8471857ba668f07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d702749939d4b8cb8471857ba668f07"}]}] Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9d702749939d4b8cb8471857ba668f07 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1535344019 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 5437fbb8d7fa4c6b8dca85efdc8fc694 Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1535344019-project Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5121c14d-ec0b-45b8-8251-14462a7f1bd7'} Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.708028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] Returning 404 to user: Instance 5121c14d-ec0b-45b8-8251-14462a7f1bd7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:44.711077 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-174741af-ac3b-45e5-b29e-d0b240bcc23e tempest-TaggedBootDevicesTest_v242-1535344019 tempest-TaggedBootDevicesTest_v242-1535344019-project] 10.222.0.46 "GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7" status: 404 len: 111 microversion: 2.42 time: 0.073936 Aug 21 01:24:44.711592 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1709/3923] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:24:44 2022] GET /compute/v2.1/servers/5121c14d-ec0b-45b8-8251-14462a7f1bd7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-531bf308-153f-4e6a-b35b-1655db7c7893 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 173 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2064403982", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2064403982', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi -1 Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:24:44.720180 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-531bf308-153f-4e6a-b35b-1655db7c7893 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:44.726785 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-531bf308-153f-4e6a-b35b-1655db7c7893 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020686 Aug 21 01:24:44.729183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2215/3924] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:44 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:24:44.735522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:44.736249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.749852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.750946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.751634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.753169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.754280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.754917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.940966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:44.942410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:44.965243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.969004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.969782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:44.970734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:44.971468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:44.972568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:45.040131 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:45.396403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:45.407345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5272efb-7116-4302-a8d8-26c927db6b44 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1673 microversion: 2.1 time: 0.479453 Aug 21 01:24:45.424900 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2216/3925] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:44 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1673 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:45.435830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:45.440875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:45.450353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:45.451815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:45.452429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:45.456400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:45.457070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:45.457644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:45.683569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:45.699965 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bb8c3db-39a7-4367-99dc-3f4078b706f8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.971578 Aug 21 01:24:45.702860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1710/3926] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:44 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:45.721253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:45.722326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:45.744907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:45.745800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:45.747046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:45.747979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:45.748629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:45.753512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:45.960283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:45.999882 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f89891b9-6f7f-46a6-9800-7e9d128ccf91 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.572429 Aug 21 01:24:46.000493 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2217/3927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:45 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:46.016911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:46.017528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:46.042553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.043061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.046113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.052161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.052902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.054488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.465046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:46.473147 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea9a312d-c5aa-470d-bf92-74bb3b672b78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.768900 Aug 21 01:24:46.476741 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1711/3928] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:45 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:46.486266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:46.503062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:46.525429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.526244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.526957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.527974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.531412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.532114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.628182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:46.641179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3a553d8-2299-4b5f-bcf2-d26a7a664796 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.637792 Aug 21 01:24:46.642395 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2218/3929] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:46 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:46.689214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c3ecf39-8e49-4b12-9768-d5f9003d7ea8"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:46.691898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:46.700363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.710690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.714792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.715836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:46.717966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:46.721658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:46.956154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:46.964878 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc72e35e-7064-4750-973d-d669c369ead9 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1673 microversion: 2.1 time: 0.486765 Aug 21 01:24:46.969155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1712/3930] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:46 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:46.973840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f72baa9-8e81-4549-b02b-3391cab1c8c2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-660372284", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:46.978645 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-5f72baa9-8e81-4549-b02b-3391cab1c8c2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f72baa9-8e81-4549-b02b-3391cab1c8c2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 215 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-660372284", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-660372284', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:46.990627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 21 01:24:46.996627 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:46.997506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f72baa9-8e81-4549-b02b-3391cab1c8c2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:46.998585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f72baa9-8e81-4549-b02b-3391cab1c8c2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028416 Aug 21 01:24:46.999626 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1713/3931] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:24:47.012477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:47.013392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:47.031780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.032500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.033412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.034297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.038995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.039626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.339671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:47.352229 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e676c627-720f-4c17-83c4-977ee7b6546f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.344484 Aug 21 01:24:47.352844 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1714/3932] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:47 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:47.357749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:47.363283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:47.377293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.378108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.382749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.384101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.385734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.386318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.830846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:47.842213 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f04e62c9-6cd2-4e35-8bc3-fea7c9f1adec tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1511 microversion: 2.1 time: 0.488101 Aug 21 01:24:47.844013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1715/3933] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:47 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:47.854837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:47.855458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:47.865842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.868688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.869191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.869980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:47.870431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:47.874160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:47.904945 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:48.183685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:48.195166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33de27c1-9d5a-443a-9e59-918da64cbce2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.349916 Aug 21 01:24:48.196103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1716/3934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:47 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:48.202126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:48.203286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:48.210915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.212344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.213056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.214586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.215376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.215994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.525309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:48.535190 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5cdf8ad7-f0bc-4de1-9347-b9281e66aa52 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.337694 Aug 21 01:24:48.536505 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1717/3935] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:48 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:48.541508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:48.542598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:48.549525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.550258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.551417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.552399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.553044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.553717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.631010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.634327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.637958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.640475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lazy-loading 'fault' on Instance uuid a2fef0cb-cc28-4d9a-87b7-e9d315f3980b {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:24:48.749272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbef527355e40f3af441a57cd5807be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9027d7cd75f84b11a4b8846a9769e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:48.760741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d20085f0-3e79-43df-bf8d-576d5d91d176 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 200 len: 1327 microversion: 2.1 time: 0.222828 Aug 21 01:24:48.773980 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1718/3936] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:48 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 1327 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:48.778427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fef0cb-cc28-4d9a-87b7-e9d315f3980b", "name": "network-vif-deleted", "tag": "0019e98b-c4b9-4332-a097-0ef6309cc8e1"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:48.796509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:48.796781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:48.802993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:48.828461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] Creating event network-vif-deleted:0019e98b-c4b9-4332-a097-0ef6309cc8e1 for instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b on n-h1-master-1 Aug 21 01:24:48.837342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-89f6c9a9-d843-41aa-8c70-6506f109e9f4 req-8102e50d-a771-46bc-b7b9-b9e9beed6c04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072358 Aug 21 01:24:48.840122 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1719/3937] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:48.851476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1868012030", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-key-1207279069", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:48.949616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] validate_networks() for [('30a6b423-e11b-48a2-bd1e-1788a7209058', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:24:49.368686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Invalid key_name provided. Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 247 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1868012030", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-key-1207279069", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid key_name provided. Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1868012030', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'key_name': 'tempest-key-1207279069', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1207279069 not found for user fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:49.372318 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 21 01:24:49.375922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:49.379276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid key_name provided. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:49.381627 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d57320d-f987-4321-b281-dd4d1d65561a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.540528 Aug 21 01:24:49.383179 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1720/3938] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 543 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 21 01:24:49.394500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:49.398345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:49.416830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.417507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.418884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:49.419848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.420441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.421208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:49.545025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6c51e20-7f07-481a-92cd-f25e38b85fb6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "POST /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.863879 Aug 21 01:24:49.555461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2219/3939] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:24:46 2022] POST /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 194 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:49.588884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:49.590253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:49.601054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.602008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.603200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:49.604188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.605000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.605561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:49.634438 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:49.910808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:49.921718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58d23190-baf7-4294-9d24-fc9592f89e71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.364707 Aug 21 01:24:49.934615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2220/3940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:49 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:49.946222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:49.947211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:49.955958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.956786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.957405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:49.959217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:49.960300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:49.960989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.012898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:50.029643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-838b0bb5-97d3-401e-9cf2-745134f1cc51 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1488 microversion: 2.1 time: 0.641995 Aug 21 01:24:50.032582 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1721/3941] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:49 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1488 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:50.038274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:50.039129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] [instance: a2fef0cb-cc28-4d9a-87b7-e9d315f3980b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:50.051115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.051907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.052618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.053543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.054179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.054723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.070166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] HTTP exception thrown: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Request method failure captured: Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b HTTP/1.1 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYdU31iu4_TytCR_WBZr2hwwvl9gis9u9xVajm-4bzjIq2OD0nePWd545pOORz2lEXDw23HPh0PQs6CA8ltuPxzHEN1iBuA5VoGV0dYmhHU1jy5YZU3wmicT7Fv9Ry1RFRYyvmaWeZFmPnk4z3uMOWOSyqtbeGIAkme-WoqaPbshLV4 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9027d7cd75f84b11a4b8846a9769e356", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9027d7cd75f84b11a4b8846a9769e356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9027d7cd75f84b11a4b8846a9769e356"}]}] Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9027d7cd75f84b11a4b8846a9769e356 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-2113901040 Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3fbef527355e40f3af441a57cd5807be Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-2113901040-project Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a2fef0cb-cc28-4d9a-87b7-e9d315f3980b'} Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:50.072411 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. Aug 21 01:24:50.076557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:50.081514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Returning 404 to user: Instance a2fef0cb-cc28-4d9a-87b7-e9d315f3980b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:50.082637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-245f8426-f912-48f8-8afa-313e09dbfb4e tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b" status: 404 len: 111 microversion: 2.1 time: 0.048840 Aug 21 01:24:50.083403 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1722/3942] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:50 2022] GET /compute/v2.1/servers/a2fef0cb-cc28-4d9a-87b7-e9d315f3980b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:50.092110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:50.093076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:50.099566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.100419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.101100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.102184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.102886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.103545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.359524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:50.378383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbaa24ec-1510-4702-8e96-f0ec5985f6c0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.442235 Aug 21 01:24:50.381985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2221/3943] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:49 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:50.393770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:50.395283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:50.414895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.415301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.415734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.416442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.416967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.417712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.484418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:24:50.673519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2402eb86-e32c-4ce5-a7ad-621e1cb32ce6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 204 len: 0 microversion: 2.1 time: 0.289932 Aug 21 01:24:50.674119 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2222/3944] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:50 2022] DELETE /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:24:50.693107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-166ee6ec-ffc2-4bfb-b906-85beb8743604 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] Calling method '.version_select at 0x7fc3f9e90550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:50.742475 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-166ee6ec-ffc2-4bfb-b906-85beb8743604 tempest-ServerActionsTestJSON-2113901040 tempest-ServerActionsTestJSON-2113901040-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061475518" status: 202 len: 0 microversion: 2.1 time: 0.067150 Aug 21 01:24:50.743325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2223/3945] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061475518 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:24:50.754662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:50.755443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:50.772184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:50.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:50.797972 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa784ba1-2ad7-4da0-b5bf-80e16c88787e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.709971 Aug 21 01:24:50.801455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1723/3946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:50 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:51.065427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1006011522", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:51.273046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Neutron security group does_not_exist not found {{(pid=122483) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 21 01:24:51.273803 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 258 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1006011522", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1006011522', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 21 01:24:51.284337 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 21 01:24:51.287969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:51.293399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:51.294465 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9445a8bd-1d8f-45e6-8fbd-9633150be051 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.233326 Aug 21 01:24:51.295236 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1724/3947] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:51 2022] POST /compute/v2.1/servers => generated 106 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:24:51.305543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:51.306398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:51.328288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:51.329462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:51.330093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:51.330989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:51.331595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:51.332216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:51.501355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:51.523635 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af4578ef-1058-42c3-bb4f-b28977362d0d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1494 microversion: 2.1 time: 0.778846 Aug 21 01:24:51.524319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2224/3948] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:50 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1494 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:51.538681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:51.539474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:51.558711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:51.559459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:51.560361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:51.561244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:51.563865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:51.564434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:52.015828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:52.039645 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93a0ad3e-234d-4bdc-8301-459181118f1b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.506737 Aug 21 01:24:52.040501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2225/3949] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:51 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:52.549145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:52.549663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:52.570536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:52.571030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:52.571472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:52.572183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:52.580056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:52.580510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:52.774867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:52.788092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3635af3b-72ae-46e5-836e-1f30716e06ff tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.488115 Aug 21 01:24:52.798422 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1725/3950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:51 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:52.830067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:52.832352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:52.845632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:52.846668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:52.849320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:52.851360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:52.858684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:52.859417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.240790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:53.252964 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-756a3ad0-49fc-4af6-a0ad-61f7f8a31d75 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.429958 Aug 21 01:24:53.254878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1726/3951] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:52 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:53.263554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:53.264670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:53.274397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.276450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.278460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.284138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.286399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.287834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.354326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:53.364957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-272059b0-c995-4709-b5e3-d2df0edde1d5 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 200 len: 1494 microversion: 2.1 time: 0.819773 Aug 21 01:24:53.373958 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2226/3952] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:52 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 1494 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:53.385999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:53.386740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 4f8b42a0-6953-4e1b-839f-7f8414dba2ab] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:53.393208 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/4f8b42a0-6953-4e1b-839f-7f8414dba2ab HTTP/1.1 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4f8b42a0-6953-4e1b-839f-7f8414dba2ab'} Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:53.395381 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. Aug 21 01:24:53.399174 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:53.400324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 4f8b42a0-6953-4e1b-839f-7f8414dba2ab could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:53.401423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d24d1763-b22c-4058-80c1-51ed5105fe5b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4f8b42a0-6953-4e1b-839f-7f8414dba2ab" status: 404 len: 111 microversion: 2.1 time: 0.019842 Aug 21 01:24:53.402471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2227/3953] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:24:53 2022] DELETE /compute/v2.1/servers/4f8b42a0-6953-4e1b-839f-7f8414dba2ab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:53.412202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:53.413347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:53.420965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.421734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.422316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.423228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.423824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.424390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.623017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:53.632573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce2a9783-c8b5-473a-946d-f26d7f3266ca tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.376075 Aug 21 01:24:53.633674 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1727/3954] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:53 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:53.638893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf49931-ea3b-410c-b07d-1f9ae44f6a8b", "name": "network-vif-deleted", "tag": "c0ec1ded-7412-4d70-b328-c94711713ad4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:53.645884 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:53.659756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.660240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.660673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.695832 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] Creating event network-vif-deleted:c0ec1ded-7412-4d70-b328-c94711713ad4 for instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b on n-h1-master-1 Aug 21 01:24:53.705426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-06e6046f-c657-494f-b268-20996b52bbb7 req-000b3d6c-8461-4119-93bd-41c742f0f990 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067382 Aug 21 01:24:53.706175 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1728/3955] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:24:53.915335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:53.928324 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5dee8ec6-bbb1-4dc5-b011-c1cfe8102ef3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.521223 Aug 21 01:24:53.930661 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2228/3956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:53 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:53.961736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:53.962428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:53.981697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.982202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.983357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:53.984083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:53.985968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:53.986419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.341512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-plugged", "status": "completed", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:54.363559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.364200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.364712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.378103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:54.389301 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-31dd534c-944b-429e-89a2-5f2982207264 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.432010 Aug 21 01:24:54.393200 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1729/3957] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:53 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:54.398249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:54.399032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:54.432950 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] Creating event network-vif-plugged:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:24:54.435822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.443490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.444236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.446380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-992e5457-e256-4b6e-a651-41cc44deacc1 req-196948f1-25df-4468-9c4b-f3967b050b47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109192 Aug 21 01:24:54.446875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.447452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.448080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.453344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2229/3958] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:24:54.465592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:54.466082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:24:54.466577 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 9223372036854775808 could not be found. Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9223372036854775808'} Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.487170 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:54.490513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:54.490513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:54.490513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:54.490513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 21 01:24:54.490513 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.504021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:54.508425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f629c1eb-ac95-4734-b7cd-744eb8fd61ec tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.050434 Aug 21 01:24:54.511343 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2230/3959] 10.222.0.46 () {58 vars in 1188 bytes} [Sun Aug 21 01:24:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:24:54.520256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:54.525854 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b HTTP/1.1 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: exception: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'dbf49931-ea3b-410c-b07d-1f9ae44f6a8b'} Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:54.530709 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:24:54.533889 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:54.538168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:54.544000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:54.547297 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28fbb618-aa1a-45be-b444-c6a214ee2704 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 404 len: 111 microversion: 2.1 time: 0.152966 Aug 21 01:24:54.549141 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1730/3960] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:54 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:54.591898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.592391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.592846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.597709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.598240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.598672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.659713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:54.660907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:54.671008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.672517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.674686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:54.679474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:54.683489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:54.688252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:55.070668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:55.083395 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c727691-22e1-4853-af8d-65b4dd6fb8ed tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1317 microversion: 2.1 time: 0.427613 Aug 21 01:24:55.084693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1731/3961] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:54 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:55.101578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-517193876", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "62cb6125-7773-4f64-8e6f-2fda1fe51edd"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:55.230062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] validate_networks() for [('62cb6125-7773-4f64-8e6f-2fda1fe51edd', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:24:56.033068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:56.053951 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7d5fcec-d4f3-4dc6-886a-d4dec28f87bb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.536493 Aug 21 01:24:56.055588 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2231/3962] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:54 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:56.099747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:56.100664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:56.113516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.114838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.116114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.118514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.121415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.122043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.499510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:24:56.500037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:24:56.500589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:24:56.501624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:24:56.501624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:24:56.515257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.532886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.533648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.539070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.539653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.540320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.586739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:24:56.599953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Getting quotas for user 79c5db05d52f4b8d91b430a8b459a09b and project 8f1f63bfe1664d079f0e22116f6f4e18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:24:56.629535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:24:56.632919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:24:56.772124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc41c288-0dab-4bcf-96cd-60b833434f7d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684693 Aug 21 01:24:56.773642 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1732/3963] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:24:56.794627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:56.795448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:56.804038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.804858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.805438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.806706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:56.813791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:56.814712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:56.839293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:56.852850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f7fd839-0a85-4cfa-af52-cf9838950296 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.757484 Aug 21 01:24:56.856423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2232/3964] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:56 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:24:56.861575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edbc95c4-c08a-4667-a838-a949b7fd965a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:56.864885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edbc95c4-c08a-4667-a838-a949b7fd965a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:57.036759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edbc95c4-c08a-4667-a838-a949b7fd965a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:57.047039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edbc95c4-c08a-4667-a838-a949b7fd965a tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1214 microversion: 2.1 time: 0.189328 Aug 21 01:24:57.050027 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2233/3965] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:56 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:57.057489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:57.059205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Failed to fetch instance by id -1 {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 21 01:24:57.060409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance -1 could not be found. Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: exception: Instance -1 could not be found. Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '-1'} Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:57.063738 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:57.067018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:57.067018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:57.067018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 21 01:24:57.067018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:57.068639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:57.069705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87b5d721-e4d2-4a6f-a28e-8e377db96c0c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018640 Aug 21 01:24:57.071185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2234/3966] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:24:57 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:24:57.086635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:57.088213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:57.100588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.102402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.104313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.106042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.106876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.107706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.339344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:57.352454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d35960d0-3eaf-47d1-943a-e1cee94524d9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1466 microversion: 2.1 time: 0.576727 Aug 21 01:24:57.354462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1733/3967] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:56 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1466 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:57.375525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1368466164", "metadata": {"image_type": "test"}}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:57.382263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:57.403281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.405886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.407541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.409315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.410967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.413165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.431061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:57.460751 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3addebc-a851-4497-baad-5289187bc99b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.384116 Aug 21 01:24:57.461711 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2235/3968] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:57 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:57.488543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:57.489346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:57.497065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Getting quotas for project fb877dddfba14fe3929b1267dee0e256. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:24:57.498825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.501121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.501722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.502596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:57.505217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:57.505962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:57.508631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Getting quotas for user ea86632bc35148a68dc7a10e194e184d and project fb877dddfba14fe3929b1267dee0e256. Resources: dict_keys(['metadata_items']) {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:24:57.913431 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f22b82f2-9111-464f-82ab-f7326b0a9c78 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "POST /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8/action" status: 202 len: 0 microversion: 2.1 time: 0.542111 Aug 21 01:24:57.914105 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1734/3969] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:57 2022] POST /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:24:57.926420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78f1664f-8ce0-459a-b28e-9a79ea54fc9c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd0c98b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:58.002011 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-78f1664f-8ce0-459a-b28e-9a79ea54fc9c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.079300 Aug 21 01:24:58.004463 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1735/3970] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:57 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:58.046005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:58.055704 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-172a5c66-7003-4e40-ac28-02ef1db6981b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.572923 Aug 21 01:24:58.058939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2236/3971] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:57 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:58.071587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:58.072565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:58.085468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:58.089785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7082f653-b228-4ed7-ab27-661375a66d68] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:58.096479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.099618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.101526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.103791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.109871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.111448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.115862 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7082f653-b228-4ed7-ab27-661375a66d68/action HTTP/1.1 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 19 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: {"forceDelete": {}} Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7082f653-b228-4ed7-ab27-661375a66d68', 'body': {'forceDelete': {}}} Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:58.124421 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:58.128463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:58.128463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:58.128463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. Aug 21 01:24:58.128463 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:24:58.144851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 7082f653-b228-4ed7-ab27-661375a66d68 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:58.150681 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-060c7d49-4011-4b13-b400-2aae77f6c462 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7082f653-b228-4ed7-ab27-661375a66d68/action" status: 404 len: 111 microversion: 2.1 time: 0.069128 Aug 21 01:24:58.152316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2237/3972] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:58 2022] POST /compute/v2.1/servers/7082f653-b228-4ed7-ab27-661375a66d68/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:24:58.175877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:58.176722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:58.199134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.211196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.212358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.216424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.219458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.225863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.353426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:58.364745 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23add611-22f9-4032-b8e2-f8a6977079c2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1266 microversion: 2.1 time: 0.298176 Aug 21 01:24:58.376808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1736/3973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:58 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:58.689961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:58.698889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1332b1c-cb06-412b-a7d9-2c22bd884ecf tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.536351 Aug 21 01:24:58.700013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2238/3974] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:58 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:58.727224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:58.727796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:58.741475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.741991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.743610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.744342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:58.744941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:58.745528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:58.782061 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:24:59.018165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42bee422-9f67-4ba0-942d-748652d89950 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9e90820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:59.091713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42bee422-9f67-4ba0-942d-748652d89950 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.078497 Aug 21 01:24:59.098396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2239/3975] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:24:59 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:59.392747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:59.393397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:59.414059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:59.415703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:59.416153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:59.419451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:59.419984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:59.420434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:59.535608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:59.548278 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b6df362-be5a-4411-bf6d-bab09c5eecd8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.824272 Aug 21 01:24:59.550292 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1737/3976] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:58 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:59.576164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:24:59.579543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 2498fe41-99ac-436d-9ea0-c5b204ac784d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:59.591853 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/2498fe41-99ac-436d-9ea0-c5b204ac784d/action HTTP/1.1 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 39 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: {"os-getConsoleOutput": {"length": 10}} Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2498fe41-99ac-436d-9ea0-c5b204ac784d', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:59.598742 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. Aug 21 01:24:59.602602 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:24:59.604627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 2498fe41-99ac-436d-9ea0-c5b204ac784d could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:24:59.609586 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3423c43-3da4-41a9-8cd9-f4e6dc17577d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/2498fe41-99ac-436d-9ea0-c5b204ac784d/action" status: 404 len: 111 microversion: 2.1 time: 0.037766 Aug 21 01:24:59.614886 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1738/3977] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:24:59 2022] POST /compute/v2.1/servers/2498fe41-99ac-436d-9ea0-c5b204ac784d/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:24:59.628240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:24:59.635936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:24:59.637481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:24:59.640838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68f5dbbf-a882-4637-aaaf-5850f79eebdd tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1272 microversion: 2.1 time: 0.257028 Aug 21 01:24:59.654361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2240/3978] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:59 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:24:59.666775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:59.670302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:59.670758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:24:59.671510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:24:59.674309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:24:59.674915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:00.112319 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61776f16-d5b2-4698-8b5b-b19c76bcd3b3 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f8a34af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:00.205018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61776f16-d5b2-4698-8b5b-b19c76bcd3b3 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.097291 Aug 21 01:25:00.205586 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2241/3979] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:00 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:00.665689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:00.666311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:00.680171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:00.680708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:00.686820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:00.692437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:00.694889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:00.696020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:00.958955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:00.991699 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c41ec83c-7b32-46fe-a16d-93e7274c4e08 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1272 microversion: 2.1 time: 0.330812 Aug 21 01:25:00.994064 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2242/3980] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:00 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:01.220381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e929fae-0ca6-4a11-8a87-0e7ebceddd6b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9b71160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:01.328219 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e929fae-0ca6-4a11-8a87-0e7ebceddd6b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.111623 Aug 21 01:25:01.339249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2243/3981] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:01 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:01.426496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:01.439497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ed53ede-ea60-4292-883a-c207d2b6b83c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.820742 Aug 21 01:25:01.440309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1739/3982] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:24:59 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:01.467681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:01.468476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:01.483806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:01.484332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:01.484806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:01.486413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:01.487251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:01.487329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.011611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:02.015890 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:02.019397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:02.020219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:02.032236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51622ac0-4656-4adc-8a2a-bda5639b19da tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.569372 Aug 21 01:25:02.035302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.035914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.036349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.037087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.037531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.037983 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2244/3983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:01 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:02.045481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.065957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:02.066976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 4139732a-add4-4d9a-8329-0691bad6b9fc] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:02.099136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/4139732a-add4-4d9a-8329-0691bad6b9fc HTTP/1.1 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4139732a-add4-4d9a-8329-0691bad6b9fc'} Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:02.111372 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:02.115691 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:02.115691 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:02.115691 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:02.115691 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. Aug 21 01:25:02.115691 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:02.118200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 4139732a-add4-4d9a-8329-0691bad6b9fc could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:02.122985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-513570d3-e209-4be6-ba27-dcc8fad7fc46 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/4139732a-add4-4d9a-8329-0691bad6b9fc" status: 404 len: 111 microversion: 2.1 time: 0.062382 Aug 21 01:25:02.127879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2245/3984] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:02 2022] GET /compute/v2.1/servers/4139732a-add4-4d9a-8329-0691bad6b9fc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:25:02.145463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:02.146773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:02.170383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.171055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.171606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.173193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.173761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.174277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.772486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:02.788692 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0be7dde0-6028-49d2-a5eb-b07fa31ce14d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.769841 Aug 21 01:25:02.803111 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1740/3985] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:02 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:02.822166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9d1a169-70a5-4495-80d2-99d97a39b6d2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9c6ee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:02.880168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:02.898585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-219a44a6-5508-4fd0-93ca-817f05d2fa6d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.758471 Aug 21 01:25:02.901697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2246/3986] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:02 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:02.922694 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d9d1a169-70a5-4495-80d2-99d97a39b6d2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.117950 Aug 21 01:25:02.925061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1741/3987] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:02 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:02.927522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:02.928272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:02.944848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.946203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.946749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:02.948366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:02.954241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:02.955405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:03.445909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:03.463777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2f58d32-718b-4741-bbee-2ee66cf6a913 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.539430 Aug 21 01:25:03.481291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2247/3988] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:02 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:03.688170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c56834-b4b1-444f-93e4-c8dca537238c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430213114", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c56834-b4b1-444f-93e4-c8dca537238c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 237 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-430213114", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-430213114', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.712370 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 21 01:25:03.715869 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:03.720158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c56834-b4b1-444f-93e4-c8dca537238c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:03.721885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23c56834-b4b1-444f-93e4-c8dca537238c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042805 Aug 21 01:25:03.722990 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1742/3989] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:25:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:25:03.732030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:03.733196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:03.745167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:03.752092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:03.758515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:03.762849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:03.765930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:03.766578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:03.812579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:03.813360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:03.829706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:03.836073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:03.838792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:03.840950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:03.848051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:03.848870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:04.253101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:04.294622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-470aa097-35b1-4e88-9cfe-a038bc91bbeb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.559712 Aug 21 01:25:04.297606 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2248/3990] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:03 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:04.313781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e50f12b-74bc-4204-8c75-eb8e7a7f25e2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9563a60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:04.386548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e50f12b-74bc-4204-8c75-eb8e7a7f25e2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.087709 Aug 21 01:25:04.389169 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2249/3991] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:04 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:04.399775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:04.414352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:04.429087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:04.433793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:04.434345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:04.435448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:04.435917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:04.436337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:04.505948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:04.516821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e37a3c8-4862-4e76-87c9-09e2ada5427b tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.710882 Aug 21 01:25:04.521298 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1743/3992] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:03 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:04.597096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7", "tag": "9b538873-8d0b-443d-84d6-b2e38e590226"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:04.615266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:04.616252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:04.622010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:04.649734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] Creating event network-changed:9b538873-8d0b-443d-84d6-b2e38e590226 for instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 on n-h1-master-1 Aug 21 01:25:04.670400 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-aa0489a5-df2b-47c1-b1d2-25d19fc36065 req-452fd36b-0d5c-4997-9cce-2c5a5a11d676 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077073 Aug 21 01:25:04.671564 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1744/3993] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:05.009427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:05.030394 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6789206f-99e8-4e0e-91c9-0442e1cb99e7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.637431 Aug 21 01:25:05.032215 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2250/3994] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:04 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:05.309150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed2d1fcb-1ed7-48b8-8a31-e6c64f306bb1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053929783", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed2d1fcb-1ed7-48b8-8a31-e6c64f306bb1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 235 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053929783", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2053929783', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.314274 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 21 01:25:05.318557 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:05.320050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed2d1fcb-1ed7-48b8-8a31-e6c64f306bb1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:05.320050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed2d1fcb-1ed7-48b8-8a31-e6c64f306bb1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.017514 Aug 21 01:25:05.320370 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1745/3995] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:25:05 2022] POST /compute/v2.1/servers => generated 133 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:25:05.330052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:05.331320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:05.350178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.353390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.353971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:05.355139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.355611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.356037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:05.403122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7a604e6-b40b-496f-9513-3c6867dfa906 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd84c5e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:05.490262 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7a604e6-b40b-496f-9513-3c6867dfa906 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.091659 Aug 21 01:25:05.501161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1746/3996] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:05 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:05.545372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:05.548887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:05.565171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.565679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.566124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:05.566852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.567307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.567729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:05.779644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:05.799011 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-709424d4-e9cb-4370-b48a-79512120b718 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.469176 Aug 21 01:25:05.800267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2251/3997] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:05 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:05.835376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:05.845953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:05.863054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.868694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.881992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:05.884069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:05.885710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:05.887353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:06.072470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:06.087624 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a48b69dd-5cf0-4b38-ad2c-6b39404c6fe7 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.545689 Aug 21 01:25:06.089989 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1747/3998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:05 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:06.507030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04b199f6-bb52-4d75-ad3f-ca3d18d552e0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd84c550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:06.566518 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04b199f6-bb52-4d75-ad3f-ca3d18d552e0 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.063930 Aug 21 01:25:06.575680 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1748/3999] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:06 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:06.917820 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:06.918613 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:06.922804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-plugged", "status": "completed", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:06.948787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:06.949267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:06.953744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:06.970097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:06.983674 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3a841c3-6ff1-4741-a1a8-4b626f95c774 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.161576 Aug 21 01:25:06.986075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2252/4000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:05 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:07.012995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:07.013196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] Creating event network-vif-plugged:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:25:07.013465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 16e87f22-b704-4786-8fd6-6d3107f943a7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:07.023728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-94427899-5e35-4080-84ba-02e9417861cc req-6d0631d7-3ca2-4f65-8853-7125fe8b37f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106928 Aug 21 01:25:07.026858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1749/4001] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:25:07.030449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/16e87f22-b704-4786-8fd6-6d3107f943a7/action HTTP/1.1 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 13 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: {"pause": {}} Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '16e87f22-b704-4786-8fd6-6d3107f943a7', 'body': {'pause': {}}} Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:07.041268 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:07.048574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:07.048574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:07.048574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. Aug 21 01:25:07.048574 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:07.050948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 16e87f22-b704-4786-8fd6-6d3107f943a7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:07.052396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-35a6cf4a-9ed9-464c-b61d-956f84d36959 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/16e87f22-b704-4786-8fd6-6d3107f943a7/action" status: 404 len: 111 microversion: 2.1 time: 0.049549 Aug 21 01:25:07.053845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2253/4002] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:07 2022] POST /compute/v2.1/servers/16e87f22-b704-4786-8fd6-6d3107f943a7/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:07.064983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:07.066119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:07.082249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.082998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.085433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.088233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.089163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.091355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.114131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:07.114905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:07.117965 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:07.135428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.137584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.138297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.139683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.140403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.141067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.387977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:07.398356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30bbb6f1-432a-4000-8712-b0845b527a3c tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.288909 Aug 21 01:25:07.400071 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2254/4003] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:07 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:07.524312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:07.536029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a72200d-d6c7-44f2-af57-993e8af2ca47 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.475725 Aug 21 01:25:07.540825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1750/4004] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:07 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:07.560675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:07.561326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:07.568184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.569218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.569808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.570820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:07.571565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:07.572396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:07.587486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c5ad4b66-bc04-4e15-ade0-dbe1754884a7 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fdaed280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:07.948341 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c5ad4b66-bc04-4e15-ade0-dbe1754884a7 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.368536 Aug 21 01:25:07.952308 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1751/4005] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:07 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:07.978495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:07.994848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb9ced42-306d-4cb0-8c65-c4282e4f7454 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.439017 Aug 21 01:25:07.996565 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2255/4006] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:07 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:08.004493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:08.007022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.016897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.018744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:08.019128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.019665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.019916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.020750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.021515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.022137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.027406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.028128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.030317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.031274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.031869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.032584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.076212 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b40c4aa0-3c76-45f5-91df-899f75a2139b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075468 Aug 21 01:25:08.077380 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1752/4007] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:25:07 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:25:08.158861 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e08d620-b01f-4d51-9fd5-10b4fa07b932 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.143703 Aug 21 01:25:08.162783 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2256/4008] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:08 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:08.168943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:08.169602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.179346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.179827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.181028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.184180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.186513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.189792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.237003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:08.237760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.261160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.261758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.262202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.264331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.267987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.268492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.354070 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fecbd125-5e00-4f30-8e9c-1ac3e18a9e81 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c" status: 200 len: 194 microversion: 2.1 time: 0.122815 Aug 21 01:25:08.356249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2257/4009] 10.222.0.46 () {58 vars in 1413 bytes} [Sun Aug 21 01:25:08 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:25:08.385579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:08.389431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.413664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.415189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.416091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.419115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.421376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.422050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.692964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lazy-loading 'services' on Instance uuid 3458856f-60c0-41af-8823-196f07d19424 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:08.912585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f84edb87-d99f-486b-abde-a90b77b7da14 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c" status: 202 len: 0 microversion: 2.1 time: 0.546701 Aug 21 01:25:08.920732 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2258/4010] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:25:08 2022] DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/12462a2d-7cc5-423c-84ed-df573586929c => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:08.943945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:08.951020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:08.977427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.978271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.978976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:08.980939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:08.982132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:08.984016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:09.286987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:09.300813 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b3d8ca8-48ac-4481-ae64-2330eb58fcea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1510 microversion: 2.1 time: 1.136417 Aug 21 01:25:09.304128 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1753/4011] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:08 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1510 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:09.316027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71fb89ac-75bc-4f78-b39c-2705f06fc26c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd155e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:09.658829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:09.675623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abbc0534-d3d6-45f4-8e5a-b78195ce51b6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.750610 Aug 21 01:25:09.678030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2259/4012] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:08 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:10.331000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:10.332491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:10.372676 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:10.378182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:10.378679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:10.379384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:10.381980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:10.382627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:10.383453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:10.961525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:10.971624 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-07636ace-4d5e-4dd8-ad7f-5f3068e9b587 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1490 microversion: 2.1 time: 0.649529 Aug 21 01:25:10.980003 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2260/4013] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:10 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1490 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:11.034041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:11.041341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:11.071902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.073530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.074374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.075341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.076370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.077366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.340478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:11.367586 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a3607b9-4f1d-4f04-83b8-91478b9b5534 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.385877 Aug 21 01:25:11.369589 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2261/4014] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:10 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:11.399423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7", "name": "network-vif-plugged", "status": "completed", "tag": "9b538873-8d0b-443d-84d6-b2e38e590226"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:11.439539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.446408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.447115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.472101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] Creating event network-vif-plugged:9b538873-8d0b-443d-84d6-b2e38e590226 for instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 on n-h1-master-1 Aug 21 01:25:11.482766 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4d7c52c4-28cf-48d5-b33e-c8a241d41bce req-df316f92-15ac-4a0a-9220-cfca81d7f20f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102430 Aug 21 01:25:11.483514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2262/4015] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:11.490451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:11.491416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:11.499538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.500386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.501107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.502220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.502971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.503632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.538705 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:11.554592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'pause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state paused Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 13 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: {"pause": {}} Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'pause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state paused Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'pause': {}}} Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state paused. Cannot pause while the instance is in this state. Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state paused Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:11.558724 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:11.563038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:11.563038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:11.563038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:11.563038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state paused Aug 21 01:25:11.563038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:11.564999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'pause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state paused {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:11.566503 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81f282b2-a284-44e7-af25-b3d32f0cf158 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 143 microversion: 2.1 time: 0.081467 Aug 21 01:25:11.571361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2263/4016] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:11 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 143 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:25:11.578148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:11.579054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:11.586991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.587805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.588961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.589921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.592475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.593212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.696476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c05b68cb-10b0-4504-9ee4-55194711a8cd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.123451 Aug 21 01:25:11.708843 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2264/4017] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:11 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:11.722546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:11.724492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:11.734904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.736000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.736874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:11.738097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:11.738927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:11.739700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:12.050742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:12.067666 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49e5d8c7-28b2-4e78-aa9b-9c6cd80a60fd tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1497 microversion: 2.1 time: 0.353946 Aug 21 01:25:12.082639 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2265/4018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:11 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:12.400940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:12.403895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:12.424414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:12.425769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:12.430024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:12.434028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:12.435763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:12.439313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:12.779421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:12.791551 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4aeb20af-2e69-46a5-ba85-8b03cdd90304 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1314 microversion: 2.1 time: 0.397357 Aug 21 01:25:12.792281 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2266/4019] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:12 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:13.091679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:13.092303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:13.113272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:13.113823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:13.114276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:13.115034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:13.115499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:13.116181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:13.766099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:13.783269 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d956051-ccb4-4e8e-9be3-6d62f6715522 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.696050 Aug 21 01:25:13.809847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2267/4020] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:13 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:13.816386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:13.817264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:13.833866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:13.834637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:13.835472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:13.837600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:13.838717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:13.841462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:15.107720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:15.125361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f17c20b-9739-45c2-a24d-8ce756a52185 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.307974 Aug 21 01:25:15.145760 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2268/4021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:13 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:15.803614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:15.804234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:15.818195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:15.818690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:15.819133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:15.819862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:15.820313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:15.820736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.568142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:16.578708 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb59894a-70ef-4740-8339-68cc38795015 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1502 microversion: 2.1 time: 1.431530 Aug 21 01:25:16.579275 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2269/4022] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:15 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1502 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:16.599121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:16.602905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:16.628081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.629570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.630788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.632313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.633770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.635173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.665318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action HTTP/1.1 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 28 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: {"reboot": {"type": "SOFT"}} Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '88517872-9d13-4fe4-a69d-f943c9b1f67c', 'body': {'reboot': {'type': 'SOFT'}}} Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:16.669730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:16.673715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:16.676594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:16.678685 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e9729a5-a736-4f9f-8fed-d359b3b5913b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action" status: 404 len: 111 microversion: 2.1 time: 0.091327 Aug 21 01:25:16.687762 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2270/4023] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:16 2022] POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:16.705056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:16.707389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:16.716661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.717451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.718048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.719079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.719927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.721120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.751529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lazy-loading 'flavor' on Instance uuid eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:16.919609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ff9ba62-5ec7-4148-a828-9fb2df8095c9 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "POST /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7/action" status: 202 len: 0 microversion: 2.1 time: 0.229136 Aug 21 01:25:16.920645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2271/4024] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:16 2022] POST /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:16.928711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:16.929448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:16.947383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.948239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.948684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:16.949470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:16.949919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:16.950344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:17.236129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:17.252839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b0b6374-1aa4-4aa8-9efa-d4cb84ab015b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.330569 Aug 21 01:25:17.253775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2272/4025] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:16 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:17.273707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:17.274332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:17.282458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:17.283302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:17.283740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:17.285893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:17.286378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:17.286882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:17.860073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:17.872727 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4166551c-1003-4620-b9e8-0a58b5a77603 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1510 microversion: 2.1 time: 0.617559 Aug 21 01:25:17.874254 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2273/4026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:17 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1510 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:17.880052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:17.880750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:17.906257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:17.906857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:17.909288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:17.910153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:17.916667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:17.917940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:18.174105 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:18.617444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:18.636342 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-affb9c99-991f-4ba5-853e-088e8a193c4c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.760575 Aug 21 01:25:18.639492 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2274/4027] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:17 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:18.662530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:18.664936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 460b5563-e6dc-402d-bb4e-4ef3a3092fae] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/460b5563-e6dc-402d-bb4e-4ef3a3092fae/action HTTP/1.1 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 28 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: {"reboot": {"type": "SOFT"}} Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '460b5563-e6dc-402d-bb4e-4ef3a3092fae', 'body': {'reboot': {'type': 'SOFT'}}} Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:18.697275 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 460b5563-e6dc-402d-bb4e-4ef3a3092fae could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0723ed14-ae80-477d-92bd-a1c28538be65 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/460b5563-e6dc-402d-bb4e-4ef3a3092fae/action" status: 404 len: 111 microversion: 2.1 time: 0.039389 Aug 21 01:25:18.708374 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2275/4028] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:18 2022] POST /compute/v2.1/servers/460b5563-e6dc-402d-bb4e-4ef3a3092fae/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:18.709437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:18.709881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:18.728332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:18.729076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:18.729891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:18.730202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:18.730674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:18.731103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:19.293903 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=51 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:19.314279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:19.324165 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c948f27-7a0b-4c89-852a-4a0df7e020f2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.618613 Aug 21 01:25:19.331136 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2276/4029] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:18 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:19.342454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:19.343356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:19.375420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:19.375924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:19.376481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:19.377120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:19.377692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:19.392494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:19.820467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:19.836238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0afe6e22-93a1-4170-acb6-4e7073a77557 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1493 microversion: 2.1 time: 0.496880 Aug 21 01:25:19.837308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2277/4030] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:19 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1493 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:19.842906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:19.845590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:19.869866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:19.875228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:19.875695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:19.876446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:19.876932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:19.877346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.068370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:21.076962 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61bb2e1a-73ba-434e-93b4-42759b4a5609 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.237890 Aug 21 01:25:21.081133 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2278/4031] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:19 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:21.106756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:21.107402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:21.126635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.127500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.128453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.134933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.136820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.137872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.187768 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:21.231200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:25:21.431137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ca097a7-1d12-401a-829f-f0e3d770cc24 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 204 len: 0 microversion: 2.1 time: 0.348577 Aug 21 01:25:21.431813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2279/4032] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:21 2022] DELETE /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:25:21.455600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:21.469379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:21.481192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.481801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.482254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.482988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.483502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.484296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.503984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action HTTP/1.1 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 65 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '88517872-9d13-4fe4-a69d-f943c9b1f67c', 'body': {'rebuild': {'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1'}}} Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 21 01:25:21.507315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:21.510800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-772895b3-b120-479e-8fa9-6c19285aee60 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action" status: 404 len: 111 microversion: 2.1 time: 0.075820 Aug 21 01:25:21.511778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2280/4033] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:21 2022] POST /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:21.535957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:21.536584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:21.547402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.548160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.548403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:21.549164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:21.549690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:21.550167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.175885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c5db05d52f4b8d91b430a8b459a09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1f63bfe1664d079f0e22116f6f4e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:22.197948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c890b4b9-0429-4717-9fa4-0a5cc9db8cbc tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 200 len: 1499 microversion: 2.1 time: 0.685230 Aug 21 01:25:22.198783 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2281/4034] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:21 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 1499 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:22.230115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:22.230747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:22.250007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.250505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.251078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.257073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.257562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.258006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.786741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:22.803633 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1c751b0-9604-4b00-9805-1c8edaca6c74 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.586188 Aug 21 01:25:22.804839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2282/4035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:22 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:22.815805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:22.816542 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:22.831190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.831927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.832613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.835128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.836127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.837530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.915670 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2258a464-530a-46df-bfb1-72c15a06c0ce tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/4c3ecf39-8e49-4b12-9768-d5f9003d7ea8" status: 200 len: 194 microversion: 2.1 time: 0.109545 Aug 21 01:25:22.916965 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2283/4036] 10.222.0.46 () {58 vars in 1413 bytes} [Sun Aug 21 01:25:22 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/4c3ecf39-8e49-4b12-9768-d5f9003d7ea8 => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:22.926088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:22.929541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:22.954705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.955677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.956254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:22.963927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:22.964856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:22.965471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:24.443372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:24.459750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e493b95e-d94d-4d6c-99f2-211036a0e2cb tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.541332 Aug 21 01:25:24.461450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2284/4037] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:22 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:24.474465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:24.475249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:24.493553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:24.494041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:24.494739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:24.495989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:24.496617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:24.497379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:24.706206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lazy-loading 'services' on Instance uuid 3458856f-60c0-41af-8823-196f07d19424 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:24.898755 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-520b8606-86b7-4b58-8708-66f7b9d0cd8b tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/4c3ecf39-8e49-4b12-9768-d5f9003d7ea8" status: 202 len: 0 microversion: 2.1 time: 0.434911 Aug 21 01:25:24.900816 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2285/4038] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:25:24 2022] DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments/4c3ecf39-8e49-4b12-9768-d5f9003d7ea8 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:24.915320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:24.920866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:24.942626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:24.943716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:24.945259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:24.948138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:24.949973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:24.951613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:24.993052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:24.998570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71fb89ac-75bc-4f78-b39c-2705f06fc26c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 15.693048 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 HTTP/1.1 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: exception: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7'} Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:24.999637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.003244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:25.006208 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1754/4039] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:09 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 15695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:25.006364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b50c493-18d4-4e4a-b536-738c9b6949b2 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 404 len: 111 microversion: 2.1 time: 0.098091 Aug 21 01:25:25.006364 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2286/4040] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:24 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:25.015903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7", "name": "network-vif-deleted", "tag": "9b538873-8d0b-443d-84d6-b2e38e590226"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:25.054664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.055147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.055581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.086219 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] Creating event network-vif-deleted:9b538873-8d0b-443d-84d6-b2e38e590226 for instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 on n-h1-master-1 Aug 21 01:25:25.093817 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8d9794b2-8fec-4e2d-a6c7-45b2dfac7470 req-4ce8a296-5cfd-4b8c-88bb-ac1e5da881fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089290 Aug 21 01:25:25.095486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2287/4041] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:25.101121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:25.125703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:25.134357 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1/action HTTP/1.1 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 65 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1', 'body': {'rebuild': {'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1'}}} Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 21 01:25:25.136958 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. Aug 21 01:25:25.141201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.144569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:25.145975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72ca5f90-c173-414d-a8ee-d3257d6db94f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1/action" status: 404 len: 111 microversion: 2.1 time: 0.049208 Aug 21 01:25:25.147096 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2288/4042] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:25 2022] POST /compute/v2.1/servers/2e2a8bdd-14f3-48b3-a6e6-19109c1b0fc1/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:25.165173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-751580312", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "4898c84c-bfe4-4b50-b4fa-62ca740110c2"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:25.188359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:25.189201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:25.230745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.231263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.231705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.244258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.246948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.247431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.300602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 HTTP/1.1 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: exception: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7'} Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:25.303595 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.309154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.311661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:25.313129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8e42fe2-5313-4683-9ec8-c67c5c92bf95 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 404 len: 111 microversion: 2.1 time: 0.164824 Aug 21 01:25:25.314031 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2289/4043] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:25 2022] DELETE /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:25.324262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:25.325332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:25.334394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.335157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.335737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.336730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.337237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.339509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.367073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] validate_networks() for [('4898c84c-bfe4-4b50-b4fa-62ca740110c2', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:25:25.840468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:25.850103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc3a4089-1afd-4051-8f4b-64cb2c6b896c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.531155 Aug 21 01:25:25.857795 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2290/4044] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:25 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:25.892647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:25.897431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:25.917972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.921336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.926385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.926385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:25.926385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:25.926385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:25.959318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 HTTP/1.1 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: exception: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7'} Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:25.961551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. Aug 21 01:25:25.967974 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:25.980960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:25.982167 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c1e94070-e3a5-4ac6-8439-0b519c1a121d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7" status: 404 len: 111 microversion: 2.1 time: 0.105035 Aug 21 01:25:25.983297 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2291/4045] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:25 2022] GET /compute/v2.1/servers/eb9b50a9-f543-4871-8dbc-ff4eb24e8bf7 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:25.990202 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:25.991011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.000224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.009287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.010205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.011158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.011799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.012389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.430685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:25:26.432533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:25:26.435773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:25:26.436702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:25:26.437615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:25:26.481147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.486385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.492240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.498725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.499610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.503625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.507989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:26.527618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f32df4a5-1118-459b-8c39-3b2563400409 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.543056 Aug 21 01:25:26.528566 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2292/4046] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:25 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:26.537807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:26.538329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.560011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.567098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Getting quotas for project df675371065d4276a6b4859cb0fbad0a. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:25:26.570947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.573186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.574020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.580450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.580997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.585689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Getting quotas for user 1062e039547c4ea787a9c70121afd39f and project df675371065d4276a6b4859cb0fbad0a. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:25:26.618077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.618743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:25:26.621761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b HTTP/1.1 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: exception: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'dbf49931-ea3b-410c-b07d-1f9ae44f6a8b'} Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:26.629462 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.632947 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.636479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:26.641420 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9408fcef-08bd-4efb-8ab7-b85eba09e497 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 404 len: 111 microversion: 2.1 time: 0.108121 Aug 21 01:25:26.642480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2293/4047] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:26 2022] DELETE /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:26.652704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcdcab58-eda5-402f-adea-bf737e89c2a1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa1668b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:26.757674 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcdcab58-eda5-402f-adea-bf737e89c2a1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.112883 Aug 21 01:25:26.758930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2294/4048] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:26 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:26.767306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:26.777051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 98018db9-b6f4-42f3-97f3-6fa3ffe77a57] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.792634 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/98018db9-b6f4-42f3-97f3-6fa3ffe77a57/action HTTP/1.1 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: {"restore": {}} Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '98018db9-b6f4-42f3-97f3-6fa3ffe77a57', 'body': {'restore': {}}} Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.796346 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.800657 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:26.800657 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:26.800657 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. Aug 21 01:25:26.800657 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.801550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-854d4f32-6d49-4214-ace0-24fa5adcf787 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791871 Aug 21 01:25:26.802663 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1755/4049] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:25:26.804977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 98018db9-b6f4-42f3-97f3-6fa3ffe77a57 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:26.806030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4dc8db96-53f6-47ad-a626-82df73abe037 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/98018db9-b6f4-42f3-97f3-6fa3ffe77a57/action" status: 404 len: 111 microversion: 2.1 time: 0.045877 Aug 21 01:25:26.809771 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2295/4050] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:26 2022] POST /compute/v2.1/servers/98018db9-b6f4-42f3-97f3-6fa3ffe77a57/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:26.819025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:26.821420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fc08292-5313-42ce-a8a6-cde1d588db9d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:26.826472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: dbf49931-ea3b-410c-b07d-1f9ae44f6a8b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.828529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fc08292-5313-42ce-a8a6-cde1d588db9d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.853876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.857390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.859102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.860279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.860778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.864968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.910807 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b HTTP/1.1 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: exception: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'dbf49931-ea3b-410c-b07d-1f9ae44f6a8b'} Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:26.914517 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance dbf49931-ea3b-410c-b07d-1f9ae44f6a8b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:26.918884 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a984619c-68cd-49a4-960d-568c4ec33760 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b" status: 404 len: 111 microversion: 2.1 time: 0.112104 Aug 21 01:25:26.927385 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1756/4051] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:26 2022] GET /compute/v2.1/servers/dbf49931-ea3b-410c-b07d-1f9ae44f6a8b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:26.937895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:26.938519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:26.958027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.958565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.959002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.960031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:26.960685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:26.961156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:26.982876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8fc08292-5313-42ce-a8a6-cde1d588db9d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:26.992734 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fc08292-5313-42ce-a8a6-cde1d588db9d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1216 microversion: 2.1 time: 0.181597 Aug 21 01:25:27.004461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2296/4052] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:26 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:27.013085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.027746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.052940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.055644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.057024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.057951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.065411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.066107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.104447 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 HTTP/1.1 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87775b07-5ca8-42d0-9f0e-59632cdd3649'} Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.109577 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.113276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8bd145e3-d524-4c47-845a-fb5a6fb1ab21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 404 len: 111 microversion: 2.1 time: 0.105377 Aug 21 01:25:27.114013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2297/4053] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:27 2022] DELETE /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.129646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.130272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 87775b07-5ca8-42d0-9f0e-59632cdd3649] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.140085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.140913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.149103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.152817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.153546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.154750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.191915 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 HTTP/1.1 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87775b07-5ca8-42d0-9f0e-59632cdd3649'} Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.196345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. Aug 21 01:25:27.200365 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.204220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 87775b07-5ca8-42d0-9f0e-59632cdd3649 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.205955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ebd93cc-9fe9-4822-b748-ad9af4a70846 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649" status: 404 len: 111 microversion: 2.1 time: 0.084974 Aug 21 01:25:27.210223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2298/4054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:27 2022] GET /compute/v2.1/servers/87775b07-5ca8-42d0-9f0e-59632cdd3649 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.217473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.218189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.228183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.229208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.229965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.230832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.231425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.232192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.275747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d HTTP/1.1 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d'} Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.285025 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.289452 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.294011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.295723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1001355-960a-4779-bec7-5a4a4990dba6 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 404 len: 111 microversion: 2.1 time: 0.084090 Aug 21 01:25:27.299161 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2299/4055] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:27 2022] DELETE /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.315953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.316693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.330098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.330764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.331206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.331919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:27.333520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:27.333950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:27.402445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d HTTP/1.1 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d'} Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.404024 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. Aug 21 01:25:27.408009 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.436475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.438488 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-240bc607-aa9a-4e18-aa11-aa0f40dc83ba tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d" status: 404 len: 111 microversion: 2.1 time: 0.133945 Aug 21 01:25:27.440413 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2300/4056] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:27 2022] GET /compute/v2.1/servers/0bbb8e7b-0ea9-473a-a676-4dc0ceba3d5d => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.456563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.457578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.475389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 HTTP/1.1 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd3c30fdb-885d-4e63-ad53-c14d3b6a5515'} Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.481088 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.485962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.489503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.491110 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-158bf4bc-e732-4209-8f8d-75ec107118ca tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515" status: 404 len: 111 microversion: 2.1 time: 0.047464 Aug 21 01:25:27.494431 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2301/4057] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:27 2022] DELETE /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.504287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.507012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: d3c30fdb-885d-4e63-ad53-c14d3b6a5515] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:27.525960 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 HTTP/1.1 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd3c30fdb-885d-4e63-ad53-c14d3b6a5515'} Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:27.529506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:27.533434 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:27.533434 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:27.533434 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:27.533434 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. Aug 21 01:25:27.533434 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:27.539558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance d3c30fdb-885d-4e63-ad53-c14d3b6a5515 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:27.541418 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d26e142-c688-4fb1-b2f0-d228589d149d tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515" status: 404 len: 111 microversion: 2.1 time: 0.041977 Aug 21 01:25:27.543749 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2302/4058] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:27 2022] GET /compute/v2.1/servers/d3c30fdb-885d-4e63-ad53-c14d3b6a5515 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:27.774846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e3df9d0-bdb4-4821-84c3-2f365439ea44 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa2a3b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:27.879972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e3df9d0-bdb4-4821-84c3-2f365439ea44 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.110382 Aug 21 01:25:27.881397 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2303/4059] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:27 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:28.022815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:28.024328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:28.043847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:28.044822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:28.049067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:28.055696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:28.058270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:28.059040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:28.248082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:28.273423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d97d3155-0590-4eab-b17e-2e9965a07f66 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1220 microversion: 2.1 time: 0.250846 Aug 21 01:25:28.277061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2304/4060] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:28 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1220 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:28.525576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:28.539704 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b08b65b-9e65-4f0e-a5f3-fe3c168ace93 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.611046 Aug 21 01:25:28.540309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1757/4061] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:26 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:28.570653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:28.571590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:28.588077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:28.590731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:28.591367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:28.592278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:28.593920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:28.596831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:28.895610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7f95c22-708b-4824-baf5-a48ff7c3d508 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fe355550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:29.000153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:29.018147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-35869800-2209-4888-b656-d7555a82aa22 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.452813 Aug 21 01:25:29.020878 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2305/4062] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:28 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:29.024102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7f95c22-708b-4824-baf5-a48ff7c3d508 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.132349 Aug 21 01:25:29.024692 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1758/4063] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:28 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:29.044446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:29.045211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:29.060874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.061728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.062742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.066776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.067774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.070188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.147580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'restore' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: {"restore": {}} Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'restore' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'restore': {}}} Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state active. Cannot restore while the instance is in this state. Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:29.149386 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:29.156401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:29.156401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:29.156401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:29.156401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:29.156401 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:29.159027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'restore' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:29.160953 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6adf3cc-b598-45c1-b719-1450b3d43f72 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 145 microversion: 2.1 time: 0.122178 Aug 21 01:25:29.165174 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2306/4064] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:29 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 145 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:25:29.173215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:29.174775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:29.199095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.200329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.202214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.220623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.222358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.224155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.295540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:29.296492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:29.310870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.314514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.315740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.317196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.321118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.324192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.480166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:29.484717 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:29.502436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08324aa6-7035-4a22-9541-467cebf14a1f tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1274 microversion: 2.1 time: 0.211871 Aug 21 01:25:29.505937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2307/4065] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:29 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:29.899546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:29.916897 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5ad1ce56-010c-46b9-b035-08928e0861ad tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.740875 Aug 21 01:25:29.917597 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1759/4066] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:29 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:29.957047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:29.958214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:29.961506 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:29.969735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.974135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.975075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:29.976111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:29.980977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:29.981825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.039996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0905d643-0e26-4861-ad6a-b7d910be9319 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fead7af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:30.118317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0905d643-0e26-4861-ad6a-b7d910be9319 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.083823 Aug 21 01:25:30.123772 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1760/4067] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:30 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:30.329047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:30.353974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79c253f5-ba0b-4bb0-b140-6cc901cc2c71 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.412812 Aug 21 01:25:30.355375 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2308/4068] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:29 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:30.379573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:30.380122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:30.391688 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a/action HTTP/1.1 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 14 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: {"resume": {}} Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a', 'body': {'resume': {}}} Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:30.403746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:30.407916 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:30.407916 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:30.407916 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. Aug 21 01:25:30.407916 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:30.409218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:30.410416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f01348df-28fa-47c9-8ebb-65d98505cbd7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a/action" status: 404 len: 111 microversion: 2.1 time: 0.035096 Aug 21 01:25:30.411520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1761/4069] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:30 2022] POST /compute/v2.1/servers/ad036c6a-a0ff-49d7-b07c-bfc8c6c7bc8a/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:30.420938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:30.421791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:30.438734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.439735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.440298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.441188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.441750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.442272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.535487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:30.536402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:30.555317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.555817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.556255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.563116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.568921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.569461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.853643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:30.870553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-759ec7f2-c89a-495d-a433-70b4f842567b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.454426 Aug 21 01:25:30.872491 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2309/4070] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:30 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:30.880661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:30.897069 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-56cca562-c5d3-48f3-a7e3-1544cea1d112 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1274 microversion: 2.1 time: 0.368746 Aug 21 01:25:30.898239 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1762/4071] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:30 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:30.907019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:30.914696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:30.933350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.933956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.934781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:30.935765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:30.938320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:30.938765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.137151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1d43f6d-0250-4976-94f0-f65062bec10a tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd982040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:31.234736 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1d43f6d-0250-4976-94f0-f65062bec10a tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.104604 Aug 21 01:25:31.235370 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1763/4072] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:31 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:31.270428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:31.283701 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3b38bf7-d046-4944-ba0a-f0c0386fb4e3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.385823 Aug 21 01:25:31.286440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2310/4073] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:30 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:31.316296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:31.316960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:31.342885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.346771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.347266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.348017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.348481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.350686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.440389 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'resume' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 14 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: {"resume": {}} Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'resume' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'resume': {}}} Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state active. Cannot resume while the instance is in this state. Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:31.441996 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'resume' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:31.445943 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b15d3fe-9097-424f-a1ef-d4501bf3e107 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 144 microversion: 2.1 time: 0.137089 Aug 21 01:25:31.453163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:31.453789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:31.472917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.473560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.474020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.474772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.475228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.475655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.480051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1764/4074] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:31 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 144 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:25:31.879761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:31.890594 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d534fe4-a727-4bb2-ac45-0e4f59ec01c1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.441437 Aug 21 01:25:31.898803 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2311/4075] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:31 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:31.930113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:31.930740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:31.933696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:31.934808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:31.944463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.944984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.960100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.960606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.961090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.964965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.968896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.970102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:31.973633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.974611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:31.978214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:31.979184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:32.408722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:32.422370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-999e6ec7-83d2-421e-a516-e011f69a95f9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.498122 Aug 21 01:25:32.423327 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2312/4076] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:31 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:32.428477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c3c0689-783b-498e-b467-8aea9f51f379 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9e904c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:32.515391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c3c0689-783b-498e-b467-8aea9f51f379 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.090840 Aug 21 01:25:32.516002 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2313/4077] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:32 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:32.638767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-790a6550-4202-4ff9-9418-f32be105033f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-790a6550-4202-4ff9-9418-f32be105033f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 160 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "30a6b423-e11b-48a2-bd1e-1788a7209058"}]}} Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': '', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'networks': [{'uuid': '30a6b423-e11b-48a2-bd1e-1788a7209058'}]}}} Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi '' Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:25:32.642915 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:25:32.647373 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:32.654555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-790a6550-4202-4ff9-9418-f32be105033f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:32.656181 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-790a6550-4202-4ff9-9418-f32be105033f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023088 Aug 21 01:25:32.657387 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2314/4078] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:25:32 2022] POST /compute/v2.1/servers => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:25:32.669758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:32.670760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:32.680828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:32.682470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:32.683149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:32.685515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:32.686381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:32.687050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:32.841718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:32.850569 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13f0aee6-1c73-4693-9ba9-ce7d5445f67d tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.931180 Aug 21 01:25:32.851161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1765/4079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:31 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:33.007090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:33.020302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0bc99d0-e5e9-4b1e-983e-3875cf2d141a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.358379 Aug 21 01:25:33.039334 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2315/4080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:32 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:33.050712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:33.051705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:33.068488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.074308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.077198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:33.078671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.081552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.084911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:33.534904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72e7bc7d-c714-470d-a36a-30c022254389 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa1720d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:33.621487 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72e7bc7d-c714-470d-a36a-30c022254389 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.095492 Aug 21 01:25:33.623168 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2316/4081] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:33 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:33.643212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:33.659132 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c542df6-f5c8-4de6-87f9-20829c48ee4a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.612736 Aug 21 01:25:33.661522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1766/4082] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:33 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:33.688540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:33.689125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 32c6f46c-286b-49bc-acf1-0f8adeee15d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:33.712649 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/32c6f46c-286b-49bc-acf1-0f8adeee15d4/action HTTP/1.1 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 14 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: {"shelve": {}} Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '32c6f46c-286b-49bc-acf1-0f8adeee15d4', 'body': {'shelve': {}}} Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:33.721683 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 32c6f46c-286b-49bc-acf1-0f8adeee15d4 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:33.725420 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b3f421c-32d2-4582-8b15-747c0593ee9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/32c6f46c-286b-49bc-acf1-0f8adeee15d4/action" status: 404 len: 111 microversion: 2.1 time: 0.042962 Aug 21 01:25:33.732473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2317/4083] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:33 2022] POST /compute/v2.1/servers/32c6f46c-286b-49bc-acf1-0f8adeee15d4/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:33.733681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:33.734601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:33.743846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.745347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.746020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:33.751222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.752094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.752748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:33.872498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:33.873758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:33.894523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.896129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.896873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:33.897770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:33.898398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:33.902477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:34.376512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:34.387470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b4e6d12a-3b2d-4897-92dc-9fd0568439b2 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.519665 Aug 21 01:25:34.388265 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2318/4084] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:33 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:34.637791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b48545f-c887-408a-ad60-83671ac4a435 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa2a39d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:34.715163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b48545f-c887-408a-ad60-83671ac4a435 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.082088 Aug 21 01:25:34.722693 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2319/4085] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:34 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:35.138123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:35.152451 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66ce0737-17d3-4f92-8276-e31eecdce0f7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.422956 Aug 21 01:25:35.159077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1767/4086] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:33 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:35.186929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:35.187825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:35.206726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.220434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.225631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.226551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.227758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.228682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.411618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:35.412385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:35.427290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.427889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.428620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.433556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.434714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.470521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.610671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:35.622189 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c40364bd-b9a3-4030-a198-595fa1a1522d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.441446 Aug 21 01:25:35.622826 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2320/4087] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:35 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:35.636414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d211fd70-60d8-4842-87af-8046f808ae5f", "tag": "1c577185-b37e-4994-936b-ca333114f4b5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:35.656182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.656911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.657122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.687686 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] Creating event network-changed:1c577185-b37e-4994-936b-ca333114f4b5 for instance d211fd70-60d8-4842-87af-8046f808ae5f on n-h1-master-1 Aug 21 01:25:35.703422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8c6021d6-1d58-4e33-8483-91f45459aed8 req-3c28ce3c-3852-445d-b644-82fce84c874c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072487 Aug 21 01:25:35.707277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2321/4088] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:35.720676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:35.722434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:35.742707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.743229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.743670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.749885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:35.750783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:35.751418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:35.814642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lazy-loading 'flavor' on Instance uuid 7b499cf8-c55e-42d3-becc-1e2c05db75be {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:36.419922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ff74d8d-d092-4474-bfab-f70d6b9e2d7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.710783 Aug 21 01:25:36.427674 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2322/4089] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:35 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:36.438812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9656c24-722d-4dd2-9967-89074a542833 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f95e2160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:36.532515 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:36.555442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9656c24-722d-4dd2-9967-89074a542833 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.125323 Aug 21 01:25:36.564253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2323/4090] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:36 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:36.570573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:36.571584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:36.583506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:36.586441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:36.587107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:36.589106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:36.591726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:36.592419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:36.604108 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:36.711366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:36.728058 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5ac6add-6ce7-437f-8bc6-a011d34f10d9 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 1.320186 Aug 21 01:25:36.733717 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1768/4091] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:35 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:36.815008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:36.817354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:36.833711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:36.834282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:36.835694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:36.839970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:36.840474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:36.842317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:36.918697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:36.924683 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe63ddbc-9c6e-4970-9fbe-978a4f4da9a4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114129 Aug 21 01:25:36.931606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61ce733a-4931-4f4f-910c-f9d626007c64 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.365437 Aug 21 01:25:36.932887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1769/4092] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:25:36 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:25:36.933643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2324/4093] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:36 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:37.148061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:37.153124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:37.160516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.163826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.164291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.165144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.165752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.166185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.250673 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1dd75d5f-d838-4af6-991a-d9f41f2b371c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117644 Aug 21 01:25:37.253110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1770/4094] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:25:37 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:25:37.355894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:37.356401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:37.358951 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:37.396467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.401335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.404402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.407463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.408918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.414454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.508893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:25:37.571440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97dd775e-6796-4ce7-a7a8-616de59fce9b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd1bb1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:37.726783 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97dd775e-6796-4ce7-a7a8-616de59fce9b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1424 microversion: 2.1 time: 0.129642 Aug 21 01:25:37.730391 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1771/4095] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:37 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1424 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:37.754906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:37.760033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:37.802284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.803811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.810401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b54ff68-a735-4814-8bc9-7571da5d69f6 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 204 len: 0 microversion: 2.1 time: 0.458754 Aug 21 01:25:37.810830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.812988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.814246 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2325/4096] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:37 2022] DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:25:37.816215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.817967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.838297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:37.850909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:37.877424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.896676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.897469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:37.900904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:37.905869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:37.907719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:38.272989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:38.282545 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b48505ad-83d2-47ef-8ec6-ebcfee5050c3 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.532226 Aug 21 01:25:38.290598 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1772/4097] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:37 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:38.301749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:38.305271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:38.321470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:38.322405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:38.325100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:38.326368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:38.327069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:38.330643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:38.431359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:38.452690 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d730ade5-a7a0-4e0f-962d-e524834f32c5 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1673 microversion: 2.1 time: 0.629986 Aug 21 01:25:38.468884 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2326/4098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:37 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1673 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:38.759718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0accc602-1d58-4ab8-8a7a-426a9021f803 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc4032a5ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:38.891029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:38.912843 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05644699-937a-49b4-a5d2-d2c0f6f976d9 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.620332 Aug 21 01:25:38.913731 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1773/4099] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:38 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:38.962161 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0accc602-1d58-4ab8-8a7a-426a9021f803 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1433 microversion: 2.1 time: 0.215506 Aug 21 01:25:38.972433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2327/4100] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:38 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1433 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:38.977798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ffbd094-da04-4751-8c77-ce709018159e tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd8733a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:39.111617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ffbd094-da04-4751-8c77-ce709018159e tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 200 len: 1433 microversion: 2.1 time: 0.137420 Aug 21 01:25:39.113711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1774/4101] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:38 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 1433 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:39.136815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:39.138008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:39.166709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.167870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.168589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:39.171061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.172537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.173545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:39.215429 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:39.312438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:39.313561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:39.334373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.335018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.339243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:39.340913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.341420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.341860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:39.686340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:39.697531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cadf8e6-94b0-44ad-a36c-6d7947db29ba tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1479 microversion: 2.1 time: 0.563375 Aug 21 01:25:39.698167 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2328/4102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:39 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1479 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:39.740230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:39.746159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:39.775327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.777357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.780072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:39.781046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:39.783102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:39.783699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:40.201054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:40.215544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:40.237934 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b029b295-7157-47c1-8308-0bd4e33332b3 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1673 microversion: 2.1 time: 0.512909 Aug 21 01:25:40.238573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2329/4103] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:39 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1673 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:40.252916 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8853ec2f-1d0c-4799-aa76-bb98006536a1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.932942 Aug 21 01:25:40.252916 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1775/4104] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:39 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:40.256328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:40.257449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:40.266188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:40.276756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:40.277657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:40.278503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:40.279140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:40.279862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:40.720499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:40.721533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:40.737850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:40.738347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:40.741155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:40.741995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:40.742454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:40.753477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:40.830892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:40.840790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-294ec1b2-1c05-4f4f-92e9-406446b415d3 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.598720 Aug 21 01:25:40.843821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2330/4105] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:41.260330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:41.261045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:41.271540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:41.272037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:41.272483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:41.273249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:41.273698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:41.274120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:41.465840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:41.481898 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c35aa4e0-9def-426f-9517-4d3facd8dfad tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1466 microversion: 2.1 time: 0.764366 Aug 21 01:25:41.494064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1776/4106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:40 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1466 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:41.513687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:41.527710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:41.548373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:41.548996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:41.549326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:41.550415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:41.551181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:41.551752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:41.603949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:41.617154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1bbd689-73fc-4428-a6d5-fbee4edafb49 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1673 microversion: 2.1 time: 0.360233 Aug 21 01:25:41.619355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2331/4107] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:41 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1673 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:41.629043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d5b0e55-72f7-4c64-834b-f0607ec2d5f1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc40322ca60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:41.703031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d5b0e55-72f7-4c64-834b-f0607ec2d5f1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1" status: 200 len: 784 microversion: 2.1 time: 0.081798 Aug 21 01:25:41.703694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2332/4108] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:41 2022] GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:41.717526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47a7eb6b-4fd5-4831-860f-321a5f149583 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:41.737533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47a7eb6b-4fd5-4831-860f-321a5f149583 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023963 Aug 21 01:25:41.738412 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2333/4109] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:25:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:41.754294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-195ba7bc-6ce9-466b-8373-c55f16b5b3bc tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9f18430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:42.400945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:42.413358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8c472c3-e98b-4542-b4ed-d244576f0365 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.913134 Aug 21 01:25:42.421222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1777/4110] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:41 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:42.454341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:42.469360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:42.485181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:42.491176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:42.491682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:42.492450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:42.493260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:42.493763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:42.787453 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-195ba7bc-6ce9-466b-8373-c55f16b5b3bc tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "DELETE /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 204 len: 0 microversion: 2.1 time: 1.039658 Aug 21 01:25:42.792169 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2334/4111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:41 2022] DELETE /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:25:42.795021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:42.795720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:42.815039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:42.815632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:42.816128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:42.817114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:42.817747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:42.818337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.086038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:43.098154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1b38b00-518a-4bf8-9f7f-808bef393b9f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.675347 Aug 21 01:25:43.098761 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1778/4112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:42 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:43.123043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cff8682d-f729-49d7-bb1d-1be3fcbfc671 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd0529d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.156649 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-cff8682d-f729-49d7-bb1d-1be3fcbfc671 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] HTTP exception thrown: Image not found. Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cff8682d-f729-49d7-bb1d-1be3fcbfc671 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Request method failure captured: Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea HTTP/1.1 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYlQ3DzzbEpwz3w_S93TnNHuDWx7qeEaYtgwBt5iqy8roZuNPjNk2XZn_8pnZ2IVlX98fBWYUFF_fu2etI07yGOs8IEa1Fn05Mri-yVXtPr8vA6Dq0LdtEUlLgpNrrnN5TAnvTBGf__jWkMUWWv6VHYeeY9cO9BEA4wnoTRHACCAVMo Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fb877dddfba14fe3929b1267dee0e256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}] Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: ea86632bc35148a68dc7a10e194e184d Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: exception: Image not found. Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5484383c-8a25-46e9-b062-257d6dc3d2ea'} Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5484383c-8a25-46e9-b062-257d6dc3d2ea Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:25:43.159936 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5484383c-8a25-46e9-b062-257d6dc3d2ea could not be found. Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cff8682d-f729-49d7-bb1d-1be3fcbfc671 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Returning 404 to user: Image not found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:43.163313 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cff8682d-f729-49d7-bb1d-1be3fcbfc671 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 404 len: 62 microversion: 2.1 time: 0.051820 Aug 21 01:25:43.168284 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1779/4113] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:43 2022] GET /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:25:43.170506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211fd70-60d8-4842-87af-8046f808ae5f", "name": "network-vif-plugged", "status": "completed", "tag": "1c577185-b37e-4994-936b-ca333114f4b5"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:43.183381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.184748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.185226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.190232 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:43.198071 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] Creating event network-vif-plugged:1c577185-b37e-4994-936b-ca333114f4b5 for instance d211fd70-60d8-4842-87af-8046f808ae5f on n-h1-master-1 Aug 21 01:25:43.205273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:43.206006 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e4d3ae65-40ee-4492-ba50-4e2175beb76a req-57e6230a-1609-4765-9d21-ff69a615dabc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038352 Aug 21 01:25:43.208835 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1780/4114] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:43.232833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.233649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.234502 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58a1a4c0-1312-4e58-9e5d-f77aadd891e4 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1673 microversion: 2.1 time: 0.439294 Aug 21 01:25:43.235276 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2335/4115] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:42 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1673 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:43.247958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.251073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.251717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.253188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.254565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.255817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1654795778"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:43.256584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.262154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.282918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.285276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.288925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.289844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.290469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.291072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.293402 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c HTTP/1.1 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af65ae9b-2b7b-4c5e-875e-dc47908eb81c'} Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:43.300256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.303574 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.306736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:43.307909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23c8f8cc-0b12-47ec-a2be-1f86dfe6d7c8 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 404 len: 111 microversion: 2.1 time: 0.097392 Aug 21 01:25:43.309420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1781/4116] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:43 2022] DELETE /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:43.319286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.320160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: af65ae9b-2b7b-4c5e-875e-dc47908eb81c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.327369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.328215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.328980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.329902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.330617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.331245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.359550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c HTTP/1.1 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af65ae9b-2b7b-4c5e-875e-dc47908eb81c'} Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.361327 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. Aug 21 01:25:43.365278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.366031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance af65ae9b-2b7b-4c5e-875e-dc47908eb81c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:43.367850 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5979ce1-c607-4fca-9678-fad3130a3e21 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c" status: 404 len: 111 microversion: 2.1 time: 0.052779 Aug 21 01:25:43.368516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1782/4117] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:43 2022] GET /compute/v2.1/servers/af65ae9b-2b7b-4c5e-875e-dc47908eb81c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:43.381865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.382477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.397794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.398992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.400464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.402419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.402907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.404618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.447739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 HTTP/1.1 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '79c923fd-abe9-447e-81e9-84f40b5ae3f0'} Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:43.450452 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.453816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.456997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:43.460694 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6156dd2c-ad68-4254-887b-3c2152e0a121 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 404 len: 111 microversion: 2.1 time: 0.087062 Aug 21 01:25:43.462157 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1783/4118] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:43 2022] DELETE /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:43.467678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.468606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.478228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.481411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.482925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.484607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.489555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.490236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.714581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6d88552-e1e1-4ad3-b9b3-889e5b69599d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "POST /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8/action" status: 202 len: 0 microversion: 2.1 time: 0.472426 Aug 21 01:25:43.722594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2336/4119] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:25:43 2022] POST /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:25:43.730695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.731855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] [instance: 79c923fd-abe9-447e-81e9-84f40b5ae3f0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:43.753004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.753770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.754481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.756267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:43.759776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:43.763523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:43.796642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] HTTP exception thrown: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Request method failure captured: Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 HTTP/1.1 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYhOC8rIW5dAyj2Lobbc2APxLPI1yE4TC0Tjn4l_myM5-xtta_f0HLMsYfTZ0BQsUD7T_naKjFFHFOypnfTBYeroa3ONre5ndXp9r5_GSKsOQUKJp1Fl34Ic8Y3V9igp771OESQ1Dp7vCJLQABG9LNOW0CnmTWQeqnqbbc1OeGib7Ms Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8f1f63bfe1664d079f0e22116f6f4e18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8f1f63bfe1664d079f0e22116f6f4e18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8f1f63bfe1664d079f0e22116f6f4e18"}]}] Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 8f1f63bfe1664d079f0e22116f6f4e18 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-1496112132 Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 79c5db05d52f4b8d91b430a8b459a09b Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-1496112132-project Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '79c923fd-abe9-447e-81e9-84f40b5ae3f0'} Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:43.804065 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. Aug 21 01:25:43.807616 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:43.810745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] Returning 404 to user: Instance 79c923fd-abe9-447e-81e9-84f40b5ae3f0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:43.812545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be03b2be-5c4a-4827-93de-8e44f48d2ad1 tempest-DeleteServersTestJSON-1496112132 tempest-DeleteServersTestJSON-1496112132-project] 10.222.0.46 "GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0" status: 404 len: 111 microversion: 2.1 time: 0.088154 Aug 21 01:25:43.819780 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2337/4120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:43 2022] GET /compute/v2.1/servers/79c923fd-abe9-447e-81e9-84f40b5ae3f0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:43.836411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b4807b3-bfae-45a2-95b4-d91e35f3918d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc40322ca60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:43.912362 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b4807b3-bfae-45a2-95b4-d91e35f3918d tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.089571 Aug 21 01:25:43.913179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2338/4121] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:43 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:44.123010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:44.123844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:44.175018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:44.175757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:44.176912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:44.180447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:44.182979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:44.183691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:44.352447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:44.365611 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bce5dcc-f500-4763-8441-1fb9c8d452c1 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1316 microversion: 2.1 time: 0.902006 Aug 21 01:25:44.373134 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1784/4122] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:43 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1316 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:44.392579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:44.393885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:44.430028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:44.430531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:44.430971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:44.436106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:44.436625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:44.438309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:44.618372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:44.640233 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-763a2e4e-c551-450f-9ca5-e3c9995bd8a1 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1606 microversion: 2.1 time: 0.265569 Aug 21 01:25:44.656907 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1785/4123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:44 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1606 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:44.927582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3458856f-60c0-41af-8823-196f07d19424", "name": "network-vif-deleted", "tag": "6da4140c-4449-410e-a199-fb188843130e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:44.973224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:44.973957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:44.974892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.023211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] Creating event network-vif-deleted:6da4140c-4449-410e-a199-fb188843130e for instance 3458856f-60c0-41af-8823-196f07d19424 on n-h2-master-1 Aug 21 01:25:45.037723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4305a8ba-a59d-4d14-8eb1-1a1aa5410c2d req-c85a3e30-e08e-4563-8878-0644f43c2f47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116068 Aug 21 01:25:45.043658 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1786/4124] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:25:45.049343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4eeca307-f586-4e4e-a9c6-80182ababa6a tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd18c670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:45.118115 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4eeca307-f586-4e4e-a9c6-80182ababa6a tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.072785 Aug 21 01:25:45.118964 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1787/4125] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:45 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:45.245002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-unplugged", "status": "completed", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:45.326369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.326369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.326677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.415401 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] Creating event network-vif-unplugged:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:25:45.445457 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-52a4e336-65b9-45aa-989d-200f9176b9db req-0cd145aa-88df-4afc-8c5b-731137b63b8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207280 Aug 21 01:25:45.448493 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1788/4126] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:45.481658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:45.485356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:45.502238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.505626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.508051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.510492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.511613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.513812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.655904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:45.670918 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-247c2473-d6c4-4451-8dc0-c8e6a1ffad88 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 1.551841 Aug 21 01:25:45.671432 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2339/4127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:44 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:45.691687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:45.692337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:45.705186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.705861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.706914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.707636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.708560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.708560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.775707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.776340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.776787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.777256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lazy-loading 'fault' on Instance uuid 3458856f-60c0-41af-8823-196f07d19424 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:45.872460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:45.882983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-18f0b3ba-f9a9-4288-a27d-c92ce1ea5206 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1505 microversion: 2.1 time: 0.432817 Aug 21 01:25:45.896811 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1789/4128] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:45 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:45.908041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3338f52621ec4501b2f0b88ff5cb36fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe917515a56c4577b45df3eb16642a2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:45.908749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:45.909572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:45.921972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31b5b251-59c7-4e12-8944-0412a17d013e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 200 len: 1327 microversion: 2.1 time: 0.234379 Aug 21 01:25:45.922575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2340/4129] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:45 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 1327 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:45.923648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.924329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.925767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.926637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:45.929533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:45.930180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:45.986440 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7c4367a-f675-4ac2-b11c-166ab93b96a7 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips" status: 200 len: 109 microversion: 2.1 time: 0.082388 Aug 21 01:25:45.987755 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1790/4130] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:25:45 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips => generated 109 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:46.000136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.000634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.007313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.007794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.008252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.008968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.009477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.009892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.049559 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5187caba-45f5-4e14-908e-626800896f65 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips" status: 200 len: 109 microversion: 2.1 time: 0.053166 Aug 21 01:25:46.050741 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2341/4131] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:25:45 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips => generated 109 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:46.062076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.064164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.074212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.074682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.075106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.075803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.076242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.079402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.130877 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83a28948-62e6-4395-833d-13be1d9095e5 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips/tempest-ServerAddressesTestJSON-1824920551-network" status: 200 len: 94 microversion: 2.1 time: 0.073039 Aug 21 01:25:46.134564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e71f5c50-f82e-41c9-980f-634bf2688e39 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9d77310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.144345 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1791/4132] 10.222.0.46 () {58 vars in 1401 bytes} [Sun Aug 21 01:25:46 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f/ips/tempest-ServerAddressesTestJSON-1824920551-network => generated 94 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:25:46.155034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.156168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.168834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.169321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.169745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.170447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.181663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.182026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.228202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e71f5c50-f82e-41c9-980f-634bf2688e39 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.098139 Aug 21 01:25:46.229394 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2342/4133] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:46 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:46.230381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:25:46.405188 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90f7030e-d358-4954-8082-3d8c91a2c874 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 204 len: 0 microversion: 2.1 time: 0.258906 Aug 21 01:25:46.409523 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1792/4134] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:25:46 2022] DELETE /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:25:46.424552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.425601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.437410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.437821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.438313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.439333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.439937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.440507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.694692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.695777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.718725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.719450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.719888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.720595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:46.721085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:46.721508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:46.947459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:46.963417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2af7b60f-e74e-4b87-9289-dc436dee5727 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1511 microversion: 2.1 time: 0.548986 Aug 21 01:25:46.967657 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2343/4135] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:46 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:46.980535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:46.981648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:46.983659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:46.994213 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c2f36ce-e722-4e9b-ac9f-7af6d7c5a08c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.303982 Aug 21 01:25:46.999361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:47.000168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:47.003186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:47.004310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:47.006726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:47.007536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:47.008951 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1793/4136] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:46 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:25:47.035546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 HTTP/1.1 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3458856f-60c0-41af-8823-196f07d19424'} Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:47.037448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6060546-b4f7-4d4d-a885-d0e3791b873e tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 404 len: 111 microversion: 2.1 time: 0.070826 Aug 21 01:25:47.048488 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2344/4137] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:46 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:47.050946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88b05c1d-d9f0-4f68-83b3-f22f7c9f0c80 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '.version_select at 0x7fc3fe855ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:47.077470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88b05c1d-d9f0-4f68-83b3-f22f7c9f0c80 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695378294" status: 202 len: 0 microversion: 2.1 time: 0.031007 Aug 21 01:25:47.078084 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1794/4138] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:25:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695378294 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:25:47.244041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4cc6484-cbdf-484e-9f6b-4b58d21f7862 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa68da60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:47.335400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4cc6484-cbdf-484e-9f6b-4b58d21f7862 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.095447 Aug 21 01:25:47.336367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2345/4139] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:47 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:47.989024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:47.990181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:48.017019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:48.018389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:48.033450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:48.034156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:48.036479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:48.036890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:48.037562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:48.038214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:48.040811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:48.042468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:48.043061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:48.043801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:48.044750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:48.045589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:48.726355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:48.771297 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e29cfc3-f962-418e-800e-b49ba6e168d5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.758808 Aug 21 01:25:48.771883 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2346/4140] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:48 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:48.779998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31a1fb40-3699-4d87-b2b0-5e13a2171bf7 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fa03e940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:48.794621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:48.810744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ce270f6-4e77-4331-abe8-bc9107cec92a tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1511 microversion: 2.1 time: 0.825027 Aug 21 01:25:48.814782 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1795/4141] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:47 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1511 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:48.893392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31a1fb40-3699-4d87-b2b0-5e13a2171bf7 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.116708 Aug 21 01:25:48.893985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2347/4142] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:48 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:49.570399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211fd70-60d8-4842-87af-8046f808ae5f", "name": "network-vif-deleted", "tag": "1c577185-b37e-4994-936b-ca333114f4b5"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:49.580079 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:49.600761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.601901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.602577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.627348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] Creating event network-vif-deleted:1c577185-b37e-4994-936b-ca333114f4b5 for instance d211fd70-60d8-4842-87af-8046f808ae5f on n-h1-master-1 Aug 21 01:25:49.654497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-de914099-a5b6-404f-822b-23eac25b4989 req-dd8e39ea-81d2-44d5-bb92-fc0230d439cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092822 Aug 21 01:25:49.663369 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1796/4143] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:49.797058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:49.797752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:49.819518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.821868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.822296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.826453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.835488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:49.836892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:49.841406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.845578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.888087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.888898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.890639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.891595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.893102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.893915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.987617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:49.989048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:49.991292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:49.991976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lazy-loading 'fault' on Instance uuid d211fd70-60d8-4842-87af-8046f808ae5f {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:25:50.114395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1062e039547c4ea787a9c70121afd39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df675371065d4276a6b4859cb0fbad0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:50.136008 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39811f7c-e602-4fc0-b544-fdf4ddb8ef87 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 200 len: 1306 microversion: 2.1 time: 0.305456 Aug 21 01:25:50.153380 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1797/4144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:49 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 1306 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:50.160976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1f16b97-5a27-4e6f-9b0d-7965995a7f45 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9d4430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:50.235674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1f16b97-5a27-4e6f-9b0d-7965995a7f45 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.080292 Aug 21 01:25:50.237476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1798/4145] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:50 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:50.548200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:50.576292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da28912b-dd48-4a51-9c7a-3565f52b7a1a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.784101 Aug 21 01:25:50.579418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2348/4146] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:49 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:51.103542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-plugged", "status": "completed", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:25:51.125775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:51.128413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:51.132278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:51.160172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:51.160956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] [instance: d211fd70-60d8-4842-87af-8046f808ae5f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:51.166758 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] Creating event network-vif-plugged:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:25:51.170163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:51.174635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:51.175335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9766d5e0-eccb-4cb3-bbd3-078d49a0cfdd req-bcbf1ded-d679-4aa4-8e97-4995c998e464 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076175 Aug 21 01:25:51.175873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:51.177097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1799/4147] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:25:51.180843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:51.185781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:51.189229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:51.240643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] HTTP exception thrown: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Request method failure captured: Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f HTTP/1.1 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYmDZM5hJ3URoJ37UYbgvg9uZLQd-Qjx3XMdlWMQ9Wmm6ppQV3HeNvY5BITvEvgYhkXSOwS3INwh1a2n7WMK0-w_to2IqSFuXss3zr6B-wgwVP0YfPTj5Djff5FUSExSO4hchEQzGDD_nIG_8kkcAl8kONWHlosrye8XvBY5HHhiTtg Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: df675371065d4276a6b4859cb0fbad0a Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerAddressesTestJSON-1738441275 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df675371065d4276a6b4859cb0fbad0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df675371065d4276a6b4859cb0fbad0a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df675371065d4276a6b4859cb0fbad0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df675371065d4276a6b4859cb0fbad0a"}]}] Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerAddressesTestJSON-1738441275 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: df675371065d4276a6b4859cb0fbad0a Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1738441275 Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerAddressesTestJSON-1738441275-project Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1062e039547c4ea787a9c70121afd39f Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerAddressesTestJSON-1738441275-project Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd211fd70-60d8-4842-87af-8046f808ae5f'} Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:25:51.246165 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] Returning 404 to user: Instance d211fd70-60d8-4842-87af-8046f808ae5f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:25:51.250387 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9342ef9d-de9a-426f-bded-1e2da9722715 tempest-ServerAddressesTestJSON-1738441275 tempest-ServerAddressesTestJSON-1738441275-project] 10.222.0.46 "GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f" status: 404 len: 111 microversion: 2.1 time: 0.092492 Aug 21 01:25:51.256447 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2349/4148] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:51 2022] GET /compute/v2.1/servers/d211fd70-60d8-4842-87af-8046f808ae5f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:25:51.260009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72f5fd02-2c42-4bcd-b2cd-e8154838fba4 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd18c8b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:51.418913 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72f5fd02-2c42-4bcd-b2cd-e8154838fba4 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.164553 Aug 21 01:25:51.419517 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1800/4149] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:51 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:51.601114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:51.602055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:51.629575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:51.637387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:51.638152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:51.639161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:51.639634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:51.640063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:52.435756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aafb1060-a772-40a4-8408-f1f5f505341c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9d4700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:52.539228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aafb1060-a772-40a4-8408-f1f5f505341c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.108087 Aug 21 01:25:52.546199 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1801/4150] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:52 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:52.570851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:52.595182 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed4d0bbe-f9e3-4215-a308-f09c08b8644f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.998662 Aug 21 01:25:52.597851 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2350/4151] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:51 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:53.564306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5eef9e31-4316-4f26-bea9-8f798a4cc7cf tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9c6c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:53.619046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:53.619769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:53.643682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:53.644182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:53.644683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:53.645366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:53.645812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:53.646224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:53.670543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5eef9e31-4316-4f26-bea9-8f798a4cc7cf tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.113306 Aug 21 01:25:53.677107 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1802/4152] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:53 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:54.165018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:54.186097 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37e0232a-7232-4058-8ebe-1f8b7cd3c65f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.572368 Aug 21 01:25:54.210578 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2351/4153] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:53 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:54.704366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5248c4f3-241d-4a80-bed7-77d36139c181 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd873a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:54.845042 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5248c4f3-241d-4a80-bed7-77d36139c181 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.150073 Aug 21 01:25:54.846684 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1803/4154] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:54 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:55.220160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:55.220805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:55.239583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:55.241164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:55.243941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:55.248158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:55.251964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:55.252656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:55.861739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eb505d77-c848-4a7b-b9e5-3ac72a424e89 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd1bd3a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:55.941029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eb505d77-c848-4a7b-b9e5-3ac72a424e89 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.083847 Aug 21 01:25:55.943922 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1804/4155] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:55 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:56.677368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:25:56.710218 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:25:56.738842 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ddc7a14-fe6d-4d31-9e3f-a949f6c07542 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 1.521555 Aug 21 01:25:56.742474 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2352/4156] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:55 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:56.958291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5e231e0-bd1a-47c5-857c-0f34922970f1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd99fe50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:57.113115 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5e231e0-bd1a-47c5-857c-0f34922970f1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.158599 Aug 21 01:25:57.132285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1805/4157] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:56 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:57.800673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:57.802031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:25:57.842812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:57.847984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:57.848883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:57.853785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:25:57.854505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:25:57.855182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:25:58.161224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-803ee3a5-5d14-4a60-aba4-bf5c0ea1d414 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd99f550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:58.334811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-803ee3a5-5d14-4a60-aba4-bf5c0ea1d414 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.179012 Aug 21 01:25:58.338622 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1806/4158] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:58 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:25:59.350981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4867613-c344-4602-b54a-df013007147b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd0528b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:25:59.486938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4867613-c344-4602-b54a-df013007147b tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.140865 Aug 21 01:25:59.487529 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1807/4159] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:25:59 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:00.504020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a48b1774-08b7-47b0-bf0b-ce392f09916c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd873700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:00.642350 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a48b1774-08b7-47b0-bf0b-ce392f09916c tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.143603 Aug 21 01:26:00.643527 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1808/4160] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:00 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:00.715343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:00.741843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba5e1567-9c50-4f95-a066-9dbb62fcd504 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 2.958705 Aug 21 01:26:00.742463 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2353/4161] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:25:57 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 2963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:01.659388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a21ab423-bd99-40aa-9d22-1b67d4b5e6fb tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd126b80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:01.670548 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:01.671724 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:01.766589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:01.773721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:01.776620 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a21ab423-bd99-40aa-9d22-1b67d4b5e6fb tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.121728 Aug 21 01:26:01.782402 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1809/4162] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:01 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:01.791457 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:01.801730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:01.802332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:01.802860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:01.805919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:01.807956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:01.808851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:02.654530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:02.663948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d49d9a62-f73f-4829-ad0a-9fc27559e670 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.901196 Aug 21 01:26:02.671114 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2354/4163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:01 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:02.797067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33dafb92-716b-44af-b581-0002be5542d1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd99f700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:02.918400 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33dafb92-716b-44af-b581-0002be5542d1 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.125092 Aug 21 01:26:02.922565 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1810/4164] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:02 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:03.690070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:03.691872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:03.716959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:03.717954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:03.718629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:03.719637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:03.721437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:03.726364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:04.040751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-954181251", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "83e29afb-1a8c-4dbc-90e5-466dc9f262ce"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:04.211314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] validate_networks() for [('83e29afb-1a8c-4dbc-90e5-466dc9f262ce', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:26:05.239131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:05.286332 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b592667-7eb8-45fc-93d6-538c6a51e930 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1532 microversion: 2.1 time: 1.599460 Aug 21 01:26:05.301808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1811/4165] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:03 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1532 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:05.309223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67377193-238e-427a-84d9-478263986628 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fda0b550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:05.477223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67377193-238e-427a-84d9-478263986628 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.185293 Aug 21 01:26:05.483851 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1812/4166] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:05 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:05.597236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:26:05.600008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:26:05.601399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:26:05.602004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:26:05.605604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:26:05.619917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:05.620750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:05.621640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:05.622674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:05.623308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:05.624112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:05.658260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:05.674588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for user 949126b9470c418897afeacef01c275f and project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:05.698805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:26:05.702411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:26:05.790260 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0674f26d-dd21-4fb4-9a81-cc789928d850 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.298943 Aug 21 01:26:05.792495 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2355/4167] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:26:05.809341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b2accf8-79a0-41a4-818c-5eb4566a4ec8 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:05.810011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b2accf8-79a0-41a4-818c-5eb4566a4ec8 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:06.148096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b2accf8-79a0-41a4-818c-5eb4566a4ec8 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:06.160704 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b2accf8-79a0-41a4-818c-5eb4566a4ec8 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1217 microversion: 2.1 time: 0.361076 Aug 21 01:26:06.161355 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1813/4168] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:05 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1217 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:06.324943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:06.325582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:06.357680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.358181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.372907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:06.375150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.375663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.376098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:06.493414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b286c53c-1637-45ec-9444-7c3274181bf8 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9c29d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:06.603662 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b286c53c-1637-45ec-9444-7c3274181bf8 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.114344 Aug 21 01:26:06.625428 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1814/4169] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:06 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:06.661330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:06.662584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:06.719191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.726559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.735438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:06.738547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.747950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.750262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:06.863179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 HTTP/1.1 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '3458856f-60c0-41af-8823-196f07d19424'} Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:26:06.865016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:06.869600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:06.887135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ccd8b1b8-0b4a-4788-9a1b-1aa88bc0080d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 404 len: 111 microversion: 2.1 time: 0.232033 Aug 21 01:26:06.891077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1815/4170] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:26:06 2022] DELETE /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:06.915438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:06.916068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3458856f-60c0-41af-8823-196f07d19424] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:06.964842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.968530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.970065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:06.972466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:06.975086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:06.978712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:07.022372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 HTTP/1.1 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '3458856f-60c0-41af-8823-196f07d19424'} Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:07.024016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3458856f-60c0-41af-8823-196f07d19424 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:07.028134 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa1d1214-530d-4b7b-a0a6-677fb840dd5d tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424" status: 404 len: 111 microversion: 2.1 time: 0.134767 Aug 21 01:26:07.031629 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1816/4171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:06 2022] GET /compute/v2.1/servers/3458856f-60c0-41af-8823-196f07d19424 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:07.034005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:07.046631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14f575d7-4955-4333-ad71-cef73299618f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1532 microversion: 2.1 time: 0.740746 Aug 21 01:26:07.064538 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2356/4172] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:06 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1532 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:07.184955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:07.185570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:07.206472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:07.208178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:07.208881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:07.218629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:07.220230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:07.223174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:07.621347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e43c47c2-3fe4-4373-b5ae-02659f747f08 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f95e4430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:07.709860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e43c47c2-3fe4-4373-b5ae-02659f747f08 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.094856 Aug 21 01:26:07.719054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2357/4173] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:07 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:07.807220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:07.819428 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2b283a2-7834-4fd9-92d4-c171d740ae2b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1221 microversion: 2.1 time: 0.638839 Aug 21 01:26:07.823159 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1817/4174] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:07 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1221 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:08.072190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:08.073615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:08.107264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:08.108614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:08.111408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:08.112611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:08.116182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:08.116662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:08.731512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8809446c-0760-4830-b88f-1f4d1454a5ff tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fdb44f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:08.895014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8809446c-0760-4830-b88f-1f4d1454a5ff tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.167977 Aug 21 01:26:08.896218 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1818/4175] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:08 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:08.933655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:08.934382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:08.977129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:08.977702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:08.978200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:08.981630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:08.982142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:08.982578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:09.220095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:09.230498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94138cc1-ee9b-4eb0-9908-39006306507e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1275 microversion: 2.1 time: 0.333175 Aug 21 01:26:09.231113 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1819/4176] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:08 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:09.915044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b65fcab6-0220-413c-b52b-a99045253b53 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fdb443a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:10.015143 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b65fcab6-0220-413c-b52b-a99045253b53 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1429 microversion: 2.1 time: 0.107045 Aug 21 01:26:10.016581 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1820/4177] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:09 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:10.253041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:10.254039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:10.268532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:10.269843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:10.271612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:10.273125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:10.277116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:10.277824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:10.961265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:10.976918 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94b75be1-cdb0-4dc9-ba21-accf98b9ba5b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 0.727161 Aug 21 01:26:10.994991 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1821/4178] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:10 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:11.032795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e2dc36d-0d88-4f8b-b751-ea52cd650c60 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fdac0c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:11.291114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:11.302072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-510e148d-d7d8-4b8a-855f-153d527fd869 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1532 microversion: 2.1 time: 3.237459 Aug 21 01:26:11.303991 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2358/4179] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:08 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1532 bytes in 3240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:12.004154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:12.005064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:12.022123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:12.029557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:12.035505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:12.036489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:12.037131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:12.037738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:13.002376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:13.029513 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95fc4f5f-c602-40a9-b72d-814a71a838b4 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 1.029551 Aug 21 01:26:13.036564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2359/4180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:11 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:13.054447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:13.067997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:13.094485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:13.096710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:13.099667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:13.102874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:13.104211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:13.108690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:14.212856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:14.222337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c8de5363-e28d-42d8-9a8e-f0f6d2cb09e4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.184398 Aug 21 01:26:14.236883 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2360/4181] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:13 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:14.241947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:14.250032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:14.282465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:14.285971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:14.289892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:14.296399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:14.298506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:14.300016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:15.649895 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:15.693044 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:15.998347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:16.008515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-821c5953-81f6-4048-9cde-8d2978fc94a9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 1.770262 Aug 21 01:26:16.028581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2361/4182] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:14 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:16.036694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a16f3cb-090f-42f5-ac2f-126e2b60450a", "tag": "5b3d8124-4453-45eb-a291-8f381ef59527"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:16.066287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.067243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.069556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.096622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] Creating event network-changed:5b3d8124-4453-45eb-a291-8f381ef59527 for instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a on n-h1-master-1 Aug 21 01:26:16.111643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b1c1ef60-0c55-4c11-bcdd-a21535e17e58 req-8a046270-ac24-4171-a3e6-71c91f0aa0ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081384 Aug 21 01:26:16.112982 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2362/4183] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:16.128217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "name": "network-vif-plugged", "status": "completed", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:16.153154 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:16.161796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.163678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.165391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.194435 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] Creating event network-vif-plugged:ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18 for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be on n-h2-master-1 Aug 21 01:26:16.206511 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1e147ae8-d46e-44cb-9626-36e83040bd41 req-94ced141-247d-42b3-91e3-c4985ce1adab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091908 Aug 21 01:26:16.208751 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2363/4184] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:16.223451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:16.227024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:16.243912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.245241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.246514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.248015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.251392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.252590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.639412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:16.650818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5940e17-b980-4485-bed5-764fae8c2269 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 0.438940 Aug 21 01:26:16.658656 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2364/4185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:16 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:16.694714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:16.698512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:16.727380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.730035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.731808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.735202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.739791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.741417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.819949 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 HTTP/1.1 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3b529918-528f-4ae1-8f5b-552174a5c2e9'} Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:26:16.827928 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.831625 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.840617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:16.845237 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bef175c2-3390-4ac4-9cbc-17ea3492059c tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 404 len: 111 microversion: 2.1 time: 0.183622 Aug 21 01:26:16.857522 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2365/4186] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:26:16 2022] DELETE /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:16.872296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:16.879512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] [instance: 3b529918-528f-4ae1-8f5b-552174a5c2e9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:16.906331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.907163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.910481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.914250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:16.919395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:16.920405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:16.977950 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] HTTP exception thrown: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Request method failure captured: Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 HTTP/1.1 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYeboRHE6Y1I1H0VDkpx_hXiHi33rsN6Dozt3xr0rpV0-UqM3PEXTlPZOheckR_rmwtQGg_zH37Y-wrf0Dzh0ElzvpYjbtlRFffKuV3DUnY0Wt8i3rZAW78_0TRGBRxAF9QJprJatOpHpGkjgN8mrppffNSA5kJUysmQI9oqZQwm9UY Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fe917515a56c4577b45df3eb16642a2d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fe917515a56c4577b45df3eb16642a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fe917515a56c4577b45df3eb16642a2d"}]}] Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: fe917515a56c4577b45df3eb16642a2d Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524768535 Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 3338f52621ec4501b2f0b88ff5cb36fb Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeTestJSON-524768535-project Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3b529918-528f-4ae1-8f5b-552174a5c2e9'} Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:16.979740 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. Aug 21 01:26:16.983949 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:16.993785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] Returning 404 to user: Instance 3b529918-528f-4ae1-8f5b-552174a5c2e9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:16.994987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7f3286a-00c8-4cae-b870-1a9e50b21181 tempest-AttachVolumeTestJSON-524768535 tempest-AttachVolumeTestJSON-524768535-project] 10.222.0.46 "GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9" status: 404 len: 111 microversion: 2.1 time: 0.132931 Aug 21 01:26:16.995570 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2366/4187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:16 2022] GET /compute/v2.1/servers/3b529918-528f-4ae1-8f5b-552174a5c2e9 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:17.036823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:17.037728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:17.064546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:17.065098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:17.065545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:17.066291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:17.073273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:17.075266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:18.445046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:18.454278 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b36138c-99d7-4946-aee0-a767f28d427c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 1.422673 Aug 21 01:26:18.468935 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2367/4188] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:17 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:18.491899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:18.492539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:18.521473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:18.521871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:18.528255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:18.532270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:18.532753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:18.533212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:19.590470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:19.599985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7cf0c57-5082-443b-9eef-20aec380d601 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.129857 Aug 21 01:26:19.605564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2368/4189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:18 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:19.616118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:19.617048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:19.639575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:19.640309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:19.641025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:19.641884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:19.642686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:19.643418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:20.267777 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=16 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:20.972114 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:21.904538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:21.948597 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51975d0e-2146-4f25-8e20-67849169cc3b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 2.340203 Aug 21 01:26:21.949339 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2369/4190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:19 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:21.967457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:21.974382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:21.992909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:21.993812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:21.994455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:21.995392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:22.010154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:22.012385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:23.870755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:23.880858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-024d1736-ff47-45ed-9a41-cce6c9c4c63b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.926613 Aug 21 01:26:23.881441 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2370/4191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:21 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:23.901570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:23.904490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:23.926551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:23.929110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:23.935070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:23.936813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:23.937425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:23.938814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:25.168236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:25.194662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-320edeff-bf02-4013-9955-b2457ea10422 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 1.297096 Aug 21 01:26:25.205030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2371/4192] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:23 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:25.221117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:25.229274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:25.259984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:25.260428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:25.274436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:25.275915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:25.282065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:25.282844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:26.352539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:26.372546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9835b7ce-9e3a-4605-85ba-bff350840b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.161849 Aug 21 01:26:26.373528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2372/4193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:25 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:26.392800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:26.394711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:26.422870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:26.424436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:26.428926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:26.434319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:26.436077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:26.441630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:27.736638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:27.740222 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:27.756687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5d1a862-77eb-4baa-b2ed-54e6d655d0e2 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 1.379686 Aug 21 01:26:27.757641 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2373/4194] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:26 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:27.774408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:27.775792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:27.784571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:27.785356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:27.786717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:27.787635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:27.794726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:27.796081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:27.878344 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e2dc36d-0d88-4f8b-b751-ea52cd650c60 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1438 microversion: 2.1 time: 16.849779 Aug 21 01:26:27.879319 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1822/4195] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:11 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1438 bytes in 16851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:27.896745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd893ceb-7b92-4d52-94e0-acd619d40169 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fe17baf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:28.019801 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd893ceb-7b92-4d52-94e0-acd619d40169 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 200 len: 1438 microversion: 2.1 time: 0.127043 Aug 21 01:26:28.021419 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1823/4196] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:26:27 2022] GET /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:28.034955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:28.035791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:28.050983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:28.051722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:28.052310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:28.053540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:28.055318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:28.057029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:29.203112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:29.245234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:29.264417 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e164d468-f683-48ac-bb50-0cdb9a976249 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1479 microversion: 2.1 time: 1.233156 Aug 21 01:26:29.265354 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1824/4197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:28 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1479 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:29.268041 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-999597e8-bfed-4921-84a2-77d1b6194258 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.505550 Aug 21 01:26:29.268821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2374/4198] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:27 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:29.293870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:29.294973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:29.313535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:29.319239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:29.322848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:29.325135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:29.330406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:29.331131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:29.916488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:29.925271 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c5ee0138-feab-4e9e-a066-7b22768157c3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 0.658359 Aug 21 01:26:29.937527 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1825/4199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:29 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:30.060403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1417793522", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:30.155471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] validate_networks() for [('07d25e16-c3cd-4c95-be27-27ab4566e2ee', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:26:30.294000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:30.294000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:30.308544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:30.311470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:30.312141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:30.313132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:30.316143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:30.320024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:31.071055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:31.083711 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86ff43a9-559d-4ea3-8600-721e74a7b1ea tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1466 microversion: 2.1 time: 0.793927 Aug 21 01:26:31.085705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1826/4200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:30 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1466 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:31.115511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:31.116148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:31.142526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:31.586097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:31.603827 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d955cf72-5acd-40ed-a5f4-c5f20aa3f268 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 0.486075 Aug 21 01:26:31.607038 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1827/4201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:31 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:31.624426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:31.625371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:31.656339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:31.656875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:31.657378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:31.658761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:31.659218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:31.667459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:32.531732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:32.569374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a598db33-bb1b-4f84-ab09-29d22d1d0465 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 0.959148 Aug 21 01:26:32.588863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1828/4202] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:31 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:32.609990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffcc2d9e-dc4b-43ac-96f7-8ea928368d12 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3fd9d4d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:33.019803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:26:33.020878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:26:33.021820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:26:33.022442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:26:33.023062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:26:33.025521 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:33.078184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:33.086883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:33.087375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:33.088189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:33.100236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:33.100687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:33.310224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Getting quotas for project b5998151f0304fd48efd6b5956f27519. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:33.326529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Getting quotas for user f54784294b484ac48e28a0dd50e25222 and project b5998151f0304fd48efd6b5956f27519. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:33.396880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:26:33.401320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:26:33.587604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05eac788-fde8-4fa2-b113-bdb4bf5ee77b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.882423 Aug 21 01:26:33.589139 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2375/4203] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:26:33.605474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:33.610681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:33.624280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:33.627730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:33.629228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:33.650944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:33.651625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:33.652225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:34.360326 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffcc2d9e-dc4b-43ac-96f7-8ea928368d12 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "DELETE /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a" status: 204 len: 0 microversion: 2.1 time: 1.780251 Aug 21 01:26:34.361576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1829/4204] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:32 2022] DELETE /compute/v2.1/images/af26b7e6-2b12-4005-be01-54445fb0501a => generated 0 bytes in 1783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:26:34.369811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42f6e793-9d2e-4248-99c8-c9d4c0bc6a02 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:34.370716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42f6e793-9d2e-4248-99c8-c9d4c0bc6a02 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:34.506951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42f6e793-9d2e-4248-99c8-c9d4c0bc6a02 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:34.519098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42f6e793-9d2e-4248-99c8-c9d4c0bc6a02 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1224 microversion: 2.1 time: 0.153048 Aug 21 01:26:34.519667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1830/4205] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:34 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:34.532635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:34.537640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:34.559000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:34.559683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:34.560277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:34.561203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:34.561806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:34.562379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:34.591345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:34.600094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-44ad2dd1-ef09-49f3-b4f7-51e4b1473909 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.008131 Aug 21 01:26:34.605930 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2376/4206] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:33 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:34.616962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08bb40f8-ac89-4817-a24b-d92183a3867f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '.version_select at 0x7fc3f9e019d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:34.667724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-08bb40f8-ac89-4817-a24b-d92183a3867f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] HTTP exception thrown: Image not found. Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08bb40f8-ac89-4817-a24b-d92183a3867f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Request method failure captured: Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea HTTP/1.1 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYlQ3DzzbEpwz3w_S93TnNHuDWx7qeEaYtgwBt5iqy8roZuNPjNk2XZn_8pnZ2IVlX98fBWYUFF_fu2etI07yGOs8IEa1Fn05Mri-yVXtPr8vA6Dq0LdtEUlLgpNrrnN5TAnvTBGf__jWkMUWWv6VHYeeY9cO9BEA4wnoTRHACCAVMo Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fb877dddfba14fe3929b1267dee0e256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}] Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: ea86632bc35148a68dc7a10e194e184d Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5484383c-8a25-46e9-b062-257d6dc3d2ea'} Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5484383c-8a25-46e9-b062-257d6dc3d2ea to delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5484383c-8a25-46e9-b062-257d6dc3d2ea could not be found. Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.670029 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:26:34.673962 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:34.675987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08bb40f8-ac89-4817-a24b-d92183a3867f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:34.677257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08bb40f8-ac89-4817-a24b-d92183a3867f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "DELETE /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea" status: 404 len: 62 microversion: 2.1 time: 0.070116 Aug 21 01:26:34.678534 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2377/4207] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:34 2022] DELETE /compute/v2.1/images/5484383c-8a25-46e9-b062-257d6dc3d2ea => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:26:34.697496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:34.699461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:34.730519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:34.734394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:34.735110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:34.736043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:34.740063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:34.744493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:34.856223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:26:34.957935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:34.969917 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d5972c00-15bb-4392-a2a0-c359243dae88 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 0.447955 Aug 21 01:26:34.970429 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1831/4208] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:34 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:35.066532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10c04e44-4a1f-4ad7-933b-25bb7fdec0f2 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "DELETE /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 204 len: 0 microversion: 2.1 time: 0.383812 Aug 21 01:26:35.070359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2378/4209] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:26:34 2022] DELETE /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:26:35.076054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:35.077060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:35.087642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.090672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.091339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.101320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.102033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.102646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.395398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a16f3cb-090f-42f5-ac2f-126e2b60450a", "name": "network-vif-plugged", "status": "completed", "tag": "5b3d8124-4453-45eb-a291-8f381ef59527"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:35.413470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.419964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.420692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.475365 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] Creating event network-vif-plugged:5b3d8124-4453-45eb-a291-8f381ef59527 for instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a on n-h1-master-1 Aug 21 01:26:35.479845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:35.491308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9ce6741-1673-4f6a-b492-14592e4a4258 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1472 microversion: 2.1 time: 0.419268 Aug 21 01:26:35.497143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1832/4210] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:35 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:35.506769 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a5f44952-eca0-4add-a8d9-b0b3b767e9fc req-cf9db625-9780-47d9-85f3-40af4bfb5def service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117884 Aug 21 01:26:35.511231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2379/4211] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:26:35.539940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:35.541479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:35.563204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.563703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.564140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.564878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.576873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.577719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.627596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:35.628893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:35.646967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.647766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.651637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.652513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:35.653021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:35.653455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:35.800190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:35.811823 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dca86f88-0bc3-4de2-a3e8-0eb31a7cbb7c tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1276 microversion: 2.1 time: 0.275874 Aug 21 01:26:35.812438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1833/4212] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:35 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:35.991904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:35.992755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:36.009144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.009672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.010120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:36.021164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.021800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.022261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:36.567067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:36.590161 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13c5b36e-5b83-4b0c-911a-af509854ee8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 0.956374 Aug 21 01:26:36.593086 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2380/4213] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:35 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:36.595659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:36.604408 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5c3e0425-9bf6-4a23-9da5-33edfda3e5cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1317 microversion: 2.1 time: 0.617422 Aug 21 01:26:36.608478 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1834/4214] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:35 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:36.620629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:36.622220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:36.652537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.654171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.661670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:36.664987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.667212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.668663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:36.837810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:36.838472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:36.853575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.854377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.855874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:36.858562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:36.861944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:36.863104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:37.007431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:37.027895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a52b67b-00d9-46ff-ad22-3d6115224192 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1472 microversion: 2.1 time: 0.424351 Aug 21 01:26:37.045504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2381/4215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:36 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:37.208185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:37.220217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b3db68b-19e6-4a6d-9658-495e28786dde tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1276 microversion: 2.1 time: 0.387745 Aug 21 01:26:37.222414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1835/4216] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:36 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1276 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:37.614361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:37.615249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:37.629762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:37.630953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:37.636273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:37.640048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:37.645305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:37.646158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:37.647093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:37.647706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:37.648278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:37.654503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:37.659322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:37.660918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:37.661565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:37.662149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:38.117191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:38.146785 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-214b3f1d-232e-47f6-bbe8-a89109d8fd4b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1508 microversion: 2.1 time: 0.518936 Aug 21 01:26:38.148500 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1836/4217] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:37 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:38.163163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-unplugged", "status": "completed", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:38.190134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:38.221253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:38.222017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:38.262959 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] Creating event network-vif-unplugged:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:26:38.284640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2ea12a0b-399c-48e0-8b87-e98ff501d1e1 req-07f0c64d-40a4-4f7c-be2e-5ed9859dd4c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129315 Aug 21 01:26:38.287255 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1837/4218] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:38.302275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:38.315137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:38.338844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:38.341204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:38.342474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:38.346906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:38.348728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:38.355422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:38.842180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:38.855571 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1a9d46c-4eb5-4976-a065-4c1232d5651f tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1430 microversion: 2.1 time: 0.566612 Aug 21 01:26:38.856116 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1838/4219] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:38 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1430 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:38.867921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:38.868543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:38.909193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:38.909603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:38.910037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:38.910755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:38.911205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:38.911625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:39.429071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:39.501974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74d07350-7afe-4ea0-be87-6e8c331454af tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.879984 Aug 21 01:26:39.525602 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2382/4220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:37 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:39.536879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:39.554759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:39.559994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:39.574936 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cce2548e-c7d5-4abf-bdce-66eacc192bc3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1508 microversion: 2.1 time: 0.711890 Aug 21 01:26:39.576653 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1839/4221] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:38 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:39.593685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:39.598575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:39.605873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:39.610838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:39.612139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:39.618474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:39.632435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8", "name": "network-vif-deleted", "tag": "e8cf9285-ea72-4409-847d-4f0cb6989eda"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:39.707726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:39.713654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:39.714970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:39.803785 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] Creating event network-vif-deleted:e8cf9285-ea72-4409-847d-4f0cb6989eda for instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 on n-h2-master-1 Aug 21 01:26:39.838100 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f4f2c733-0e20-4525-96b1-9931c5cc0d3f req-2a44db06-46c6-4485-89b6-7b30c13fe128 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228176 Aug 21 01:26:39.841660 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1840/4222] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:39.899352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:39.950020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:39.991153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:39.993029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:39.996693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.000336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.011489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.016081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.119702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:40.129323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-beeae31f-e01e-424e-af4e-781fd65b307a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1282 microversion: 2.1 time: 0.601845 Aug 21 01:26:40.174992 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2383/4223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:39 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1282 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:40.192708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:40.196974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:40.263645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.264462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.264945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.265704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.266160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.266578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.457803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.458413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.458754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.465049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lazy-loading 'fault' on Instance uuid abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:26:40.495728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:26:40.496311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:26:40.507866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:26:40.508485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:26:40.512476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:26:40.769041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea86632bc35148a68dc7a10e194e184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb877dddfba14fe3929b1267dee0e256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:40.779294 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5405233-c929-47cf-a35f-452d02335f85 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 200 len: 1307 microversion: 2.1 time: 0.601091 Aug 21 01:26:40.783461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2384/4224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:40 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:40.790754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:40.799449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:40.800061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:40.807181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.808712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.809554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.811057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.811823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.812932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.843355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.844346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.846965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.848737 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:40.849780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.855759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.856254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf233696-375d-46c7-9236-37f8eff65a57 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "POST /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a/action" status: 202 len: 1110 microversion: 2.1 time: 0.993230 Aug 21 01:26:40.869402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.880818 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1841/4225] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:26:39 2022] POST /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a/action => generated 1110 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 21 01:26:40.888813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:40.889720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:40.901917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.903528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.904365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:40.905975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:40.915117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:40.915980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:41.204272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:41.216829 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97978168-9f6d-4153-9ae0-063fbd32519a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 0.431210 Aug 21 01:26:41.217450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2385/4226] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:41.645751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: .version_select at 0x7fc4032475e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1484973444", "policies": ["affinity"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:41.698513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:41.714577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:41.796650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:41.812748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:41.870873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1489bd91-ab55-4a79-824d-18370562fa22 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.650788 Aug 21 01:26:41.877270 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2386/4227] 10.222.0.46 () {60 vars in 1174 bytes} [Sun Aug 21 01:26:41 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:41.877558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:41.879064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:41.887615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:41.888272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:41.888928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:41.890219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:41.890885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:41.891413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:41.961196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:41.982397 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-102d0f94-a478-4df6-8653-b724843a2ba7 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 1.099841 Aug 21 01:26:41.995307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:41.997870 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1842/4228] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:40 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:42.007184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:42.007804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] [instance: abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:42.010065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a7a6b96-b5b0-42f4-8b9c-bb9b687fa4b6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1282 microversion: 2.1 time: 0.136199 Aug 21 01:26:42.011451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2387/4229] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:41 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:42.017057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: .version_select at 0x7fc3f95e2160>, body: {"server_group": {"name": "tempest-server-group-1799908152", "policies": ["affinity"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:42.018294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:42.018797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:42.019847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:42.022499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:42.031272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:42.033338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:42.076289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] HTTP exception thrown: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Request method failure captured: Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 HTTP/1.1 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYlQ3DzzbEpwz3w_S93TnNHuDWx7qeEaYtgwBt5iqy8roZuNPjNk2XZn_8pnZ2IVlX98fBWYUFF_fu2etI07yGOs8IEa1Fn05Mri-yVXtPr8vA6Dq0LdtEUlLgpNrrnN5TAnvTBGf__jWkMUWWv6VHYeeY9cO9BEA4wnoTRHACCAVMo Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fb877dddfba14fe3929b1267dee0e256", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fb877dddfba14fe3929b1267dee0e256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb877dddfba14fe3929b1267dee0e256"}]}] Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: fb877dddfba14fe3929b1267dee0e256 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2007362708 Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: ea86632bc35148a68dc7a10e194e184d Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesOneServerTestJSON-2007362708-project Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: exception: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8'} Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:42.080141 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. Aug 21 01:26:42.084029 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:42.089057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] Returning 404 to user: Instance abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:42.090306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d70dac52-6c4e-47be-a89d-225b5ed62ec9 tempest-ImagesOneServerTestJSON-2007362708 tempest-ImagesOneServerTestJSON-2007362708-project] 10.222.0.46 "GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8" status: 404 len: 111 microversion: 2.1 time: 0.091286 Aug 21 01:26:42.093804 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1843/4230] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:41 2022] GET /compute/v2.1/servers/abbcb4da-c62c-4a4c-a9d9-0cbf67fa02e8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:42.107672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:42.152016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:42.269728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:42.280694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:42.331211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd2cda25-59f1-4056-963c-ab0e844a0d89 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.318329 Aug 21 01:26:42.344813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2388/4231] 10.222.0.46 () {60 vars in 1173 bytes} [Sun Aug 21 01:26:42 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:42.353548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:42.354171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:42.380258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:42.387884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:42.388376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:42.389247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:42.389680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:42.390156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:42.881168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:42.908877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bdc11b4b-5693-407f-b0bf-88138f8e5a4d tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 0.559432 Aug 21 01:26:42.914758 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2389/4232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:42 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:42.936264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: .version_select at 0x7fc403247940>, body: {"server_group": {"name": "tempest-server-group-1799908152", "policies": ["affinity"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:42.955540 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:42.994078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:43.008846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:43.137267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-092e182e-a72e-4e9c-93b7-7eda91e16496 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Action: 'create', calling method: .version_select at 0x7fc3fd873b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1855058864", "metadata": {"Type": "work"}}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:43.140159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:43.149663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:43.171855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92407770-dc98-499b-a305-ee9e5cf39c82 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.253453 Aug 21 01:26:43.176697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2390/4233] 10.222.0.46 () {60 vars in 1173 bytes} [Sun Aug 21 01:26:42 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:43.185839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:43.189905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:43.200125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:43.200743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:43.201270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:43.202048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:43.202685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:43.203168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:43.232278 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:43.522968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:43.534043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db95ce0d-29f8-4f5f-9309-313cb6690d95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.356003 Aug 21 01:26:43.535036 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2391/4234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:43 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:43.540404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:43.541123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:43.577495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:43.577969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:43.578406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:43.579148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:43.579579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:43.580824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:43.787077 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-092e182e-a72e-4e9c-93b7-7eda91e16496 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.620829 Aug 21 01:26:43.788105 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1844/4235] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:26:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1623 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 21 01:26:43.796302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5773b988-4d62-40dc-bc57-39cb9fc37cc6 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:43.895329 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5773b988-4d62-40dc-bc57-39cb9fc37cc6 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/908955ec-e394-4a11-b9a1-9b5a7f5e474e" status: 204 len: 0 microversion: 2.1 time: 0.105762 Aug 21 01:26:43.896087 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1845/4236] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:26:43 2022] DELETE /compute/v2.1/os-server-groups/908955ec-e394-4a11-b9a1-9b5a7f5e474e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:26:43.912807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d757dc73-4aa9-4654-b9bf-f503b36b4292 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3feb63040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.011396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:44.023945 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-600e5248-903e-4b04-a7ef-9be6a0f54cbf tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.487765 Aug 21 01:26:44.028996 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2392/4237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:43 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:44.035196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d757dc73-4aa9-4654-b9bf-f503b36b4292 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 353 microversion: 2.1 time: 0.137148 Aug 21 01:26:44.035774 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1846/4238] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:43 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:44.038238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ea7b839-bf14-4cd9-8804-ec2ae88a9382 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.042133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.042903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:44.059839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:44.060633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:44.065034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:44.066130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:44.066758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:44.067347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:44.067839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ea7b839-bf14-4cd9-8804-ec2ae88a9382 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.033542 Aug 21 01:26:44.070675 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2393/4239] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:26:44 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:44.080240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-019c53e1-7443-412a-9591-b4ef5d0b7b32 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.160939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-019c53e1-7443-412a-9591-b4ef5d0b7b32 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/87639c7e-ab90-4ffc-a00f-4160fdd5bdf7" status: 204 len: 0 microversion: 2.1 time: 0.084411 Aug 21 01:26:44.162274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2394/4240] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:26:44 2022] DELETE /compute/v2.1/os-server-groups/87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:26:44.174295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eedae0c2-61d4-4697-975e-604f6540fe1c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.195209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eedae0c2-61d4-4697-975e-604f6540fe1c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026815 Aug 21 01:26:44.196850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2395/4241] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:26:44 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:44.219583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: .version_select at 0x7fc3fa5ab700>, body: {"server_group": {"name": "tempest-server-group-657625778", "policies": ["affinity"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:44.254988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:44.281933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:44.408479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:44.434817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:44.510043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-794ee62c-2af8-4494-8ba5-5ecaba67dd3b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.295582 Aug 21 01:26:44.512023 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:44.521955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2396/4242] 10.222.0.46 () {60 vars in 1173 bytes} [Sun Aug 21 01:26:44 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:44.532121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bcff445-f0ca-477d-b6fe-0be37fd81f09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.611053 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bcff445-f0ca-477d-b6fe-0be37fd81f09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/400e8ecd-69ab-4e35-8742-257172b40776" status: 204 len: 0 microversion: 2.1 time: 0.086842 Aug 21 01:26:44.612956 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2397/4243] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:26:44 2022] DELETE /compute/v2.1/os-server-groups/400e8ecd-69ab-4e35-8742-257172b40776 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:26:44.620240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:44.621420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:44.629658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:44.630493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:44.631311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:44.632510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:44.633376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:44.634247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:45.009397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:45.016714 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:45.040706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc00bb1d-1889-4afc-abc1-ba29b61b6987 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.425076 Aug 21 01:26:45.044604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2398/4244] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:44 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:45.085597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1627e991-e335-4cd8-aa68-5e0ecc5d3473 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:45.130530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1627e991-e335-4cd8-aa68-5e0ecc5d3473 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.066102 Aug 21 01:26:45.131552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2399/4245] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:26:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:45.161754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:45.162388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:45.198799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:45.200280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:45.200754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:45.204645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:45.205166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:45.205607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:45.209976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:45.218308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-850ab102-a02a-4f69-a5ce-4a7ed08a6b92 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1527 microversion: 2.1 time: 1.181389 Aug 21 01:26:45.221843 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1847/4246] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:44 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1527 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:45.233885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3985c54e-3c56-4dd7-8057-b45978756ff3 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fe371d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:45.486571 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3985c54e-3c56-4dd7-8057-b45978756ff3 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 353 microversion: 2.1 time: 0.256618 Aug 21 01:26:45.487309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1848/4247] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:45 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 353 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:45.492356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: .version_select at 0x7fc3fd9d45e0>, body: {"server_group": {"name": "tempest-server-group-1332450127", "policies": ["anti-affinity"]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:45.562873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:45.584274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:45.710580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:45.720895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_groups'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:45.761104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af33d417-fad9-4c6a-985e-b42fd7a5ba96 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.272133 Aug 21 01:26:45.765320 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1849/4248] 10.222.0.46 () {60 vars in 1173 bytes} [Sun Aug 21 01:26:45 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:45.788190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a80ac49-bf06-416b-ba11-a181a1283c9d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:45.856204 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a80ac49-bf06-416b-ba11-a181a1283c9d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/5bd9d1cb-abaa-4f72-99fb-c6fc28061293" status: 204 len: 0 microversion: 2.1 time: 0.080489 Aug 21 01:26:45.857611 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1850/4249] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:26:45 2022] DELETE /compute/v2.1/os-server-groups/5bd9d1cb-abaa-4f72-99fb-c6fc28061293 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:26:45.871816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64ec87c0-96b3-4394-85c2-6de24462b2f4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:45.900502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64ec87c0-96b3-4394-85c2-6de24462b2f4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037204 Aug 21 01:26:45.912803 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1851/4250] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:26:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:46.005363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:46.021984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2bde78d-5b4f-4195-9e13-5385d9d14b0a tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.886041 Aug 21 01:26:46.027839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2400/4251] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:45 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:46.074361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:46.075073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:46.100122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:46.103111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:46.105570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:46.108561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:46.109071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:46.114298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:46.206916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-302402054", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "95d55705-2a01-4066-b3a4-eb2d95f21359"}]}, "os:scheduler_hints": {"group": "d8c1fb12-4034-494e-b366-35b687751b26"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:46.320718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] validate_networks() for [('95d55705-2a01-4066-b3a4-eb2d95f21359', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:26:47.055134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:47.066517 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10d4a1b2-0fb5-4c26-8153-1b44240f1cd9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.998748 Aug 21 01:26:47.070050 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1852/4252] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:46 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:47.081272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:47.083410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:47.105971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:47.107035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:47.109791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:47.110606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:47.117718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:47.118439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:47.883566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:47.891006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:26:47.892106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:26:47.892823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:26:47.893442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:26:47.894108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:26:47.908819 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72bab743-f51e-4225-8d5f-f90c1b494313 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1509 microversion: 2.1 time: 0.835627 Aug 21 01:26:47.929195 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1853/4253] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:47 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1509 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:47.937924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ba03ccd-a2a6-4f19-a085-0ee4de80a6c0 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fd9c6ee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:47.948445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:47.956224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:47.957335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:47.959110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:47.959839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:47.960472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:47.983469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:47.990194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:48.005567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:26:48.008637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:26:48.092746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ba03ccd-a2a6-4f19-a085-0ee4de80a6c0 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 354 microversion: 2.1 time: 0.161791 Aug 21 01:26:48.093433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1854/4254] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:47 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:48.098363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:48.102702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:48.122812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:48.123553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:48.124372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:48.128217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:48.129446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:48.130923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:48.137531 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:48.195528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:48.214606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:48.334205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for project b07c7490e08043f89ea40531d634b859. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:26:48.341086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Getting quotas for user 19a35912e003492288b68566b677b0da and project b07c7490e08043f89ea40531d634b859. Resources: {'server_group_members'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:26:48.437390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e28cf8f-a85e-49c2-ac57-4e620ca5916c tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235585 Aug 21 01:26:48.440300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2401/4255] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:26:48.456421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e", "tag": "2015dd01-4c9f-4fa8-a229-9f2b18c2f19a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:48.480263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:48.481631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:48.484704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:48.506873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] Creating event network-changed:2015dd01-4c9f-4fa8-a229-9f2b18c2f19a for instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e on n-h2-master-1 Aug 21 01:26:48.512407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-426ae658-aa03-489f-99b3-f6dfbcc75229 req-43314d27-cb80-47fc-8c01-e315308618a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069841 Aug 21 01:26:48.527841 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2402/4256] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:48.536263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:48.543226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:48.553176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:48.554009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:48.554717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:48.555706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:48.556396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:48.557045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:48.831044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:48.854270 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-61871cff-3e80-48e1-8035-1d2701439b7b tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.759358 Aug 21 01:26:48.861235 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1855/4257] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:48 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:48.867028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39fa2bfb-704a-444e-bb69-30c887ec47e7 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fe842700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.008978 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39fa2bfb-704a-444e-bb69-30c887ec47e7 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 354 microversion: 2.1 time: 0.145907 Aug 21 01:26:49.009940 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1856/4258] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:48 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:49.016099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d8f77bc-39f2-4541-b101-9ef5b9d3060f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.016833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2d8f77bc-39f2-4541-b101-9ef5b9d3060f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:49.073801 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:49.204207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d8f77bc-39f2-4541-b101-9ef5b9d3060f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:49.251570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d8f77bc-39f2-4541-b101-9ef5b9d3060f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1212 microversion: 2.1 time: 0.240441 Aug 21 01:26:49.257517 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1857/4259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:49 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1212 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:49.264868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.265818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:49.272549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:49.273635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:49.274838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:49.275756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:49.276406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:49.277056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:49.471193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:49.487282 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c8a1a22-e157-4989-bf71-e72781b5d282 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.956821 Aug 21 01:26:49.488846 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2403/4260] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:48 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:49.500953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05e2d652-6b76-4926-89f5-16ca58d2fa4c tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3f950d940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.745543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05e2d652-6b76-4926-89f5-16ca58d2fa4c tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 202 len: 0 microversion: 2.1 time: 0.252325 Aug 21 01:26:49.746475 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2404/4261] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:26:49 2022] DELETE /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:26:49.755953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "name": "network-vif-unplugged", "status": "completed", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:49.796710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:49.797916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:49.799463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:49.825751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_external_events [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] Unable to find a host for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be. Dropping event network-vif-unplugged {{(pid=122482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 01:26:49.828532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3e6e4ffb-1363-4df6-8444-c4626b32621d req-bdedd76b-73dd-4589-a533-8f517a879a64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079502 Aug 21 01:26:49.829973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2405/4262] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 01:26:49.852908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b06489b5-9a29-4fd5-a2e7-e5b2c7f30ba2 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fa253040>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.972600 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b06489b5-9a29-4fd5-a2e7-e5b2c7f30ba2 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 353 microversion: 2.1 time: 0.141162 Aug 21 01:26:49.973834 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2406/4263] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:49 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:49.980141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:49.981774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:49.998246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.000416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.002175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:50.003526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.006894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.008582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:50.209026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:50.227577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00808fcd-2da6-4569-9ecd-34e2f4e17cf7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1452 microversion: 2.1 time: 0.968591 Aug 21 01:26:50.232479 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1858/4264] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:49 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1452 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:50.249809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:50.253600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:50.269863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.272063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.275285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:50.276624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.283372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.284097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:50.791886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:50.806593 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-101a396d-a0fe-4aed-83d3-9bd8df832e89 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.829072 Aug 21 01:26:50.809372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2407/4265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:49 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:50.815393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:50.816520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:50.835712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.837825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.839561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:50.841275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:50.842990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:50.843664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.141727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:51.161647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:51.168322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-514d3aad-e456-46f7-a060-85527c971e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1270 microversion: 2.1 time: 0.354236 Aug 21 01:26:51.171640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b77ed5cc-b16f-4fa6-93f4-e924f8035e9e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1452 microversion: 2.1 time: 0.925775 Aug 21 01:26:51.172407 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1859/4266] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:50 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1452 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:51.179300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:51.184512 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2408/4267] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:50 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1270 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:51.185644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:51.205061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.205547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.205977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.206669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.207117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.207533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.216575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c959207b-d3af-418f-b5ef-c0e802504a49 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3f9d00f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:51.347411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c959207b-d3af-418f-b5ef-c0e802504a49 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 353 microversion: 2.1 time: 0.160441 Aug 21 01:26:51.348216 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2409/4268] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:51 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:51.354075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:51.355061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:51.370408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.371248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.371929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.375905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.376788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.377431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.451421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lazy-loading 'flavor' on Instance uuid 7b499cf8-c55e-42d3-becc-1e2c05db75be {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:26:51.480619 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'shelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state shelved_offloaded Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 14 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: {"shelve": {}} Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'shelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state shelved_offloaded Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'shelve': {}}} Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:26:51.487154 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state shelved_offloaded Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state shelved_offloaded Aug 21 01:26:51.490912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:26:51.494032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'shelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state shelved_offloaded {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:51.497529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3419cd92-97b8-4ba2-8fde-d123e46acb6f tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 155 microversion: 2.1 time: 0.146995 Aug 21 01:26:51.500559 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2410/4269] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:26:51 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 155 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:26:51.511887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:51.516941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:51.537066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.537765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.538386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.539455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.540057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.540671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.598230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:51.613443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed879577-7120-4912-882c-e52ed16113cd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.437601 Aug 21 01:26:51.614263 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1860/4270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:51 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:51.695926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122482) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 21 01:26:51.834188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:51.835170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:51.856189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.856806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.859978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.863926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.865579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.870692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.919290 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-474a5316-522e-475b-b6a6-9082e1ce978b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.414173 Aug 21 01:26:51.925125 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2411/4271] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:26:51 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:26:51.940531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:51.946947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:51.970466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.974453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.976510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:51.977651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:51.980002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:51.982554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:52.589262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:52.601555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8975f22c-47d8-4ead-bf1f-ea96cb11ce3d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.772656 Aug 21 01:26:52.603208 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1861/4272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:51 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:52.635486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:52.636225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:52.650561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:52.651082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:52.652728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:52.655408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:52.655952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:52.656384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:53.121282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:53.130550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc283427-eb6e-4465-baf4-75a937162a2b tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1270 microversion: 2.1 time: 0.515390 Aug 21 01:26:53.133937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1862/4273] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:52 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1270 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:53.157151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-026b3fd3-3a7f-4208-a672-ef93200dd9e2 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fdcd75e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:53.235870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:53.264518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3677e843-0079-4ae4-8191-45c584b0b4a7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1460 microversion: 2.1 time: 1.321839 Aug 21 01:26:53.266133 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2412/4274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:51 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1460 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:53.291267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:53.292353 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-026b3fd3-3a7f-4208-a672-ef93200dd9e2 tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 200 len: 353 microversion: 2.1 time: 0.156635 Aug 21 01:26:53.292931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:53.301957 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1863/4275] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:53 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:53.305571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:53.306067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:53.306506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:53.307571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:53.318342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:53.319174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:53.631493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:53.632160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:53.684369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:53.684853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:53.685303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:53.695758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:53.697238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:53.698001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:53.869884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:53.902713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2bb03fa3-3b1a-4447-858b-e9ffc39d3686 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.635954 Aug 21 01:26:53.905812 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2413/4276] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:53 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:54.167374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:54.168126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:54.202750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:54.203263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:54.203706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:54.206484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:54.217562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:54.220702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:54.275007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:54.288560 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5796e28b-7bb7-4eeb-866f-1cee65e69916 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.665460 Aug 21 01:26:54.291678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1864/4277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:53 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:54.306516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:54.307909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:54.323478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:54.324665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:54.326626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:54.327529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:54.328430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:54.329070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:55.412803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:55.435334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02c1f053-30fa-4867-8659-a0c01e654a1b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1460 microversion: 2.1 time: 1.142197 Aug 21 01:26:55.435932 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1865/4278] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:54 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1460 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:55.463184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98f9198a-e0ef-4c72-8bd9-6970315ac5cc tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Calling method '.version_select at 0x7fc3fdeb68b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:55.495478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:55.506188 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c6d9a32-517c-4b90-adfb-2b3c31854720 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 1.344335 Aug 21 01:26:55.520796 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-98f9198a-e0ef-4c72-8bd9-6970315ac5cc tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] HTTP exception thrown: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98f9198a-e0ef-4c72-8bd9-6970315ac5cc tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Request method failure captured: Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 HTTP/1.1 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnROrrR-41Ravh9RZs7O5cGY0D_NvNn9xhEc1bygG5M02rZbntRhEJR0JpCjgYSCEr14aRyiCObETjX-IYunjJpqIKe8t6MMhkUy2Jmw20R2mgQvym-7R-rT6M7RncP4JCpWNO3O39D99o7eEx-uY8g-BnWP3jsql2Nc2QFM1qiC8s Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: ae5843fcb4094624be80c2b88298e66a Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesGetTestJSON-932181864 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ae5843fcb4094624be80c2b88298e66a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ae5843fcb4094624be80c2b88298e66a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ae5843fcb4094624be80c2b88298e66a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ae5843fcb4094624be80c2b88298e66a"}]}] Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesGetTestJSON-932181864 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: ae5843fcb4094624be80c2b88298e66a Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesGetTestJSON-932181864 Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesGetTestJSON-932181864-project Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 13fb37fb933645f68ddaef25715083de Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesGetTestJSON-932181864-project Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: exception: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '19bccf6d-195b-46ec-84c0-c1579c968847'} Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. (HTTP 404) (Request-ID: req-8b448f30-9e4e-49b5-ae60-60fb05640cdb) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:26:55.522764 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:26:55.527210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98f9198a-e0ef-4c72-8bd9-6970315ac5cc tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] Returning 404 to user: Volume 19bccf6d-195b-46ec-84c0-c1579c968847 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:26:55.530359 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2414/4279] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:54 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:55.530889 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-98f9198a-e0ef-4c72-8bd9-6970315ac5cc tempest-VolumesGetTestJSON-932181864 tempest-VolumesGetTestJSON-932181864-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847" status: 404 len: 109 microversion: 2.1 time: 0.087346 Aug 21 01:26:55.531080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:55.535067 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1866/4280] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:26:55 2022] GET /compute/v2.1/os-volumes/19bccf6d-195b-46ec-84c0-c1579c968847 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:26:55.538652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:55.546501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:55.559222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:55.565228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:55.565986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:55.570956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:55.572065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:55.573750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:55.574628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:55.585585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:55.586117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:55.586654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:55.600168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:55.603528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:55.604028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:56.282076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:56.293934 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2903070-3ac9-4b75-b967-bafd590d995c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.769032 Aug 21 01:26:56.310130 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2415/4281] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:55 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:56.456711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:56.457344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:56.466970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:56.470701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:56.473981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:56.474917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:56.475657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:56.476256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:56.708270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:56.717723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-219e005b-9537-46c4-883d-b6f98b6e02a6 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 1.181481 Aug 21 01:26:56.723054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1867/4282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:55 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:56.737091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:56.737091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:56.750733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:56.751475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:56.755801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:56.756690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:56.757305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:56.757866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:56.959762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:56.972997 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6c655c1-0b88-4a2d-bf7e-d7b3f8233e7e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.520301 Aug 21 01:26:56.974877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2416/4283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:56 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:57.195870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:57.211248 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0226452d-961f-4927-befe-e81448b7b422 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.486968 Aug 21 01:26:57.224693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1868/4284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:56 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:57.327407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:57.328027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:57.340136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:57.340620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:57.341081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:57.346718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:57.347238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:57.347672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:57.753866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:57.755095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:57.774642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:57.775402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:57.776297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:57.777378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:57.779314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:57.779972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:57.921528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:57.938090 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4864aefd-eca9-406a-9f85-f0217797630a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.618082 Aug 21 01:26:57.952681 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2417/4285] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:57 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:58.000065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:58.000894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:58.009419 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:58.018432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.021493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.022108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.024801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.027937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.028577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.371199 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=52 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:58.414876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:58.428403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-25d7d3b2-2d65-49b2-ad3e-836236a98cfb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.679209 Aug 21 01:26:58.432554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1869/4286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:57 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:26:58.443710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae58e535-c3ba-47de-ba78-7d910d80cadd", "tag": "62e2ad9a-1ec8-4f39-82db-616e1c80d213"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:26:58.468892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.469733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.471945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.505403 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] Creating event network-changed:62e2ad9a-1ec8-4f39-82db-616e1c80d213 for instance ae58e535-c3ba-47de-ba78-7d910d80cadd on n-h1-master-1 Aug 21 01:26:58.517565 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ffa85bf5-2b9d-410a-ba15-b10c31052048 req-a698c366-5565-4ec6-b2a9-85c5a8178afc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082578 Aug 21 01:26:58.521414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1870/4287] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:26:58.527340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:58.528404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:58.542576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.543754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.544452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.546565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.553524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.554157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.613758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:58.621899 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41b29f68-d38b-4b34-8ddd-f02e6dd399d1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.626369 Aug 21 01:26:58.633738 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2418/4288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:57 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:58.952712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:58.959251 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:58.961891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:58.962748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:58.964150 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0142ef2b-30d3-454a-b19b-1d6254bd62d7 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.441304 Aug 21 01:26:58.971519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.972290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.973489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.974583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:58.975515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:58.975952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:58.977645 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1871/4289] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:58 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:59.461685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:59.462327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:59.472565 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:26:59.488995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:59.492343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:59.493596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:59.495467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:59.498266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:59.498724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:59.548047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:26:59.562516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5ff83b6-980b-4ad1-b164-9470a5e57a9c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1515 microversion: 2.1 time: 0.606699 Aug 21 01:26:59.563450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2419/4290] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:58 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:26:59.646800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:26:59.647449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:26:59.666843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:59.667602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:59.668043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:59.668790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:26:59.669247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:26:59.669665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:26:59.726359 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:00.840152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:00.857858 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f068c9b-4556-4cb3-94b0-089866751132 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 1.214868 Aug 21 01:27:00.859807 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2420/4291] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:59 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:00.894331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:00.895343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:00.910689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:00.913017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:00.915568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:00.919293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:00.922174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:00.923852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:01.567910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:01.578596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70d1859f-4d33-477d-9a20-76da927e490d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 2.126541 Aug 21 01:27:01.584533 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1872/4292] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:26:59 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:01.599680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e", "name": "network-vif-plugged", "status": "completed", "tag": "2015dd01-4c9f-4fa8-a229-9f2b18c2f19a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:01.669092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:01.669943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:01.670484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:01.695843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:01.704374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d138b1d-95da-47a6-84ea-c0c4f9d9d841 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.820632 Aug 21 01:27:01.705052 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2421/4293] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:00 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:01.736713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:01.754292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:01.757687 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] Creating event network-vif-plugged:2015dd01-4c9f-4fa8-a229-9f2b18c2f19a for instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e on n-h2-master-1 Aug 21 01:27:01.779195 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-beee6de1-e6b4-497b-b7d4-c051371f1c41 req-ce2bf84a-9728-4e77-b58b-106b29b28bb9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182868 Aug 21 01:27:01.781724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:01.782385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:01.784410 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1873/4294] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:01.786121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:01.788210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:01.791401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:01.794318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:01.888670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:01.903128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:01.927015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:01.927526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:01.927961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:01.928753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:01.929487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:01.930166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:02.547281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:02.563754 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-355a7fa4-7c81-4a0b-98ec-2b46c24c640c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1521 microversion: 2.1 time: 0.857556 Aug 21 01:27:02.586150 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2422/4295] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:01 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1521 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:02.617021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:02.619191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:02.644075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:02.648587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:02.649568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:02.649968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:02.661497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:02.662347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:02.663690 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3bc07e03-a263-41b7-9e8f-09d21dcb8c56 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.784250 Aug 21 01:27:02.665416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:02.675068 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1874/4296] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:01 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:02.726277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:02.727219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:02.750370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:02.762615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:02.766877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:02.768959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:02.772915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:02.773883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:03.547688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:03.583666 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd2dbbcb-941c-41b8-b582-58e0818b0397 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.980077 Aug 21 01:27:03.588941 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2423/4297] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:02 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:03.614079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:03.614699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:03.650362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:03.650858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:03.656162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:03.660966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:03.661738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:03.662545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:04.116300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:04.126248 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cab275f3-04b5-4053-bb0b-c709108c459f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 1.404579 Aug 21 01:27:04.131933 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1875/4298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:02 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:04.137595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:04.147043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:04.165421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:04.166296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:04.170176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:04.171221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:04.173198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:04.177506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:04.775096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:04.801263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be3bac8d-f525-4c36-acbe-383904864efc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.667515 Aug 21 01:27:04.802176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1876/4299] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:04 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:04.812983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2aeff02-f9df-4648-a5d8-4144d80ff021 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3fd9d4040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:04.988019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2aeff02-f9df-4648-a5d8-4144d80ff021 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3621b62f-5467-4ffa-9a8b-768d95d9db3e" status: 200 len: 349 microversion: 2.1 time: 0.184746 Aug 21 01:27:04.997602 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1877/4300] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:27:04 2022] GET /compute/v2.1/os-volumes/3621b62f-5467-4ffa-9a8b-768d95d9db3e => generated 349 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:05.003620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:05.004401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:05.030473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:05.032174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:05.037985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:05.039262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:05.040273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:05.040903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:05.099987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:05.113910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a80f9111-9bf3-4a8c-a5a4-48d53682328c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1521 microversion: 2.1 time: 1.523638 Aug 21 01:27:05.117087 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2424/4301] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:03 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1521 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:05.155713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:05.156497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:05.171513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:05.172229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:05.175449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:05.185708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:05.186323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:05.187010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:05.421881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:05.439356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-850ba47e-b675-4b3a-b865-7aa362bcb195 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1324 microversion: 2.1 time: 0.440050 Aug 21 01:27:05.440946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1878/4302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:04 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:05.995474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-283044587", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "a43710e8-0478-4e33-b824-c541f642d410"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:06.029383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:06.042869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c331777-e379-4e57-8ee2-beb219855c8e tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.889546 Aug 21 01:27:06.044193 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2425/4303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:05 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:06.059943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:06.060906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:06.076737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:06.077559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:06.078159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:06.081990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:06.082699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:06.083290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:06.212787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] validate_networks() for [('a43710e8-0478-4e33-b824-c541f642d410', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:27:06.606034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:06.627232 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c1c888a-7703-439d-adad-f424ebd78d82 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.574515 Aug 21 01:27:06.643890 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2426/4304] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:06 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:06.664901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:06.665889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:06.694990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:06.696430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:06.703840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:06.705037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:06.705670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:06.706279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:07.202305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:07.211832 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13c10149-bba1-40a2-9608-fb9b0ff3888e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1521 microversion: 2.1 time: 0.566404 Aug 21 01:27:07.222317 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2427/4305] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:06 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:07.227808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:07.229505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:07.248880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:07.249859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:07.250523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:07.251461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:07.252063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:07.252636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:07.571143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:07.579910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6c9d91c-bbbe-4e5e-b744-d0c2fed0a1eb tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1521 microversion: 2.1 time: 0.356153 Aug 21 01:27:07.580511 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2428/4306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:07 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:07.590201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a16f3cb-090f-42f5-ac2f-126e2b60450a", "name": "network-vif-plugged", "status": "completed", "tag": "5b3d8124-4453-45eb-a291-8f381ef59527"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:07.669798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:07.670519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:07.693327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:07.727199 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] Creating event network-vif-plugged:5b3d8124-4453-45eb-a291-8f381ef59527 for instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a on n-h1-master-1 Aug 21 01:27:07.738539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0b4365ef-387d-4239-a256-fa590cddcac8 req-b7085280-2b08-40d9-9789-bfb6bd46ff78 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149118 Aug 21 01:27:07.742112 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2429/4307] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:07.757144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:07.766241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:07.792236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:07.794126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:07.795686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:07.806854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:07.808001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:07.808669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.240703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:08.254019 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d1f8510-dfed-4396-8a09-476519ac9035 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.500928 Aug 21 01:27:08.272844 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2430/4308] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:07 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:08.281184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:08.283306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:08.306345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.309789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.310514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.313580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.315106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.316710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.635838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:27:08.636935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:27:08.638296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:27:08.638938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:27:08.639631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:27:08.644429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:08.659086 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa3f9ae6-e79e-46f3-b462-d0aad61e3193 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.382533 Aug 21 01:27:08.661188 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2431/4309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:08 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:08.666176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.667925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a690319-a8e8-4854-a488-8cf3dc64aae7 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-36978928", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:08.668693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.669462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.673042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.673758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a690319-a8e8-4854-a488-8cf3dc64aae7 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 241 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-36978928", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-36978928', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '07d25e16-c3cd-4c95-be27-27ab4566e2ee'}]}}} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:08.673908 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:08.678094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a690319-a8e8-4854-a488-8cf3dc64aae7 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:08.681457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.684381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a690319-a8e8-4854-a488-8cf3dc64aae7 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021836 Aug 21 01:27:08.685653 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2432/4310] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:08 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:08.702705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76168d0d-fd9d-4d52-8e49-c5ee6530daaa tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc403195940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:08.767900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:27:08.799461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for user d35661d01cfb4f8d90ea78c7c7ead1b6 and project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:27:08.819495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:27:08.831134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:27:08.859055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76168d0d-fd9d-4d52-8e49-c5ee6530daaa tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/caf088e7-3729-43b2-b84c-307cd43816cd" status: 200 len: 350 microversion: 2.1 time: 0.170477 Aug 21 01:27:08.859055 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2433/4311] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:27:08 2022] GET /compute/v2.1/os-volumes/caf088e7-3729-43b2-b84c-307cd43816cd => generated 350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:08.870526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:08.873098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:08.912674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.913310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.913939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.914989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:08.925053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:08.937652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:08.987154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d58d6a24-504a-4a0e-9284-63ddfabe5d1f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.495748 Aug 21 01:27:08.998183 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1879/4312] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:27:09.015122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:09.019895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: c42cd9dc-db19-4156-8528-6300275f1c77] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:09.045487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] HTTP exception thrown: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/c42cd9dc-db19-4156-8528-6300275f1c77/metadata HTTP/1.1 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'c42cd9dc-db19-4156-8528-6300275f1c77'} Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.053061 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.057592 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:09.057592 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:09.057592 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. Aug 21 01:27:09.057592 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.060058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 404 to user: Instance c42cd9dc-db19-4156-8528-6300275f1c77 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:09.061406 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-894d98a9-7263-4720-8239-2390e845583d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/c42cd9dc-db19-4156-8528-6300275f1c77/metadata" status: 404 len: 111 microversion: 2.1 time: 0.061868 Aug 21 01:27:09.063916 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1880/4313] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:27:08 2022] GET /compute/v2.1/servers/c42cd9dc-db19-4156-8528-6300275f1c77/metadata => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:09.095752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa0e8515-11c6-4007-8f14-49a31670fa5c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:09.096433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa0e8515-11c6-4007-8f14-49a31670fa5c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:09.374256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:09.416398 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb1aa003-4bd8-4420-b57e-0b979c466372 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1521 microversion: 2.1 time: 0.553528 Aug 21 01:27:09.417743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2434/4314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:08 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:09.424132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efba3c2-a038-4c9d-873e-9c7f944fcdcc tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1302858", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efba3c2-a038-4c9d-873e-9c7f944fcdcc tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 496 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1302858", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1302858', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '07d25e16-c3cd-4c95-be27-27ab4566e2ee'}]}}} Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:09.430905 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.434057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.438774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fa0e8515-11c6-4007-8f14-49a31670fa5c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:09.439780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa0e8515-11c6-4007-8f14-49a31670fa5c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1224 microversion: 2.1 time: 0.374685 Aug 21 01:27:09.446426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1881/4315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:09 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1224 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:09.448982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efba3c2-a038-4c9d-873e-9c7f944fcdcc tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:09.450946 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8efba3c2-a038-4c9d-873e-9c7f944fcdcc tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031193 Aug 21 01:27:09.451774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2435/4316] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:09 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:09.456847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:09.457920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:09.476310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:09.477694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:09.478227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:09.479014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:09.480056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:09.481318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:09.539474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6f754c8-884e-4f67-a507-ea7f7635d80d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-840543392", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6f754c8-884e-4f67-a507-ea7f7635d80d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 499 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-840543392", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-840543392', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '07d25e16-c3cd-4c95-be27-27ab4566e2ee'}]}}} Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:09.553081 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6f754c8-884e-4f67-a507-ea7f7635d80d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:09.556218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6f754c8-884e-4f67-a507-ea7f7635d80d tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030267 Aug 21 01:27:09.577172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2436/4317] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:09 2022] POST /compute/v2.1/servers => generated 689 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:09.672066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cff503e6-2e99-438e-8f66-2f7d7fd39ea9 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-173656815", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cff503e6-2e99-438e-8f66-2f7d7fd39ea9 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 753 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-173656815", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-173656815', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '07d25e16-c3cd-4c95-be27-27ab4566e2ee'}]}}} Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:09.677520 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:09.681188 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:09.683964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:09.683964 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:09.683964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cff503e6-2e99-438e-8f66-2f7d7fd39ea9 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:09.683964 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cff503e6-2e99-438e-8f66-2f7d7fd39ea9 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022308 Aug 21 01:27:09.696305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2437/4318] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:09 2022] POST /compute/v2.1/servers => generated 1197 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 21 01:27:09.711084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:09.712331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:09.719832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:09.720639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:09.721327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:09.722528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:09.723236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:09.723889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.150561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:10.167520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-079c20d6-6f52-46fc-a34d-de5bc5f38b63 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.719843 Aug 21 01:27:10.168713 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1882/4319] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:09 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:10.174127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16df4d0a-7779-40f1-a89e-f9ffd15cc258 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-4540390", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16df4d0a-7779-40f1-a89e-f9ffd15cc258 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 1263 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-4540390", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "07d25e16-c3cd-4c95-be27-27ab4566e2ee"}]}} Aug 21 01:27:10.180332 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-4540390', 'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '07d25e16-c3cd-4c95-be27-27ab4566e2ee'}]}}} Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.182712 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:10.183679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:10.185269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:10.185269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.189290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16df4d0a-7779-40f1-a89e-f9ffd15cc258 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:10.190693 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16df4d0a-7779-40f1-a89e-f9ffd15cc258 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020752 Aug 21 01:27:10.191903 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1883/4320] 10.222.0.46 () {60 vars in 1148 bytes} [Sun Aug 21 01:27:10 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 21 01:27:10.199153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae58e535-c3ba-47de-ba78-7d910d80cadd", "name": "network-vif-plugged", "status": "completed", "tag": "62e2ad9a-1ec8-4f39-82db-616e1c80d213"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:10.225516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.226572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.227793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.241006 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] Creating event network-vif-plugged:62e2ad9a-1ec8-4f39-82db-616e1c80d213 for instance ae58e535-c3ba-47de-ba78-7d910d80cadd on n-h1-master-1 Aug 21 01:27:10.249168 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bea8066a-5792-4131-8e75-20b8acb0fd60 req-d54782ea-7069-4b4d-b08f-a1a0f637dfe5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054483 Aug 21 01:27:10.252945 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1884/4321] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:10.276617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:10.278087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 410724f7-3b97-4c92-a0e0-8978d43dff46] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:10.298162 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] HTTP exception thrown: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/410724f7-3b97-4c92-a0e0-8978d43dff46/metadata/test2 HTTP/1.1 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '410724f7-3b97-4c92-a0e0-8978d43dff46', 'id': 'test2'} Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:10.303687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 404 to user: Instance 410724f7-3b97-4c92-a0e0-8978d43dff46 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:10.308470 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-737fe885-4c78-4b64-9b9d-d9d1274eb028 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/410724f7-3b97-4c92-a0e0-8978d43dff46/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.053482 Aug 21 01:27:10.309640 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1885/4322] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 01:27:10 2022] GET /compute/v2.1/servers/410724f7-3b97-4c92-a0e0-8978d43dff46/metadata/test2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:10.326211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:10.327024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:10.346751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.347957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:10.350850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.353787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.355203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.357877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.359291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.363884 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0d7c00d-37e5-4041-8081-b090eb9023f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.665954 Aug 21 01:27:10.380338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2438/4323] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:09 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:10.443106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:10.445702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:10.478255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.481385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.481980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.485111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.486588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.492393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.532731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:27:10.904377 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bcdb844-ad03-4d93-b0e9-64d8dc7e4ea4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "DELETE /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 204 len: 0 microversion: 2.1 time: 0.584655 Aug 21 01:27:10.909025 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1886/4324] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:27:10 2022] DELETE /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:10.932992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:10.934587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:10.943027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.943812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.944469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:10.945869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:10.946798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:10.947436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.119669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:11.129707 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3686cb7d-fe69-493b-83a2-6ba8903859c7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1228 microversion: 2.1 time: 0.218060 Aug 21 01:27:11.141881 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1887/4325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:10 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:11.150800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:11.152320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:11.157576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:11.159975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.160701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.161367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.162451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.163126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.163818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.170765 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e75072db-2c06-4c5d-978a-ba3dd5d8b21f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1506 microversion: 2.1 time: 0.732452 Aug 21 01:27:11.177868 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2439/4326] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:10 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:11.192707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:11.194777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:11.215906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.220617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.221262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.227673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.228652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.233249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.409107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:11.419633 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d46f636-0d4c-405e-a134-c829b467ffa2 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1527 microversion: 2.1 time: 0.272686 Aug 21 01:27:11.420371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1888/4327] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:11 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1527 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:11.425835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:11.426741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:11.439820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.440310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.440745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.441757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.442211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.442664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.601480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:11.632972 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4734f43f-e22c-436f-95f4-431cfb7ef2ff tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1312 microversion: 2.1 time: 0.444140 Aug 21 01:27:11.658938 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2440/4328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:11 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:11.676981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:11.683818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:11.710573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.711981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.714307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.717844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.718557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.719699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.780046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:11.789915 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fcf80858-9059-4de8-9551-c1c3e548fb63 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 200 len: 1506 microversion: 2.1 time: 0.367913 Aug 21 01:27:11.790865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1889/4329] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:11 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:11.813266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:11.813944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:11.825334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.826230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.826619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.828681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:11.829365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:11.829899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:11.879469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:27:12.031296 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7811c5bc-a3ec-4588-acf4-cd4d14e4640b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 204 len: 0 microversion: 2.1 time: 0.223907 Aug 21 01:27:12.032887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1890/4330] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:27:11 2022] DELETE /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:12.154988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:12.155641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:12.172165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:12.172822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:12.173262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:12.173987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:12.174439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:12.175166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:12.227172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:12.238384 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-22a5885e-824b-4502-8740-b99edce013db tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.576321 Aug 21 01:27:12.240271 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2441/4331] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:11 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:12.289966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3056ffe7-03f8-4e96-8a5b-639b655c123e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3f8b385e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:12.306429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:12.317519 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8924a2c7-194c-4310-8eff-3f34fa63575d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1228 microversion: 2.1 time: 0.166559 Aug 21 01:27:12.318735 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1891/4332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:12 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1228 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:12.324187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1874608777", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "83e29afb-1a8c-4dbc-90e5-466dc9f262ce"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:12.422413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] validate_networks() for [('83e29afb-1a8c-4dbc-90e5-466dc9f262ce', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:27:12.470300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3056ffe7-03f8-4e96-8a5b-639b655c123e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d7685c1f-09d9-45f7-a27d-18dc76f8de0b" status: 200 len: 351 microversion: 2.1 time: 0.184253 Aug 21 01:27:12.471944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2442/4333] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:27:12 2022] GET /compute/v2.1/os-volumes/d7685c1f-09d9-45f7-a27d-18dc76f8de0b => generated 351 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:27:12.479573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:12.480401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:12.504385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:12.518786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:12.519608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:12.520379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:12.526545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:12.527279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:13.301123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:13.305049 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:13.320358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14e7e4a7-0dec-4f8e-b978-9c7d20a9ea0e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1527 microversion: 2.1 time: 0.845990 Aug 21 01:27:13.329915 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2443/4334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:12 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1527 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:13.338920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a2a07ab-5061-4fc3-8ec6-af7ab2192347 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3f929d790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:13.547315 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a2a07ab-5061-4fc3-8ec6-af7ab2192347 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.215839 Aug 21 01:27:13.548022 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2444/4335] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:27:13 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:13.563399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:13.564576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:13.612702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:13.617643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:13.618234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:13.619000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:13.619523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:13.619914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.266028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:14.282816 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-349834ef-88f8-4443-9273-56fc1306c9c8 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1497 microversion: 2.1 time: 0.724282 Aug 21 01:27:14.283410 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2445/4336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:13 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1497 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:14.303355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:14.305911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:14.328874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.344874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.346839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.349078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.349664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.351419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.625867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:27:14.626921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:27:14.627559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:27:14.628268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:27:14.628906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:27:14.647575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.649231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.649850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.650791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.651414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.652002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.686333 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:14.717870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:27:14.733380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for user 949126b9470c418897afeacef01c275f and project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:27:14.772686 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:14.791505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:27:14.793994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:27:14.931476 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca66455b-cf25-444c-bd27-74aa6fa80f39 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611416 Aug 21 01:27:14.932484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1892/4337] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:27:14.960481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:14.961311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:14.979975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.980468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.980936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:14.981677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:14.982110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:14.982538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:15.046255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:15.058650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bba3e0ac-bb6e-4707-92f2-2c85f781e8b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.766748 Aug 21 01:27:15.077063 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2446/4338] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:14 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:15.108205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a95628a8-86f8-4e02-baa7-2c4ddf7569f7 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc40310e5e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:15.360045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:15.401154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f26eb32-13fd-44fc-8982-b0cc378a6a84 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1284 microversion: 2.1 time: 0.455254 Aug 21 01:27:15.405296 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1893/4339] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:14 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1284 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:15.416535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:15.470345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.server_groups [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Querying cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) for 1 instances {{(pid=122483) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 21 01:27:15.471602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:15.472368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:15.474364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:15.554765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-adcd4d12-05ac-40f8-ab97-733a4b1cbdc0 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26" status: 200 len: 222 microversion: 2.1 time: 0.146030 Aug 21 01:27:15.555570 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1894/4340] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:27:15 2022] GET /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26 => generated 222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:15.577527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:15.591074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:15.591211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a95628a8-86f8-4e02-baa7-2c4ddf7569f7 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.506778 Aug 21 01:27:15.595563 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2447/4341] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:27:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:15.600755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5f14536-f595-48ca-9406-7c87261ac40c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:15.601702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5f14536-f595-48ca-9406-7c87261ac40c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:15.604352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:15.604885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:15.605320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:15.606142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:15.606634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:15.607126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:15.618769 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:15.727158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:15.728388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:15.730721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:15.731751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lazy-loading 'fault' on Instance uuid 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:15.876635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5f14536-f595-48ca-9406-7c87261ac40c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:15.900782 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5f14536-f595-48ca-9406-7c87261ac40c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1218 microversion: 2.1 time: 0.303707 Aug 21 01:27:15.910172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2448/4342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:15 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1218 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.051263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e", "name": "network-vif-deleted", "tag": "2015dd01-4c9f-4fa8-a229-9f2b18c2f19a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:16.064259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.065499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.066094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.085747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] Creating event network-vif-deleted:2015dd01-4c9f-4fa8-a229-9f2b18c2f19a for instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e on n-h2-master-1 Aug 21 01:27:16.100164 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0ceac569-5d7d-4f43-8426-883bd332cddf req-ba038819-9b0b-4e0f-ba5e-1a559a2e8546 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187330 Aug 21 01:27:16.101385 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2449/4343] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:16.107547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.108178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:16.115748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.116786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.117549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.118477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.119139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.119738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.135217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:16.151281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b046e30-4dd7-47e9-8bda-e13e73857bd4 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1314 microversion: 2.1 time: 0.585446 Aug 21 01:27:16.158437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1895/4344] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:15 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.179632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e150d845-a043-4d6d-b274-b6387fa8df7e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3fe32f280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.208392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:27:16.363003 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b9d07cc-bb75-4572-aeaf-021e4961ee33 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 204 len: 0 microversion: 2.1 time: 0.259779 Aug 21 01:27:16.364161 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2450/4345] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:27:16 2022] DELETE /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:16.372972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.374264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:16.389030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.390012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.390694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.391855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.392462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.393099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.458854 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e150d845-a043-4d6d-b274-b6387fa8df7e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.298323 Aug 21 01:27:16.459693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1896/4346] 10.222.0.46 () {58 vars in 1134 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.474744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.477714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:16.499602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.500089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.500533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.506365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.507100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.507693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.745685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:16.758159 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba254ab0-ba65-480b-8408-dbd0ef77bd2a tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1503 microversion: 2.1 time: 0.291933 Aug 21 01:27:16.759436 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1897/4347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.763608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:16.773097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.773242 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a1204cf-6bb2-438a-ba14-7ca708f990e8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.407324 Aug 21 01:27:16.774029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:16.774338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2451/4348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.781454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.781781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-944d2f24-e3ad-4f88-92e8-402e4151b70e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc4032a5c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.782167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.782700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.784030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.784795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.785309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.866152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:16.876176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ed0ee29-f97f-4356-8f1b-81ae37465537 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1282 microversion: 2.1 time: 0.115574 Aug 21 01:27:16.876799 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1898/4349] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:16.911968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-944d2f24-e3ad-4f88-92e8-402e4151b70e tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136378 Aug 21 01:27:16.912583 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2452/4350] 10.222.0.46 () {58 vars in 1167 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:16.932866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e92dd533-81d7-4aa9-8349-ebe5be0cbbc6 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3fead7af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.935212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:16.935831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:16.946819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.947318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.948052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:16.948811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:16.949314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:16.949899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.031348 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e92dd533-81d7-4aa9-8349-ebe5be0cbbc6 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.108996 Aug 21 01:27:17.032293 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1899/4351] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:17.046968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3795938c-c4c6-4d20-8556-b954a6dd4777 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3fda4e1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.055979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:17.068499 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9738b70-b864-4b8f-a1ac-1e75e87fba92 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1222 microversion: 2.1 time: 0.141686 Aug 21 01:27:17.069160 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2453/4352] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:16 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:17.160631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3795938c-c4c6-4d20-8556-b954a6dd4777 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.117810 Aug 21 01:27:17.161385 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1900/4353] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:17.175305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-967000b8-3c68-4979-8da8-414e6d906681 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3fa166790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.176068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.177112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:17.190136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.190711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.191213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.191981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.192496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.193154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.241331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.241978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.242448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.246803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lazy-loading 'fault' on Instance uuid 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:17.287911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-967000b8-3c68-4979-8da8-414e6d906681 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.115902 Aug 21 01:27:17.288123 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2454/4354] 10.222.0.46 () {58 vars in 1188 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:17.301570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c617d980-b718-4b5f-b32f-3253c3074318 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] Calling method '.version_select at 0x7fc3f937ee50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.350077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:17.368990 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fa16288-0cbe-4b11-b388-0e219aa78964 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1314 microversion: 2.1 time: 0.197231 Aug 21 01:27:17.370216 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1901/4355] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:17.435408 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c617d980-b718-4b5f-b32f-3253c3074318 tempest-VolumesTestJSON-1253225889 tempest-VolumesTestJSON-1253225889-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.137675 Aug 21 01:27:17.436140 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2455/4356] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:17.780283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.781588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:17.794559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:17.795733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:17.803326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.804177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.804795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.805090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.805593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.806023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.806200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.807064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:17.807433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.807551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:17.807914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:17.808275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.152677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:18.165869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-302cd43d-042c-4b08-9016-eeb1b49685b4 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.374956 Aug 21 01:27:18.178265 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2456/4357] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:18.188710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:18.189551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:18.205962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.208844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.209627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.213196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.213921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.214531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.248458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:18.267768 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-638e597b-bc98-4369-a1c8-3649c5bdf3a1 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1503 microversion: 2.1 time: 0.488772 Aug 21 01:27:18.268722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1902/4358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:17 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1503 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:18.294270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:18.295407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:18.320705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.322160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.323928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.324939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.326197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.328941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.496686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:18.506062 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5cda563-7194-4fc6-848d-179dfdd02f5f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1282 microversion: 2.1 time: 0.326272 Aug 21 01:27:18.507231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:18.510864 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2457/4359] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:18 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:18.524277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1cab4604-2ef9-4f35-b636-521d9dd3c064 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1278 microversion: 2.1 time: 0.249285 Aug 21 01:27:18.528401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a16f3cb-090f-42f5-ac2f-126e2b60450a", "name": "network-vif-deleted", "tag": "5b3d8124-4453-45eb-a291-8f381ef59527"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:18.529473 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1903/4360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:18 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:18.536356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:18.537675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:18.544760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.545740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.546385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.547631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.548530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.549217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.565378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.566195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.568647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.600234 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] Creating event network-vif-deleted:5b3d8124-4453-45eb-a291-8f381ef59527 for instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a on n-h1-master-1 Aug 21 01:27:18.635476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5327cbd1-9d16-46fc-b25b-6427141660c8 req-79f6fe8b-7bce-4c10-a573-81161b505195 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114403 Aug 21 01:27:18.640730 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2458/4361] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:18.653601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:18.654092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:18.654828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:18.654976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lazy-loading 'fault' on Instance uuid 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:18.871786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:18.880095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ee89238-d10f-4cb0-a4b9-40b4b922165e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1314 microversion: 2.1 time: 0.348306 Aug 21 01:27:18.889497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1904/4362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:18 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:19.202217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:19.204529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:19.216468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.216987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.217417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.218123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.218568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.218978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.299817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:19.300397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:19.310057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.310691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.311134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.311838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.312289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.312708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.496614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:19.505378 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9ce0581-4e5d-4481-b249-0b0c4d0c5633 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.307995 Aug 21 01:27:19.511305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2459/4363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:19 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:19.531929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:19.532793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:19.542112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.542604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.552609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.553683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.554347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.555069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.670664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:19.682967 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7f3b3d2-e0a3-4beb-bc56-b0a22f63ec9a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1282 microversion: 2.1 time: 0.153280 Aug 21 01:27:19.684082 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2460/4364] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:19 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:19.692329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:19.693561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:19.701431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.702124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.702817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.703656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.704258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.704840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.897573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:19.911257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15bc4808-e18a-4b57-9a78-4f33e4d28efe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1276 microversion: 2.1 time: 0.223287 Aug 21 01:27:19.915332 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2461/4365] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:19 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:19.936837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:19.937472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:19.952015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.952517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.953001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.953721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:19.954184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:19.954601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:19.998555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a35912e003492288b68566b677b0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b07c7490e08043f89ea40531d634b859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:20.014735 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7ed1374-3d13-4890-a336-5de3c3f17989 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 200 len: 1503 microversion: 2.1 time: 0.726175 Aug 21 01:27:20.030754 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1905/4366] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:19 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 1503 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:20.126383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.126988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.127439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:20.127913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lazy-loading 'fault' on Instance uuid 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:20.235739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:20.245381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a322ecf4-cf63-469c-9919-da9558f7b8ed tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1314 microversion: 2.1 time: 0.328751 Aug 21 01:27:20.251496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2462/4367] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:19 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:20.528135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:20.529013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:20.545894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.546736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.548150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:20.550048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.550902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.552808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:20.689538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae58e535-c3ba-47de-ba78-7d910d80cadd", "name": "network-vif-deleted", "tag": "62e2ad9a-1ec8-4f39-82db-616e1c80d213"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:20.707452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.708586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.709904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:20.770365 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] Creating event network-vif-deleted:62e2ad9a-1ec8-4f39-82db-616e1c80d213 for instance ae58e535-c3ba-47de-ba78-7d910d80cadd on n-h1-master-1 Aug 21 01:27:20.801044 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3a757115-f70b-458c-b12c-f7ceef7361a9 req-8e62548b-433c-4316-8257-4c5658f8babd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116287 Aug 21 01:27:20.807968 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2463/4368] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:27:20.824709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:20.826125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:20.835704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.836941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.837596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:20.839006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:20.839848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:20.842186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.001890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:21.015821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c921fd2-c620-476f-8f01-5536a0747034 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1282 microversion: 2.1 time: 0.196407 Aug 21 01:27:21.029690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:21.033099 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7c6050d3-36a1-4467-bfb9-7b6afc8c3864 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.510716 Aug 21 01:27:21.033798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1906/4369] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:20 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:21.035319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2464/4370] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:20 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:21.049061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.050086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:21.053057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.054387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:21.065315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.065800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.066223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.069907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.070387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.070816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.082636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.083144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.083584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.084298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.092277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.093037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.107481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd HTTP/1.1 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ae58e535-c3ba-47de-ba78-7d910d80cadd'} Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.112158 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.117332 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.120553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.127490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09b33dc0-41aa-43fd-8752-b31351f260b4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 404 len: 111 microversion: 2.1 time: 0.089979 Aug 21 01:27:21.130380 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2465/4371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.153845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.202349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_groups [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Querying cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) for 1 instances {{(pid=122482) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 21 01:27:21.203507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.204157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.204749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.232914 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53a1b718-afb8-496d-a70e-b0f6173271a4 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.091859 Aug 21 01:27:21.234728 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2466/4372] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:21.247515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.266546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_groups [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Querying cell 3803a468-2abb-4e12-bf4a-d931a62c2742(cell1) for 1 instances {{(pid=122482) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 21 01:27:21.267568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.268275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.268975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.282860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-deb6ce8a-4cee-412a-a653-3f4bb112dff5 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26" status: 200 len: 184 microversion: 2.1 time: 0.039164 Aug 21 01:27:21.284636 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2467/4373] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26 => generated 184 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:21.294919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.295797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:21.322675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.325548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.326869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.329467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.330972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.332262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.378620 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:21.410976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.412959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.414362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.417686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lazy-loading 'fault' on Instance uuid 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:21.574326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54784294b484ac48e28a0dd50e25222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5998151f0304fd48efd6b5956f27519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:21.596073 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8d4e917-2d6b-410a-a2d2-ed529b85e88e tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 200 len: 1314 microversion: 2.1 time: 0.309814 Aug 21 01:27:21.609038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2468/4374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:21.627614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.628886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:21.656036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.660193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.660800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.662863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.666278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.667478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.728927 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd HTTP/1.1 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ae58e535-c3ba-47de-ba78-7d910d80cadd'} Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:21.736053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.740120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.742510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-981bd6b6-ae50-425e-a1fb-146193159a98 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 404 len: 111 microversion: 2.1 time: 0.133766 Aug 21 01:27:21.745182 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2469/4375] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.763020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.768425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] [instance: ae58e535-c3ba-47de-ba78-7d910d80cadd] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:21.788848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.789366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.790085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.792019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:21.792540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:21.794517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:21.848583 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd HTTP/1.1 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ae58e535-c3ba-47de-ba78-7d910d80cadd'} Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.850841 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance ae58e535-c3ba-47de-ba78-7d910d80cadd could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.854913 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e9f8fa0-94af-4331-a8c7-7fd47d05cc11 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd" status: 404 len: 111 microversion: 2.1 time: 0.104486 Aug 21 01:27:21.857143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2470/4376] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/servers/ae58e535-c3ba-47de-ba78-7d910d80cadd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.864929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c51af588-6c29-4c06-9279-22ec56715e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.873590 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c51af588-6c29-4c06-9279-22ec56715e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c51af588-6c29-4c06-9279-22ec56715e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-server-groups/5bd9d1cb-abaa-4f72-99fb-c6fc28061293 HTTP/1.1 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: exception: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5bd9d1cb-abaa-4f72-99fb-c6fc28061293'} Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.875531 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c51af588-6c29-4c06-9279-22ec56715e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance group 5bd9d1cb-abaa-4f72-99fb-c6fc28061293 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.880187 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c51af588-6c29-4c06-9279-22ec56715e60 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/5bd9d1cb-abaa-4f72-99fb-c6fc28061293" status: 404 len: 117 microversion: 2.1 time: 0.016967 Aug 21 01:27:21.882749 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2471/4377] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/os-server-groups/5bd9d1cb-abaa-4f72-99fb-c6fc28061293 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.887435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2a7bc28-d35c-4de5-bbd7-f3aea2a6a09d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.898116 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b2a7bc28-d35c-4de5-bbd7-f3aea2a6a09d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2a7bc28-d35c-4de5-bbd7-f3aea2a6a09d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-server-groups/400e8ecd-69ab-4e35-8742-257172b40776 HTTP/1.1 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: exception: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '400e8ecd-69ab-4e35-8742-257172b40776'} Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.907436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. Aug 21 01:27:21.912042 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.913448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2a7bc28-d35c-4de5-bbd7-f3aea2a6a09d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance group 400e8ecd-69ab-4e35-8742-257172b40776 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.914404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2a7bc28-d35c-4de5-bbd7-f3aea2a6a09d tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/400e8ecd-69ab-4e35-8742-257172b40776" status: 404 len: 117 microversion: 2.1 time: 0.031799 Aug 21 01:27:21.918132 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2472/4378] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/os-server-groups/400e8ecd-69ab-4e35-8742-257172b40776 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.923957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d6efe94-c6ad-4a26-9d7b-436637277506 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.931222 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5d6efe94-c6ad-4a26-9d7b-436637277506 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d6efe94-c6ad-4a26-9d7b-436637277506 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-server-groups/87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 HTTP/1.1 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: exception: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87639c7e-ab90-4ffc-a00f-4160fdd5bdf7'} Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.933931 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d6efe94-c6ad-4a26-9d7b-436637277506 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance group 87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d6efe94-c6ad-4a26-9d7b-436637277506 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/87639c7e-ab90-4ffc-a00f-4160fdd5bdf7" status: 404 len: 117 microversion: 2.1 time: 0.015650 Aug 21 01:27:21.937779 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2473/4379] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/os-server-groups/87639c7e-ab90-4ffc-a00f-4160fdd5bdf7 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.944636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77ceba2d-93e0-49be-a33c-0d8fb757fe09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.957211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-77ceba2d-93e0-49be-a33c-0d8fb757fe09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] HTTP exception thrown: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77ceba2d-93e0-49be-a33c-0d8fb757fe09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Request method failure captured: Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-server-groups/908955ec-e394-4a11-b9a1-9b5a7f5e474e HTTP/1.1 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnQ4PVSxihxw0IjV1mcr6_dIhsOpBfiHSwGg0zqry2NSzuTwOkjwO2CJ207UfJSfOgLvwzpgNMahMT2jxJcczOhyarvVEegNhqnnjvR9VYgn_iDmdLk5cKPPRW2vdl7093ihIvNpWIWxHAMh3EDTGjxsGKodvW_I10VwAAMg73JnNM Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b07c7490e08043f89ea40531d634b859", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b07c7490e08043f89ea40531d634b859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b07c7490e08043f89ea40531d634b859"}]}] Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b07c7490e08043f89ea40531d634b859 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerGroupTestJSON-705652788 Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 19a35912e003492288b68566b677b0da Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerGroupTestJSON-705652788-project Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: exception: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '908955ec-e394-4a11-b9a1-9b5a7f5e474e'} Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.958912 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. Aug 21 01:27:21.963685 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:21.965731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77ceba2d-93e0-49be-a33c-0d8fb757fe09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Returning 404 to user: Instance group 908955ec-e394-4a11-b9a1-9b5a7f5e474e could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:21.967748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77ceba2d-93e0-49be-a33c-0d8fb757fe09 tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/908955ec-e394-4a11-b9a1-9b5a7f5e474e" status: 404 len: 117 microversion: 2.1 time: 0.027402 Aug 21 01:27:21.973008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2474/4380] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/os-server-groups/908955ec-e394-4a11-b9a1-9b5a7f5e474e => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:21.983101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a533457-02bc-4600-9a96-3a7ff89e0e6f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:21.988969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:22.000935 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81149014-7d11-4cce-98bf-16f76f186842 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.965958 Aug 21 01:27:22.026014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1907/4381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:21 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:22.040427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:22.041126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:22.059585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a533457-02bc-4600-9a96-3a7ff89e0e6f tempest-ServerGroupTestJSON-705652788 tempest-ServerGroupTestJSON-705652788-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26" status: 204 len: 0 microversion: 2.1 time: 0.085277 Aug 21 01:27:22.068346 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2475/4382] 10.222.0.46 () {58 vars in 1266 bytes} [Sun Aug 21 01:27:21 2022] DELETE /compute/v2.1/os-server-groups/d8c1fb12-4034-494e-b366-35b687751b26 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:22.074089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:22.074733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.074962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:22.075242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.075685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.076414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.076883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.077307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.082646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.083298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.083841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.084991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.085700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.086340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.447513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:22.456334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-efaf854f-6065-45fa-8084-21121eac103c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.420469 Aug 21 01:27:22.467747 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1908/4383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:22 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:22.626376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:22.626543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] [instance: 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:22.637591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.638359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.640078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.642102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:22.643866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:22.644505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:22.685671 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] HTTP exception thrown: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Request method failure captured: Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e HTTP/1.1 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnF3lhwImRityEXLpqBhHn-sMfQ5p3NiS6M9tpA_J9SfssUFaQkiuvAhqWJ-jglo4Y045_57mGrUfPTWinWoE-dV333olOXj3Z4Ph3bbI5RZZnM0duSxPyAScBye-1UVjTo4o9hKhONw8v0dTZGaQc6JZBzks-L-2T8hcLdT64Q16g Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b5998151f0304fd48efd6b5956f27519", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b5998151f0304fd48efd6b5956f27519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b5998151f0304fd48efd6b5956f27519"}]}] Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: b5998151f0304fd48efd6b5956f27519 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-366602879 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f54784294b484ac48e28a0dd50e25222 Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-366602879-project Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e'} Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:22.687543 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. Aug 21 01:27:22.691911 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:22.693201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] Returning 404 to user: Instance 34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:22.694504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd863ad0-c140-4382-89c0-70802b027bb1 tempest-ServerMetadataNegativeTestJSON-366602879 tempest-ServerMetadataNegativeTestJSON-366602879-project] 10.222.0.46 "GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e" status: 404 len: 111 microversion: 2.1 time: 0.072345 Aug 21 01:27:22.696246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1909/4384] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:22 2022] GET /compute/v2.1/servers/34ed6b5c-fa5b-4d1c-a9d3-0f91a572596e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:23.022516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:23.023878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:23.036570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:23.037091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:23.045524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:23.047138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:23.050222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:23.050871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:23.170430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:23.181425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-544b9d83-73bc-4cf8-80d1-4fb96fd35685 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 1.111654 Aug 21 01:27:23.182352 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2476/4385] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:22 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:23.497073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:23.497847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:23.506941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:23.507479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:23.507942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:23.508635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:23.509104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:23.509666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:23.970527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:23.983074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9a26e24-221f-4784-a7ad-e06ca3623283 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.491668 Aug 21 01:27:23.999939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2477/4386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:23 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:24.204469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:24.205132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:24.217768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:24.223496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:24.224403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:24.227951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:24.228626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:24.231060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:24.260408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:24.274068 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83e9d63a-e8fb-4ebd-9e24-57997ce35192 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 1.255416 Aug 21 01:27:24.280720 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1910/4387] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:23 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:24.608733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:24.623772 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a51bf67-e912-4dde-80ae-60c1ded24726 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 0.423739 Aug 21 01:27:24.625335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2478/4388] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:24 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:25.010800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:25.011694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:25.036424 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:25.039049 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=14 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:25.049084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:25.050488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:25.052894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:25.056874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:25.063726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:25.064531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:25.301738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:25.302363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:25.315710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:25.316373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:25.317022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:25.318305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:25.324757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:25.326396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:25.794990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:25.808410 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-258bcd66-8cd4-4e52-99e2-8b1a8ad1a79c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.510903 Aug 21 01:27:25.812429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2479/4389] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:25 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:25.825262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:25.869240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:25.870143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:25.870817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:25.885403 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:25.895123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] Creating event network-changed:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:27:25.908168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-83f93681-9fcc-4467-ae64-375d0f6e9d5f req-884f2a5c-a78e-457e-afa4-1a3ed7df8f1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090123 Aug 21 01:27:25.912700 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2480/4390] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:26.101910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:26.115218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-27dd452f-ce23-4754-bbe6-d7772e86ac38 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 1.109219 Aug 21 01:27:26.116894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1911/4391] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:25 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:26.122610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:26.123812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:26.133239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:26.134247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:26.135305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:26.136590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:26.137303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:26.137934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:26.168381 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:26.279753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "name": "network-vif-plugged", "status": "completed", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:26.297135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:26.301331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:26.301864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:26.333574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] Creating event network-vif-plugged:ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18 for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be on n-h2-master-1 Aug 21 01:27:26.351180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-df6847c3-ec32-4e5b-b622-c75fafb735b6 req-c9606523-28fb-4715-b0d0-19f24a3976d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434131 Aug 21 01:27:26.353821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2481/4392] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:26.835519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:26.836330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:26.854668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:26.855132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:26.857905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:26.865916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:26.867357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:26.868431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:27.223380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:27.236970 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea5acf86-7ea8-4c63-92d5-3be3981ef423 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 1.118430 Aug 21 01:27:27.239817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1912/4393] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:26 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:27.253093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:27.254208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:27.260339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:27.271995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:27.272917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:27.276264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:27.276524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e855628-a935-422c-8aee-b0bd99bb8a0e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.445230 Aug 21 01:27:27.277459 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2482/4394] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:26 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:27.277660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:27.278242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:27.280176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:27.900266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:27.917610 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1cd36801-bc80-4ca6-88b2-fad132e17448 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.676482 Aug 21 01:27:27.918521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1913/4395] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:27 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:28.045638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aaa58da-5e38-4db6-8f8e-d46277c42e2f", "tag": "4b3c58be-c31b-455b-9398-bc97eb0d84f0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:28.070889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.071619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.072257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.093461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] Creating event network-changed:4b3c58be-c31b-455b-9398-bc97eb0d84f0 for instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f on n-h2-master-1 Aug 21 01:27:28.101407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d0702f9d-a5ea-48da-ab39-054358340553 req-d3a3653b-60f4-482a-8e5d-d257d52b3726 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057917 Aug 21 01:27:28.105068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2483/4396] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:28.259707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:28.260217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:28.268019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.268791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.269508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.270552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.273943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.274718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.302880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:28.304272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:28.314786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.315582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.316153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.317169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.317836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.318496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.584598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:28.601806 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-624f8fa0-e679-41be-897f-0f23f01defbe tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.302750 Aug 21 01:27:28.613981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2484/4397] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:28 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:28.939228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:28.940259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:28.949116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.949977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.950899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:28.951889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:28.952556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:28.960871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:29.356599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:29.373256 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbbfd0ac-1260-47c0-9ccf-56d43e931a68 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.436913 Aug 21 01:27:29.376633 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2485/4398] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:28 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:29.633585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:29.634200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:29.660681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:29.662544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:29.665179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:29.666128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:29.670046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:29.671014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:30.071018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:30.083171 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85f72fa2-19ac-4e62-9892-aa65addd90af tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.455084 Aug 21 01:27:30.085153 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2486/4399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:29 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:30.400235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:30.401065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:30.426935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:30.427439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:30.433169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:30.437304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:30.439069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:30.443286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:31.140133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:31.158675 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c14fbbbd-b336-4a4c-813e-e3d9f5a2d668 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.764490 Aug 21 01:27:31.163963 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2487/4400] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:30 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:31.172129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:31.178830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:31.197800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:31.204287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:31.205180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:31.211821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:31.212540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:31.214722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:31.280317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:31.297206 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b9bb3a4-cb9a-4bb1-ab55-be1c5121907b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1518 microversion: 2.1 time: 3.038135 Aug 21 01:27:31.303281 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1914/4401] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:28 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1518 bytes in 3048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:31.706617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:31.736383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d52739aa-26d1-4222-9ae0-5247e20dd920 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 0.570887 Aug 21 01:27:31.743270 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2488/4402] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:31 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:32.184564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:32.185597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:32.197842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.200325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.204664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.205861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.206600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.207241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.325038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:32.325664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:32.340668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.341382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.342979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.346102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.346573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.348220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.870249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:32.884969 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-843596e7-1bab-4a56-ba8f-919a18811ae3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.703042 Aug 21 01:27:32.886670 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1915/4403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:32 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:32.897862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:32.899767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:32.906861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.907566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.908152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.910243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.913611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.914250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.923519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:32.934090 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1df0df1a-c7d7-46fe-8d47-37158360a069 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.613961 Aug 21 01:27:32.951875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2489/4404] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:32 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:32.965665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:32.966559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:32.977613 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:32.993946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:32.994738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:32.995349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:32.996178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:33.001362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:33.001993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:33.280368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:33.298961 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63ec338f-3d64-4fbe-9dc9-6b69743bd351 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.341283 Aug 21 01:27:33.299664 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2490/4405] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:32 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:33.556835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87d3b9b3-ad00-444f-bdd1-92e5bc543e5d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Action: 'create', calling method: .version_select at 0x7fc3f89d49d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-513289509", "metadata": {"Type": "work"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87d3b9b3-ad00-444f-bdd1-92e5bc543e5d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 121 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-513289509", "metadata": {"Type": "work"}}} Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-513289509', 'metadata': {'Type': 'work'}}}} Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi '#$%' Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:33.561057 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 21 01:27:33.564922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:33.567533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87d3b9b3-ad00-444f-bdd1-92e5bc543e5d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:33.569162 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87d3b9b3-ad00-444f-bdd1-92e5bc543e5d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.267864 Aug 21 01:27:33.570419 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2491/4406] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:27:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:33.575843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:33.577965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:33.585589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:33.586424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:33.587081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:33.588019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:33.588860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:33.589489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:33.969003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:33.981619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebdea676-8639-4fe0-9297-feb25ecc4a95 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 1.093637 Aug 21 01:27:33.982433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1916/4407] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:32 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:34.004515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac9b79f1-8372-468e-92a9-8add6b5bb3ee tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Action: 'create', calling method: .version_select at 0x7fc3fd9d4700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-99262524", "metadata": {"Type": "work"}}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac9b79f1-8372-468e-92a9-8add6b5bb3ee tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 118 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-99262524", "metadata": {"Type": "work"}}} Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-99262524', 'metadata': {'Type': 'work'}}}} Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '0' Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:34.009064 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac9b79f1-8372-468e-92a9-8add6b5bb3ee tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ac9b79f1-8372-468e-92a9-8add6b5bb3ee tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014262 Aug 21 01:27:34.014163 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1917/4408] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:27:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:34.017424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:34.018061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:34.026268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:34.026792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:34.027225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:34.027948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:34.028398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:34.028859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:34.522086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:34.532562 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-209509a9-78c6-4e4d-96b4-8189882daf4b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.960794 Aug 21 01:27:34.546400 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2492/4409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:33 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:34.559641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51ba8e8d-fcbe-4cf9-a790-020f68f0ed23 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Action: 'create', calling method: .version_select at 0x7fc3f89d18b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1347617568", "metadata": {"Type": "work"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51ba8e8d-fcbe-4cf9-a790-020f68f0ed23 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 119 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1347617568", "metadata": {"Type": "work"}}} Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1347617568', 'metadata': {'Type': 'work'}}}} Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi '' Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:34.563916 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.568849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51ba8e8d-fcbe-4cf9-a790-020f68f0ed23 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:34.570027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51ba8e8d-fcbe-4cf9-a790-020f68f0ed23 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017398 Aug 21 01:27:34.570636 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2493/4410] 10.222.0.46 () {60 vars in 1156 bytes} [Sun Aug 21 01:27:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:34.579970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "name": "network-vif-plugged", "status": "completed", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:34.616293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:34.617730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:34.618471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:34.642179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] Creating event network-vif-plugged:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:27:34.649238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9bcd5b18-4cf9-4db1-a0eb-e987e8d1b30e req-f5e6bb74-bd9c-496e-8c28-541563ce7d0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076924 Aug 21 01:27:34.651892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2494/4411] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:34.660017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6802e723-5a57-4ee3-843b-244c99a9ad6c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:34.669169 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6802e723-5a57-4ee3-843b-244c99a9ad6c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6802e723-5a57-4ee3-843b-244c99a9ad6c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/a7d50035-77e9-40ce-88eb-008d55206c7e/action HTTP/1.1 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: {"os-stop": {}} Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: exception: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a7d50035-77e9-40ce-88eb-008d55206c7e', 'body': {'os-stop': {}}} Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:34.681699 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. Aug 21 01:27:34.686265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.688067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6802e723-5a57-4ee3-843b-244c99a9ad6c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance a7d50035-77e9-40ce-88eb-008d55206c7e has no mapping to a cell. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:34.690893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6802e723-5a57-4ee3-843b-244c99a9ad6c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/a7d50035-77e9-40ce-88eb-008d55206c7e/action" status: 404 len: 117 microversion: 2.1 time: 0.037411 Aug 21 01:27:34.699478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2495/4412] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:34 2022] POST /compute/v2.1/servers/a7d50035-77e9-40ce-88eb-008d55206c7e/action => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:34.714278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-931aad7c-ce70-4edd-a517-ab7bfbebb08d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Calling method '.version_select at 0x7fc3f89d4c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:34.805596 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-931aad7c-ce70-4edd-a517-ab7bfbebb08d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] HTTP exception thrown: Volume tempest-invalid-747548193 could not be found. Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-931aad7c-ce70-4edd-a517-ab7bfbebb08d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-747548193 HTTP/1.1 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: exception: Volume tempest-invalid-747548193 could not be found. Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'tempest-invalid-747548193'} Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-747548193 could not be found. (HTTP 404) (Request-ID: req-77f749d9-09fb-475e-ae9c-48b72ac39aab) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:27:34.812639 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-747548193 could not be found. Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-747548193 could not be found. Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-747548193 could not be found. Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-931aad7c-ce70-4edd-a517-ab7bfbebb08d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 404 to user: Volume tempest-invalid-747548193 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-931aad7c-ce70-4edd-a517-ab7bfbebb08d tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-747548193" status: 404 len: 98 microversion: 2.1 time: 0.114365 Aug 21 01:27:34.821147 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2496/4413] 10.222.0.46 () {58 vars in 1215 bytes} [Sun Aug 21 01:27:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-747548193 => generated 98 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:27:34.843927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:34.847146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:34.867398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:34.878045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:34.878637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:34.879162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:34.880975 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3de3f04c-00e2-4376-ae8b-7295b3f9538c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.865992 Aug 21 01:27:34.893356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:34.893356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:34.893356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:34.901283 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1918/4414] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:34 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:34.912178 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f2d3fcbb-0030-4ab3-b181-f0944c6bb8b3 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006883 Aug 21 01:27:34.913777 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1919/4415] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:27:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 21 01:27:34.923644 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8194fff7-682f-4678-92c9-624b104afca3 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003816 Aug 21 01:27:34.930496 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1920/4416] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:27:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 21 01:27:34.942953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae5413eb-8315-48cd-ab23-6c1faa7a68f7 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Calling method '.version_select at 0x7fc3fe3710d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:35.012634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ae5413eb-8315-48cd-ab23-6c1faa7a68f7 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] HTTP exception thrown: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae5413eb-8315-48cd-ab23-6c1faa7a68f7 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-volumes/fe813380-4202-4f91-ad28-e262b1071c71 HTTP/1.1 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: exception: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'fe813380-4202-4f91-ad28-e262b1071c71'} Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. (HTTP 404) (Request-ID: req-7655bf4d-78af-4d02-951a-9fa7db03ecc4) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:27:35.015684 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. Aug 21 01:27:35.019278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.026693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae5413eb-8315-48cd-ab23-6c1faa7a68f7 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 404 to user: Volume fe813380-4202-4f91-ad28-e262b1071c71 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:35.027815 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae5413eb-8315-48cd-ab23-6c1faa7a68f7 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/fe813380-4202-4f91-ad28-e262b1071c71" status: 404 len: 109 microversion: 2.1 time: 0.089121 Aug 21 01:27:35.028605 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1921/4417] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:27:34 2022] DELETE /compute/v2.1/os-volumes/fe813380-4202-4f91-ad28-e262b1071c71 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:35.038638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:35.041583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:35.060647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.061727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.062381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:35.065844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.066700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.067584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:35.217204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:35.224115 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:35.240049 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee661d09-a9ed-4d09-b9c9-9f493d14f90a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.402339 Aug 21 01:27:35.244512 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2497/4418] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:34 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:35.276052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd43d3f3-70d3-4c49-8b07-20e285e713b6 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Calling method '.version_select at 0x7fc3f9e15ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:35.349753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-dd43d3f3-70d3-4c49-8b07-20e285e713b6 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] HTTP exception thrown: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd43d3f3-70d3-4c49-8b07-20e285e713b6 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Request method failure captured: Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-volumes/a5e82041-47f6-4e99-915c-96be32d5fcdf HTTP/1.1 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoEVvgfBPfFjWuE80W8wbQSJj4MLBRoJTFVnjR6suRcoFdEzImblAbAGOGiTeX2J_FQCNS11oJIRUDEWC0jXJTS598hP5A0sSthlaOo6d2sJ_ojH5mI3jg-J9Z5KMopRTXocKEMT14lcS5tPg6x6SXssDxAOqR6gCdqA5p-3Trx4KY Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_199fba4d83764ebbb35031c97b6fdd8d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/199fba4d83764ebbb35031c97b6fdd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/199fba4d83764ebbb35031c97b6fdd8d"}]}] Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 199fba4d83764ebbb35031c97b6fdd8d Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesNegativeTest-1718932096 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7b4c276d7dbe422ca97da4d297149be7 Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesNegativeTest-1718932096-project Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: exception: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a5e82041-47f6-4e99-915c-96be32d5fcdf'} Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. (HTTP 404) (Request-ID: req-c02884be-2885-4b72-ae6d-dadf00c4722e) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:27:35.352250 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd43d3f3-70d3-4c49-8b07-20e285e713b6 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] Returning 404 to user: Volume a5e82041-47f6-4e99-915c-96be32d5fcdf could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:35.357767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd43d3f3-70d3-4c49-8b07-20e285e713b6 tempest-VolumesNegativeTest-1718932096 tempest-VolumesNegativeTest-1718932096-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a5e82041-47f6-4e99-915c-96be32d5fcdf" status: 404 len: 109 microversion: 2.1 time: 0.094531 Aug 21 01:27:35.366995 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2498/4419] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:27:35 2022] GET /compute/v2.1/os-volumes/a5e82041-47f6-4e99-915c-96be32d5fcdf => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:35.386481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:35.387480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:35.411754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.416791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.418315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:35.421015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.423809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.428403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:35.848650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:35.864826 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c49e9410-08a8-4e96-a131-e5729a41ea23 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.496310 Aug 21 01:27:35.884667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2499/4420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:35 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:35.909478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:35.910049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 385c0ea8-4e9b-43e9-b63c-345e81ddae9a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:35.928368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/385c0ea8-4e9b-43e9-b63c-345e81ddae9a/action HTTP/1.1 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: {"suspend": {}} Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '385c0ea8-4e9b-43e9-b63c-345e81ddae9a', 'body': {'suspend': {}}} Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:35.932723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 385c0ea8-4e9b-43e9-b63c-345e81ddae9a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dee5fec2-33a9-4dac-972a-614cc22a0f6b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/385c0ea8-4e9b-43e9-b63c-345e81ddae9a/action" status: 404 len: 111 microversion: 2.1 time: 0.043820 Aug 21 01:27:35.941454 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2500/4421] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:35 2022] POST /compute/v2.1/servers/385c0ea8-4e9b-43e9-b63c-345e81ddae9a/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:35.941967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:35.947774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:35.969444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.970919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.971359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:35.973280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:35.973743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:35.974185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:36.246020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:36.255043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3231d429-37a5-418b-9f64-583c73eb95d7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.318306 Aug 21 01:27:36.257423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2501/4422] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:35 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:36.263227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:36.272220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:36.281278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:36.282113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:36.282868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:36.284129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:36.284942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:36.285514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:36.409900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:36.443565 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11f36946-c28a-4c6f-96ee-8e1632afb811 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1318 microversion: 2.1 time: 1.413471 Aug 21 01:27:36.451902 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1922/4423] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:35 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1318 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:36.547293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:36.567871 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b4bb498-d403-4047-a049-3d0c22b7ded5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.308901 Aug 21 01:27:36.568737 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2502/4424] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:36 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:36.594070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:36.595874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:36.612058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:36.618625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:36.619689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:36.620696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:36.621517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:36.622148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.300594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:37.305604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:37.307949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:37.322509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.328561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.329605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.331246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.332608 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9172d9e4-ff19-4fc3-8eb5-57daeb0f0a94 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.742419 Aug 21 01:27:37.334234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.336072 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1923/4425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:36 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:37.336459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.367969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:37.368518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:37.379289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.379778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.380216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.380987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.381476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.382573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.457968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lazy-loading 'flavor' on Instance uuid 7b499cf8-c55e-42d3-becc-1e2c05db75be {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:37.661621 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-34a455b8-e7dd-443f-84f5-e7d2ca9d3c39 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.303149 Aug 21 01:27:37.666687 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1924/4426] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:37 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:27:37.680987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:37.684860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:37.712676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.714116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:37.714871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.716005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.717307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.719338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.721098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.724337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2be6a863-3f67-4b1b-8f74-80273363bfd3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.430085 Aug 21 01:27:37.725379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2503/4427] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:37 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:37.732388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa58da-5e38-4db6-8f8e-d46277c42e2f", "name": "network-vif-plugged", "status": "completed", "tag": "4b3c58be-c31b-455b-9398-bc97eb0d84f0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:37.770543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.771937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.773994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.796297 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] Creating event network-vif-plugged:4b3c58be-c31b-455b-9398-bc97eb0d84f0 for instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f on n-h2-master-1 Aug 21 01:27:37.803614 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c5f3b79f-54b2-4123-9407-44c473c27cae req-41ac6f9f-e2d3-4b80-afdf-baae5948b38b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075952 Aug 21 01:27:37.806112 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2504/4428] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:37.830666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:37.831567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:37.853440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.854275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.857726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:37.861822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:37.862820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:37.863508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:38.075848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:38.087050 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c18864d2-d7d7-4023-b8f9-c3d8c3522ce7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1513 microversion: 2.1 time: 0.279160 Aug 21 01:27:38.089604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2505/4429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:37 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:38.747459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:38.749097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:38.760372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:38.761270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:38.762109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:38.766961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:38.768886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:38.770980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:38.870785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:38.881577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b2283fa-eff5-49ae-9ad1-1c4200f7886c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1508 microversion: 2.1 time: 1.214548 Aug 21 01:27:38.882365 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1925/4430] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:37 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1508 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:38.902481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:38.903073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:38.909759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:38.910548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:38.911127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:38.912099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:38.912784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:38.913430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.109608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:39.121346 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a40014d2-7ac9-484a-941d-35a09b238473 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1324 microversion: 2.1 time: 0.378825 Aug 21 01:27:39.138652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2506/4431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:38 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:39.148485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:39.149973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:39.159519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.160419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.161108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.162088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.162866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.163546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.348605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:39.362897 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d2e9cc71-c361-43aa-aede-271cddbb930b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1508 microversion: 2.1 time: 0.462061 Aug 21 01:27:39.380733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1926/4432] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:38 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:39.388036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:39.391164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:39.408164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.411574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.413145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.415843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.418990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.419670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.645357 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-887b46c7-3ed2-4e19-aa29-432ed7a87914 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "PUT /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1080 microversion: 2.1 time: 0.259891 Aug 21 01:27:39.656793 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1927/4433] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:27:39 2022] PUT /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1080 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:39.668051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:39.673361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:39.692632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.692632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.692632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.692632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.692632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.695668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.723593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:39.739662 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2b53ce4-5df8-443a-8b17-d00e320ebee2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1496 microversion: 2.1 time: 0.599545 Aug 21 01:27:39.740257 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2507/4434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:39 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1496 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:39.771471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:39.775273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:39.795746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.796235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.798331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.799064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.803443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.804236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.860475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lazy-loading 'flavor' on Instance uuid 7b499cf8-c55e-42d3-becc-1e2c05db75be {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:27:39.877626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'suspend' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state suspended Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 15 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: {"suspend": {}} Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'suspend' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state suspended Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'suspend': {}}} Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state suspended. Cannot suspend while the instance is in this state. Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 21 01:27:39.879855 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state suspended Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state suspended Aug 21 01:27:39.883765 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:39.887523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'suspend' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state suspended {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:39.888598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0952c518-42ce-4c6c-81b2-dca25d1c10a8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 148 microversion: 2.1 time: 0.130108 Aug 21 01:27:39.889896 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2508/4435] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:39 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 148 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:27:39.902706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:39.903459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:39.916676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.917307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.917815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:39.918482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:39.918981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:39.921016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.042283 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-183882a7-2cde-407c-978f-b44adfc1ff98 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 202 len: 0 microversion: 2.1 time: 0.147349 Aug 21 01:27:40.047538 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2509/4436] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:39 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:27:40.072363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:40.074685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:40.096505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.098260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.098926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.100191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.101953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.103180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.180871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:40.191304 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2331d208-86bc-4c76-b8e0-9d7d11a70f28 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1506 microversion: 2.1 time: 0.528340 Aug 21 01:27:40.201889 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1928/4437] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:39 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:40.220145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:40.220842 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:40.241288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.243888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.245846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.248941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.250182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.252491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.607713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:40.620410 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4cd3be18-35d1-4992-ab51-a3a112105ba1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1502 microversion: 2.1 time: 0.560359 Aug 21 01:27:40.621191 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2510/4438] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:40 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:40.636970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:40.637903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:40.645384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.645953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.646852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:40.647266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:40.647803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:40.648292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.041264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:41.058821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da4f7b5f-e25b-48de-852f-573bf7a76842 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.855548 Aug 21 01:27:41.059730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1929/4439] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:40 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:41.071767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:41.082420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:41.083037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:41.085737 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a20a5db-3bbc-4198-9545-5f90dcc5ae32 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1506 microversion: 2.1 time: 0.460711 Aug 21 01:27:41.086740 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2511/4440] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:40 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:41.103468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.104252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.104907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.105968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.106847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.107428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.109079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:41.112179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:41.141541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.142054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.142731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.143207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.145067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.145696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.314125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:27:41.314558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:27:41.315141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:27:41.315553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:27:41.315964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:27:41.426930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:41.435659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.436316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.438290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.439888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.440676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.441170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.478231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62992e62-29c4-4b6e-ad2a-5114e99eac5c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "POST /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c/action" status: 202 len: 1112 microversion: 2.1 time: 0.373795 Aug 21 01:27:41.479470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2512/4441] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:41 2022] POST /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c/action => generated 1112 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 21 01:27:41.500626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:41.502210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:41.514969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.516211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.517721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.518769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:41.520625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:41.521562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:41.962429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:41.969689 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:41.971658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:41.975893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c9567a5-20ed-4821-ac31-1667f6b7c1f9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.897205 Aug 21 01:27:41.980729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1930/4442] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:41 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:41.987959 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a15628e-9bd6-4243-b2d9-22264a5d2085 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.491647 Aug 21 01:27:42.002915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:42.003807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:42.008654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2513/4443] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:41 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:42.014995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c21d771-2a6b-498c-aee7-f3a7522e1be1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761335914", "metadata": {"": ""}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:42.018753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.019761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.021271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.024018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.026073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c21d771-2a6b-498c-aee7-f3a7522e1be1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action HTTP/1.1 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 107 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761335914", "metadata": {"": ""}}} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1761335914', 'metadata': {'': ''}}}} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'': ''} Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:42.027276 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.031079 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.033639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c21d771-2a6b-498c-aee7-f3a7522e1be1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:42.033840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.033925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c21d771-2a6b-498c-aee7-f3a7522e1be1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action" status: 400 len: 170 microversion: 2.1 time: 0.023695 Aug 21 01:27:42.035693 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2514/4444] 10.222.0.46 () {60 vars in 1279 bytes} [Sun Aug 21 01:27:42 2022] POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:42.043908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:42.044545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:42.071816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.072637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.073350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.074490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.081134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.081494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.091077 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:42.500220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:42.525684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28022e73-2e04-4f08-bb49-edca5b80eea6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.484946 Aug 21 01:27:42.527514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2515/4445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:42 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:42.554970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:42.557917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:42.574435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.575705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.577074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.579031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.579792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.580658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.874821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:42.888888 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff3ae764-d2fd-4be7-b01e-9e29c61f7552 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.342868 Aug 21 01:27:42.906107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2516/4446] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:42 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:42.913959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be6948b2-632c-4f3c-97b6-4b020da5171e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-262533259", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be6948b2-632c-4f3c-97b6-4b020da5171e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action HTTP/1.1 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 618 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-262533259", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-262533259', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:42.938234 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 21 01:27:42.941331 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:42.958901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be6948b2-632c-4f3c-97b6-4b020da5171e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:42.960051 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be6948b2-632c-4f3c-97b6-4b020da5171e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action" status: 400 len: 938 microversion: 2.1 time: 0.052404 Aug 21 01:27:42.963165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2517/4447] 10.222.0.46 () {60 vars in 1279 bytes} [Sun Aug 21 01:27:42 2022] POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action => generated 938 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:42.983881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:42.985257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:42.995776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.996554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:42.997179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:42.998609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:42.999588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.000162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.052310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:43.064323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64d2df28-2464-417e-a3f9-77b99a195937 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1502 microversion: 2.1 time: 1.081868 Aug 21 01:27:43.065420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1931/4448] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:41 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1502 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:43.088421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:43.093605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:43.103219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.103787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.104319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.105158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.105706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.107470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.275125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:43.290296 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8992835c-f01f-4a5c-b60f-ed556fa45d9f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.320087 Aug 21 01:27:43.294961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2518/4449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:42 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:43.322689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:43.323637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:43.331580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.332566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.333792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.335017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.335765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.336405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.557389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:43.567824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b626e487-c867-4180-b44d-4bf1480b53a9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.249051 Aug 21 01:27:43.569137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2519/4450] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:43 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:43.589885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d1345ca-20c9-42f8-bbe7-0a86b8efb008 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d1345ca-20c9-42f8-bbe7-0a86b8efb008 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action HTTP/1.1 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 285 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.593951 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:27:43.598326 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:43.601034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d1345ca-20c9-42f8-bbe7-0a86b8efb008 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:43.602633 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d1345ca-20c9-42f8-bbe7-0a86b8efb008 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action" status: 400 len: 619 microversion: 2.1 time: 0.017223 Aug 21 01:27:43.607191 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2520/4451] 10.222.0.46 () {60 vars in 1279 bytes} [Sun Aug 21 01:27:43 2022] POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:27:43.613989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:43.615175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:43.630310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.630908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.632000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.632635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:43.633119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.633674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.634204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.649706 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-697b218f-7a77-4b93-bd51-51757dbac5eb tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.582938 Aug 21 01:27:43.650675 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1932/4452] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:43 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:43.916136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:43.925209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2b5baec-1d33-4e08-b763-1a81e22d58b8 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.316627 Aug 21 01:27:43.942469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2521/4453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:43 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:43.951014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:43.951631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:43.968379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.968907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.969415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:43.970122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:43.970573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:43.970988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.086584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:44.087631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:44.099053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.101702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.102348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.105149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.106541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.107746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.334510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:44.343368 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc03db4b-301f-4707-acc9-47ce9f6ede54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.396139 Aug 21 01:27:44.343964 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1933/4454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:43 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:44.366919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1695664561"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:44.375125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:44.392563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.395016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.396445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.402081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.402820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.403496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.767226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:44.777951 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2351f15-fc9e-40b3-9725-64aadfb6ec07 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1502 microversion: 2.1 time: 0.695529 Aug 21 01:27:44.781775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2522/4455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:44 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1502 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:44.799774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:44.802310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:44.820549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.825033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.825493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.826668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.827110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.827531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.835505 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b65f4e8f-9964-4fc4-91d3-6f885f97db62 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action" status: 202 len: 0 microversion: 2.1 time: 0.472772 Aug 21 01:27:44.836420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1934/4456] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:44 2022] POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:27:44.847804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-166928404"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:44.861268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:44.876560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.877391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.878037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.878926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:44.883248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:44.883930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:44.959920 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Cannot 'createImage' instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f while it is in task_state image_snapshot_pending Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action HTTP/1.1 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 84 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-166928404"}} Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'createImage' instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f while it is in task_state image_snapshot_pending Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-166928404'}}} Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:27:44.969550 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f while it is in task_state image_snapshot_pending Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f while it is in task_state image_snapshot_pending Aug 21 01:27:44.973537 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:44.975283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 409 to user: Cannot 'createImage' instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f while it is in task_state image_snapshot_pending {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:44.976367 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94b14993-d581-46d7-80be-88572d546e9b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action" status: 409 len: 167 microversion: 2.1 time: 0.133116 Aug 21 01:27:44.977328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1935/4457] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:44 2022] POST /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f/action => generated 167 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 21 01:27:44.987033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40e08eb9-cecf-4bf3-bdc5-00500a8b6986 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc3fdb44a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:45.155567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:45.169597 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4916346c-a19e-480f-8fc3-d2e0245e01b3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.384526 Aug 21 01:27:45.170524 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2523/4458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:44 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:45.173490 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40e08eb9-cecf-4bf3-bdc5-00500a8b6986 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/images/7e0207d7-53ef-47db-8c02-435bcb198786" status: 204 len: 0 microversion: 2.1 time: 0.191394 Aug 21 01:27:45.174068 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1936/4459] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:44 2022] DELETE /compute/v2.1/images/7e0207d7-53ef-47db-8c02-435bcb198786 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:45.192284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:45.193140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:45.199844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:45.200331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:45.200801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:45.201492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:45.201940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:45.202355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:45.413790 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:45.422756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65f9dd51-5105-44d8-96b6-c9348162e1dc tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1533 microversion: 2.1 time: 0.234442 Aug 21 01:27:45.423585 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2524/4460] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:45 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1533 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:45.807673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:45.808441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:45.822601 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:45.824523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:45.832516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:45.833292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:45.834189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:45.834872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:45.835296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.193387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:46.194644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:46.223094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.224360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.227241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.229692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.231424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.233059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.568011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:46.579761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a9b17e1-9f9d-4d95-ba3c-9c596b2bb507 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.391756 Aug 21 01:27:46.580357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2525/4461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:46 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:46.600293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:46.601321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:46.609959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.614132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.614763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.615717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.616354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.619029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.628345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:46.648708 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10d9ae2b-e29a-467d-8f11-5f680bdd98cc tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.846550 Aug 21 01:27:46.653437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1937/4462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:45 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:46.675438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:46.676244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:46.695329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.696325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.701667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:46.714668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:46.716878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:46.717431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:47.176546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:47.186472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5eeba1b6-07cf-46a7-bc9a-487e549b2cac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1533 microversion: 2.1 time: 0.594682 Aug 21 01:27:47.194566 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2526/4463] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:46 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1533 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:47.609375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:47.610506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:47.640739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:47.641703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:47.642447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:47.645218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:47.657121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:47.660055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:47.953470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:47.965717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae4623bb-ff8e-43d2-a628-e112ad781974 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.292255 Aug 21 01:27:47.967798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1938/4464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:46 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:47.991020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:47.992220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 677db68d-a033-4d3a-ab5b-16b9d7e13c61] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:48.007035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/677db68d-a033-4d3a-ab5b-16b9d7e13c61/action HTTP/1.1 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 15 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: {"unpause": {}} Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '677db68d-a033-4d3a-ab5b-16b9d7e13c61', 'body': {'unpause': {}}} Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:48.009756 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:48.014395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:48.014395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:48.014395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. Aug 21 01:27:48.014395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:48.016063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 677db68d-a033-4d3a-ab5b-16b9d7e13c61 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:48.017160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d3149d7-4b13-4006-b1be-4f95f7abd1de tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/677db68d-a033-4d3a-ab5b-16b9d7e13c61/action" status: 404 len: 111 microversion: 2.1 time: 0.030360 Aug 21 01:27:48.017963 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1939/4465] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:47 2022] POST /compute/v2.1/servers/677db68d-a033-4d3a-ab5b-16b9d7e13c61/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:27:48.027032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:48.028024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:48.036979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:48.038041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:48.038781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:48.039679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:48.040279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:48.040870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:48.588659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:48.598215 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9037929c-7a5f-4b0c-bbff-3d9f095ca5c1 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.994647 Aug 21 01:27:48.601442 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2527/4466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:47 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:48.612079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:48.613299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:48.630064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:48.638511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:48.639132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:48.641473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:48.642069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:48.643961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:49.079715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:49.093464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f97ec233-53da-46fa-b25a-2cbfc318b9a5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1539 microversion: 2.1 time: 0.490276 Aug 21 01:27:49.094160 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2528/4467] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:48 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1539 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:49.632957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:49.638587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:49.660130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:49.679336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:49.680401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:49.681570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:49.683303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:49.683770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:49.958702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:50.013627 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1900dd2-4701-465a-8a48-cdb33dfbb714 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.983157 Aug 21 01:27:50.020364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1940/4468] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:48 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:50.042818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:50.044352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:50.072184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:50.074368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:50.075690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:50.078642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:50.081985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:50.087209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:50.499030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:50.509025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09fa8008-e834-4d68-ac6d-89a38ec87c17 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.880758 Aug 21 01:27:50.512328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2529/4469] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:49 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:50.523954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:50.524808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:50.542105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:50.544998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:50.545699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:50.546606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:50.551291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:50.551770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:50.842608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:50.857166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-941c18be-5d91-4f7f-8f4b-e273214f1141 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1539 microversion: 2.1 time: 0.341005 Aug 21 01:27:50.857972 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2530/4470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:50 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1539 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:51.499056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa58da-5e38-4db6-8f8e-d46277c42e2f", "name": "network-vif-plugged", "status": "completed", "tag": "4b3c58be-c31b-455b-9398-bc97eb0d84f0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:51.533846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:51.541738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:51.542192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:51.619437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] Creating event network-vif-plugged:4b3c58be-c31b-455b-9398-bc97eb0d84f0 for instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f on n-h2-master-1 Aug 21 01:27:51.650871 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7b41e83d-c606-49ad-80cf-59434adac3af req-0d0f1199-c5d1-4ce6-8997-8667419ec405 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156427 Aug 21 01:27:51.654132 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2531/4471] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:27:51.676302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:51.677046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:51.703413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:51.703904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:51.704346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:51.707699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:51.708187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:51.708684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:51.899833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:51.913651 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dece4b2f-c74b-4e33-8250-76e203f9a825 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.873930 Aug 21 01:27:51.920646 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1941/4472] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:50 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:51.925901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:51.926523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:51.960759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:51.967574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:51.971361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:51.972327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:51.973141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:51.981072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:52.709543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:52.727029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f440ab74-f7a1-45ad-a45e-5e639d913316 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1539 microversion: 2.1 time: 0.805127 Aug 21 01:27:52.730322 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1942/4473] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:51 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1539 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:52.746412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:52.749458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:52.759049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:52.763035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:52.763538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:52.763982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:52.764700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:52.765189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:52.765613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:52.778221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9adfec0f-dc32-4fc2-9876-5cc67a9289e0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 1.120328 Aug 21 01:27:52.781983 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2532/4474] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:51 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:52.828429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'unpause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 15 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: {"unpause": {}} Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'unpause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'unpause': {}}} Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state active. Cannot unpause while the instance is in this state. Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:52.841220 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'unpause' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c0f3df4-fcd2-4660-8d48-b0a6783cd4f1 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 145 microversion: 2.1 time: 0.110847 Aug 21 01:27:52.849919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1943/4475] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:52 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:27:52.852038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:52.852906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:52.862888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:52.873721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:52.876223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:52.877208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:52.885236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:52.886030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.226382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:53.235607 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8357d93-e2d3-4730-adb4-774ff8cbc443 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.387567 Aug 21 01:27:53.242829 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2533/4476] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:52 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:53.278113 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:53.281219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:53.316944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.319476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.321056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.323607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.328495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.332079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.754324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:53.755203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:53.777359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.781622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.783563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.785270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.790419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.791666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.830584 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:53.882348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:53.918320 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e098db27-4a5b-4ae1-abdc-1e9bf43f76fe tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.661047 Aug 21 01:27:53.918973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1944/4477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:53 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:53.924199 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:53.930271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:53.946953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.947749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.952640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:53.953717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:53.954336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:53.955055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:54.089939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:54.099124 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fadc0e81-63b4-4f16-8abc-735330edb243 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1521 microversion: 2.1 time: 0.349087 Aug 21 01:27:54.099771 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2534/4478] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:53 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:54.333663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-872569043", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:54.394900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] validate_networks() for [('3511ebbb-0e39-4262-b6f0-d74c007a5656', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:27:54.816285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:54.838110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0753206-c7d2-4f7b-b272-aa9f78f8335a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.914724 Aug 21 01:27:54.839022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1945/4479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:53 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:54.845932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:54.846568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: e27e1c54-485e-47b8-b51d-6ad8bd276990] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:54.869983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/e27e1c54-485e-47b8-b51d-6ad8bd276990/action HTTP/1.1 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 18 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: {"unshelve": null} Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e27e1c54-485e-47b8-b51d-6ad8bd276990', 'body': {'unshelve': None}} Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:54.879865 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance e27e1c54-485e-47b8-b51d-6ad8bd276990 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:54.883831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0a3f494-964b-421d-abc7-920ecb7f6852 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/e27e1c54-485e-47b8-b51d-6ad8bd276990/action" status: 404 len: 111 microversion: 2.1 time: 0.041039 Aug 21 01:27:54.885797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1946/4480] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:54 2022] POST /compute/v2.1/servers/e27e1c54-485e-47b8-b51d-6ad8bd276990/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:27:54.893652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:54.899766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:54.910927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:54.913477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:54.920879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:54.921862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:54.922347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:54.922780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:54.973205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:27:55.081731 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:55.153705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21e119d4-c9d3-49d3-80fa-e89b6df06016 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 204 len: 0 microversion: 2.1 time: 0.266345 Aug 21 01:27:55.154728 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1947/4481] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:27:54 2022] DELETE /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:27:55.173049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:55.173767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:55.197747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.204202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.204760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.205676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.206236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.206848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.323070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:27:55.324373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:27:55.325122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:27:55.326110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:27:55.326876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:27:55.339831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.341461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.342121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.343625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.344413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.345176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.372831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:27:55.380294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for user bd0447e656f9418da68b308f19e8e807 and project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:27:55.400410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:27:55.404201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:27:55.474580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6319aa7a-97c8-40ea-8c58-3ec804cf8fe3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.359612 Aug 21 01:27:55.481826 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2535/4482] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:27:55.493809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:55.494859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:55.508947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.509863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.509997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.510622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:55.511165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:55.511585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:55.646416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:55.659107 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3cb45fbe-3ae4-4c2e-92a3-36e75c36fd8e tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.501578 Aug 21 01:27:55.660376 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1948/4483] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:55 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:55.668123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5469b865-7461-4117-b5f5-1705eedcb8e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:55.669882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5469b865-7461-4117-b5f5-1705eedcb8e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:55.911459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5469b865-7461-4117-b5f5-1705eedcb8e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:55.923488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5469b865-7461-4117-b5f5-1705eedcb8e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1221 microversion: 2.1 time: 0.261385 Aug 21 01:27:55.944453 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1949/4484] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:55 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1221 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:55.969603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:55.970264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:56.009219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.009717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.010008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:56.010140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.010861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.011316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.011740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.026846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98eee19b-03b8-4654-8319-6c84e76c2b96 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1527 microversion: 2.1 time: 0.544621 Aug 21 01:27:56.027355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2536/4485] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:55 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1527 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:56.065715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:56.066244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:56.106674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.107170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.107609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.108321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.108814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.109224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.498654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:56.511146 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e339c7a2-bf81-46ee-98f9-c61ace4938c8 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.566921 Aug 21 01:27:56.511755 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1950/4486] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:55 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:56.526565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:56.531835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1477447556", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:56.542560 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f418292-436d-4caf-b748-fd692784236b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.488273 Aug 21 01:27:56.543192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2537/4487] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:56 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:56.556620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:56.557695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:56.572246 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:27:56.606933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.607426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.607854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.608589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.612871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.617199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.651765 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] validate_networks() for [('3511ebbb-0e39-4262-b6f0-d74c007a5656', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:27:56.676081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Cannot 'unshelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action HTTP/1.1 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 18 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: {"unshelve": null} Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'unshelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'unshelve': None}} Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be in vm_state active. Cannot unshelve while the instance is in this state. Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:27:56.677943 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 409 to user: Cannot 'unshelve' instance 7b499cf8-c55e-42d3-becc-1e2c05db75be while it is in vm_state active {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc735dc0-bb40-4f72-9949-031cda3bd734 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action" status: 409 len: 146 microversion: 2.1 time: 0.135351 Aug 21 01:27:56.682288 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2538/4488] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:27:56 2022] POST /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:27:56.688814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:56.689433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:56.710119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.710981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.711980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:56.716053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:56.716754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:56.717382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:57.491275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:57.506316 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b40ee9c-92a7-487a-ac29-6df8ef889940 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.818847 Aug 21 01:27:57.509291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2539/4489] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:56 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:27:57.532630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:57.534186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:57.551181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:57.560542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:57.561188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:57.562151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:57.562824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:57.563461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:57.946038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:27:57.946528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:27:57.947034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:27:57.947563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:27:57.948343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:27:57.996113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:57.996594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:57.997046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.000534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.012314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.012933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.149827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:27:58.171488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for user bd0447e656f9418da68b308f19e8e807 and project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:27:58.220342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:27:58.225040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:27:58.310895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7af6f0c-a81b-4096-96cc-38621692ad0e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.783325 Aug 21 01:27:58.311831 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1951/4490] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:27:58.323376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa58da-5e38-4db6-8f8e-d46277c42e2f", "name": "network-vif-unplugged", "status": "completed", "tag": "4b3c58be-c31b-455b-9398-bc97eb0d84f0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:27:58.373730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.379059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.382461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.411321 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] Creating event network-vif-unplugged:4b3c58be-c31b-455b-9398-bc97eb0d84f0 for instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f on n-h2-master-1 Aug 21 01:27:58.424939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-446badee-24e3-4282-b1ea-886827aca95b req-d95a65eb-d88b-4d0d-add8-77d5e56ec2c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111373 Aug 21 01:27:58.426268 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1952/4491] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:27:58.437104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:58.438582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:58.464425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.481655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.486809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.489518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.496210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.498309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.543276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:58.555009 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ee2105e-5ba1-4b81-82ae-d0c2163743df tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1527 microversion: 2.1 time: 1.043116 Aug 21 01:27:58.577820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2540/4492] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:57 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1527 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:27:58.583748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:27:58.584540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:27:58.618597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.619089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.622800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:58.623804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:27:58.624464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:27:58.633655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:27:59.485858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:27:59.498575 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6239d241-bb6c-4075-8ec8-691c29a43749 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.919078 Aug 21 01:27:59.515473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2541/4493] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:58 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:00.019251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1986609286", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:00.078287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:00.093072 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e1365cf-33ac-4407-9534-f47b8676946c tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 1.663932 Aug 21 01:28:00.093667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1953/4494] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:27:58 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:00.121881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:00.123815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:00.152565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:00.154385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:00.154999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:00.156238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:00.159005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:00.159758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:00.243968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] validate_networks() for [('1047fa3b-122c-4463-a43e-06a87ecdfcd9', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:28:00.444128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:00.458793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aad528a6-cc32-4ca2-81cb-ea72661b469e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1274 microversion: 2.1 time: 0.363356 Aug 21 01:28:00.462933 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1954/4495] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:00 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:00.479267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:00.480180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:00.497189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:00.498810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:00.501141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:00.503626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:00.504691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:00.507601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:00.637130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:00.638929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:00.639432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:00.640150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lazy-loading 'fault' on Instance uuid 4aaa58da-5e38-4db6-8f8e-d46277c42e2f {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:00.932781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:00.963876 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8328c93e-b9eb-41d1-a6c2-431395222e1d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 200 len: 1314 microversion: 2.1 time: 0.492212 Aug 21 01:28:00.965682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1955/4496] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:00 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:00.973631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa58da-5e38-4db6-8f8e-d46277c42e2f", "name": "network-vif-deleted", "tag": "4b3c58be-c31b-455b-9398-bc97eb0d84f0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:01.015943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:01.016755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:01.017542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:01.082984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] Creating event network-vif-deleted:4b3c58be-c31b-455b-9398-bc97eb0d84f0 for instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f on n-h2-master-1 Aug 21 01:28:01.102686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8095fc8c-3246-4544-b1ed-b845b773eb56 req-b419cf9b-7d50-437f-9346-45f93a52f646 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135428 Aug 21 01:28:01.109800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1956/4497] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:01.126204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1670435168_updated"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:01.137081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 50093ae9-79ee-4a1b-9924-674adbeb1ac8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:01.161181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/servers/50093ae9-79ee-4a1b-9924-674adbeb1ac8 HTTP/1.1 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 81 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1670435168_updated"}} Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '50093ae9-79ee-4a1b-9924-674adbeb1ac8', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1670435168_updated'}}} Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 21 01:28:01.173256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:01.177816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 50093ae9-79ee-4a1b-9924-674adbeb1ac8 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:01.181021 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-635a1ae6-d958-4e8a-8357-898c5c3b8938 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "PUT /compute/v2.1/servers/50093ae9-79ee-4a1b-9924-674adbeb1ac8" status: 404 len: 111 microversion: 2.1 time: 0.062462 Aug 21 01:28:01.186234 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1957/4498] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:28:01 2022] PUT /compute/v2.1/servers/50093ae9-79ee-4a1b-9924-674adbeb1ac8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:01.213100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:01.216843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:01.247879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:01.248404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:01.250500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:01.251507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:01.255925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:01.258599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:01.901621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:01.913648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fc6a17b-dc34-4915-aea3-a24405cd132c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 0.726265 Aug 21 01:28:01.914584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1958/4499] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:01 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:01.919222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:01.919845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:01.951505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:01.953290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:01.954517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:01.956963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:01.959556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:01.962530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.146344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:28:02.148139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:28:02.151471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:28:02.153257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:28:02.155042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:28:02.187968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.193129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.198884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.200214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.205031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.205759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.260068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Getting quotas for project 0c6c6457b07a43f193af082ada523651. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:28:02.267502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Getting quotas for user 400e677f335446c0817c32b85e1e24b1 and project 0c6c6457b07a43f193af082ada523651. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:28:02.285081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:28:02.291342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:28:02.385477 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30d64523-3036-40e2-8c92-3b02ea5b31d2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.867708 Aug 21 01:28:02.388520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2542/4500] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:27:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:28:02.404005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:02.404814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:02.413902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.414406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.415109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.416240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.416902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.418213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.622720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:02.665428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61b6574d-b9e9-4549-895e-a406eb296d0a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1280 microversion: 2.1 time: 0.270936 Aug 21 01:28:02.669146 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2543/4501] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:02 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:02.703505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:02.705145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:02.731561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.734061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.734663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.737544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:02.747879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:02.749294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:02.781651 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f HTTP/1.1 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f'} Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:02.788281 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:28:02.792450 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:02.798132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:02.802115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0841bbbe-8633-4239-9e09-f678d251896e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 404 len: 111 microversion: 2.1 time: 0.130600 Aug 21 01:28:02.804280 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2544/4502] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:02 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:02.815087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e14a192-c41e-461d-87dd-b434808cf26e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:02.815979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e14a192-c41e-461d-87dd-b434808cf26e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:02.818738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:02.829589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35efa333-9ebb-4026-908a-462450bd6742 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.913940 Aug 21 01:28:02.835311 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1959/4503] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:01 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:02.851943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d74571d1-e647-4c9f-af28-ef5587084138 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'create', calling method: .version_select at 0x7fc3fd99f670>, body: {"keypair": {"name": "tempest-keypair-1029168553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbKZYEZq2DdEqogDKTdoWR3mUadkHFU2a0+J1jjSpnOVl6zEnmIdkO+589gMgZo2GlCMJo6i6sxesnrAy6fe9JH/EIPnj2ItrQ7OTOG8RH5V16OHlV9xXUjzLB1bVRWzQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:02.911085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d74571d1-e647-4c9f-af28-ef5587084138 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for project 032fcd2138744226a6b98ddeeef4766d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:28:02.952275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d74571d1-e647-4c9f-af28-ef5587084138 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for user d35661d01cfb4f8d90ea78c7c7ead1b6 and project 032fcd2138744226a6b98ddeeef4766d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:28:02.973215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e14a192-c41e-461d-87dd-b434808cf26e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:03.001437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e14a192-c41e-461d-87dd-b434808cf26e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1223 microversion: 2.1 time: 0.190316 Aug 21 01:28:03.011667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2545/4504] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:02 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:03.020223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:03.022512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:03.043336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d74571d1-e647-4c9f-af28-ef5587084138 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200231 Aug 21 01:28:03.046482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1960/4505] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:28:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:03.047880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.048429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.048891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:03.049626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.050226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.050855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:03.075815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:03.076569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:03.112023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.120010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.120830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:03.131478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.132169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.132744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:03.441720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:03.464321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09032dce-89d6-4225-8b2a-23ed35c278c7 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.450348 Aug 21 01:28:03.476744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2546/4506] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:03 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:03.502605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d5d3a8f-b8d9-4285-ab6e-2e831e66cdda tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d5d3a8f-b8d9-4285-ab6e-2e831e66cdda tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: request: PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be HTTP/1.1 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 280 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.509976 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 21 01:28:03.514436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:03.526541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d5d3a8f-b8d9-4285-ab6e-2e831e66cdda tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:03.528189 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d5d3a8f-b8d9-4285-ab6e-2e831e66cdda tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 400 len: 619 microversion: 2.1 time: 0.031577 Aug 21 01:28:03.534857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2547/4507] 10.222.0.46 () {60 vars in 1257 bytes} [Sun Aug 21 01:28:03 2022] PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:28:03.549167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:03.550025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:03.572129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.572732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.573137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:03.576139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:03.577405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:03.577851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.195879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:04.207136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96d22aae-1f65-47d8-9957-9152a8764d85 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.670160 Aug 21 01:28:04.207779 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2548/4508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:03 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:04.219148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:04.221440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:04.235748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.236661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.237912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.239021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.239675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.240372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.443216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:04.453264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-03f08f12-408b-41c3-b60f-22d83ff21f40 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1280 microversion: 2.1 time: 0.242807 Aug 21 01:28:04.457593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2549/4509] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:04 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1280 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:04.495560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:04.499379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:04.517843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.518770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.519455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.520419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.524726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.527482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.711587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:04.727464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bee4dac-0cee-4b6b-876b-5d42f0da19a1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1275 microversion: 2.1 time: 0.259185 Aug 21 01:28:04.728471 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2550/4510] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:04 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:04.742611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:04.743671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:04.752482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.753825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.754654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:04.756397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:04.767493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:04.768796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:05.090143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:05.101069 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-266f0404-cbc4-49bc-8506-642b3e7f974c tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1517 microversion: 2.1 time: 2.051560 Aug 21 01:28:05.102110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1961/4511] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:03 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1517 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:05.335189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:05.360022 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a3303cf-9faa-4a6a-b075-f1f2a314fa8a tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.630084 Aug 21 01:28:05.360624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2551/4512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:04 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:05.391005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a10a912b-6777-4a8b-b5d2-39dc838683d2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a10a912b-6777-4a8b-b5d2-39dc838683d2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be HTTP/1.1 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 24 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": ""}} Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be', 'body': {'server': {'name': ''}}} Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '' Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:28:05.400176 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:05.404386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a10a912b-6777-4a8b-b5d2-39dc838683d2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:05.405865 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a10a912b-6777-4a8b-b5d2-39dc838683d2 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 400 len: 108 microversion: 2.1 time: 0.023160 Aug 21 01:28:05.408703 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1962/4513] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:28:05 2022] PUT /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:28:05.417685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:05.418442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:05.434383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:05.434990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:05.436653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:05.441766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:05.442635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:05.443353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:05.479207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:05.480965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:05.495241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:05.495728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:05.496716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:05.499778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:05.500337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:05.505567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:05.961419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:05.969782 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30833fcf-5a1a-421b-8a4b-f8ae0bbba21b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1505 microversion: 2.1 time: 0.557594 Aug 21 01:28:05.988520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2552/4514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:05 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:05.994950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:05.994950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:06.002208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:06.011226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:06.011798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:06.012661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:06.013239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:06.013900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:06.227121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:06.253304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f27173a-32cd-4715-aa36-028fda4c7f65 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1281 microversion: 2.1 time: 0.276535 Aug 21 01:28:06.254206 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2553/4515] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:05 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1281 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:06.259391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:06.267174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:06.298910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:06.299674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:06.305949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:06.306960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:06.307606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:06.308200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:06.340075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:06.357023 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30bd3ed4-a87d-49f5-aec6-9a8941468012 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.882256 Aug 21 01:28:06.357636 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1963/4516] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:05 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:07.036430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:07.050590 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7865d8b2-95d4-41c7-97b9-0063366cadd0 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.795040 Aug 21 01:28:07.058659 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2554/4517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:06 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:07.277114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:07.277735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:07.285655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:07.287934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:07.288386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:07.289163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:07.289626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:07.290051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:07.381191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:07.382494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:07.400690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:07.403006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:07.403796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:07.405461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:07.406545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:07.409434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:07.440875 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:07.705799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:07.721713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-399b4512-8652-42ec-915a-3e94c0eb77f5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.346614 Aug 21 01:28:07.736667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2555/4518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:07 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:08.016059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:08.029025 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-701682e3-c22d-4c25-b1b2-0e7105e2fd3b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1281 microversion: 2.1 time: 0.757531 Aug 21 01:28:08.034566 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1964/4519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:07 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1281 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:08.085446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:08.086152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:08.104621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:08.106252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:08.107301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:08.108038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:08.110701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:08.113758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:08.168397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-77224714", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:08.187898 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:08.277201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] validate_networks() for [('a43710e8-0478-4e33-b824-c541f642d410', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:28:08.582915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:08.592170 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b0cea2f-062a-4967-9b51-1a3bcad6c7fd tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.513190 Aug 21 01:28:08.607403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2556/4520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:08 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:08.608568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "name": "network-vif-unplugged", "status": "completed", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:08.639024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:08.640794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:08.642751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:08.675495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] Creating event network-vif-unplugged:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:28:08.689952 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-34f7d36e-ea8a-4f9f-b74b-cceacf6607cc req-2b2fe220-a443-4729-a671-2bfe8797b29a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090070 Aug 21 01:28:08.693319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2557/4521] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:08.745999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:08.746738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:08.759916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:08.760431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:08.760909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:08.765262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:08.767865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:08.768394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.043077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:09.055875 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c3cf6e6-863d-4a52-8fcf-65139c99ecc5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.316019 Aug 21 01:28:09.057070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2558/4522] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:08 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:09.061893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:09.062663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:09.070610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:09.071372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:09.072026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.073000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:09.073645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:09.074278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.289463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:09.298119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ac158c4-6cc4-4a59-a240-e5478b3f258b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.239726 Aug 21 01:28:09.312530 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2559/4523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:09 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:09.621753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:09.622375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:09.633550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:09.645585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:09.647133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.648072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:09.649762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:09.650741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.878374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:09.887213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83927ce3-29f5-4def-a5df-ba6272bec533 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.269239 Aug 21 01:28:09.897285 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2560/4524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:09 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:09.904793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2f87fc-4faf-4318-9068-90ccce7924e4", "tag": "dc3ed71f-0da2-43a9-99bc-7c339bcec6b7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:09.927093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:09.927613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:09.928214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:09.986861 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] Creating event network-changed:dc3ed71f-0da2-43a9-99bc-7c339bcec6b7 for instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 on n-h2-master-1 Aug 21 01:28:09.997975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6d2ecb30-d76d-4108-b1f4-b4329ef398a6 req-30667037-fc6f-4558-b7d3-71b158dbde39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098889 Aug 21 01:28:09.999802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2561/4525] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:10.079155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:10.080906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:10.118298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.118966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.121556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:10.122596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.125755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.127520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:10.441669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:10.459403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9285fbc3-ec00-46b6-a790-0135b2dc255e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.385817 Aug 21 01:28:10.474183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2562/4526] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:10 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:10.479933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:10.480546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:10.488686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.489325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.489712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:10.491021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.491556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.491983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:10.702237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:10.713269 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56eb1c26-f18a-4c30-9eda-0c3ce6e378a2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.236262 Aug 21 01:28:10.728298 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2563/4527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:10 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:10.909610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:10.910915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:10.920256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.923618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.924296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:10.926738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:10.927548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:10.929154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:11.212464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:11.220601 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d353a7d6-0adb-4275-bbf3-9be1b091133a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.315484 Aug 21 01:28:11.231827 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2564/4528] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:10 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:11.248241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:28:11.248787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:28:11.249570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:28:11.250267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:28:11.250943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:28:11.269796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:11.270483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:11.271225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:11.272129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:11.273852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:11.274401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:11.313803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:28:11.320274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for user d35661d01cfb4f8d90ea78c7c7ead1b6 and project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:28:11.336007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:28:11.339018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:28:11.421433 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:11.481398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:11.482595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:11.490015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:11.495722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:11.496560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:11.498939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:11.500414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:11.501328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:11.529616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa413bd2-6b4e-4337-bf5f-dc70b4980e54 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.366356 Aug 21 01:28:11.543281 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1965/4529] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:28:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:28:11.554548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9454efd2-1118-4137-86b9-73958cabf5ac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:11.555187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9454efd2-1118-4137-86b9-73958cabf5ac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:12.028326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9454efd2-1118-4137-86b9-73958cabf5ac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:12.043920 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9454efd2-1118-4137-86b9-73958cabf5ac tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1223 microversion: 2.1 time: 0.497733 Aug 21 01:28:12.057679 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1966/4530] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:11 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1223 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:12.068422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:12.073653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:12.099380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:12.100736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:12.101503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:12.102496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:12.103218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:12.103884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:12.246371 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:12.643412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:12.668254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47b8eadd-a281-4133-b520-e4ccdd42e281 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 1.189361 Aug 21 01:28:12.688376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2565/4531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:11 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:12.710358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "name": "network-vif-plugged", "status": "completed", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:12.743234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:12.743707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:12.748366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:12.804025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] Creating event network-vif-plugged:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:28:12.832013 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-26182e3f-0fa2-4e26-b39a-080cb72342de req-e168c465-5de9-4037-bb80-9fff44af8a55 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129573 Aug 21 01:28:12.833296 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2566/4532] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:12.850057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:12.851475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:12.869090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:12.873500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:12.874507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:12.875654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:12.877011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:12.878631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:12.997726 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:13.067232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:13.076731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-038859d8-adff-4200-9380-f5e591083ff3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 1.017731 Aug 21 01:28:13.083327 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1967/4533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:12 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:13.108939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c5b2e5d-8a33-43bb-8900-cd033579d74b", "tag": "b1f8ca0f-1b24-43ee-a952-eb8abde0ea79"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:13.148006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:13.149711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:13.150155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:13.197016 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] Creating event network-changed:b1f8ca0f-1b24-43ee-a952-eb8abde0ea79 for instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b on n-h1-master-1 Aug 21 01:28:13.209996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-730b38f8-a2d3-4add-ad6e-a3280eea904f req-f7645470-e417-4abb-8cc7-e71489a38880 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116299 Aug 21 01:28:13.213209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1968/4534] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:13.229419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:13.233364 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:13.253993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:13.254493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:13.257470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:13.260569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:13.262726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:13.264364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:13.325805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:13.340517 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7114f21-9ca6-43b0-af2e-39f6f96307d5 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.497150 Aug 21 01:28:13.342501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2567/4535] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:12 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:13.434043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:13.446464 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f37122b1-455b-47b9-b679-8854754680d2 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1219 microversion: 2.1 time: 0.231951 Aug 21 01:28:13.447061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1969/4536] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:13 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:13.703234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:13.706759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:13.724155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:13.725127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:13.725745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:13.726677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:13.727281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:13.727882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.039865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:14.057122 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0127c2f-5d4b-4167-92af-09a76e9b063d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.369014 Aug 21 01:28:14.058954 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2568/4537] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:13 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:14.108651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:14.110209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:14.120174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.120632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.121111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.122068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.122683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.123299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.366099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:14.366987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:14.367783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:14.387428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.388035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d71923cd-5891-4943-a3bc-618dca34c97b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.287123 Aug 21 01:28:14.388837 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1970/4538] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:14 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:14.401032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.401032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.401032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.401032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.401032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.481347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:14.484882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:14.504561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.505193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.505886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.508917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:14.510724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:14.513275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:14.618097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:14.626904 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e9f3269-e2ca-40a6-b170-9626509dcd7b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1219 microversion: 2.1 time: 0.162770 Aug 21 01:28:14.650736 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1971/4539] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:14 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:14.785935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:14.797415 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5bf1aed-4998-4104-b154-8bf035a0e05b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1523 microversion: 2.1 time: 0.436972 Aug 21 01:28:14.798223 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2569/4540] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:14 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:15.086609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.088387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.101441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.102423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.103211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.104372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.105195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.106871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.195189 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:15.303335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:15.326094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.328589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.329290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.355922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] Creating event network-changed:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:28:15.366790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a784218f-7f10-4d66-9ad2-067d0314e4ce req-f6e8ff21-504f-4008-bca6-6087af5fafca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069127 Aug 21 01:28:15.374221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2570/4541] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:15.380229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.386107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.407233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.408361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.409016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.409910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.410523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.411095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.446656 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c HTTP/1.1 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '88517872-9d13-4fe4-a69d-f943c9b1f67c'} Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:15.449359 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:15.453813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ccde032-c802-4f90-8cc7-a1735b55a84b tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 404 len: 111 microversion: 2.1 time: 0.075227 Aug 21 01:28:15.455488 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2571/4542] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:15 2022] DELETE /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:15.464475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.465591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.472888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.473602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.474281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.475293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.475902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.476465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.744265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:15.766598 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd4fba81-2e14-4c49-a8ff-0f7bd3a658ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.685391 Aug 21 01:28:15.769382 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1972/4543] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:15 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:15.783329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.784419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 88517872-9d13-4fe4-a69d-f943c9b1f67c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.801923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:15.805727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.806997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.808136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.809511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.810205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.811358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-569cdb10-859c-4d11-8cce-bb338a6c82e5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.354687 Aug 21 01:28:15.811598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.811944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2572/4544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:15 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:15.835255 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.836525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.837524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c HTTP/1.1 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '88517872-9d13-4fe4-a69d-f943c9b1f67c'} Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:15.838939 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. Aug 21 01:28:15.847969 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:15.850311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.850819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.851264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.851971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.852100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 88517872-9d13-4fe4-a69d-f943c9b1f67c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:15.852680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.853149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.853429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff338527-3b5c-458f-a37a-32aaf3948d38 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c" status: 404 len: 111 microversion: 2.1 time: 0.082445 Aug 21 01:28:15.854286 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1973/4545] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:15 2022] GET /compute/v2.1/servers/88517872-9d13-4fe4-a69d-f943c9b1f67c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:15.866880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:15.868114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:15.878303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.879103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.879744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.882875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:15.883696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:15.884306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:15.982082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:16.007825 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce4e9bdb-7618-4ad7-89de-86617e8e36c3 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1219 microversion: 2.1 time: 0.194661 Aug 21 01:28:16.027789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2573/4546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:15 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1219 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:16.050034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:16.050543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:16.069734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.070219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.070651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.071351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.071793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.072213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.170950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:28:16.235785 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:16.436462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81b70c23-2751-4641-afe9-4a758e38be18 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 204 len: 0 microversion: 2.1 time: 0.407066 Aug 21 01:28:16.437421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2574/4547] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:16 2022] DELETE /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:16.453618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:16.461574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:16.471340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.471832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.472269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.482451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.482950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.483642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.857841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:16.875252 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-39598a99-76ff-431b-a34c-1b98c775c397 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.429766 Aug 21 01:28:16.886270 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2575/4548] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:16 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:16.894583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:16.895214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:16.911470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.912355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.912820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.913533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:16.913987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:16.914413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:16.988737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:16.998020 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-567fd6ea-2f6f-4daa-aab1-edd862a66635 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1508 microversion: 2.1 time: 1.141935 Aug 21 01:28:16.999384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1974/4549] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:15 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1508 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:17.020683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:17.021727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:17.030270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.030805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.031344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.032089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.032543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.033290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.283206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:17.295410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-317db9c5-dbf1-4748-b4fd-3cbbd0ef83c7 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.294693 Aug 21 01:28:17.297561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1975/4550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:16 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:17.302809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:17.303596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:17.313580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.314273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.314942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.315546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:17.316083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.316712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.317336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.323857 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73d13047-1730-48ba-90f8-c3d926a10586 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.436254 Aug 21 01:28:17.327085 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2576/4551] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:16 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:17.339272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:17.346646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:17.375363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.375854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.376278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.380045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.380747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.381330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.527065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:17.534781 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-387b4e97-c42c-4928-a8e8-1b553c052ce6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1275 microversion: 2.1 time: 0.202527 Aug 21 01:28:17.535361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2577/4552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:17 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:17.592267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:17.611678 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ad0538f-35a4-4b7d-a047-2df4b4bc6a8f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 200 len: 1508 microversion: 2.1 time: 0.312836 Aug 21 01:28:17.621989 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1976/4553] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:17 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:17.640783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:17.641417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:17.644640 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:17.653324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.653820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.654250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.654951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.658139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.660616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.725485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:28:17.909536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:17.911538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:17.936148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.937211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.938056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.940259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:17.941005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:17.941207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3e22739-7c37-4f17-9071-fe2429fe74b6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 204 len: 0 microversion: 2.1 time: 0.302789 Aug 21 01:28:17.942183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:17.943374 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2578/4554] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:17 2022] DELETE /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:18.151264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1696956129", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "83e29afb-1a8c-4dbc-90e5-466dc9f262ce"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:18.267907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] validate_networks() for [('83e29afb-1a8c-4dbc-90e5-466dc9f262ce', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:28:18.575209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:18.589273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1871faf1-6183-42f8-a0e0-f65c179939f5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.693399 Aug 21 01:28:18.590993 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1977/4555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:17 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:18.604734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:18.608827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:18.628059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:18.628686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:18.630262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:18.632838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:18.634553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:18.635431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:19.172956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:19.189089 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50c76956-9bd7-4db1-a0f3-a170e5d1bb54 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.596211 Aug 21 01:28:19.189993 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1978/4556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:18 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:19.200726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:19.202919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:19.225680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:19.226492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:19.227103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:19.228019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:19.233902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:19.234653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:19.691190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:19.742617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4fce79c-ee62-45f6-9757-1626e503bc50 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.546038 Aug 21 01:28:19.743757 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1979/4557] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:19 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:19.770210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:19.774210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:19.803801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:19.805807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:19.811032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:19.816746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:19.821364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:19.821931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:19.951305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:19.963519 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92dc8978-8951-4a6d-80a2-03be8b7c110b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1281 microversion: 2.1 time: 0.216290 Aug 21 01:28:19.965314 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1980/4558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:19 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:19.971983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:19.989203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:20.011255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.011770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.012217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.012997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.024162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.025748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.307794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:20.320868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f3f54759-3b58-4625-b8c1-476947adc1c5 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.354215 Aug 21 01:28:20.321706 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1981/4559] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:19 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:20.359959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "name": "network-vif-unplugged", "status": "completed", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:20.373362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.374066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.374653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.393464 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] Creating event network-vif-unplugged:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:28:20.400624 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c7d7444c-ae11-480e-8af2-fd0425cc75e0 req-1c0d5563-e32d-4878-a31d-cb881e8b6593 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044338 Aug 21 01:28:20.405302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1982/4560] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:20.417186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:20.418769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:20.432876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:28:20.433850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:28:20.434601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:28:20.435190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:28:20.435741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:28:20.436567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.437333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.437962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.438865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.439678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.440322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.455884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.456626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.457226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.458102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.458853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.459485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.505603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:28:20.522490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Getting quotas for user 949126b9470c418897afeacef01c275f and project 25322a249ef24a419f9cf750797da096. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:28:20.559335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:28:20.561849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:28:20.625323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d74aeac3-9314-4f02-8ec0-9af0448cebd6 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480365 Aug 21 01:28:20.633694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2579/4561] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:28:20.640724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23facb15-1bed-4534-a59f-1e6fc3152f11 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:20.642953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23facb15-1bed-4534-a59f-1e6fc3152f11 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:20.855047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23facb15-1bed-4534-a59f-1e6fc3152f11 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:20.862202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:20.865697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23facb15-1bed-4534-a59f-1e6fc3152f11 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1218 microversion: 2.1 time: 0.229263 Aug 21 01:28:20.866286 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2580/4562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:20 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:20.873853 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da3e557e-162f-4e91-aa4d-3be0f48e1ffb tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.465090 Aug 21 01:28:20.890470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590923b7-19cc-4b0c-be83-0ab7c361ce8c", "name": "network-vif-deleted", "tag": "8ccb244a-1b5f-4008-8ebb-904fa71fd563"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:20.890742 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1983/4563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:20 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:20.895779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:20.897164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:20.912062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.912723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.918784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.922914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.923419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.923853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.924780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.925468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.925816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.949335 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] Creating event network-vif-deleted:8ccb244a-1b5f-4008-8ebb-904fa71fd563 for instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c on n-h1-master-1 Aug 21 01:28:20.974341 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ad065967-6947-481c-a2b1-0f09c24aa0d5 req-6fe132a7-02aa-430f-b9cf-283807ddf23c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076324 Aug 21 01:28:20.977377 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2581/4564] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:20.989086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:20.990470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:20.997415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:20.998223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:20.998817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:20.999710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.000499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.001111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.289157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:21.300166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a225bd4a-d636-4788-a271-178a9f9eb5d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.408188 Aug 21 01:28:21.302247 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1984/4565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:20 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:21.359362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:21.360356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:21.369625 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:21.372274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.373071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.382944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.385143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.387365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.388001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.452581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:21.471209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1077dd8-2c21-4009-b239-612faf5429e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1281 microversion: 2.1 time: 0.489239 Aug 21 01:28:21.472127 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2582/4566] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:20 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1281 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:21.626976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:21.636461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b5f34b0-fca3-4b69-9aaa-f7cee20d9676 tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1511 microversion: 2.1 time: 0.284052 Aug 21 01:28:21.640256 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1985/4567] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:21 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:21.890529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:21.891149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:21.899919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:21.900538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:21.916912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.919796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.920477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.921244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.921821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.922416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.923150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.924173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:21.924621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.925062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:21.931467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:21.931878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:22.042662 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=20 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:22.152713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:22.172625 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-437e5b6a-76b3-4b84-b284-dd2470f53738 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1270 microversion: 2.1 time: 0.284911 Aug 21 01:28:22.174272 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2583/4568] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:21 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1270 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:22.287585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:22.300424 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71d4c220-b67b-4c35-9690-5e6d0cc8165e tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.406059 Aug 21 01:28:22.307968 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1986/4569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:21 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:22.328512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:22.329146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:22.343081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:22.343566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:22.343995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:22.344708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:22.353378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:22.354432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:22.438887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2f87fc-4faf-4318-9068-90ccce7924e4", "name": "network-vif-plugged", "status": "completed", "tag": "dc3ed71f-0da2-43a9-99bc-7c339bcec6b7"}, {"server_uuid": "8c5b2e5d-8a33-43bb-8900-cd033579d74b", "name": "network-vif-plugged", "status": "completed", "tag": "b1f8ca0f-1b24-43ee-a952-eb8abde0ea79"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:22.463042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:22.463776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:22.464033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:22.503596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Creating event network-vif-plugged:dc3ed71f-0da2-43a9-99bc-7c339bcec6b7 for instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 on n-h2-master-1 Aug 21 01:28:22.504164 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] Creating event network-vif-plugged:b1f8ca0f-1b24-43ee-a952-eb8abde0ea79 for instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b on n-h1-master-1 Aug 21 01:28:22.533439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-70a744fe-e0f5-4304-817a-b68cccb36692 req-c249e96a-3ad1-4f39-bc2c-e80197c8f9ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100005 Aug 21 01:28:22.534093 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1987/4570] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:28:22.555645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:22.556526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:22.563888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:22.564379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:22.565134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:22.565932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:22.566563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:22.567251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.050460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:23.060176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b471408a-8f3d-489b-a3e1-b96d04b045e4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.736398 Aug 21 01:28:23.060788 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2584/4571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:22 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:23.159793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:23.199127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ecff660-fc8a-4d2c-91c5-fd766ee06f48 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.648931 Aug 21 01:28:23.204699 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1988/4572] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:22 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:23.219696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:23.224524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:23.246666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.247473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.248184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.273686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.275210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.275951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.493378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b499cf8-c55e-42d3-becc-1e2c05db75be", "name": "network-vif-deleted", "tag": "ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:23.516581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e970187b548d0878f3cbfc89f25fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f6cf1c2694e7099cff8757420b421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:23.517926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.518411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.518847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.527976 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6bbd3b1-a2bd-41f7-8070-b30b4cfb42ea tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 200 len: 1469 microversion: 2.1 time: 0.321548 Aug 21 01:28:23.530943 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1989/4573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:23 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:23.549406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] Creating event network-vif-deleted:ec2ddceb-ba23-49d9-8f4f-0e87f18a4e18 for instance 7b499cf8-c55e-42d3-becc-1e2c05db75be on n-h2-master-1 Aug 21 01:28:23.558067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:23.558700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:23.559987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-31ec481b-bad3-4533-ad87-9f6944cb931b req-eacca9b0-293f-4875-8c64-db1fdfc97777 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.495360 Aug 21 01:28:23.560943 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2585/4574] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:23.574086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:23.574802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:23.591121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.591629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.592063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.592998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.593614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.594456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.604316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.604942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.608412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.609317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:23.609844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:23.610271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:23.762878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:23.782551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-077716e1-04e7-4271-bd25-0e92a6d75f40 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1276 microversion: 2.1 time: 0.249017 Aug 21 01:28:23.784097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1990/4575] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:23 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:24.101691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:24.102830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:24.117883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.119054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.121114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:24.123751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.124380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.125018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:24.130048 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:24.219722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:24.252539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ed092bb9-2b79-402f-9def-13a73d3c504c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.684140 Aug 21 01:28:24.255155 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2586/4576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:23 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:24.263618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:24.264641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:24.297104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.298992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.300062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:24.304034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.305363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.308158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:24.592076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:24.608338 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0c6feb9-e892-4c3d-8f44-d0252e5f3368 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1322 microversion: 2.1 time: 0.510693 Aug 21 01:28:24.610846 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1991/4577] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:24 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:24.921720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:24.933871 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0616d850-3a19-4375-8cde-b0076a104b16 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.676120 Aug 21 01:28:24.934743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2587/4578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:24 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:24.953185 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:24.954082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:24.963705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.966503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.967195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:24.968192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:24.970646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:24.971863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.076222 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:25.077742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] [instance: 7b499cf8-c55e-42d3-becc-1e2c05db75be] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:25.089551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.090517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.092601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.093502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.098613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.099523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.124149 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] HTTP exception thrown: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Request method failure captured: Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be HTTP/1.1 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYkLA6FJgVPdAHWstjbseMPYfwEbDaHsZhRR_yA0LLzHK2gx9FI84LG5bsA2ufo1pgMJXf-dom5STBBoCpV7S8B6xzQXHTK9_K2tvuqC4citfd1e2LsAUlV7-sRZTorIkmrPNNNaVsilaVN_joINfNpqO8R2pY1Pr99CuRG3KNZhVPM Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6d9f6cf1c2694e7099cff8757420b421", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6d9f6cf1c2694e7099cff8757420b421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6d9f6cf1c2694e7099cff8757420b421"}]}] Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 6d9f6cf1c2694e7099cff8757420b421 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-365953399 Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: fe0e970187b548d0878f3cbfc89f25fc Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-365953399-project Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b499cf8-c55e-42d3-becc-1e2c05db75be'} Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:25.132280 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:25.136426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] Returning 404 to user: Instance 7b499cf8-c55e-42d3-becc-1e2c05db75be could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:25.146577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4bfaf154-c6e8-41d2-b49e-fb5eb902c0ba tempest-ServersNegativeTestJSON-365953399 tempest-ServersNegativeTestJSON-365953399-project] 10.222.0.46 "GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be" status: 404 len: 111 microversion: 2.1 time: 0.533584 Aug 21 01:28:25.157643 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1992/4579] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:24 2022] GET /compute/v2.1/servers/7b499cf8-c55e-42d3-becc-1e2c05db75be => generated 111 bytes in 542 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:25.277165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:25.278054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:25.286308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.287110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.287773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.288669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.289844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.290633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.398622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:25.414239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-466a6461-e306-4952-a970-4d6426152034 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.474909 Aug 21 01:28:25.415552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2588/4580] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:24 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:25.631148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:25.632075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:25.640817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.641664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.642306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:25.643211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:25.643843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:25.644503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.073272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:26.089784 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b7ae66e-4f3c-43e2-a922-e1058ff3179c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.817881 Aug 21 01:28:26.090729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1993/4581] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:25 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:26.095414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3266ea48-f838-498c-b5b0-0149627414c0", "tag": "650a8940-1df2-4516-b42e-ea4e86f405bb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:26.112293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.113067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.113656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.136317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] Creating event network-changed:650a8940-1df2-4516-b42e-ea4e86f405bb for instance 3266ea48-f838-498c-b5b0-0149627414c0 on n-h1-master-1 Aug 21 01:28:26.141789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4b30afde-f4a0-41d0-a169-ade7ef72ace8 req-e961ada6-7158-408e-8474-cadb46b6bc27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049807 Aug 21 01:28:26.142650 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1994/4582] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:26.149436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:26.151152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:26.159949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.160614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.161264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.162546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.163219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.163828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.599618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:26.621134 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d011ecae-e9cf-4f62-923b-851dc4b16c35 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.477033 Aug 21 01:28:26.622704 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1995/4583] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:26 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:26.630695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:26.631854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:26.639094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.639570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.640028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.640718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.641356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.641775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.656076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:26.680800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a69620bb-c1aa-4fdb-b826-03c8ad690d85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1517 microversion: 2.1 time: 1.054575 Aug 21 01:28:26.681418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2589/4584] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:25 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1517 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:26.703076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:26.706247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:26.713376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.714118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.714743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.716056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.716694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.717345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.746929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'flavor' on Instance uuid 8c5b2e5d-8a33-43bb-8900-cd033579d74b {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:26.827488 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:26.873957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d40d579b-7f2a-4223-84dc-c14d96fc06ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action" status: 200 len: 32 microversion: 2.1 time: 0.174965 Aug 21 01:28:26.874901 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2590/4585] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:26 2022] POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:28:26.892258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:26.893014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:26.903526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.904681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.906809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:26.907809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:26.908516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:26.909731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.047656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:27.058572 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9c6684f-d17e-489b-a347-3aa2ed5ea222 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.433692 Aug 21 01:28:27.059898 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1996/4586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:26 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:27.067449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ff062d-be50-4a2f-b4ad-b40fc3c0a037", "tag": "69b7540e-d53f-4c16-adac-97b2916b6634"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:27.083413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.084856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.086229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.106315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] Creating event network-changed:69b7540e-d53f-4c16-adac-97b2916b6634 for instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 on n-h2-master-1 Aug 21 01:28:27.114235 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-246bd02c-385c-44f2-ace0-16d572ebf060 req-b15d798c-e1d9-4fed-9307-a9fd126ae344 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052153 Aug 21 01:28:27.116009 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1997/4587] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:27.125041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:27.126300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:27.157230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.158248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.158854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.159741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.160412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.161401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.493278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:27.500446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:27.512370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-807fb5ae-444b-4abc-96be-64cc311102b5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.631902 Aug 21 01:28:27.521423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4abbb866-333f-4790-bf62-858c1556ba51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.391346 Aug 21 01:28:27.525090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1998/4588] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:27 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:27.532041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2591/4589] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:26 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:27.642934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:27.643548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:27.656921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.657502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.657847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.658581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.659036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.659456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.682330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "name": "network-vif-plugged", "status": "completed", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:27.743566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:27.744409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:27.745126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:27.760479 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] Creating event network-vif-plugged:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:28:27.768752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7c670f78-a9be-4df0-a79d-094f33cc0dd1 req-e24585fa-c5e6-4899-8479-64d6b6ed21b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089574 Aug 21 01:28:27.769960 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2592/4590] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:28:28.083759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:28.084536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:28.093457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.093939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.094367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.095065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.095502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.095913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.271549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:28.281095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ac198c15-5d26-4b4d-99f9-edf7c690e02c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.641824 Aug 21 01:28:28.304567 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 1999/4591] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:27 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:28.533296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:28.533914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:28.549069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.549573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.550010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.550736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.551190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.551613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.685663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:28.698422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1ffb10e-c2fd-485b-8bc8-bcfbf460bb2e tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.621606 Aug 21 01:28:28.700345 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2593/4592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:28 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:28.706430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:28.707224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:28.714921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.715613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.716468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.717607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:28.718413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:28.719399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:28.903844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:28.917348 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a54e0350-8973-4e1f-9772-69d0288f3c07 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.215160 Aug 21 01:28:28.918168 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2594/4593] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:28 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:29.309385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:29.311167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:29.320530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.321409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.322304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:29.323307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.324749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.325436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:29.573613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:29.597340 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4403988b-7ecc-42cc-8531-28d72ea50e8e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.294659 Aug 21 01:28:29.598426 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2595/4594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:29 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:29.638937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:29.657614 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f8063be-8841-4109-a063-8ad7d3788947 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 1.128172 Aug 21 01:28:29.658250 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2000/4595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:28 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:29.721523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:29.722257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:29.735288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.735933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.741371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:29.742686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.743172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.743602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:29.955192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:29.955820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:29.975853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.976708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.978432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:29.979411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:29.980071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:29.980700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:30.060515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:30.077180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbbe7588-4d2e-4093-83b5-ca7ba9390671 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.361153 Aug 21 01:28:30.078031 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2596/4596] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:29 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:30.450353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:30.461176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-575305e1-da49-47f0-a098-ccd23f8a4a4c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.522092 Aug 21 01:28:30.461768 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2001/4597] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:29 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:30.619965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:30.620588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:30.630294 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:30.636154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:30.637132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:30.637833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:30.638748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:30.639544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:30.640210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:30.685850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:30.686502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:30.699105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:30.699926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:30.700867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:30.702082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:30.702754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:30.703582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:30.859273 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:31.062323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:31.071958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1686b00e-82c8-42b0-a06a-9c313660a5a2 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.392856 Aug 21 01:28:31.080644 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2002/4598] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:30 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:31.101238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:31.104755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:31.104950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:31.113618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb9ebba2-01f3-4052-85e6-619a344980c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.498085 Aug 21 01:28:31.116358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:31.117754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:31.119311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:31.121628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:31.123809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:31.124639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:31.133590 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2597/4599] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:30 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:31.481235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:31.481851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:31.495383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:31.495878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:31.496336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:31.497094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:31.497547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:31.497962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:31.589641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:31.597868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf51aafe-01c6-4328-8dfe-c4067eb3bc3d tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.502125 Aug 21 01:28:31.611993 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2003/4600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:31 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:31.972480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:31.989368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0495d50c-3274-4f42-b4f5-f8ae0671050c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.511985 Aug 21 01:28:32.009008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2598/4601] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:31 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:32.105163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:32.106530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:32.116665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.117214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.117656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.126264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.126981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.127596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.155242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:32.157764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:32.175926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.179715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.188589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.189445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.189904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.190325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.506555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:32.516280 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6e28a206-4e49-4d6a-a6d1-d05a2a6d92c9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.415008 Aug 21 01:28:32.529359 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2004/4602] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:32 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:32.538571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266ea48-f838-498c-b5b0-0149627414c0", "name": "network-vif-plugged", "status": "completed", "tag": "650a8940-1df2-4516-b42e-ea4e86f405bb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:32.556064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.557453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.558404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.572573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] Creating event network-vif-plugged:650a8940-1df2-4516-b42e-ea4e86f405bb for instance 3266ea48-f838-498c-b5b0-0149627414c0 on n-h1-master-1 Aug 21 01:28:32.577955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a0c9264a-892c-4e6e-8fac-aae92bb13504 req-06f7e284-4e1a-42a5-baeb-3682cb21ca99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047259 Aug 21 01:28:32.578795 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2005/4603] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:32.624326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:32.625306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:32.634135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.635445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.636511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.637697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:32.638158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:32.638577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:32.878496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:32.892613 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a9d6f04-5ba2-4908-87f9-d130c3dfa26b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1318 microversion: 2.1 time: 0.275054 Aug 21 01:28:32.894203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2006/4604] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:32 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:32.931681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:32.962489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-903bff89-9623-46e8-a7f9-6906891d6935 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.823576 Aug 21 01:28:32.980820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2599/4605] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:32 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:33.017647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:33.018227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:33.046217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:33.046983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:33.048155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:33.051903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:33.053558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:33.054181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:33.311487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:33.324297 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e44f7f4-8a97-4af8-9ff7-1323afad7da4 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1323 microversion: 2.1 time: 0.311392 Aug 21 01:28:33.331625 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2007/4606] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:33 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:33.545960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:33.546736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:33.559108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:33.559608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:33.560046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:33.560758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:33.561231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:33.570184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:33.988392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:33.989834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:34.010103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.010439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.011079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.012019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.012987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.013607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.118217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:34.133682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c7b8957-b244-4a24-8375-38304515a7e6 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.592588 Aug 21 01:28:34.151619 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2600/4607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:33 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:34.156696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:34.161564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:34.175135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.175853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.176433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.177651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.186690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.187282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.683799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:34.690240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bc509ea1-a9fd-4125-aa9f-d977efeb1577 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1509 microversion: 2.1 time: 0.537317 Aug 21 01:28:34.690837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2601/4608] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:34 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:34.697105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:34.697879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:34.708267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.708922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.709382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.710083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.710528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.710937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.801790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:34.811363 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59b39771-12bc-4cbe-ae21-3ad138265893 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.826913 Aug 21 01:28:34.826768 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2008/4609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:33 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:34.833699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:34.834521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:34.842514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.843354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.843946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.844822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:34.845490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:34.846281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:34.983650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:34.997383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fe96ebe-cc6d-48e6-a96d-4ac2f97ab3ae tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1517 microversion: 2.1 time: 0.304671 Aug 21 01:28:34.998210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2602/4610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:34 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:35.022103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:35.036469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:35.049090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.050449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.051101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.052239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.052932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.053634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.092455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lazy-loading 'flavor' on Instance uuid 50a48ebf-327b-47df-b4cb-1ae9131d94a9 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:35.146787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:35.162281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d1c6985-de9c-4d19-94e0-0db52ecad0e3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1509 microversion: 2.1 time: 0.333637 Aug 21 01:28:35.162888 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2009/4611] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:34 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:35.176944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:35.176944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:35.186067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.186572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.187018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.187728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.188179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.195257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.247183 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:35.250239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1464b8e4-ff15-462d-b550-661829e8ae21 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action" status: 200 len: 32 microversion: 2.1 time: 0.235778 Aug 21 01:28:35.252523 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2603/4612] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:35 2022] POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:28:35.260646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:35.268657 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:35.285542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.286204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.286716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.287671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.288909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.289477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.364693 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:35.400137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02f27db8-8413-48d0-b808-a515b9fadc35 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "PUT /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1081 microversion: 2.1 time: 0.143393 Aug 21 01:28:35.412797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2604/4613] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:28:35 2022] PUT /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1081 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:35.426338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:35.430106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:35.445831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.446339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.447971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.450390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.451040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.453539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.688151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:35.697719 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c282fb3-3f83-40e1-9886-d3dda1cedf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.281883 Aug 21 01:28:35.699387 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2605/4614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:35 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:35.705918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:35.707191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:35.719868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.720979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.721699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:35.722928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:35.723536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:35.724388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.001741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:36.015129 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3b6d250-60d2-40be-b170-d97867f73a1f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.850937 Aug 21 01:28:36.017099 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2010/4615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:35 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:36.035121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:36.036079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:36.051136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.053870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.056399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.057375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.060061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.061120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.186258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:36.198419 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-983660bd-501d-4ee5-863d-7c9f2d4cf18b tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1507 microversion: 2.1 time: 0.493351 Aug 21 01:28:36.219790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2606/4616] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:35 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:36.227830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ff062d-be50-4a2f-b4ad-b40fc3c0a037", "name": "network-vif-plugged", "status": "completed", "tag": "69b7540e-d53f-4c16-adac-97b2916b6634"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:36.264137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.267554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.268148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.300740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] Creating event network-vif-plugged:69b7540e-d53f-4c16-adac-97b2916b6634 for instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 on n-h2-master-1 Aug 21 01:28:36.310733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-475e424f-336e-4261-9b94-9cfd5224a0f8 req-7791320c-1222-4814-9ba7-868e153abf67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088903 Aug 21 01:28:36.313552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2607/4617] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:36.320863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:36.322024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:36.331984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.335005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.335814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.336891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.337540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.338155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.735464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:36.749361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a79445c6-379b-4c01-860b-d4655af01fbf tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1507 microversion: 2.1 time: 0.430698 Aug 21 01:28:36.750514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2608/4618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:36 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:36.756963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:36.757877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:36.764847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.765865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.767436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.768160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.768573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.769046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.785585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:36.797940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-093e9fc3-3ab5-489a-91d0-c50701d9af89 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.779406 Aug 21 01:28:36.798858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2011/4619] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:36 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:36.803827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:36.807136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:36.814094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.814744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.815325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.816189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.816851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.817494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.922880 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c1b6a51f-7c0c-4c2a-b265-8a3120c4f629 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "PUT /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1083 microversion: 2.1 time: 0.122649 Aug 21 01:28:36.923881 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2012/4620] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:28:36 2022] PUT /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1083 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:36.943506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:36.944997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:36.951375 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:36.953710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.955096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.955826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.956890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:36.957584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:36.958464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:36.982139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:36.996926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee9ba6fa-127f-46ad-b484-715cc6517a56 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.244632 Aug 21 01:28:36.997636 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2609/4621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:36 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:37.037569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:37.038519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:37.046820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.047562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.048343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.049241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.052606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.053354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.325868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:37.335830 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b508ab6-a292-4688-930e-86e1cf66536a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.302713 Aug 21 01:28:37.336615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2610/4622] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:37 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:37.557503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:37.569709 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea8ce5d7-a66e-4169-a805-7c039e62a3a3 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1509 microversion: 2.1 time: 0.631123 Aug 21 01:28:37.570510 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2013/4623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:36 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1509 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:37.590464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:37.591357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:37.600262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.601115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.601703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.603139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.603749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.604321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.825508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:37.828164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:37.843189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.844926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.849398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.850419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:37.851175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:37.851760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:37.953543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:37.965544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8b30633-925a-4326-988e-169a29de2420 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1509 microversion: 2.1 time: 0.379313 Aug 21 01:28:37.966307 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2611/4624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:37 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:37.988055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:37.997755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:38.011669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.013845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.016378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.017213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.017672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.018096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.107622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:28:38.217245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:38.244577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-824c987f-ec17-47cc-afe1-2c4a8d30782a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1323 microversion: 2.1 time: 0.419800 Aug 21 01:28:38.247968 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2014/4625] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:37 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:38.268628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:38.270711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:38.289627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.292509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.294151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.295537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.297469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.298620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.432486 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-788894d1-deed-400f-b1be-954acad4468a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 204 len: 0 microversion: 2.1 time: 0.448065 Aug 21 01:28:38.433127 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2612/4626] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:37 2022] DELETE /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:38.445254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:38.445962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:38.462228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.463113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.463711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.468594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.469438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.470091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.710103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:38.732478 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4eceaac3-fde0-4d74-b45c-810c69dc0b66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.297563 Aug 21 01:28:38.734841 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2613/4627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:38 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:38.742221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:38.743377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:38.749483 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:38.754247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.756019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.756739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.758441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.759412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.760017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.817237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:28:38.920604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Instance is already in deleting state, ignoring this request Aug 21 01:28:38.921868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 204 len: 0 microversion: 2.1 time: 0.185145 Aug 21 01:28:38.923006 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2614/4628] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:38 2022] DELETE /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:38.924561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:38.925840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-987bea84-46cb-4ec7-a98c-2577f1a8740a tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001428 Aug 21 01:28:38.934027 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2615/4629] 10.222.0.46 () {56 vars in 886 bytes} [Sun Aug 21 01:28:38 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 21 01:28:38.940077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:38.945542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:38.950159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:38.954810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-363ee100-9d1b-4fbe-b6af-565cd51402be tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.704872 Aug 21 01:28:38.963946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2015/4630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:38 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:38.969537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.970452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.975873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:38.976900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:38.977614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:38.978262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:39.244030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:39.254736 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ddfd64fa-5078-42c0-beb3-ad4ca9015891 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1515 microversion: 2.1 time: 0.318933 Aug 21 01:28:39.255722 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2616/4631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:38 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:39.267023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:39.268017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:39.280664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:39.281663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:39.282403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:39.283734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:39.284693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:39.287098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:39.756553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:39.769113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:39.793726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:39.794148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:39.794590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:39.796489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:39.799880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:39.800547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.080144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:40.089546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1e5313c-e6b4-4215-a947-914662a557cb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.337384 Aug 21 01:28:40.091322 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2617/4632] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:39 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:40.097675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:40.098829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:40.129333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.135452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.136865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.152213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.152807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.153253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.238050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:40.265166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a08eba3-ed70-4f74-9463-5ad5016d5765 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1520 microversion: 2.1 time: 1.001988 Aug 21 01:28:40.283874 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2016/4633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:39 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1520 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:40.293013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:40.293933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:40.300555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.301470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.302851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.303790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.304446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.305907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.385232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:40.400296 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9546c5c-850e-4997-a8ab-5adbcc181d51 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.307573 Aug 21 01:28:40.405240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2618/4634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:40 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:40.418579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:40.422314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:40.432737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.433250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.433676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.434370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.439696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.440309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.650876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:40.653909 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:40.663903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbe72077-37ad-4b3d-a95a-ebe3a71bae81 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1520 microversion: 2.1 time: 0.257152 Aug 21 01:28:40.664669 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2619/4635] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:40 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:40.695981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-347838090"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:40.699559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:40.705530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.706219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.706973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.708087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:40.708718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:40.709345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:40.757051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:40.766557 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be9a7fa0-7276-4704-85f4-63e5411328b9 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1515 microversion: 2.1 time: 0.481066 Aug 21 01:28:40.769582 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2017/4636] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:40 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1515 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:41.053339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f984830e-19ce-4344-ad1a-339f00bb0fa4 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037/action" status: 202 len: 0 microversion: 2.1 time: 0.362109 Aug 21 01:28:41.062774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2620/4637] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:40 2022] POST /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 21 01:28:41.068139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04b5e7a1-53ea-4680-ac56-ac340c0b2183 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc403283b80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:41.112496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:41.113687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:41.131077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.133940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.134996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.135878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.136425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.137879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.485634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04b5e7a1-53ea-4680-ac56-ac340c0b2183 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59" status: 204 len: 0 microversion: 2.1 time: 0.421599 Aug 21 01:28:41.486855 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2018/4638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:41 2022] DELETE /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:41.499711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266ea48-f838-498c-b5b0-0149627414c0", "name": "network-vif-deleted", "tag": "650a8940-1df2-4516-b42e-ea4e86f405bb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:41.555849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.561307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.561905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.603311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] Creating event network-vif-deleted:650a8940-1df2-4516-b42e-ea4e86f405bb for instance 3266ea48-f838-498c-b5b0-0149627414c0 on n-h1-master-1 Aug 21 01:28:41.613537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b0ffea7c-f3d2-424e-aade-e309671bfe72 req-98956415-2096-452b-b5fb-d4241709caa0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125228 Aug 21 01:28:41.615091 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2019/4639] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:41.627865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:41.629180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:41.638854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.639690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.640573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.643303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.644265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.644865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.697317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:41.724379 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d44fc1b7-7c8e-49df-a4a4-64de57c9d1fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.616574 Aug 21 01:28:41.726189 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2621/4640] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:41 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:41.736127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb0d35d7-af5c-4068-86df-53f2b927ee5a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc3f88cf820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:41.777292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-cb0d35d7-af5c-4068-86df-53f2b927ee5a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Image not found. Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb0d35d7-af5c-4068-86df-53f2b927ee5a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59 HTTP/1.1 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a4ace35d-cda4-47c2-a318-a665b9490b59'} Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4ace35d-cda4-47c2-a318-a665b9490b59 Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 21 01:28:41.781038 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4ace35d-cda4-47c2-a318-a665b9490b59 could not be found. Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:28:41.784890 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:41.793356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb0d35d7-af5c-4068-86df-53f2b927ee5a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:41.794481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb0d35d7-af5c-4068-86df-53f2b927ee5a tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59" status: 404 len: 62 microversion: 2.1 time: 0.062616 Aug 21 01:28:41.796609 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2622/4641] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:28:41 2022] GET /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:28:41.805122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:41.807468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:41.823393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.836518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.838568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.840301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.842468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.843160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.971995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:41.972874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:41.973867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:41.974577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lazy-loading 'fault' on Instance uuid 3266ea48-f838-498c-b5b0-0149627414c0 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:42.089313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '949126b9470c418897afeacef01c275f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25322a249ef24a419f9cf750797da096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:42.097893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56c9285c-9e65-4637-82b3-05c9b6a6a321 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 200 len: 1308 microversion: 2.1 time: 0.299166 Aug 21 01:28:42.099452 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2623/4642] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:41 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:42.112602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:42.113719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:42.126961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:42.127831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:42.128673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:42.131608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:42.132292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:42.132939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:42.165834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:42.176042 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ae5a68f-6c8d-4bd4-94c3-e758a3cfb982 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.557896 Aug 21 01:28:42.188947 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2020/4643] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:41 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:42.435324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:42.449430 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d80466e7-3146-4e4f-8dcd-2f98981ff21b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1532 microversion: 2.1 time: 0.347656 Aug 21 01:28:42.453509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2624/4644] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:42 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1532 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:42.754336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:42.756752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:42.765098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:42.766272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:42.767613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:42.771480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:42.773474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:42.774161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.123015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.124422 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 3266ea48-f838-498c-b5b0-0149627414c0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.159483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.160346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.161059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.162182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.162892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.163638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.200113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] HTTP exception thrown: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Request method failure captured: Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 HTTP/1.1 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYmrr9Y2ArEWy9RAdhjnZgNrKCynZ4Di3wuDvOf56YG8zn7LV7Er2sRTgOxXkOamif_7iW9LXbbE8ghGhKwYORhJLUncrC0RTrWLeZ748X9HAO_12ri7wHkIu1LsQdosW_NpMKfOowErNnaG5sgbRxI37BuOF2KaL3dM5tsR0caSvnc Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25322a249ef24a419f9cf750797da096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25322a249ef24a419f9cf750797da096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}] Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 949126b9470c418897afeacef01c275f Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3266ea48-f838-498c-b5b0-0149627414c0'} Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.202159 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. Aug 21 01:28:43.210296 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.212249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Returning 404 to user: Instance 3266ea48-f838-498c-b5b0-0149627414c0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:43.212735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-848a7ab4-3233-4c3e-a2b8-a8a2c5246416 tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0" status: 404 len: 111 microversion: 2.1 time: 0.095656 Aug 21 01:28:43.216352 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2625/4645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:43 2022] GET /compute/v2.1/servers/3266ea48-f838-498c-b5b0-0149627414c0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:28:43.220438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.222850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.229521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.230011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.230444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.231425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.231966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.232507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.419550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:43.431830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88f79084-d887-4b1a-96f6-339efd3cbcf5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.683822 Aug 21 01:28:43.437135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2021/4646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:42 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:43.446389 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.446872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.459068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.459472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.459908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.460619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.468657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.469181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.493740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] HTTP exception thrown: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Request method failure captured: Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c HTTP/1.1 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYmrr9Y2ArEWy9RAdhjnZgNrKCynZ4Di3wuDvOf56YG8zn7LV7Er2sRTgOxXkOamif_7iW9LXbbE8ghGhKwYORhJLUncrC0RTrWLeZ748X9HAO_12ri7wHkIu1LsQdosW_NpMKfOowErNnaG5sgbRxI37BuOF2KaL3dM5tsR0caSvnc Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25322a249ef24a419f9cf750797da096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25322a249ef24a419f9cf750797da096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}] Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 949126b9470c418897afeacef01c275f Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '590923b7-19cc-4b0c-be83-0ab7c361ce8c'} Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:43.503846 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Returning 404 to user: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:43.508622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-004d3032-8741-406f-9b27-f5a924b3e32f tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 404 len: 111 microversion: 2.1 time: 0.068008 Aug 21 01:28:43.512656 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2022/4647] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:43 2022] DELETE /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:43.517772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.518378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.542413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.542901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.543518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.544401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.545028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.545602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.727431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:43.777165 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c3524ef-dc65-47aa-bad7-f78ad9a8608f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.556028 Aug 21 01:28:43.777871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2626/4648] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:43 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:43.797567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.799794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 590923b7-19cc-4b0c-be83-0ab7c361ce8c] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.824700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.833570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.837400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.839175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.840256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.840895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.874545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] HTTP exception thrown: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Request method failure captured: Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c HTTP/1.1 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYmrr9Y2ArEWy9RAdhjnZgNrKCynZ4Di3wuDvOf56YG8zn7LV7Er2sRTgOxXkOamif_7iW9LXbbE8ghGhKwYORhJLUncrC0RTrWLeZ748X9HAO_12ri7wHkIu1LsQdosW_NpMKfOowErNnaG5sgbRxI37BuOF2KaL3dM5tsR0caSvnc Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25322a249ef24a419f9cf750797da096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25322a249ef24a419f9cf750797da096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}] Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 949126b9470c418897afeacef01c275f Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '590923b7-19cc-4b0c-be83-0ab7c361ce8c'} Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.876161 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Returning 404 to user: Instance 590923b7-19cc-4b0c-be83-0ab7c361ce8c could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:43.880251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f7ecf02-6b3d-4b48-aced-52dbae54f2df tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c" status: 404 len: 111 microversion: 2.1 time: 0.099190 Aug 21 01:28:43.880954 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2627/4649] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:43 2022] GET /compute/v2.1/servers/590923b7-19cc-4b0c-be83-0ab7c361ce8c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:43.905549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.906065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:43.922799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.923426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.923853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.924577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:43.925055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:43.925657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:43.952859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] HTTP exception thrown: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Request method failure captured: Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a HTTP/1.1 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYmrr9Y2ArEWy9RAdhjnZgNrKCynZ4Di3wuDvOf56YG8zn7LV7Er2sRTgOxXkOamif_7iW9LXbbE8ghGhKwYORhJLUncrC0RTrWLeZ748X9HAO_12ri7wHkIu1LsQdosW_NpMKfOowErNnaG5sgbRxI37BuOF2KaL3dM5tsR0caSvnc Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25322a249ef24a419f9cf750797da096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25322a249ef24a419f9cf750797da096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}] Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 949126b9470c418897afeacef01c275f Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0a16f3cb-090f-42f5-ac2f-126e2b60450a'} Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:43.954601 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:43.958925 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:43.964908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Returning 404 to user: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:43.966526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f0d3726-a017-444b-9951-a0e97acb87ca tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 404 len: 111 microversion: 2.1 time: 0.077173 Aug 21 01:28:43.971608 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2628/4650] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:43 2022] DELETE /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:43.982516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:43.985563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] [instance: 0a16f3cb-090f-42f5-ac2f-126e2b60450a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:44.004467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.005285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.005825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:44.006632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.007197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.007713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:44.036292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] HTTP exception thrown: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Request method failure captured: Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a HTTP/1.1 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYmrr9Y2ArEWy9RAdhjnZgNrKCynZ4Di3wuDvOf56YG8zn7LV7Er2sRTgOxXkOamif_7iW9LXbbE8ghGhKwYORhJLUncrC0RTrWLeZ748X9HAO_12ri7wHkIu1LsQdosW_NpMKfOowErNnaG5sgbRxI37BuOF2KaL3dM5tsR0caSvnc Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25322a249ef24a419f9cf750797da096", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25322a249ef24a419f9cf750797da096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25322a249ef24a419f9cf750797da096"}]}] Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 25322a249ef24a419f9cf750797da096 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989154668 Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 949126b9470c418897afeacef01c275f Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-989154668-project Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0a16f3cb-090f-42f5-ac2f-126e2b60450a'} Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:44.042715 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] Returning 404 to user: Instance 0a16f3cb-090f-42f5-ac2f-126e2b60450a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:44.046682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79ebc76c-1c13-408c-b393-22fb8490e6de tempest-ServerDiskConfigTestJSON-989154668 tempest-ServerDiskConfigTestJSON-989154668-project] 10.222.0.46 "GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a" status: 404 len: 111 microversion: 2.1 time: 0.073070 Aug 21 01:28:44.047218 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2629/4651] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:43 2022] GET /compute/v2.1/servers/0a16f3cb-090f-42f5-ac2f-126e2b60450a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:44.301777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:44.310668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97f151e7-afe6-4f9e-b803-f4a5a94b3a82 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1532 microversion: 2.1 time: 0.796669 Aug 21 01:28:44.321192 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2023/4652] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:43 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1532 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:44.454618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:44.458005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:44.470003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.473075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.473886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:44.476116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.482284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.483103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:44.801834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:44.803576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:44.812759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.814296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.814986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:44.815948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:44.816924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:44.818166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:45.028919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:45.039510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a922356f-85f2-40b9-96ef-cd02d6504182 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.588803 Aug 21 01:28:45.057532 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2630/4653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:44 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:45.331593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:45.332201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:45.339850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:45.344912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:45.345367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:45.346161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:45.346745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:45.347036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:45.605960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:45.617237 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c18531de-621b-48f3-be2d-2f446e206cb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.819460 Aug 21 01:28:45.621938 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2024/4654] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:44 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:45.930330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:45.949970 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e57fbdfb-ae92-4fc7-80cb-53c929171a13 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1538 microversion: 2.1 time: 0.615993 Aug 21 01:28:45.950709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2631/4655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:45 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1538 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:46.072745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:46.073495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:46.088966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.091378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.091971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:46.092861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.096103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.096634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:46.583137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:46.603350 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-198cb04e-d71a-4729-bda1-32061a6480de tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1523 microversion: 2.1 time: 0.533502 Aug 21 01:28:46.605121 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2025/4656] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:46 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:46.643223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:46.643993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:46.698826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.699544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.700353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:46.701346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.702218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.713864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:46.972402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:46.973269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:46.985022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.985941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.987077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:46.988478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:46.993617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:46.994187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:47.477262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:47.487580 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e09ac91-31ad-4238-8a5d-25f484e9fc15 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1538 microversion: 2.1 time: 0.519818 Aug 21 01:28:47.488437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2026/4657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:46 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1538 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:47.494137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:47.515805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3bf6f240-ceb0-4ade-ae19-be81d8f88b1c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.877152 Aug 21 01:28:47.517213 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2632/4658] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:46 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:47.628032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:47.629067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:47.643328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:47.643825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:47.644251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:47.651595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:47.652206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:47.652713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:47.958228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ff062d-be50-4a2f-b4ad-b40fc3c0a037", "name": "network-vif-plugged", "status": "completed", "tag": "69b7540e-d53f-4c16-adac-97b2916b6634"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:47.983704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:47.984183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:47.984608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.011322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] Creating event network-vif-plugged:69b7540e-d53f-4c16-adac-97b2916b6634 for instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 on n-h2-master-1 Aug 21 01:28:48.033869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-00c56de0-11e5-4b1b-87d7-7e3c18dd3750 req-5eb7a3ea-0519-4bee-a628-5df5ff6d354b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080377 Aug 21 01:28:48.034500 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2633/4659] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:28:48.245065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:48.254342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1276725-7fa6-47d0-8c41-1592ecba4f4a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1503 microversion: 2.1 time: 0.631719 Aug 21 01:28:48.260521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2027/4660] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:47 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1503 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:48.283140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:48.284022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:48.297596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.298398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.299015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.299898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.300493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.301079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.512783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:48.513766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:48.527758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.529865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.532416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.533689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.536815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.537485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.909893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:48.914496 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:48.927746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-159a0285-ba46-4563-8a31-142cb3c4408c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1533 microversion: 2.1 time: 0.422028 Aug 21 01:28:48.929861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2028/4661] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:48 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1533 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:48.947107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:48.947967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:48.967540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.968039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.968455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:48.969199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:48.969645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:48.970057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.242735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:49.255939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe2329b4-8f16-46e8-b7a3-ff0293fe5db1 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.320317 Aug 21 01:28:49.257051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2029/4662] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:48 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:49.661132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:49.671809 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d9fe85a-19ac-4bf9-882d-3d36b9a388bb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1515 microversion: 2.1 time: 1.392874 Aug 21 01:28:49.674679 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2634/4663] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:48 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1515 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:49.700357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:49.703097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 12c26425-019b-4094-8c35-f00ae06ac8a6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:49.715126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/12c26425-019b-4094-8c35-f00ae06ac8a6/action HTTP/1.1 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 14 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: {"rescue": {}} Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '12c26425-019b-4094-8c35-f00ae06ac8a6', 'body': {'rescue': {}}} Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:49.724045 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 404 to user: Instance 12c26425-019b-4094-8c35-f00ae06ac8a6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e35e6453-a9f5-44e4-b0ee-e6ac2221a297 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/12c26425-019b-4094-8c35-f00ae06ac8a6/action" status: 404 len: 111 microversion: 2.1 time: 0.030130 Aug 21 01:28:49.730374 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2030/4664] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:49 2022] POST /compute/v2.1/servers/12c26425-019b-4094-8c35-f00ae06ac8a6/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:28:49.736059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:49.736623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:49.745869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.746410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.746788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.747496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.747945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.748366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.903636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b41565b-84de-48b0-9454-005653121d33 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action" status: 202 len: 0 microversion: 2.1 time: 0.171571 Aug 21 01:28:49.907444 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2635/4665] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:49 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:28:49.913276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:49.914205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:49.933721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.935329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.937179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.939353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.940080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.941284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.952024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:49.953899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:49.978156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.983518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.985667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:49.986664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:49.989833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:49.991451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.286324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:50.301019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd40bc1b-72a7-4e5a-af17-a8300a0db561 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1520 microversion: 2.1 time: 0.391848 Aug 21 01:28:50.306432 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2031/4666] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:49 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:50.316069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:50.319005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:50.330170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.336726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.337495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.338278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.338742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.339163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.451942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:50.472025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6da4acf6-b242-466c-b97c-f9e4bbc4fa57 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1520 microversion: 2.1 time: 0.518706 Aug 21 01:28:50.477706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2636/4667] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:49 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:50.495985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:50.496691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:50.506411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.508013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.509467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.512273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.513069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.513775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.550650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:28:50.603962 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:28:50.684981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:50.698456 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87aa4d96-7759-4fe1-9a08-5855f64cd367 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.389749 Aug 21 01:28:50.701147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2032/4668] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:50 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:50.760252 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1559930-c60d-4bcc-9db1-3b43087a1227 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 204 len: 0 microversion: 2.1 time: 0.267725 Aug 21 01:28:50.762205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2637/4669] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:28:50 2022] DELETE /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:28:50.771443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:50.772359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:50.781604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.786411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.787133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:50.788065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:50.789490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:50.790719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.116783 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:51.149394 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-274a32a1-e66d-4b90-b973-67c3db772f1e tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1526 microversion: 2.1 time: 0.378381 Aug 21 01:28:51.150337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2033/4670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:50 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1526 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:51.343698 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:51.344697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:51.364743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.365285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.365728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.366464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.370682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.371129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.727845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:51.729847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:51.743943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.748718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.750008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.751164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.752718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.754404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.846382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:51.863094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a923d77-180b-4e86-b050-5078509a03ed tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1500 microversion: 2.1 time: 0.537985 Aug 21 01:28:51.877708 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2638/4671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:51 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1500 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:51.898571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:51.901812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:51.918821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.919704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.920364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.921397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:51.922069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:51.922707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:51.994781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'flavor' on Instance uuid 0f2f87fc-4faf-4318-9068-90ccce7924e4 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:52.020442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Cannot 'rescue' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state paused Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action HTTP/1.1 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 14 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: {"rescue": {}} Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: exception: Cannot 'rescue' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state paused Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0f2f87fc-4faf-4318-9068-90ccce7924e4', 'body': {'rescue': {}}} Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 in vm_state paused. Cannot rescue while the instance is in this state. Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state paused Aug 21 01:28:52.035244 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state paused Aug 21 01:28:52.039369 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:52.041510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 409 to user: Cannot 'rescue' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state paused {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:52.042635 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0abd4b4-4fec-47fa-88d5-59ab68449df4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action" status: 409 len: 144 microversion: 2.1 time: 0.148714 Aug 21 01:28:52.043819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2639/4672] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:51 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action => generated 144 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:28:52.051813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:52.052868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:52.066510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.068309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.068901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.077777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.078413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.078951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.280236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1172324a-6110-4f1c-8004-f581ab173eaa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action" status: 202 len: 0 microversion: 2.1 time: 0.231963 Aug 21 01:28:52.281105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2640/4673] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:52 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:28:52.299611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:52.302727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:52.331503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.332006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.336737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.338852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.341204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.344042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.439756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:52.467448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d12f41e3-2b3c-4b5e-9644-e50e9e05527f tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.743227 Aug 21 01:28:52.468573 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2034/4674] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:51 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:52.482114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:52.486605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:52.505560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.506267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.506926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.509750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:52.510325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:52.513420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:52.860220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:52.895397 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3cb47a0d-3ebf-4f24-8ea4-df27b4b275e5 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1526 microversion: 2.1 time: 0.611778 Aug 21 01:28:52.896632 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2641/4675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:52 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1526 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:52.989303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:52.999399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d573cf7-104a-4728-84ec-5fde5d617a6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1507 microversion: 2.1 time: 0.528869 Aug 21 01:28:53.005074 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2035/4676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:52 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:53.492115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:53.492905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:53.503977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:53.504698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:53.505344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:53.506580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:53.507316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:53.508092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:53.920843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:53.923529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:53.941126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:53.945974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:53.948267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:53.951407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:53.956382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:53.957968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:54.706821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:54.716110 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ff8da5a-f754-4e26-8607-10dfcac3bb39 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 1.228184 Aug 21 01:28:54.723501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2642/4677] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:53 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:54.728350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ff062d-be50-4a2f-b4ad-b40fc3c0a037", "name": "network-vif-unplugged", "status": "completed", "tag": "69b7540e-d53f-4c16-adac-97b2916b6634"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:54.738350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:54.739133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:54.739906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:54.759481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] Creating event network-vif-unplugged:69b7540e-d53f-4c16-adac-97b2916b6634 for instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 on n-h2-master-1 Aug 21 01:28:54.767461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bd78104d-e0e4-4cf0-b758-f92eca92d935 req-c8928f9e-c099-46aa-85ab-cf22627fdb67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042606 Aug 21 01:28:54.768887 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2643/4678] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:54.776572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:54.778142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:54.787406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:54.788629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:54.789263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:54.790152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:54.790752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:54.791347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:54.838744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:54.852474 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d096c02-1521-4946-9d1f-91db4fe7d11c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1526 microversion: 2.1 time: 0.936653 Aug 21 01:28:54.853267 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2036/4679] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:53 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1526 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:28:55.226297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:55.246966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7dcb9241-3632-4d2f-b512-bbb563132d86 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1515 microversion: 2.1 time: 0.476652 Aug 21 01:28:55.248064 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2644/4680] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:54 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:55.594024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6de879a-5cee-4aa9-817f-dd8eae3fc944 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: .version_select at 0x7fc3fea669d0>, body: {"keypair": {"name": "tempest-keypair-1907058602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8kDOaVQ+bX1Wksm9oTMbjB37k+q4jgTqhYF7l0KQHZn1XisPEzjauyZeVU/sX1LvKDtUQMssr6I5V69AE2ZnpsIPceiCfLF4L3EEcSNJFMXgMTBPOzcUV9nQn27wTGLA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:55.631214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a6de879a-5cee-4aa9-817f-dd8eae3fc944 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for project 22b84439bde64075ab7459b430b0e612. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:28:55.679939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a6de879a-5cee-4aa9-817f-dd8eae3fc944 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for user 61445b694d0c484c99648ec99f21a34a and project 22b84439bde64075ab7459b430b0e612. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:28:55.745685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:55.747072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:55.750095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6de879a-5cee-4aa9-817f-dd8eae3fc944 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.440898 Aug 21 01:28:55.757968 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2037/4681] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:28:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 449 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:28:55.783367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:55.787044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:55.789398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:55.790616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:55.793293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:55.797231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:55.893320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:55.901811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:55.921953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:55.922446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:55.922884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:55.923596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:55.938622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:55.939094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:56.453991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:56.469679 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-593a016d-0092-48e5-9d34-1e40fb3f344b tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.734749 Aug 21 01:28:56.470885 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2645/4682] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:55 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:56.951015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:56.959599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce111243-1c9f-43f3-854b-96e5d34c65d1 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 200 len: 1526 microversion: 2.1 time: 1.073459 Aug 21 01:28:56.978461 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2038/4683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:55 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 1526 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:57.043269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ff062d-be50-4a2f-b4ad-b40fc3c0a037", "name": "network-vif-deleted", "tag": "69b7540e-d53f-4c16-adac-97b2916b6634"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:57.072673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:57.073214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:57.073657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:57.132422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] Creating event network-vif-deleted:69b7540e-d53f-4c16-adac-97b2916b6634 for instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 on n-h2-master-1 Aug 21 01:28:57.148640 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a655fe96-294d-495c-aff9-9cd7e33c22db req-aece3d45-f80d-4a6f-886d-e8aa1298f3ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110724 Aug 21 01:28:57.154923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2646/4684] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:28:57.495198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:57.496133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:57.520761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:57.521280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:57.521718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:57.522443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:57.522878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:57.523291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:57.985580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:57.986393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:58.003507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.004090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.005130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.005709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.006232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.006777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.042323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 HTTP/1.1 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '55ff062d-be50-4a2f-b4ad-b40fc3c0a037'} Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:58.043996 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a651f396-0d02-48d2-b8df-241414658304 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 404 len: 111 microversion: 2.1 time: 0.066622 Aug 21 01:28:58.048488 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2647/4685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:57 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:28:58.174713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:58.178120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:58.214334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.215100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.215664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.216544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.217134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.217679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.277878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'flavor' on Instance uuid 0f2f87fc-4faf-4318-9068-90ccce7924e4 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:28:58.469877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50977441-e4ad-4e71-b760-52d529225867 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action" status: 200 len: 32 microversion: 2.1 time: 0.299582 Aug 21 01:28:58.471078 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2648/4686] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:28:58 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:28:58.479789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1354707773", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:28:58.522518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:58.538951 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dabf53fb-78fb-47c7-84df-c336c0a1070c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 1.048025 Aug 21 01:28:58.544727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2039/4687] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:57 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:58.594586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:58.596990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:58.622016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.623392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.624019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.625079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:58.625693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:58.626278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:58.636309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] validate_networks() for [('a43710e8-0478-4e33-b824-c541f642d410', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:28:58.869713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:58.880854 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2a2c13c-2471-4327-8af1-224876efb60f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.334558 Aug 21 01:28:58.884300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2040/4688] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:58 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:59.560487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:59.561951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:59.575318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:59.576068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:59.579018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:59.580706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:59.581350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:59.581934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:59.925520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:28:59.943977 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c6fc8c3-2b29-4aec-b7e5-222e35a11b25 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.380995 Aug 21 01:28:59.944849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2041/4689] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:59 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:28:59.956872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:28:59.962180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:28:59.975673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:59.976171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:59.976603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:28:59.983367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:28:59.983868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:28:59.984304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:00.841126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:29:00.841722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:29:00.842272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:29:00.842706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:29:00.843180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:29:00.843685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:00.859055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bb259c1c-6777-480c-b08f-f2cf03651443 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.912744 Aug 21 01:29:00.859471 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2042/4690] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:28:59 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:00.882298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1129032317", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2de5a34-25c8-417b-a28b-2cd78053fb82"}], "security_groups": [{"name": "tempest-securitygroup--114990453"}], "key_name": "tempest-keypair-1907058602", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:00.892386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:00.892957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:00.893408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:00.894162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:00.897862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:00.898538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:00.946608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:00.960111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Getting quotas for user d35661d01cfb4f8d90ea78c7c7ead1b6 and project 032fcd2138744226a6b98ddeeef4766d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:00.984390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:29:00.992110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:29:01.067026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] validate_networks() for [('a2de5a34-25c8-417b-a28b-2cd78053fb82', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:29:01.156014 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3786cf29-510b-49e8-82df-bede778cfbd9 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.683200 Aug 21 01:29:01.157023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2649/4691] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:28:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:29:01.175160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:01.186958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:01.223641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:01.224536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:01.225495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:01.226990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:01.228687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:01.229821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:01.562640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:01.575099 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a23b5787-40e9-428d-a3f8-bdabb905e8ab tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.410034 Aug 21 01:29:01.576132 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2650/4692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:01 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:01.582182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-500e33b1-a74a-464e-9d0a-11627892512c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:01.583194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-500e33b1-a74a-464e-9d0a-11627892512c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:01.777142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-500e33b1-a74a-464e-9d0a-11627892512c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:01.812228 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-500e33b1-a74a-464e-9d0a-11627892512c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1225 microversion: 2.1 time: 0.230889 Aug 21 01:29:01.812911 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2651/4693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:01 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:01.883566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:01.884192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:01.911375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:01.915264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:01.917477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:01.920884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:01.924518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:01.928150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.568649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:02.594258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d14ab50-83f1-4505-99ee-81c573849272 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.715456 Aug 21 01:29:02.608421 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2652/4694] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:01 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:02.618966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:02.619596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:02.628973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.629856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.630295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.631185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.631638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.632059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.803857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:29:02.805186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:29:02.805893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:29:02.806519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:29:02.807136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:29:02.816821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.817889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.818538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.819488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.820174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.820867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.844001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for project 22b84439bde64075ab7459b430b0e612. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:02.870239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for user 61445b694d0c484c99648ec99f21a34a and project 22b84439bde64075ab7459b430b0e612. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:02.888438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:29:02.891078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:29:02.948444 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a873539c-c4ec-4096-ae0c-496063a20941 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.087832 Aug 21 01:29:02.949691 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2043/4695] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:29:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:29:02.956744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:02.958018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:02.965931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.966977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.967647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:02.968839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:02.969726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:02.970382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:03.097115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:03.101011 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:03.112846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-288cf894-c4ec-490d-a24f-93b7afc85eda tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.500267 Aug 21 01:29:03.133679 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2653/4696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:02 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:03.148000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:03.148927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:03.161180 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:03.424211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:03.435475 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f966fc13-366e-4faa-bdb9-e9baa41b7214 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1277 microversion: 2.1 time: 0.484367 Aug 21 01:29:03.440838 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2044/4697] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:02 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1277 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:03.444508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:03.453754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:03.456943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:03.462204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43ae45b1-53b1-407e-b1d9-2eb2bb73b685 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1282 microversion: 2.20 time: 0.326261 Aug 21 01:29:03.462995 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2654/4698] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:03 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:03.619511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:03.620608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:03.628577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:03.629601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:03.630281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:03.631251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:03.631916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:03.632647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.086417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.108116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3bdebd0-2506-4dbe-8621-0dfb608c583e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.493675 Aug 21 01:29:04.110501 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2045/4699] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:03 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:04.136086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:04.137293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:04.152512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.155372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.156110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.157035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.157646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.158229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.464902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:04.465794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:04.472319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.473208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.474136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.475021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.475615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.476185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.586742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.594902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dcfde41d-9969-4217-a2a1-7afa824e567c tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1283 microversion: 2.1 time: 0.133871 Aug 21 01:29:04.598496 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2046/4700] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:04 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:04.603865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:04.604744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:04.611236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.611999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.612658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.613618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:04.614298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:04.614925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:04.654449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.670873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8da8289-357e-43f4-bcbb-1cb6d9298998 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.538770 Aug 21 01:29:04.674541 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2655/4701] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:04 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:04.798303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.820305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.821913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:04.823175 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14ef14cd-6c52-48af-aa2a-dfb06b06d7f9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1334 microversion: 2.20 time: 0.223305 Aug 21 01:29:04.823845 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2047/4702] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:04 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1334 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:05.134889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:05.135702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:05.146913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:05.153822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:05.154521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:05.155465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:05.156106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:05.157257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:05.622286 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:05.622989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:05.635412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:05.640528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:05.641303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:05.642487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:05.643112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:05.643690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:05.648942 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:06.084914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:06.100969 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f3529d4-e78d-4c74-8bb0-3ca70cf839b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.971150 Aug 21 01:29:06.113736 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2656/4703] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:05 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:06.130666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:06.131620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:06.150332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:06.151535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:06.152134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:06.153091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:06.156551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:06.157378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:06.626251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:06.641223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0e2f9abd-92ff-41b4-9bdb-b25cc6b19409 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 1.024016 Aug 21 01:29:06.641894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2048/4704] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:05 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:06.657413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:06.658296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:06.669840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:06.670344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:06.670882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:06.671621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:06.672139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:06.672570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:06.907033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:06.924711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:06.938071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:06.940972 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cdc0f28f-1ac4-4e2b-874c-a680d23092ef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1340 microversion: 2.20 time: 0.292540 Aug 21 01:29:06.941998 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2049/4705] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:06 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1340 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:07.036281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:07.060868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-214e47c2-fdc7-44fe-a51e-efaa66085eb2 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.945441 Aug 21 01:29:07.065644 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2657/4706] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:06 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:07.127029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:07.128999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:07.131111 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:07.140254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:07.141250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:07.141917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:07.144988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:07.145774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:07.149199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:07.613530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:07.622751 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d1526fb-058d-482d-8431-c2b6e5a82f03 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.499530 Aug 21 01:29:07.629784 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2050/4707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:07 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:07.670522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:07.671146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:07.692326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:07.692705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:07.693222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:07.693943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:07.694401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:07.694814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:07.973837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:07.974699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:08.029840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:08.040975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:08.053637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:08.055254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:08.055802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:08.056404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:08.431260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:08.443960 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80d299f1-ea00-4da5-ba64-e4ee37d99f98 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 0.777231 Aug 21 01:29:08.448655 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2658/4708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:07 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:08.459811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:08.463914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:08.479691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:08.481892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:08.483342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:08.484379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:08.485868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:08.488490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:09.117098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:09.147812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9052ed1e-94a1-401f-b6b7-f65617af3bb3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.697780 Aug 21 01:29:09.169746 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2659/4709] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:08 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:09.178171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:09.179950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:09.186520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:09.187270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:09.187873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:09.190097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:09.190737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:09.191360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:09.372737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:09.382946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:09.388969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:09.403459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f1f8cb07-8a3c-4be5-bf15-56c3532fa83a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 1.434801 Aug 21 01:29:09.406930 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2051/4710] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:07 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:09.467530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:09.468273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:09.477656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:09.480718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:09.481658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:09.482881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:09.485141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:09.487163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:09.724794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:09.733294 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8972386c-db43-46b2-959a-7ad0eb9d5c42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.562245 Aug 21 01:29:09.745976 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2660/4711] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:09 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:10.179814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:10.181082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:10.199911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:10.201992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:10.204548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:10.206162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:10.206851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:10.207424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:10.511403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:10.518913 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97f9b471-b2d9-4364-95a0-a0eca65e0e20 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 1.055526 Aug 21 01:29:10.535826 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2052/4712] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:09 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:10.541334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:10.542208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:10.549458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:10.550237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:10.550881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:10.551775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:10.552379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:10.552986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:10.929727 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:11.011155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:11.020549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-beb6fd67-4659-4a4d-b4f2-ce65f34faf95 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1523 microversion: 2.1 time: 0.848560 Aug 21 01:29:11.033594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2661/4713] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:10 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1523 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:11.039453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc5776f-5918-4b8c-8963-241d15332754", "tag": "7a1890e8-6482-4236-8047-830ecfc8a803"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:11.055418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.059650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.062029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.079610 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] Creating event network-changed:7a1890e8-6482-4236-8047-830ecfc8a803 for instance 0dc5776f-5918-4b8c-8963-241d15332754 on n-h1-master-1 Aug 21 01:29:11.094360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1a747ed2-5407-4710-9c25-ef684fe3b8fd req-1324d380-2c8e-42f3-909d-a414bc6eba56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059241 Aug 21 01:29:11.096915 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2662/4714] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:11.107752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:11.113602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:11.142076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.142993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.144314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.145467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.146159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.146812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.166543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:11.174967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:11.176588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:11.177749 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a878bf86-9bb0-484b-9f96-7d938084036c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 0.640613 Aug 21 01:29:11.178682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2053/4715] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:10 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:11.183559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:11.206647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.207371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.207823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.232260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] Creating event network-changed:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h2-master-1 Aug 21 01:29:11.244263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5582cf51-257d-45e2-87f7-1d68981f3f59 req-53e000b7-f60f-4f0d-9ea9-bb828c579d03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063935 Aug 21 01:29:11.245215 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2054/4716] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:11.542852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:11.544431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:11.557675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.560050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.560751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.561755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:11.562733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:11.564512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:11.658324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:11.670126 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d41ba0be-7517-4127-8eb0-6fb688d0e4ac tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.566637 Aug 21 01:29:11.673498 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2663/4717] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:11 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:12.058385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:12.059736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:12.074765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.081802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.082708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:12.094240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.094734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.095178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:12.224504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:12.232735 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d5be5f8d-2bbd-4e9c-a487-90770798721f tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 0.694301 Aug 21 01:29:12.233365 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2055/4718] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:11 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:12.263717 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:12.264858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:12.275269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.275763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.276206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:12.276928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.277373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.277787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:12.834984 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:12.861412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:12.881291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c88b611-fe0b-4925-9eb0-e6d802f7f2fa tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1503 microversion: 2.1 time: 0.829374 Aug 21 01:29:12.881520 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:12.900796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2664/4719] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:12 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1503 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:12.901818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:12.908011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:12.946777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.947333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.947782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:12.948521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:12.949015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:12.949436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:13.154350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:13.174272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:13.176028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:13.184889 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf340c6d-ba7c-4b00-9539-f3eccba60074 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 0.930978 Aug 21 01:29:13.189181 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2056/4720] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:12 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:13.195983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e9332b7-1b0e-4f9b-975a-08cd8f4fa3d3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'create', calling method: .version_select at 0x7fc3fdefc4c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-800269025", "description": "tempest-description-527248049"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:13.451931 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:13.458418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:13.477205 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97fa31f4-b708-49ff-84f7-ec9dbb6ca32f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.588005 Aug 21 01:29:13.481912 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2665/4721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:12 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:13.494960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:13.499075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:13.515111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:13.515844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:13.518425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:13.520719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:13.523673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:13.524318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:14.521352 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e9332b7-1b0e-4f9b-975a-08cd8f4fa3d3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.330201 Aug 21 01:29:14.529591 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2057/4722] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:29:13 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:14.529591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:14.529591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:14.543609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:14.544132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:14.544574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:14.545321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:14.545770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:14.546190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:14.802295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:14.842828 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6665e0e0-e4b6-4182-bd3e-758902739a61 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 1.359578 Aug 21 01:29:14.843597 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2666/4723] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:13 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:14.849145 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:14.850170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:14.856853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:14.857505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:14.858252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:14.859319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:14.860054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:14.860859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:15.085609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:15.097332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:15.105704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:15.106892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-56a5ca14-3831-4db2-9214-eb443b549a8b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 0.582833 Aug 21 01:29:15.107486 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2058/4724] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:14 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:15.119917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-800269025"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:15.149392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:15.165353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:15.167128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:15.167582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:15.168301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:15.171820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:15.174743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:15.197278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:15.210837 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9fc665f3-9ded-402e-8651-701727f50c9e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.366013 Aug 21 01:29:15.212698 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2667/4725] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:14 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:15.867986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:15.868596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:15.878086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:15.881822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:15.882706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:15.884028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:15.884522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:15.887669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:16.182015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:16.190833 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Adding security group 0cf6c985-87f2-4662-bef8-35df764cd86b to port 7922f1f1-6eb8-4682-aa08-edebf8306595 Aug 21 01:29:16.205327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4cd2c592-46d2-4236-b29c-a7c5514f227d tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 0.341352 Aug 21 01:29:16.206844 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2668/4726] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:15 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:16.214135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:16.215212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:16.222936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:16.223603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:16.224176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:16.226468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:16.227172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:16.227730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:17.197381 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8fd8891c-8b9f-47f6-bfec-b5334d13e962 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action" status: 202 len: 0 microversion: 2.1 time: 2.087718 Aug 21 01:29:17.204054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2059/4727] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:29:15 2022] POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action => generated 0 bytes in 2096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:17.209910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:17.211273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:17.221461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:17.222228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:17.222909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:17.224461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:17.225439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:17.225876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:17.305798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:17.319701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:17.322854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:17.324728 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf9de131-2a6a-47c4-8897-02ac813e9bc3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 1.115080 Aug 21 01:29:17.326357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2669/4728] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:16 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:17.521353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1433176140", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "d97afe1b-8443-4fee-bff2-b3f5b8cc411d"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:17.591426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] validate_networks() for [('d97afe1b-8443-4fee-bff2-b3f5b8cc411d', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:29:17.694322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:17.715985 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4514634-0790-4c82-a0d2-1f8483086f66 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.509215 Aug 21 01:29:17.717726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2060/4729] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:17 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:17.744416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc5776f-5918-4b8c-8963-241d15332754", "name": "network-vif-plugged", "status": "completed", "tag": "7a1890e8-6482-4236-8047-830ecfc8a803"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:17.800322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:17.801503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:17.802254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:17.822429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] Creating event network-vif-plugged:7a1890e8-6482-4236-8047-830ecfc8a803 for instance 0dc5776f-5918-4b8c-8963-241d15332754 on n-h1-master-1 Aug 21 01:29:17.829496 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9ca60804-9143-4716-af11-c4fa63fb82f6 req-c9632bdb-8807-47d3-b81a-b89d89bfbb9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110033 Aug 21 01:29:17.831468 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2061/4730] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:17.843929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-168164900", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "095566ea-71ad-4f76-928b-7397311acb2f"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:17.953143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] validate_networks() for [('095566ea-71ad-4f76-928b-7397311acb2f', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:29:18.807020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:29:18.807657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:29:18.807893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:29:18.808478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:29:18.809058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:29:18.828703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:18.829345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:18.831468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:18.832730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:18.833222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:18.833749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:18.863498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Getting quotas for project c92a6cc6152c46bb982b30251f7aad18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:18.870749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Getting quotas for user f0524cc60bd640ca9ae88845970eb013 and project c92a6cc6152c46bb982b30251f7aad18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:18.923287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:29:18.928908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:29:19.013584 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76a24797-bfe2-425e-afa1-4320bf075830 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180096 Aug 21 01:29:19.015150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2062/4731] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:29:19.021777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-800269025"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:19.022514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:19.047347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.048048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.048664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.049570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.050303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.051561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.087449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:29:19.087997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:29:19.088470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:29:19.088966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:29:19.089379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:29:19.109594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.111104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.111700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.112657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.113699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.114205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.136382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Getting quotas for project c8a2139ece3e4b669c5c1262f24e6771. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:19.143399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Getting quotas for user bfef9e4f835c4533acc3a00772c71561 and project c8a2139ece3e4b669c5c1262f24e6771. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:19.162382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:29:19.165578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:29:19.248316 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad1385e6-6709-4e23-ab9d-bd2d13d79605 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.920237 Aug 21 01:29:19.254775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2670/4732] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:29:19.268451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:19.349103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.349591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.350025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.378859 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] Creating event network-changed:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:29:19.414978 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d4821fc2-8f98-4d65-803a-8216148526f7 req-f13edfd1-8dbd-44c0-a8d9-1fa6d8bfcc4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154249 Aug 21 01:29:19.416828 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2671/4733] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:19.436910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:19.450473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:19.484510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.485038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.485656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.486429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:19.486919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:19.487409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:19.620409 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Removing security group 0cf6c985-87f2-4662-bef8-35df764cd86b from port 7922f1f1-6eb8-4682-aa08-edebf8306595 Aug 21 01:29:20.625003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:20.639580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-29aca864-bffa-48b0-8289-1c270818c045 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1325 microversion: 2.1 time: 1.218216 Aug 21 01:29:20.643308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2672/4734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:19 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1325 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:20.659058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:20.661530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:20.671930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:20.672810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:20.674624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:20.676199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:20.677464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:20.679029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:20.751995 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d7149ae-2d3c-4c1a-9eaf-c62d3acd10d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action" status: 202 len: 0 microversion: 2.1 time: 1.735501 Aug 21 01:29:20.753309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2063/4735] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:29:19 2022] POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:20.759628 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:20.765241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:20.766196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:20.780049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:20.781180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:20.786055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:20.791942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:20.792679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:20.793301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.209540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.227074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.228946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.231282 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c804c56a-e52b-46be-91d6-0bb191da43e5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 0.586643 Aug 21 01:29:21.236021 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2673/4736] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:20 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:21.258541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:21.260848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:21.278629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.279388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.281468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.282692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.285195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.286577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.542122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.553055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1fb5905d-95b1-4882-86ec-7b5ed47e5653 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1276 microversion: 2.1 time: 0.317031 Aug 21 01:29:21.569104 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2674/4737] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:21 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1276 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:21.574719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:21.575281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:21.582989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.583868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.584497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.585431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.586051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.586659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.737675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.746854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.748358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.749536 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd8bb14f-a650-49f2-92c6-1cd97b312364 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1332 microversion: 2.26 time: 0.178970 Aug 21 01:29:21.764991 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2675/4738] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:21 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1332 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:21.764991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "name": "network-vif-plugged", "status": "completed", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:21.769939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.770199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.770657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.784146 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] Creating event network-vif-plugged:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h2-master-1 Aug 21 01:29:21.790027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f7667f9d-b7e3-466c-9b60-a264aa5804f6 req-141a880a-6df7-4b62-821a-534c5fbce3f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 Aug 21 01:29:21.793886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2676/4739] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:21.799988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d92d1f8a-0ce7-4ec3-a507-e896b8e602a3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'create', calling method: .version_select at 0x7fc3f9d77040>, body: {"pool": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:21.810757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:21.819080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cb50c145-c168-45fc-b52e-312c6df37c7e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1501 microversion: 2.1 time: 1.057976 Aug 21 01:29:21.835531 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2064/4740] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:20 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1501 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:21.843150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:21.847371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:21.853747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.854471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.855409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:21.856283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:21.856927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:21.858088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.342069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:22.353885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4bce354-a660-4ab1-80cd-5bd75d4e7c41 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1523 microversion: 2.1 time: 0.517118 Aug 21 01:29:22.368794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2065/4741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:21 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:22.374326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:22.387806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.388428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.388969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.403531 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] Creating event network-changed:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:29:22.410127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6e90cc5b-4c81-41a6-a56e-9efc384fe7da req-cf0d8961-a608-45fd-9b0f-b213227a175f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045152 Aug 21 01:29:22.410799 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2066/4742] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:22.417716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74f1e2b3-17d0-42de-be92-92352e012d8a"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:22.420960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:22.429189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.429969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.430696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.431415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.432059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.432467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.463013 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state rescued Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/os-volume_attachments HTTP/1.1 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 74 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: {"volumeAttachment": {"volumeId": "74f1e2b3-17d0-42de-be92-92352e012d8a"}} Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'attach_volume' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state rescued Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '0f2f87fc-4faf-4318-9068-90ccce7924e4', 'body': {'volumeAttachment': {'volumeId': '74f1e2b3-17d0-42de-be92-92352e012d8a'}}} Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 21 01:29:22.465098 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state rescued Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state rescued Aug 21 01:29:22.470114 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:22.471746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 409 to user: Cannot 'attach_volume' instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 while it is in vm_state rescued {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:22.473310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee31aa8d-f0e1-4c15-9e74-c2020b41631b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060875 Aug 21 01:29:22.473683 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2067/4743] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:29:22 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:29:22.478527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:22.479396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:22.485838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.489586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.490313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.491746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.492210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.493592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.814771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:22.827422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:22.829500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:22.830792 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-559f5810-d297-4b7f-99ed-0f7daa379ac7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1407 microversion: 2.20 time: 0.355917 Aug 21 01:29:22.831622 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2068/4744] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:22 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:22.837934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:22.838573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:22.845182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.846186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.846700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.848136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:22.848872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:22.849500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:22.872136 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:22.883448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:29:23.010154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-805fb1fb-0417-46dc-96f3-fa2be7c2ad52 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 204 len: 0 microversion: 2.1 time: 0.175720 Aug 21 01:29:23.012730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2069/4745] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:29:22 2022] DELETE /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:29:23.020755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:23.023752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:23.036567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.037741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.038702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.039659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.040508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.041413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.160027 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8723d11d-2ea2-4641-b80a-a54cfee36449 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action" status: 202 len: 0 microversion: 2.1 time: 0.145463 Aug 21 01:29:23.164275 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2070/4746] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:29:23 2022] POST /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:23.167069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:23.167798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:23.184857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.185349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.185777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.186486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.186931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.187535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.505797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:23.514578 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-57f36c39-36f1-48df-b325-24f88fa1efb6 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.351937 Aug 21 01:29:23.528250 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2071/4747] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:23 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:23.547319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:23.547943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:23.555835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.556180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.556629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.557344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.557788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.558198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.679910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:23.689260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:23.690739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:23.692182 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0821d6d0-edda-4aad-8ef0-c1d5fa33a481 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1320 microversion: 2.26 time: 0.160296 Aug 21 01:29:23.693029 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2072/4748] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:23 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:23.697192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:23.697787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:23.703726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.704460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.704595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:23.705324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:23.705752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:23.706159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:24.162495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:24.174505 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23de6696-5e71-4040-80ef-1017ce28360b tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1529 microversion: 2.1 time: 0.480612 Aug 21 01:29:24.176850 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2073/4749] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:23 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1529 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:24.183729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:24.184548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:24.192082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:24.193313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:24.194048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:24.195298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:24.196285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:24.197315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:24.716198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:24.727017 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ac4d413-f02d-442b-b7a6-fda984dd62b1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1509 microversion: 2.1 time: 0.547248 Aug 21 01:29:24.738948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2074/4750] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:24 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:24.750570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:24.751306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:24.758343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:24.759282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:24.760072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:24.761030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:24.761666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:24.762137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:25.614105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:25.638453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:25.640290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:25.641627 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5873c1bc-fb2d-48ef-a528-648f343472c1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1598 microversion: 2.20 time: 0.895662 Aug 21 01:29:25.642701 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2075/4751] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:24 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1598 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:25.666299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:25.667288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:25.675194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:25.675903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:25.676333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:25.677253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:25.677866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:25.679031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.066505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.074641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dbe7601-95ad-4161-ac7a-e40e4d83df3d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.414762 Aug 21 01:29:26.075262 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2076/4752] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:25 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:26.080470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:26.081131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:26.088815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.089300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.089738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.090445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.090913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.091308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.408033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.424987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.431696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.435590 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb6bd7b7-5493-4693-9f89-b4f33c658efc tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.359099 Aug 21 01:29:26.436894 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2077/4753] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:26 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:26.442870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:26.443942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:26.452225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.453133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.453819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.454891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.455403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.455894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.493111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.493950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.495146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.497639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lazy-loading 'fault' on Instance uuid 0dc5776f-5918-4b8c-8963-241d15332754 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:26.567314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35661d01cfb4f8d90ea78c7c7ead1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032fcd2138744226a6b98ddeeef4766d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.568758 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d92d1f8a-0ce7-4ec3-a507-e896b8e602a3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.773542 Aug 21 01:29:26.570093 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2677/4754] 10.222.0.46 () {60 vars in 1170 bytes} [Sun Aug 21 01:29:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:26.575421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:26.576045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:26.579691 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbcba1e8-acfa-491a-83ab-ef592f5287e7 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 200 len: 1315 microversion: 2.1 time: 0.141356 Aug 21 01:29:26.580375 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2078/4755] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:26 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:26.584492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.585242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.585531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:26.586456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:26.587314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.588110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.588574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.589114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.594914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.595704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.596383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.597246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.597845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.598289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.772041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:26.784909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ecd5143-f2ef-4c07-a5c3-304e71f505e9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1509 microversion: 2.1 time: 0.202882 Aug 21 01:29:26.801893 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b617bd31-0c32-444d-9993-365015733d4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.223382 Aug 21 01:29:26.801893 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2678/4756] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:29:26 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:29:26.805762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc5776f-5918-4b8c-8963-241d15332754", "name": "network-vif-deleted", "tag": "7a1890e8-6482-4236-8047-830ecfc8a803"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:26.806545 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2079/4757] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:26 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:26.817984 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.195"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:26.820743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:26.826648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.828446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.829036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.830497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.830497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:26.831061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.831496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:26.831727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.832372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:26.876244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:29:26.876819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquired lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:29:26.894671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] Creating event network-vif-deleted:7a1890e8-6482-4236-8047-830ecfc8a803 for instance 0dc5776f-5918-4b8c-8963-241d15332754 on n-h1-master-1 Aug 21 01:29:26.911325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c43ce163-d298-4af0-8196-c272a3024796 req-8189a444-5925-40be-a96b-1c311a10fcef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112718 Aug 21 01:29:26.914770 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2679/4758] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:26.996183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8b951f-9f21-458c-9863-689ce9fae970", "tag": "2af8f845-75c0-469b-82b5-f8300b131258"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:27.012539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:27.013545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:27.014716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:27.037052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] Creating event network-changed:2af8f845-75c0-469b-82b5-f8300b131258 for instance 0c8b951f-9f21-458c-9863-689ce9fae970 on n-h2-master-1 Aug 21 01:29:27.044939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-99f8ee1d-9652-40d8-bbf3-046c920c810c req-a78be3d0-40d1-4533-b131-7491e130d9e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052944 Aug 21 01:29:27.045862 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2680/4759] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:29:27.098497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:27.100157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:27.141611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:27.142494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:27.143198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:27.144394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:27.148269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:27.150281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:27.469055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:27.477716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b26e4b8b-e437-49f2-aa88-257a31d0d59a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.385352 Aug 21 01:29:27.478294 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2681/4760] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:27 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:27.483798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:27.484375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:27.494836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:27.495746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:27.497634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:27.498288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:27.498738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:27.499154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:27.954913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:27.967382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:27.969381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:27.970955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2172e950-9093-4787-bec3-db726c43cf93 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.490988 Aug 21 01:29:27.971789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2682/4761] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:27 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:27.993497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:27.994466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 0dc5776f-5918-4b8c-8963-241d15332754] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:28.001806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.002779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.003443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.004528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.005171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.005744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.024194 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 HTTP/1.1 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '0dc5776f-5918-4b8c-8963-241d15332754'} Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.026273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. Aug 21 01:29:28.031015 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.033189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 0dc5776f-5918-4b8c-8963-241d15332754 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:28.034315 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-678b022b-5bd1-41d8-b470-d32e6f7672c6 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754" status: 404 len: 111 microversion: 2.1 time: 0.045219 Aug 21 01:29:28.035602 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2683/4762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:27 2022] GET /compute/v2.1/servers/0dc5776f-5918-4b8c-8963-241d15332754 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:28.041901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:28.043363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:28.049917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.053060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.054090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.054876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.055392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.055812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.669412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:28.678724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9ba58a9-94d4-4942-b4e0-0248e592a210 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1509 microversion: 2.1 time: 0.641325 Aug 21 01:29:28.680056 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2684/4763] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:28 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1509 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:28.685052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa37c6a0-cf44-49c2-9d28-cf9dff7f0f10 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc3f8807f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:28.713047 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-aa37c6a0-cf44-49c2-9d28-cf9dff7f0f10 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Image not found. Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa37c6a0-cf44-49c2-9d28-cf9dff7f0f10 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59 HTTP/1.1 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a4ace35d-cda4-47c2-a318-a665b9490b59'} Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a4ace35d-cda4-47c2-a318-a665b9490b59 to delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4ace35d-cda4-47c2-a318-a665b9490b59 could not be found. Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:28.716404 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:29:28.721800 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:28.724629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa37c6a0-cf44-49c2-9d28-cf9dff7f0f10 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:28.725803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa37c6a0-cf44-49c2-9d28-cf9dff7f0f10 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59" status: 404 len: 62 microversion: 2.1 time: 0.044364 Aug 21 01:29:28.726401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2685/4764] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:28 2022] DELETE /compute/v2.1/images/a4ace35d-cda4-47c2-a318-a665b9490b59 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:29:28.734351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:28.735062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:28.745421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.746524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.747220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.748536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:28.749268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:28.749921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:28.848042 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:28.886882 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:29.127358 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:29.152947 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:29.241958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:29.255350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2aa9403c-7e31-4772-8e7d-937536e33205 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.523608 Aug 21 01:29:29.256349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2686/4765] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:28 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:29.275609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:29.276240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:29.283728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:29.284393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:29.285434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:29.286273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:29.286826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:29.287408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:29.313171 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 HTTP/1.1 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '55ff062d-be50-4a2f-b4ad-b40fc3c0a037'} Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:29.318192 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:29.323006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:29.324509 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8efaa104-2db4-48f2-9312-7af9e0a3d1fb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 404 len: 111 microversion: 2.1 time: 0.052804 Aug 21 01:29:29.326327 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2687/4766] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:29:29 2022] DELETE /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:29.333773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58b97db-cd17-42da-9acb-63690515d5d4", "tag": "f416f883-7091-4354-b912-0e20d1ac2bc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:29.344356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:29.344880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:29.345306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:29.369424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] Creating event network-changed:f416f883-7091-4354-b912-0e20d1ac2bc6 for instance a58b97db-cd17-42da-9acb-63690515d5d4 on n-h1-master-1 Aug 21 01:29:29.377380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-08db7374-0303-4e09-8ee4-855e47c122c9 req-d2018fc8-7ef1-4d79-a0d5-e432a61ae51d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050154 Aug 21 01:29:29.384620 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2688/4767] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:29.393693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:29.398049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:29.415779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:29.416282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:29.416720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:29.417467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:29.417916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:29.418342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:29.623056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:29:30.162166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:30.172258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:30.179848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:30.184643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a360f9f-ce3c-4f06-b0c8-122243e8c162 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.798623 Aug 21 01:29:30.185509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2689/4768] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:29 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:30.207539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:30.209835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 55ff062d-be50-4a2f-b4ad-b40fc3c0a037] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:30.223494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.224402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.224870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:30.227337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.228436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.232200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:30.273957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 HTTP/1.1 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '55ff062d-be50-4a2f-b4ad-b40fc3c0a037'} Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:30.275677 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. Aug 21 01:29:30.280335 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:30.283616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 55ff062d-be50-4a2f-b4ad-b40fc3c0a037 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:30.284100 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba8ed88f-fb3d-4e69-a722-a392dfa6c6fd tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037" status: 404 len: 111 microversion: 2.1 time: 0.096784 Aug 21 01:29:30.284939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2690/4769] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:30 2022] GET /compute/v2.1/servers/55ff062d-be50-4a2f-b4ad-b40fc3c0a037 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:30.294334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:30.294956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:30.314003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.314787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.315382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:30.316318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.317113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.317694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:30.856138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:30.864620 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-22689b6f-e34c-4579-a220-08831b6c5372 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1515 microversion: 2.1 time: 0.578724 Aug 21 01:29:30.877026 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2691/4770] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:30 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1515 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:30.877026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:30.877354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:30.898608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.899111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.899545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:30.900252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:30.900702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:30.901156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:31.065806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Updating instance_info_cache with network_info: [{"id": "7922f1f1-6eb8-4682-aa08-edebf8306595", "address": "fa:16:3e:00:a8:56", "network": {"id": "1047fa3b-122c-4463-a43e-06a87ecdfcd9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-561390171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0c6c6457b07a43f193af082ada523651", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7922f1f1-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:29:31.095366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Releasing lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:29:31.096517 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bc35888-82c2-4577-970b-1e3a1d4a3592 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action" status: 202 len: 0 microversion: 2.1 time: 4.288921 Aug 21 01:29:31.097471 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2080/4771] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:29:26 2022] POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action => generated 0 bytes in 4290 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:29:31.119133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3ad5e2f-4ebf-41dc-a798-ada1de487afb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc3fdadb700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:31.177407 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3ad5e2f-4ebf-41dc-a798-ada1de487afb tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029168553" status: 202 len: 0 microversion: 2.1 time: 0.071445 Aug 21 01:29:31.180145 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2081/4772] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029168553 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:31.191203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.195"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:31.584732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:31.593956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:31.594386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:31.594819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:31.597453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:31.601973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:31.602601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:31.631838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:31.641342 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abaa84c3-5058-44d6-8245-b5de1319d03e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.771049 Aug 21 01:29:31.647650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2692/4773] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:30 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:31.653650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:31.657765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:31.670999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:31.677140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:31.677951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:31.679400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:31.679932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:31.680433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:31.967297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 21 01:29:31.967707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquired lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 21 01:29:32.219156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:32.231537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:32.233085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:32.239892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63a056dd-5b13-49cc-8198-0d4c14f2293d tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.590314 Aug 21 01:29:32.240519 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2693/4774] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:31 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:32.258721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}, {"name": "network-changed", "server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:32.284430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:32.285821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:32.286537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:32.306404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Creating event network-changed:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h2-master-1 Aug 21 01:29:32.308912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] Creating event network-changed:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:29:32.324812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-05c3d194-ed89-459c-bd2e-655a0a12ee68 req-904300ff-dfce-45d2-b0f1-49932fd7348a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079363 Aug 21 01:29:32.328156 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2694/4775] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:32.669427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:32.670165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:32.687821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:32.688556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:32.689079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:32.689797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:32.690429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:32.692999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:33.229766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:33.239645 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b21e0faa-d29c-4043-9d64-30219484ad26 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.575277 Aug 21 01:29:33.240777 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2695/4776] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:32 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:33.268291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:33.269369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:33.276408 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:33.279141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:33.280576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:33.281283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:33.284306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:33.286076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:33.286725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.008433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:34.017121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:34.018579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:34.020838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13c6e25e-27fe-4e55-835d-e23f74403e77 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.756928 Aug 21 01:29:34.021679 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2696/4777] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:33 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:34.026762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c525145-f20c-4d2a-b1c2-acad72fd0108 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '.version_select at 0x7fc3f88ef310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:34.061505 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8c525145-f20c-4d2a-b1c2-acad72fd0108 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Image not found. Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c525145-f20c-4d2a-b1c2-acad72fd0108 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/images/7e0207d7-53ef-47db-8c02-435bcb198786 HTTP/1.1 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: exception: Image not found. Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7e0207d7-53ef-47db-8c02-435bcb198786'} Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7e0207d7-53ef-47db-8c02-435bcb198786 to delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e0207d7-53ef-47db-8c02-435bcb198786 could not be found. Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.066711 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c525145-f20c-4d2a-b1c2-acad72fd0108 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Image not found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:34.070636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c525145-f20c-4d2a-b1c2-acad72fd0108 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/images/7e0207d7-53ef-47db-8c02-435bcb198786" status: 404 len: 62 microversion: 2.1 time: 0.047315 Aug 21 01:29:34.077112 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2697/4778] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:34 2022] DELETE /compute/v2.1/images/7e0207d7-53ef-47db-8c02-435bcb198786 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:29:34.086569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-354899ca-8939-44ad-a23d-17cd876c2267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: .version_select at 0x7fc3f886b790>, body: {"keypair": {"name": "tempest-keypair-1322368897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE2fbvQlp/12dicomgeSPHb/OjXsCki9CA0DmbPJiIgTjsnpdOoZggEDJbJNQNdmQ96seaHtv/13iqwpi65zWdBYGF3E5Z5T1eDmPcioju3dhurWlno4G79y8t/VUj4NA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:34.106293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-354899ca-8939-44ad-a23d-17cd876c2267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:34.112379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-354899ca-8939-44ad-a23d-17cd876c2267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for user bd0447e656f9418da68b308f19e8e807 and project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:34.165620 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-354899ca-8939-44ad-a23d-17cd876c2267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087273 Aug 21 01:29:34.166532 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2698/4779] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:29:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:34.171608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:34.175769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:34.192126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.192633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.193108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.193829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.199322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.199841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.225773 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f HTTP/1.1 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f'} Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:34.233001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.238981 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.240386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:34.243020 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6883ec7-ea50-4597-b709-96a66905aede tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 404 len: 111 microversion: 2.1 time: 0.075387 Aug 21 01:29:34.244578 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2699/4780] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:29:34 2022] DELETE /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:34.262556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:34.263638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] [instance: 4aaa58da-5e38-4db6-8f8e-d46277c42e2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:34.284426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.288271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.289632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.290655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.292971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.295589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.321320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] HTTP exception thrown: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Request method failure captured: Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f HTTP/1.1 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYnpDZ8rn9zPtEuGFVkrhqy-nWQoMXc6NtpdmKM_MXmhHCk3k1jEW6kifztV76PwKhYB3flKdsKidy8wO1vAkkfpQ3LGh4Bt6glU2PF06eTPolIHpyf2yLX5O61cJ5jrZZemrEi5_Mp5cGGFW9ht-em6yXPFpuf3rjh9kUqc3AUlU8Y Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_032fcd2138744226a6b98ddeeef4766d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/032fcd2138744226a6b98ddeeef4766d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/032fcd2138744226a6b98ddeeef4766d"}]}] Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 032fcd2138744226a6b98ddeeef4766d Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-392409359 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d35661d01cfb4f8d90ea78c7c7ead1b6 Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-392409359-project Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4aaa58da-5e38-4db6-8f8e-d46277c42e2f'} Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.323397 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. Aug 21 01:29:34.328195 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:34.329988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] Returning 404 to user: Instance 4aaa58da-5e38-4db6-8f8e-d46277c42e2f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:34.331033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-39a35bd5-8a0f-4fe8-8feb-4eadd14a4f70 tempest-ImagesOneServerNegativeTestJSON-392409359 tempest-ImagesOneServerNegativeTestJSON-392409359-project] 10.222.0.46 "GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f" status: 404 len: 111 microversion: 2.1 time: 0.082451 Aug 21 01:29:34.332512 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2700/4781] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:34 2022] GET /compute/v2.1/servers/4aaa58da-5e38-4db6-8f8e-d46277c42e2f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:34.344594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:34.345578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:34.352557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.353567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.354588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.355658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.356272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.356889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.385744 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:34.556337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Building network info cache for instance {{(pid=122483) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 21 01:29:34.801228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:34.811156 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4965ac7-dd52-4a49-b5f4-3f7b8bfafe20 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.477112 Aug 21 01:29:34.811760 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2701/4782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:34 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:34.833788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58b97db-cd17-42da-9acb-63690515d5d4", "name": "network-vif-plugged", "status": "completed", "tag": "f416f883-7091-4354-b912-0e20d1ac2bc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:34.866798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.872903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.874197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:34.903260 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] Creating event network-vif-plugged:f416f883-7091-4354-b912-0e20d1ac2bc6 for instance a58b97db-cd17-42da-9acb-63690515d5d4 on n-h1-master-1 Aug 21 01:29:34.921167 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ec084000-8f51-45af-90a4-c714901fd583 req-7f5e27df-0e04-4192-a404-7ad307f01392 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096950 Aug 21 01:29:34.928618 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2702/4783] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:34.940759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:34.978581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:34.988992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:34.993025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:35.024497 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] Creating event network-changed:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:29:35.039052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-78ec23a3-ba64-40ea-84f3-25d72e226365 req-32aae9ee-e5c3-40c6-9467-53d9e1d3930a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104714 Aug 21 01:29:35.044530 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2703/4784] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:35.055568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:35.060321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:35.079478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:35.084677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:35.085578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:35.087869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:35.090073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:35.090727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:35.547509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:35.567724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:35.573382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:35.577840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d4f4849-3c8b-497f-94fe-cd474a8bc3ff tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.530764 Aug 21 01:29:35.579710 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2704/4785] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:35 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:35.833770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:35.834905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:35.857726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:35.864464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:35.868038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:35.871662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:35.878685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:35.879991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:36.247130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:36.261353 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57991b2b-9d25-44de-afe1-93674cb90d52 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.433234 Aug 21 01:29:36.263055 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2705/4786] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:35 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:36.634213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:36.638708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:36.669169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:36.672870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:36.674206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:36.682155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:36.684636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:36.688265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:37.035836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:37.044992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:37.046942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:37.048519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-67625bf6-b7c7-4c81-8c6f-62be650f8fcb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.447796 Aug 21 01:29:37.049354 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2706/4787] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:36 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:37.286215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:37.287961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:37.296227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:37.297178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:37.297834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:37.303479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:37.304375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:37.305097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:37.606878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Updating instance_info_cache with network_info: [{"id": "7922f1f1-6eb8-4682-aa08-edebf8306595", "address": "fa:16:3e:00:a8:56", "network": {"id": "1047fa3b-122c-4463-a43e-06a87ecdfcd9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-561390171-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0c6c6457b07a43f193af082ada523651", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7922f1f1-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122483) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 21 01:29:37.622510 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:37.648884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Releasing lock "refresh_cache-50a48ebf-327b-47df-b4cb-1ae9131d94a9" {{(pid=122483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 21 01:29:37.651619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20e938aa-9f8b-474d-bb99-d4ecbd1e1155 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action" status: 202 len: 0 microversion: 2.1 time: 6.465723 Aug 21 01:29:37.653788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2082/4788] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:29:31 2022] POST /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9/action => generated 0 bytes in 6473 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 21 01:29:37.657642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:37.664454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50e6417c-c503-4b83-8b1c-d935261a62ac tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '.version_select at 0x7fc403122f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:37.673492 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-43e56c52-d924-4997-a82d-eca547c210cf tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1508 microversion: 2.1 time: 0.394238 Aug 21 01:29:37.677375 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2707/4789] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:37 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1508 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:38.076600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:38.077477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:38.094636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:38.095314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:38.098229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:38.099461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:38.100553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:38.101025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:38.401177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:38.414207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:38.416827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:38.420038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aba40809-4431-46ed-b693-9c69ad024211 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.347153 Aug 21 01:29:38.420750 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2708/4790] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:38 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:29:38.426359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-714615347", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3511ebbb-0e39-4262-b6f0-d74c007a5656"}], "security_groups": [{"name": "tempest-securitygroup--1309279891"}], "key_name": "tempest-keypair-1322368897", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:38.591813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] validate_networks() for [('3511ebbb-0e39-4262-b6f0-d74c007a5656', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:29:39.540527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:29:39.541104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:29:39.541465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:29:39.542098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:29:39.542530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:29:39.556657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:39.557171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:39.557945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:39.558929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:39.559604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:39.560258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:39.603066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:29:39.610703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Getting quotas for user bd0447e656f9418da68b308f19e8e807 and project 0514462a9a1b45ac9b7b3285fd0bf6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:29:39.629062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:29:39.633092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:29:39.689160 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fec61b01-cfad-42d2-8407-5e5a9051de11 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.266947 Aug 21 01:29:39.689961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2709/4791] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:29:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:29:39.697007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b951f-9f21-458c-9863-689ce9fae970", "name": "network-vif-plugged", "status": "completed", "tag": "2af8f845-75c0-469b-82b5-f8300b131258"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:39.710648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:39.711394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:39.711994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:39.724376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] Creating event network-vif-plugged:2af8f845-75c0-469b-82b5-f8300b131258 for instance 0c8b951f-9f21-458c-9863-689ce9fae970 on n-h2-master-1 Aug 21 01:29:39.731663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8a707011-4827-47b9-8533-c05409970828 req-2824a0a0-1702-4e70-94d6-fd5c4baea8b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040004 Aug 21 01:29:39.732579 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2710/4792] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:39.738912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:39.739607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:39.748111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:39.749004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:39.749607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:39.750319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:39.753936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:39.753936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:40.178868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:40.195327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:40.196896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:40.203039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c3db3ebf-3eb6-440a-8141-b351cb8900fb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.465788 Aug 21 01:29:40.205396 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2711/4793] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:39 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:40.210620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fd59f75-6b12-44bb-bd51-23a49f48c86d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:40.211238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fd59f75-6b12-44bb-bd51-23a49f48c86d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:40.358919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fd59f75-6b12-44bb-bd51-23a49f48c86d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:40.380870 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fd59f75-6b12-44bb-bd51-23a49f48c86d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1245 microversion: 2.1 time: 0.174171 Aug 21 01:29:40.381987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2712/4794] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:40 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:41.227929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:41.228565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:41.243083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:41.248856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:41.249640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:41.252406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:41.253338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:41.254726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:41.594998 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:41.631095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:41.658337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:41.660056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:41.661445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4e4043d6-9803-45c4-abd9-fe4bea112432 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1362 microversion: 2.26 time: 0.437748 Aug 21 01:29:41.662754 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2713/4795] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:41 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:29:41.668272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:41.669100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:41.684987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:41.685498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:41.685940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:41.688630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:41.689144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:41.689581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:41.792141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:41.827752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e6da317-bbf4-4421-b136-508b221f79ea tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1315 microversion: 2.1 time: 0.163878 Aug 21 01:29:41.845505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2714/4796] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:41 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:42.403323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50e6417c-c503-4b83-8b1c-d935261a62ac tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/6a60b2bd-09b2-4885-b002-2568710477a7" status: 202 len: 0 microversion: 2.1 time: 4.744312 Aug 21 01:29:42.406414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2083/4797] 10.222.0.46 () {58 vars in 1263 bytes} [Sun Aug 21 01:29:37 2022] DELETE /compute/v2.1/os-floating-ips/6a60b2bd-09b2-4885-b002-2568710477a7 => generated 0 bytes in 4749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:42.417368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04617570-0292-4827-a728-e45716400d6c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '.version_select at 0x7fc3f881aca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:42.698070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:42.698738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:42.712745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:42.719290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:42.722911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:42.724676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:42.726536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:42.733562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:42.954741 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04617570-0292-4827-a728-e45716400d6c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0cf6c985-87f2-4662-bef8-35df764cd86b" status: 202 len: 0 microversion: 2.1 time: 0.542252 Aug 21 01:29:42.959617 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2715/4798] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:29:42 2022] DELETE /compute/v2.1/os-security-groups/0cf6c985-87f2-4662-bef8-35df764cd86b => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:29:42.966352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:42.967188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:42.973725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:42.974570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:42.975208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:42.976082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:42.976528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:42.976999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.092903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:43.101536 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b674228-4461-4d54-8f6d-abd21594c957 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1303 microversion: 2.1 time: 0.140535 Aug 21 01:29:43.111468 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2716/4799] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:42 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1303 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:43.119262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.120096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:43.127791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.129727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.130483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.131405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.132081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.132720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.169491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:29:43.204065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:43.217506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:43.226027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:43.227450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0717cc9-9bf0-4858-91b4-138573c533ed tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1546 microversion: 2.26 time: 0.537695 Aug 21 01:29:43.228728 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2084/4800] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:42 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1546 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:29:43.254213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc4030ef160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.273398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.274234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.275180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.277159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:43.295664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.296146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.296596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.297303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.297729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.307947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.315092 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9a154b3-6a3b-46c4-a15c-d8660e4ae0d6 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "DELETE /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 204 len: 0 microversion: 2.1 time: 0.201812 Aug 21 01:29:43.318311 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2717/4801] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:29:43 2022] DELETE /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:29:43.346412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.347693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:43.364495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.364926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.365365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.366064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.366507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.367427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.370655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.371335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.372564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.404021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.404824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.405408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.456456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:43.474306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59c8cf75-266f-48ac-96c8-b63ed3939894 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1840980527" status: 201 len: 0 microversion: 2.26 time: 0.224804 Aug 21 01:29:43.480152 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2085/4802] 10.222.0.46 () {62 vars in 1380 bytes} [Sun Aug 21 01:29:43 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1840980527 => generated 0 bytes in 226 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 21 01:29:43.501473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-037f15fe-4e65-4727-a05e-02a068c40477 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fd0e8670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.513987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037f15fe-4e65-4727-a05e-02a068c40477 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.514728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037f15fe-4e65-4727-a05e-02a068c40477 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.515300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-037f15fe-4e65-4727-a05e-02a068c40477 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.527843 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-037f15fe-4e65-4727-a05e-02a068c40477 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1840980527" status: 204 len: 0 microversion: 2.26 time: 0.046504 Aug 21 01:29:43.529078 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2086/4803] 10.222.0.46 () {60 vars in 1361 bytes} [Sun Aug 21 01:29:43 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1840980527 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:43.537710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc4032dc1f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.546095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.546894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.547507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.548151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:43.555405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.556164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.556795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.557680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.558311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.558912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.587653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.588435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.589076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.615847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:43.661821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-003eb8a3-c714-4aaa-8ab6-af3e3816b6ae tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 204 len: 0 microversion: 2.26 time: 0.128120 Aug 21 01:29:43.669825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2087/4804] 10.222.0.46 () {60 vars in 1295 bytes} [Sun Aug 21 01:29:43 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:43.686621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a2ffdb1-ead6-448d-9284-d88450e83b21 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fe16fe50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.700231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a2ffdb1-ead6-448d-9284-d88450e83b21 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.700956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a2ffdb1-ead6-448d-9284-d88450e83b21 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.701208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a2ffdb1-ead6-448d-9284-d88450e83b21 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.717626 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a2ffdb1-ead6-448d-9284-d88450e83b21 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 12 microversion: 2.26 time: 0.040474 Aug 21 01:29:43.726585 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2088/4805] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 01:29:43 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:43.734956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:43.741963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fdd1a700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:43.744657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09e210c6-dc5a-406d-8a61-d4ba2d1be27c tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1509 microversion: 2.1 time: 0.411464 Aug 21 01:29:43.757953 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2718/4806] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:43 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:43.766753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.777968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.783537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.785327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:43.827276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.828192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.831989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.833005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.835179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.835877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.917308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.917799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.918260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.928196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:43.928923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:43.929544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:43.970319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.010478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90c3dc94-4948-4da4-b81d-e9a0f33e43f1 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1324761789" status: 201 len: 0 microversion: 2.26 time: 0.279424 Aug 21 01:29:44.014094 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2089/4807] 10.222.0.46 () {62 vars in 1380 bytes} [Sun Aug 21 01:29:43 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1324761789 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 21 01:29:44.022979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2b52013-ad6b-4815-a548-af9dedad5aca tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3f8957550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.032732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2b52013-ad6b-4815-a548-af9dedad5aca tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.033689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2b52013-ad6b-4815-a548-af9dedad5aca tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.034822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2b52013-ad6b-4815-a548-af9dedad5aca tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.052657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2b52013-ad6b-4815-a548-af9dedad5aca tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 36 microversion: 2.26 time: 0.033949 Aug 21 01:29:44.054508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2719/4808] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 01:29:44 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 36 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:44.069388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fdca7a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.082752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.083383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.083864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.084348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.091947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.092676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.093296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.094248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.095017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.095448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.127099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.127964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.138681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.139456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.139975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.140415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.141154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.141620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.142070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.143338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.144998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.195323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.212036 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea0ed2e5-86ca-407f-bd45-93f1b1995393 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1324761789" status: 204 len: 0 microversion: 2.26 time: 0.151481 Aug 21 01:29:44.213305 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2090/4809] 10.222.0.46 () {60 vars in 1364 bytes} [Sun Aug 21 01:29:44 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1324761789 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:44.221582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c42b3cc-5a37-4b6d-bacf-c4e5fe4a35a9 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc403283820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.230001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c42b3cc-5a37-4b6d-bacf-c4e5fe4a35a9 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.230801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c42b3cc-5a37-4b6d-bacf-c4e5fe4a35a9 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.231395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2c42b3cc-5a37-4b6d-bacf-c4e5fe4a35a9 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.241355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c42b3cc-5a37-4b6d-bacf-c4e5fe4a35a9 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 12 microversion: 2.26 time: 0.023870 Aug 21 01:29:44.241985 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2091/4810] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 01:29:44 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:44.258068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fdd1a9d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.280893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.281808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.282338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.283171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.303979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.305184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.308434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.310546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.313386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.315502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.351909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.352964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.353647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.371968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.398648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6fdb6d7d-6a92-4cdf-9356-48c0b99b3a43 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 204 len: 0 microversion: 2.26 time: 0.144698 Aug 21 01:29:44.410893 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2092/4811] 10.222.0.46 () {60 vars in 1295 bytes} [Sun Aug 21 01:29:44 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:44.417148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fdd1adc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.428374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.429242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.429449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.429955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.441277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.441758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.442183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.443929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.444628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.445084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.476147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.476637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.480567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.492121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.492607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.493302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.526900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.548343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8a3081c-2f88-4cd9-bb5f-c05c28fd43e8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-94384945" status: 201 len: 0 microversion: 2.26 time: 0.135292 Aug 21 01:29:44.549954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2093/4812] 10.222.0.46 () {62 vars in 1374 bytes} [Sun Aug 21 01:29:44 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-94384945 => generated 0 bytes in 138 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Aug 21 01:29:44.564601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fde4daf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.577140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.578077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.578666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.579450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.589704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.590492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.591111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.592186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.592973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.594786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.632038 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:RELEASE=4,nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:DELETE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:44.640793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.641543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.642161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.655375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:44.679741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.679969 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2426ed8-324d-40dd-bec9-b021fcabc22e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.552174 Aug 21 01:29:44.680818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.681358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.688211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2720/4813] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:44 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:44.750641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.772870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.774374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.790953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.792371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.793967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-730dfb22-4979-4cdc-a5da-efaf541289b7 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1321690440" status: 201 len: 0 microversion: 2.26 time: 0.235278 Aug 21 01:29:44.794856 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2094/4814] 10.222.0.46 () {62 vars in 1380 bytes} [Sun Aug 21 01:29:44 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-1321690440 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 21 01:29:44.795154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.796269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.799894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.803568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.813223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fd150040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:44.823826 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:44.843962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.844350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.844807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.845415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:44.864162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.864710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.865947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.867042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.868036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.869364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.942846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:44.948299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:44.948299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:44.967552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:44.995822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-adec99b8-969f-49e9-bd2a-4c579e5a5f61 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 204 len: 0 microversion: 2.26 time: 0.191212 Aug 21 01:29:44.996814 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2095/4815] 10.222.0.46 () {60 vars in 1295 bytes} [Sun Aug 21 01:29:44 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:45.008339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bdba627c-1aeb-4f24-951a-e11a6e97e878 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3fde509d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:45.021621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdba627c-1aeb-4f24-951a-e11a6e97e878 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.022096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdba627c-1aeb-4f24-951a-e11a6e97e878 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.022531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bdba627c-1aeb-4f24-951a-e11a6e97e878 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.047323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bdba627c-1aeb-4f24-951a-e11a6e97e878 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 12 microversion: 2.26 time: 0.038671 Aug 21 01:29:45.053311 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2096/4816] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 01:29:45 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:45.071509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc400880f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:45.097124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.102365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.102778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.103400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:45.131655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.132153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.132589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.133337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.133787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.134217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.168783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:45.182540 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2ce3b64-cbc4-45b7-89f8-ee9b5de037b9 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1509 microversion: 2.1 time: 0.415481 Aug 21 01:29:45.196864 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2721/4817] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:44 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:29:45.198469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.199003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.199393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.230183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:45.292475 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fadb95a3-1c02-4da4-a2bb-9a0826c13b36 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 204 len: 0 microversion: 2.26 time: 0.237689 Aug 21 01:29:45.296131 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2097/4818] 10.222.0.46 () {60 vars in 1295 bytes} [Sun Aug 21 01:29:45 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:45.328148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3f881a8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:45.361122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.361500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.362612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.363492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:45.379770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.380755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.381916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.383728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.386976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.388083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.464426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.465214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.465824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.490571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.491337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.491938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.555255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:45.704588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:45.705520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:45.718893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.720127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.721115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.731251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:45.732191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:45.732747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:45.991395 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-035845ed-ca7b-4c3c-8e9d-052232d9a82f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-220472552" status: 201 len: 0 microversion: 2.26 time: 0.679365 Aug 21 01:29:46.012909 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2722/4819] 10.222.0.46 () {62 vars in 1377 bytes} [Sun Aug 21 01:29:45 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-220472552 => generated 0 bytes in 711 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 21 01:29:46.018414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3f8834dc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:46.030336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.031235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.031764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.032344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:46.041433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.042054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.042716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.043664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.044330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.044989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.078677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.079558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.080198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.090561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.091415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.092063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.118867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:46.137379 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc0253c7-befd-41de-9afb-f263cd618cbf tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-537126340" status: 201 len: 0 microversion: 2.26 time: 0.122860 Aug 21 01:29:46.143183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2723/4820] 10.222.0.46 () {62 vars in 1377 bytes} [Sun Aug 21 01:29:46 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags/tempest-tag-537126340 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 21 01:29:46.149929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Action: 'update_all', calling method: .version_select at 0x7fc3f88174c0>, body: {"tags": ["tempest-tag-1070772437", "tempest-tag-338315100"]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:46.160552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.161681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.162602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.163567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:46.170456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.171262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.171895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.172870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.173530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.174177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.199944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.200820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.201704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.229565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:46.248074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-312f362a-a96c-4b46-a1bd-255965c89f00 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 61 microversion: 2.26 time: 0.102841 Aug 21 01:29:46.255583 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2724/4821] 10.222.0.46 () {62 vars in 1312 bytes} [Sun Aug 21 01:29:46 2022] PUT /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 61 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:46.261101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:46.262091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:46.270704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.271614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.272288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.273568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.274124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.274638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.572265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:46.580385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d008e4ac-0e71-403e-ac90-25e68c954c13 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1509 microversion: 2.1 time: 0.323239 Aug 21 01:29:46.600803 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2725/4822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:46 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:46.600803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abf491a9-6891-4a54-a189-199cc10075bb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3f8834790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:46.614338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abf491a9-6891-4a54-a189-199cc10075bb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.616963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abf491a9-6891-4a54-a189-199cc10075bb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.618448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abf491a9-6891-4a54-a189-199cc10075bb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.640210 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abf491a9-6891-4a54-a189-199cc10075bb tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 200 len: 61 microversion: 2.26 time: 0.048959 Aug 21 01:29:46.643336 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2726/4823] 10.222.0.46 () {60 vars in 1292 bytes} [Sun Aug 21 01:29:46 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 61 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:46.658984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '.version_select at 0x7fc3f885be50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:46.679565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.680318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.680657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:46.681575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.682350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:46.685725 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:46.690140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.691077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.691671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.692827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.693428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.693995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.698092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2f30f53-32e7-4409-b316-176dcabad8b8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.997782 Aug 21 01:29:46.698714 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2098/4824] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:45 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:46.722424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.723245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.723865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.743292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'flavor' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:46.776170 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80efa7a7-c337-415c-9480-7c9b679116f3 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags" status: 204 len: 0 microversion: 2.26 time: 0.125505 Aug 21 01:29:46.776861 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2727/4825] 10.222.0.46 () {60 vars in 1295 bytes} [Sun Aug 21 01:29:46 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970/tags => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:46.805757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:46.811914 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:46.854189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.856419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.858412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.866424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:46.866914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:46.867351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:46.939669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:29:47.242507 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a36a5e7f-7845-4583-a3dd-d42c169df2b2 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 204 len: 0 microversion: 2.26 time: 0.456635 Aug 21 01:29:47.245948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2099/4826] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:29:46 2022] DELETE /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:29:47.255589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:47.256625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:47.270162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:47.271358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:47.272362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:47.273401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:47.275239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:47.275978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:47.613593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:47.614500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:47.631564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:47.632271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:47.632817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:47.638194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:47.638716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:47.639947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:48.162282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:48.177331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:48.179702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:48.187578 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85be03bb-ad0c-4d71-89db-b02ca154438f tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1552 microversion: 2.26 time: 0.937485 Aug 21 01:29:48.188402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2728/4827] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:47 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1552 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:29:48.215705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:48.216557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:48.232947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:48.235898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:48.236591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:48.237607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:48.241101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:48.241861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:48.446145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:48.458480 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5df6ed5-e9ee-496a-8021-8f1cced1e59d tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1509 microversion: 2.1 time: 0.849831 Aug 21 01:29:48.471964 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2100/4828] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:47 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1509 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:48.643661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:48.653406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36b64a00-b9f1-4013-b6ae-84b390415fde tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.450247 Aug 21 01:29:48.655066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2729/4829] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:48 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:49.134121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a48ebf-327b-47df-b4cb-1ae9131d94a9", "name": "network-vif-deleted", "tag": "7922f1f1-6eb8-4682-aa08-edebf8306595"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:49.153536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.157120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.161435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.217128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:49.217755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:49.233647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.234166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.234863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.235756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.237382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.240703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.244723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] Creating event network-vif-deleted:7922f1f1-6eb8-4682-aa08-edebf8306595 for instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 on n-h2-master-1 Aug 21 01:29:49.263548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c0fe5901-8d10-443a-af9c-fa9104551839 req-8dbb0087-db98-4b9b-b264-b4222fd0f9d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130724 Aug 21 01:29:49.265125 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2101/4830] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:49.480528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:49.481275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:49.501155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.501690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.502313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.504111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.504727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.506061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.573036 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:49.586837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.587632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.588361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.589023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lazy-loading 'fault' on Instance uuid 50a48ebf-327b-47df-b4cb-1ae9131d94a9 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:49.675086 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400e677f335446c0817c32b85e1e24b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6c6457b07a43f193af082ada523651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:49.686660 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-080597d1-aa9d-4ce6-94cd-b546f241f7b3 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 200 len: 1313 microversion: 2.1 time: 0.210617 Aug 21 01:29:49.710944 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2102/4831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:49 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:49.719986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:49.722268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:49.729654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.730503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.731094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:49.731966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:49.732568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:49.733165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:50.377707 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:50.425891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:50.452311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:50.461702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:50.464662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:50.469714 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1c0c376-d572-47ee-b36f-ec6da2b596d8 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1552 microversion: 2.26 time: 1.252678 Aug 21 01:29:50.477476 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2730/4832] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:49 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1552 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:50.487432 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b42eccda-db51-4de9-a898-e468e696b6c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.773432 Aug 21 01:29:50.488187 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2103/4833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:49 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:50.711180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:50.720982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] [instance: 50a48ebf-327b-47df-b4cb-1ae9131d94a9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:50.743083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:50.743675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:50.744169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:50.745711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:50.746299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:50.746995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:50.794058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] HTTP exception thrown: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Request method failure captured: Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 HTTP/1.1 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYodQeMcDilFh4eTOnR_75pvFyeWWKB3VrhQpeijvTRU7MM0o2aKgd6Va0Xt4kcfvEtjlqRnPuSfFgkPmw_tckz3x7wKDZqcZd5RXbvO2RvfMQ2FB5Hk8upbkIelyi76enoX6lDEg1pmNNqBRXyVoTi9XpMqNO_5296ZqpddMPE-JvM Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 0c6c6457b07a43f193af082ada523651 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2127144507 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c6c6457b07a43f193af082ada523651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c6c6457b07a43f193af082ada523651", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c6c6457b07a43f193af082ada523651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c6c6457b07a43f193af082ada523651"}]}] Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2127144507 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 0c6c6457b07a43f193af082ada523651 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2127144507 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerRescueTestJSONUnderV235-2127144507-project Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 400e677f335446c0817c32b85e1e24b1 Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2127144507-project Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '50a48ebf-327b-47df-b4cb-1ae9131d94a9'} Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:50.800262 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. Aug 21 01:29:50.806675 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:29:50.810730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] Returning 404 to user: Instance 50a48ebf-327b-47df-b4cb-1ae9131d94a9 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:50.812885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9abdb3f-4d99-41f6-878a-0bf21ddb29a5 tempest-ServerRescueTestJSONUnderV235-2127144507 tempest-ServerRescueTestJSONUnderV235-2127144507-project] 10.222.0.46 "GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9" status: 404 len: 111 microversion: 2.1 time: 0.107053 Aug 21 01:29:50.814253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2731/4834] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:50 2022] GET /compute/v2.1/servers/50a48ebf-327b-47df-b4cb-1ae9131d94a9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:29:51.017951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8b951f-9f21-458c-9863-689ce9fae970", "name": "network-vif-deleted", "tag": "2af8f845-75c0-469b-82b5-f8300b131258"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:51.043360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.043854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.044290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.070836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] Creating event network-vif-deleted:2af8f845-75c0-469b-82b5-f8300b131258 for instance 0c8b951f-9f21-458c-9863-689ce9fae970 on n-h2-master-1 Aug 21 01:29:51.098844 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-063c31d7-3649-496b-bee3-33f048d100ab req-46d1f520-6fdd-4bc6-bb5e-ae4bcfd71557 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084481 Aug 21 01:29:51.099484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2104/4835] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:51.417696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:51.479190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.479664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.480089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.500399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:51.501975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:51.527557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.531621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.534763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.535182 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] Creating event network-changed:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:29:51.542514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.543244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.543862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.606558 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-44017956-5c24-4448-bbb9-f325e9065f6b req-ce8e2520-4ffd-40ab-a502-8fd008b14862 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193831 Aug 21 01:29:51.608802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2732/4836] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:51.615615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:51.616730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:51.625854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.626529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.627156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.628267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.629010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.629596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.696098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:51.698941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:51.700759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:51.701855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lazy-loading 'fault' on Instance uuid 0c8b951f-9f21-458c-9863-689ce9fae970 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:29:51.947035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:51.977116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:51.985305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfef9e4f835c4533acc3a00772c71561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a2139ece3e4b669c5c1262f24e6771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:51.991772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-49b669db-07c7-4795-9db9-0decef72c372 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 200 len: 1352 microversion: 2.26 time: 0.494849 Aug 21 01:29:51.992442 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2105/4837] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:51 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 1352 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:29:52.082823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:52.098147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15a78810-185b-4196-a049-3a01590e38c8 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.486502 Aug 21 01:29:52.098802 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2733/4838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:51 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:53.015204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:53.016115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] [instance: 0c8b951f-9f21-458c-9863-689ce9fae970] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:53.028384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:53.031944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:53.032480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:53.036356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:53.036979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:53.037481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:53.082848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] HTTP exception thrown: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Request method failure captured: Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 HTTP/1.1 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYpsfSR2-dI8yoLfKQnilGYedaJFCuqkMD2-N9EOh4K-3xym9KEmY-S6s49UgVrXv86IC5uDD7hoA7mg0jfcniT0YVpzq663VORBZzpIfmxms8xBWuMBlblZ4UhfGeZB_beEn39Jqf-AGlax6auTOJuwAgeXCs87SuHryBRmo9R5zLM Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.26 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c8a2139ece3e4b669c5c1262f24e6771 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerTagsTestJSON-2126570004 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c8a2139ece3e4b669c5c1262f24e6771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c8a2139ece3e4b669c5c1262f24e6771", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c8a2139ece3e4b669c5c1262f24e6771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c8a2139ece3e4b669c5c1262f24e6771"}]}] Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerTagsTestJSON-2126570004 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c8a2139ece3e4b669c5c1262f24e6771 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerTagsTestJSON-2126570004 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerTagsTestJSON-2126570004-project Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bfef9e4f835c4533acc3a00772c71561 Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerTagsTestJSON-2126570004-project Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '0c8b951f-9f21-458c-9863-689ce9fae970'} Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:29:53.091658 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] Returning 404 to user: Instance 0c8b951f-9f21-458c-9863-689ce9fae970 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:29:53.096268 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0117811-0e35-49ee-9794-6103ffab4625 tempest-ServerTagsTestJSON-2126570004 tempest-ServerTagsTestJSON-2126570004-project] 10.222.0.46 "GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970" status: 404 len: 111 microversion: 2.26 time: 0.081877 Aug 21 01:29:53.102485 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2106/4839] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:29:53 2022] GET /compute/v2.1/servers/0c8b951f-9f21-458c-9863-689ce9fae970 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:29:53.125260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:53.125949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:53.146522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:53.147020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:53.147708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:53.148172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:53.148620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:53.149076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:53.191092 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:53.904807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:53.948629 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef4c58b2-bb38-4fa1-a609-bdb0384c5f56 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.828632 Aug 21 01:29:53.950526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2734/4840] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:53 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:54.972269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:54.973764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:54.992984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:54.993733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:54.994940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:55.001710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:55.002546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:55.007770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:56.631248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:56.645322 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afa8a2ab-e131-40fc-a550-4bcbbdae7916 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 1.674320 Aug 21 01:29:56.649887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2107/4841] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:54 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:57.670589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:57.671198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:57.690691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:57.694241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:57.695105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:57.696723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:57.697481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:57.699353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:58.218259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:29:58.248671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95096602-39bc-4de9-9a92-65cb215d7c69 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.582104 Aug 21 01:29:58.251126 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2735/4842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:57 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:29:58.357060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-75c7f393-aa92-4866-ad23-8038e9595486 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4030ef550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:58.425292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-75c7f393-aa92-4866-ad23-8038e9595486 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755" status: 200 len: 662 microversion: 2.1 time: 0.072014 Aug 21 01:29:58.439179 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2108/4843] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:58 2022] GET /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755 => generated 662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:58.453260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5dca1e94-9f78-4987-b3b1-2863b399e0a5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8957ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:58.523330 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5dca1e94-9f78-4987-b3b1-2863b399e0a5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755" status: 200 len: 662 microversion: 2.1 time: 0.073887 Aug 21 01:29:58.524535 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2736/4844] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:29:58 2022] GET /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755 => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:59.051581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "name": "network-vif-plugged", "status": "completed", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:29:59.069322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:59.070129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:59.070884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:59.078324 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:29:59.091576 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] Creating event network-vif-plugged:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:29:59.100970 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-92a23c35-9a42-47e0-bf95-c15866aaa495 req-d3cd55e0-1121-4af3-b26f-dcf34aff5e1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052651 Aug 21 01:29:59.102016 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2109/4845] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:29:59.271705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:29:59.272325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:29:59.290886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:59.291389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:59.291833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:29:59.292551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:29:59.293210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:29:59.293795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:00.072264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:00.085301 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1616b795-db4a-42b2-9614-76863b00b679 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1371 microversion: 2.1 time: 0.818383 Aug 21 01:30:00.086755 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2737/4846] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:29:59 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:00.180301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d4ff8ca-4d8f-4ba5-9bd1-8889d62925a8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fdf25ee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:00.255537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d4ff8ca-4d8f-4ba5-9bd1-8889d62925a8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d" status: 200 len: 662 microversion: 2.1 time: 0.081266 Aug 21 01:30:00.264115 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2110/4847] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:00 2022] GET /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:00.270231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-91d8614c-d680-4a31-95e9-dddd8fa22f10 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8957940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:00.350647 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-91d8614c-d680-4a31-95e9-dddd8fa22f10 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d" status: 200 len: 662 microversion: 2.1 time: 0.084393 Aug 21 01:30:00.351279 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2738/4848] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:00 2022] GET /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:01.110346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:01.122237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:01.148064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:01.148716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:01.149171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:01.155378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:01.176224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:01.178681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:02.119672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:02.152862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e089f5a5-11c3-453e-9e94-6fcc752cd1c3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1566 microversion: 2.1 time: 1.048431 Aug 21 01:30:02.166914 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2111/4849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:01 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1566 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:02.178093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:02.179683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:02.194823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:02.199203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:02.199980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:02.200982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:02.203132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:02.203831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:02.467484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a205cd07-4142-4481-8b45-6ec448709f20 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fdf25ee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:02.521288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ff480de-2e30-4da6-bf2b-27adf0ba7ba1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347871 Aug 21 01:30:02.524744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2739/4850] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:30:02 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-interface => generated 285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:02.544338 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a205cd07-4142-4481-8b45-6ec448709f20 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20" status: 200 len: 662 microversion: 2.1 time: 0.081048 Aug 21 01:30:02.557184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2112/4851] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:02 2022] GET /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20 => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:02.560821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73ae3cb1-47d2-4001-b928-77281a1285d8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f88cd430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:02.635813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73ae3cb1-47d2-4001-b928-77281a1285d8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20" status: 200 len: 662 microversion: 2.1 time: 0.078901 Aug 21 01:30:02.653745 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2740/4852] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:02 2022] GET /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20 => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:02.876047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1185152100", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:02.994263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:30:04.072434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:30:04.073055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:30:04.073462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:30:04.073867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:30:04.074274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:30:04.098734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:04.102322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:04.103094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:04.103915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:04.104422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:04.104811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:04.164376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Getting quotas for project 7111e801da7a46f99a04f9a6d4a59312. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:30:04.210180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Getting quotas for user aa5eb68dbbb34d1b9bc4ec9ebac6ff08 and project 7111e801da7a46f99a04f9a6d4a59312. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:30:04.245692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:30:04.251091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:30:04.350489 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ed578e2-8909-41ca-a592-756fd7011257 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478623 Aug 21 01:30:04.354693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2113/4853] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:30:04.580150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-570342996", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:04.739772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:30:06.571795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:30:06.572359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:30:06.573674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:30:06.574211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:30:06.575021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:30:06.594823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:06.597068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:06.598983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:06.600824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:06.603255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:06.604849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:06.634826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Getting quotas for project 7111e801da7a46f99a04f9a6d4a59312. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:30:06.641776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Getting quotas for user aa5eb68dbbb34d1b9bc4ec9ebac6ff08 and project 7111e801da7a46f99a04f9a6d4a59312. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:30:06.690810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:30:06.696065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:30:06.865080 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5009e138-594f-4905-92b3-70236ca9ab6b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.285615 Aug 21 01:30:06.869888 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2741/4854] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:30:06.881526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2529c4c5-c434-4c31-bf9c-f045a7db534e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:06.883484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2529c4c5-c434-4c31-bf9c-f045a7db534e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:06.953606 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:07.207381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2529c4c5-c434-4c31-bf9c-f045a7db534e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:07.224170 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2529c4c5-c434-4c31-bf9c-f045a7db534e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1217 microversion: 2.1 time: 0.347099 Aug 21 01:30:07.232274 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2114/4855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:06 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:07.706691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:07.745808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:07.759100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:07.759840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:07.796030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] Creating event network-changed:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:30:07.815800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8554d8e8-3a6a-4e9e-8fdb-4dc706e9d226 req-bf4488e3-07e6-495f-9064-ba173762c629 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114412 Aug 21 01:30:07.831722 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2742/4856] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:08.259459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:08.260872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:08.284821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:08.285702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:08.288120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:08.289081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:08.293498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:08.294336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:09.071597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:09.084929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-690f72c1-738d-47d3-afc6-91bc85cd269a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1213 microversion: 2.1 time: 0.831239 Aug 21 01:30:09.104321 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2115/4857] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:08 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1213 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:09.710773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3d53f7f-9864-482a-8636-16243e764348", "device": "/dev/sdb"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:09.713293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:09.756182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:09.758539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:09.759193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:09.763466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:09.764173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:09.764795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:10.112876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:10.114440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:10.132673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:10.135604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:10.144086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:10.150602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:10.153403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:10.154640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:10.296496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-329b4b58-d9b0-4541-8e6c-04da786afaff tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "POST /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593081 Aug 21 01:30:10.297518 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2743/4858] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:30:09 2022] POST /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:10.403680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:10.413861 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-79276d9b-c0f3-44f6-9358-e150cb93db46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1275 microversion: 2.1 time: 0.306324 Aug 21 01:30:10.417663 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2116/4859] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:10 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:11.446940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:11.447651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:11.454902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:11.457225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:11.457677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:11.460282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:11.461021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:11.462806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:11.659119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:11.672321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9bba24a-81f1-4724-b349-dda8b785e57d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1275 microversion: 2.1 time: 0.228749 Aug 21 01:30:11.673046 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2744/4860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:11 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:11.949336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:11.977279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:11.980792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:11.980792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:12.006047 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] Creating event network-changed:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:30:12.011985 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0f0c7106-803b-4a75-9834-05636ad3154b req-a8d95dc9-5947-4991-a524-df4d815bfb8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068741 Aug 21 01:30:12.013727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2117/4861] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:12.699354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:12.701197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:12.715798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:12.717799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:12.718817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:12.721321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:12.722047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:12.722957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:13.006824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:13.022759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6fff1509-b8f7-4ba9-9681-d576389b2930 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1275 microversion: 2.1 time: 0.332644 Aug 21 01:30:13.026463 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2745/4862] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:12 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1275 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:14.050467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:14.051223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:14.069527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:14.070019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:14.070455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:14.071150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:14.071593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:14.072004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:14.138694 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:14.220628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:14.234169 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed3e874b-3d20-4722-a4ff-36a88856a0df tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1275 microversion: 2.1 time: 0.188145 Aug 21 01:30:14.240233 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2118/4863] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:14 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:15.260068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:15.261560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:15.278374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:15.281794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:15.282501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:15.285757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:15.286487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:15.287648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:16.625329 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:16.661096 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:17.162996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:17.176154 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-268faeec-d665-422c-9667-d2b24d1eeca7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 1.919979 Aug 21 01:30:17.179187 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2746/4864] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:15 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:17.823047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47da2114-3503-4a69-b870-e602ca1c881f", "tag": "9137795b-604d-4524-ae27-148d09ea2939"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:17.863398 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:17.869521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:17.870219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:17.872036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:17.895436 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] Creating event network-changed:9137795b-604d-4524-ae27-148d09ea2939 for instance 47da2114-3503-4a69-b870-e602ca1c881f on n-h1-master-1 Aug 21 01:30:17.904453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2efed6e8-5a29-41ec-a0e9-b9143ed7b2aa req-07648eb8-72f3-4442-8224-f02a0e9b7c8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085287 Aug 21 01:30:17.906349 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2119/4865] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:18.201256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:18.202206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:18.233147 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:18.236090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:18.236902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:18.240399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:18.243520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:18.245518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:18.246677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:19.313739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:19.322325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-973f74c4-e37b-47e5-8521-5a70ba2d6aee tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 1.126331 Aug 21 01:30:19.325219 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2747/4866] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:18 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:20.349671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:20.350366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:20.367038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:20.367838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:20.368443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:20.369347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:20.369960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:20.370553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:20.926723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:20.941405 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50d82533-a578-4150-b6bd-e4f1342e7311 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 0.595223 Aug 21 01:30:20.943328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2120/4867] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:20 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:21.035503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-plugged", "status": "completed", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:21.063620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:21.064097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:21.064675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:21.127484 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] Creating event network-vif-plugged:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:30:21.143246 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6e86c45c-3276-421f-bfc9-491e2d3faeae req-2965e01a-0067-4d84-93cf-509d673615c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111524 Aug 21 01:30:21.147047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2748/4868] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:30:21.963594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:21.964520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:21.984586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:21.989977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:21.990430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:21.991221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:21.995002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:21.995658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:22.457248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:22.469807 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cfe151ff-9183-49d6-9ec6-fe35bc8ad6cb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 0.510020 Aug 21 01:30:22.470882 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2121/4869] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:21 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:23.497702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:23.500559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:23.509245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:23.509967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:23.510637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:23.511699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:23.512221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:23.522445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:23.530621 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:23.805916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:23.820038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca81247e-32d9-46d1-9f52-6418c3530691 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 0.328606 Aug 21 01:30:23.833462 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2749/4870] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:23 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:24.847480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:24.850743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:24.863679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:24.864550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:24.871263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:24.874500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:24.875471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:24.877894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:25.319997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47da2114-3503-4a69-b870-e602ca1c881f", "name": "network-vif-plugged", "status": "completed", "tag": "9137795b-604d-4524-ae27-148d09ea2939"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:25.336416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:25.348392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5eac9ef8-6faa-4ba7-bcd1-fc111c42211e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 0.509708 Aug 21 01:30:25.368594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:25.372134 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2122/4871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:24 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:25.374461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:25.376116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:25.410155 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] Creating event network-vif-plugged:9137795b-604d-4524-ae27-148d09ea2939 for instance 47da2114-3503-4a69-b870-e602ca1c881f on n-h1-master-1 Aug 21 01:30:25.424977 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-07c3a9e4-5f91-496c-b88c-a04aec0e8003 req-f1231635-5a1d-4d78-a976-70d75fbbd7b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109962 Aug 21 01:30:25.429211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2750/4872] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:30:26.370549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:26.371156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:26.386153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:26.389304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:26.392910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:26.394369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:26.395420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:26.397711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:26.777128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:26.787511 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2613144a-1647-4248-8177-017c48b21e4b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1317 microversion: 2.1 time: 0.420722 Aug 21 01:30:26.788116 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2123/4873] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:26 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:27.821027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:27.823033 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:27.833628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:27.834131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:27.834562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:27.835270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:27.835713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:27.836126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:29.024350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:29.044263 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e330731-a785-404b-bdf0-13e999121b12 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1467 microversion: 2.1 time: 1.236901 Aug 21 01:30:29.045502 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2751/4874] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:27 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1467 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:29.067651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:29.068379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:29.087572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:29.088460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:29.089174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:29.090216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:29.090878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:29.094528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:29.520977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:29.535927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-46d1abb4-4293-455f-a515-350dce99ae18 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1468 microversion: 2.1 time: 0.473399 Aug 21 01:30:29.552447 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2124/4875] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:29 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1468 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:29.559383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-354691989"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:29.562516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:29.592933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:29.595143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:29.598280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:29.603660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:29.604898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:29.606226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:30.342660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f63f091e-6393-48f1-853e-60cc29d7a171 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "POST /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9/action" status: 202 len: 0 microversion: 2.1 time: 0.788893 Aug 21 01:30:30.349434 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2752/4876] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:30:29 2022] POST /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:30:30.361492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98a2ab78-1413-4a77-b4de-d4c30b63a2d7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fddac5e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:30.508893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-98a2ab78-1413-4a77-b4de-d4c30b63a2d7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.154559 Aug 21 01:30:30.513098 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2125/4877] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:30 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:31.527379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9465ef13-0e00-49cc-932d-1116cfd51c45 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8957ca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:31.669618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9465ef13-0e00-49cc-932d-1116cfd51c45 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.146898 Aug 21 01:30:31.672013 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2753/4878] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:31 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:32.699552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c45d9261-1014-493e-a2e3-fd1afb988820 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc403102820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:32.808887 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c45d9261-1014-493e-a2e3-fd1afb988820 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.121954 Aug 21 01:30:32.812057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2126/4879] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:32 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:33.826351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47167a72-8411-41ac-b054-c41485c63033 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f899a700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:33.912334 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47167a72-8411-41ac-b054-c41485c63033 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.089808 Aug 21 01:30:33.925923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2754/4880] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:33 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:34.953062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4741153e-8031-412e-bc69-3610d56c18d6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fdca7a60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:35.059232 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4741153e-8031-412e-bc69-3610d56c18d6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.118078 Aug 21 01:30:35.059850 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2127/4881] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:34 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:36.077254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-253d019a-6d90-4bb1-aa07-0e1ff883b5a3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f88340d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:36.190401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-253d019a-6d90-4bb1-aa07-0e1ff883b5a3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.118468 Aug 21 01:30:36.192143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2755/4882] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:36 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:37.213703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f7a09ad-fc9f-4273-833b-9f9c1c333b1b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc400880790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:37.303811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f7a09ad-fc9f-4273-833b-9f9c1c333b1b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.101103 Aug 21 01:30:37.307462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2128/4883] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:37 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:38.323764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f7c4068-33df-48a2-a123-55dfa5727cc0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa1db430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:38.429992 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f7c4068-33df-48a2-a123-55dfa5727cc0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.110608 Aug 21 01:30:38.432044 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2756/4884] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:38 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:39.449383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d0ae145-ecce-4909-9710-4e4e6c2c918b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc403283820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:39.475958 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=20 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:39.530116 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=60 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:39.532006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "443f04fe-5595-49d4-98c4-3f5e370c8ae3"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:39.539609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:39.561747 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d0ae145-ecce-4909-9710-4e4e6c2c918b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.118628 Aug 21 01:30:39.563023 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2129/4885] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:39 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:39.574710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:39.590433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:39.591155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:39.591816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:39.592502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:39.592668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:40.479839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-993daeff-e9d6-478e-856c-d0a5c414b1d0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951719 Aug 21 01:30:40.503224 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2757/4886] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:30:39 2022] POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:30:40.578638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6706ca9-c250-4380-8672-12948c1e83e7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fde4daf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:40.743728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6706ca9-c250-4380-8672-12948c1e83e7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.171004 Aug 21 01:30:40.748405 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2130/4887] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:40 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:41.762467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d17b6a8d-ba07-4fbc-927c-41ba4923206b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f937ea60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:42.001768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d17b6a8d-ba07-4fbc-927c-41ba4923206b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.241340 Aug 21 01:30:42.013035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2758/4888] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:41 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:43.038748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6957d176-14a4-455b-94a4-5f8aa601449f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f88cf280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:43.140457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6957d176-14a4-455b-94a4-5f8aa601449f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.120872 Aug 21 01:30:43.141069 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2759/4889] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:43 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:30:43.415620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-plugged", "status": "completed", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:43.452413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:43.456930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:43.459497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:43.469495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1031198543", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "a9211776-7ab8-4a17-8895-60e9f060b41a"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:43.486980 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] Creating event network-vif-plugged:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:30:43.498827 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d12027f4-7d33-4f6c-87bd-a0583b039810 req-45355210-3954-4649-a468-d8c97b7a1a5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094809 Aug 21 01:30:43.503287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2760/4890] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:30:43.814702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] validate_networks() for [('a9211776-7ab8-4a17-8895-60e9f060b41a', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:30:44.157614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9d784ec-90f8-4baf-a7e0-aac2a497dc50 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8a93af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:44.261749 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9d784ec-90f8-4baf-a7e0-aac2a497dc50 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.108667 Aug 21 01:30:44.263683 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2761/4891] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:44 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:45.295934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abc9c9f8-9c2e-4e45-a447-917fb7249a16 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9d00ee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:45.567941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:30:45.570094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:30:45.570845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:30:45.571793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:30:45.572581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:30:45.622166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:45.628405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:45.632449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:45.637164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:45.639825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:45.642613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:45.723634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Getting quotas for project 9700d334841645fca1319e2b2bfbc03b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:30:45.747775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Getting quotas for user 9af3b140e73141479d1a6e7d7b7266f2 and project 9700d334841645fca1319e2b2bfbc03b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:30:45.848813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:30:45.849079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abc9c9f8-9c2e-4e45-a447-917fb7249a16 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.574038 Aug 21 01:30:45.861059 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2762/4892] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:45 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:45.868440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:30:46.048796 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9b06ffb-8077-4e23-988a-11d985372113 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.527105 Aug 21 01:30:46.050247 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2131/4893] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:30:46.073588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1066268c-976f-461a-9ce3-5b90f05d1f19 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:46.073588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1066268c-976f-461a-9ce3-5b90f05d1f19 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:46.451204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1066268c-976f-461a-9ce3-5b90f05d1f19 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:46.471947 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1066268c-976f-461a-9ce3-5b90f05d1f19 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1228 microversion: 2.1 time: 0.412563 Aug 21 01:30:46.474501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2763/4894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:46 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1228 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:46.873678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a40f951-e573-4ba5-bc80-a755b203f49f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf85d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:47.244292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a40f951-e573-4ba5-bc80-a755b203f49f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.375370 Aug 21 01:30:47.255664 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2132/4895] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:46 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:47.498305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc53c5ed-2054-4f8d-8e6b-15067a9184b4 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:47.501964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc53c5ed-2054-4f8d-8e6b-15067a9184b4 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:47.889607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc53c5ed-2054-4f8d-8e6b-15067a9184b4 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:47.915285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc53c5ed-2054-4f8d-8e6b-15067a9184b4 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1228 microversion: 2.1 time: 0.421643 Aug 21 01:30:47.918482 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2764/4896] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:47 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1228 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:48.260972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13340143-d8db-4b80-875e-1b7c173258e6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf9c310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:48.512429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13340143-d8db-4b80-875e-1b7c173258e6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.256760 Aug 21 01:30:48.513082 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2133/4897] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:48 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:30:48.955152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:48.955745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:48.981264 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:48.997695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:49.001374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:49.005350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:49.011121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:49.011973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:49.012597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:49.318907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:49.332857 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-18f07e2a-784a-4360-acc5-e1262562dc11 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1298 microversion: 2.1 time: 0.394225 Aug 21 01:30:49.335879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2765/4898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:48 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1298 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:49.530537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-676c4fe9-e546-425a-9ca2-6bb651dcd079 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcfed700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:49.700126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-676c4fe9-e546-425a-9ca2-6bb651dcd079 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.176441 Aug 21 01:30:49.700734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2134/4899] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:49 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:50.361740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:50.362355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:50.387586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:50.389378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:50.390629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:50.394181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:50.394870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:50.396597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:50.712136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:50.723864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dc407df-d3fe-48b4-b80c-d72f5eaa346c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fe371af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:50.734907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9fea381-d69f-4a24-a107-07d98d8d1554 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1286 microversion: 2.1 time: 0.377215 Aug 21 01:30:50.753070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2766/4900] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:50 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1286 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:50.837158 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dc407df-d3fe-48b4-b80c-d72f5eaa346c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.121793 Aug 21 01:30:50.838070 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2135/4901] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:50 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:51.759270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:51.760544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:51.799094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:51.799844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:51.802498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:51.803435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:51.804047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:51.805237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:51.853895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0e988f7-aa1a-46b4-96c6-40e9e970815c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcfcc550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:51.948261 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0e988f7-aa1a-46b4-96c6-40e9e970815c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.099414 Aug 21 01:30:51.964473 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2136/4902] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:51 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:52.493259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:52.525930 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b6129229-a5bc-4474-b11f-d644451193ca tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1286 microversion: 2.1 time: 0.770784 Aug 21 01:30:52.526517 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2767/4903] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:51 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1286 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:52.969819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b62fa83-3b76-4f76-a4d4-f4ba824c1212 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf9c310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:53.100113 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b62fa83-3b76-4f76-a4d4-f4ba824c1212 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.140515 Aug 21 01:30:53.101090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2137/4904] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:52 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:53.548194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:53.548969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:53.569568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:53.580652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:53.581133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:53.592519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:53.593095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:53.593540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:53.674251 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:54.117910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc7aa3aa-7500-42e8-a366-483ee2e1fab5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8a3a0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:54.181828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:54.205912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5b4d93f-d99e-49a4-95fa-1176a06c222c tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1328 microversion: 2.1 time: 0.661197 Aug 21 01:30:54.206612 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2768/4905] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:53 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1328 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:54.231659 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc7aa3aa-7500-42e8-a366-483ee2e1fab5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.119358 Aug 21 01:30:54.232957 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2138/4906] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:54 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:54.874807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9b6b5a-55c1-4697-b926-96d5ea024124", "tag": "7df07498-d7ca-4095-b03c-ff3cc82b9120"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:30:54.918097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:54.918591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:54.919909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:54.959751 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] Creating event network-changed:7df07498-d7ca-4095-b03c-ff3cc82b9120 for instance af9b6b5a-55c1-4697-b926-96d5ea024124 on n-h1-master-1 Aug 21 01:30:54.989015 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c65823ab-ffe1-4000-b290-d8abf50e222d req-82ad2900-07af-4648-8fca-7f1d998bbcdf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115071 Aug 21 01:30:54.990119 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2769/4907] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:30:55.233160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:55.236321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:55.248750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8328b15-3d01-40ee-9154-a1f41f603933 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa1db820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:55.285190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:55.292462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:55.293777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:55.295230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:55.297189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:55.298946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:55.359010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8328b15-3d01-40ee-9154-a1f41f603933 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.115144 Aug 21 01:30:55.360324 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2770/4908] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:55 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:55.693521 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:55.778183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:55.790484 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a69fb698-4604-490e-a233-58a888a2c685 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1328 microversion: 2.1 time: 0.565125 Aug 21 01:30:55.804815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2139/4909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:55 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1328 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:55.958440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:55.960508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:55.977765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:55.980898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:55.981558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:55.982299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:55.982752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:55.985956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:56.115427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lazy-loading 'services' on Instance uuid a58b97db-cd17-42da-9acb-63690515d5d4 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:30:56.262350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-17817d73-4e14-4314-b104-b0da9500cace tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4/os-volume_attachments/a3d53f7f-9864-482a-8636-16243e764348" status: 202 len: 0 microversion: 2.1 time: 0.308086 Aug 21 01:30:56.264143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2771/4910] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:30:55 2022] DELETE /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4/os-volume_attachments/a3d53f7f-9864-482a-8636-16243e764348 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:30:56.374488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2c45074-edc3-49a4-a15e-7c433f9bf413 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8a8b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:56.389691 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:56.468128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2c45074-edc3-49a4-a15e-7c433f9bf413 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.097725 Aug 21 01:30:56.469172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2140/4911] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:56 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:56.817077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:56.818074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:56.830849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:56.831351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:56.831792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:56.832509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:56.835419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:56.835887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:57.162822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:30:57.177437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d9642f0-00e3-4726-b6ca-dd0f018937fa tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1328 microversion: 2.1 time: 0.362818 Aug 21 01:30:57.179926 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2772/4912] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:56 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1328 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:57.390981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:57.396807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:57.411962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:57.413241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:57.414059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:57.414941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:57.415552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:57.416140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:57.447784 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5bf76279-316f-47b5-93db-8d8a90575b4f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/ips" status: 200 len: 151 microversion: 2.20 time: 0.061505 Aug 21 01:30:57.464520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2141/4913] 10.222.0.46 () {60 vars in 1289 bytes} [Sun Aug 21 01:30:57 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/ips => generated 151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:30:57.492212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f52c0c6-d980-484a-b711-6b2f1004d980 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8991670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:57.577037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f52c0c6-d980-484a-b711-6b2f1004d980 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.094478 Aug 21 01:30:57.577625 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2773/4914] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:57 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:58.208389 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:58.209428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:30:58.219661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:58.225548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:58.226231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:58.227667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:30:58.228289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:30:58.230457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:30:58.589107 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:30:58.598766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-491e1a61-9e48-4203-8041-598e7b909449 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f937ec10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:58.734058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-491e1a61-9e48-4203-8041-598e7b909449 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.145820 Aug 21 01:30:58.744090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2774/4915] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:58 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:30:59.753781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df9747e-b1ea-4709-a49f-e6fea1246a01 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8957820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:30:59.845742 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9df9747e-b1ea-4709-a49f-e6fea1246a01 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.099360 Aug 21 01:30:59.853867 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2775/4916] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:30:59 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:00.045629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:00.056443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c793ecf8-d59e-400e-b241-3cb5d3dffee3 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1328 microversion: 2.1 time: 1.853097 Aug 21 01:31:00.059862 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2142/4917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:30:58 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1328 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:00.868614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d8293ed-6965-4e62-b994-3f963f87e816 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89d1790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:00.946369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d8293ed-6965-4e62-b994-3f963f87e816 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.088664 Aug 21 01:31:00.955673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2776/4918] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:00 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:01.071194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9b6b5a-55c1-4697-b926-96d5ea024124", "name": "network-vif-plugged", "status": "completed", "tag": "7df07498-d7ca-4095-b03c-ff3cc82b9120"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:01.081727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:01.082674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:01.106405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:01.106908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:01.107347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:01.108076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:01.108525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:01.108988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:01.115848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:01.134896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:01.135660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:01.173548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] Creating event network-vif-plugged:7df07498-d7ca-4095-b03c-ff3cc82b9120 for instance af9b6b5a-55c1-4697-b926-96d5ea024124 on n-h1-master-1 Aug 21 01:31:01.189994 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c1c1dd7e-d125-475b-84a9-d568f0fea272 req-f32f120b-3176-43bf-932a-fe872847d2e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122924 Aug 21 01:31:01.198497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2143/4919] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:01.312257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:01.313163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:01.327981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:01.329609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:01.330658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:01.336920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:01.337642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:01.338253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:01.433948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lazy-loading 'flavor' on Instance uuid d1d362bd-347a-4615-94d8-891d6017d171 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:31:02.014252 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86bffd9c-8af9-4f3e-8da3-936da6cff57e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/action" status: 202 len: 0 microversion: 2.20 time: 0.703545 Aug 21 01:31:02.015201 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2144/4920] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:31:01 2022] POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:31:02.038899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65e58e4d-7f12-4efb-93bb-b79da24874ff tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fde50c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:02.142632 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65e58e4d-7f12-4efb-93bb-b79da24874ff tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.122160 Aug 21 01:31:02.144944 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2145/4921] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:02 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:02.155869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:02.158547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:02.175957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:02.178510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:02.179201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:02.181141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:02.181945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:02.185200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:02.859197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:02.886387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:02.895317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:02.905034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7fe009d4-0cdd-40ae-b776-d8cb906169ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.757478 Aug 21 01:31:02.909150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2146/4922] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:02 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:03.147550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:03.158975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1fb7e4f0-80cd-4b9b-8208-4c2eb6bb5336 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1328 microversion: 2.1 time: 2.083837 Aug 21 01:31:03.159559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38b6d23f-bb1e-4f30-967f-ba56910ee43f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8ae50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:03.164883 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2777/4923] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:01 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1328 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:03.247680 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38b6d23f-bb1e-4f30-967f-ba56910ee43f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.092426 Aug 21 01:31:03.248486 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2147/4924] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:03 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:03.285966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:03.289420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:03.304488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.308202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.312030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:03.313323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.316518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.317744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:03.428978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'flavor' on Instance uuid 1287227d-49d9-42ee-b8f4-a6e86d34697e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:31:03.695380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99e0ee16-8821-4882-bca5-d5875e4a583c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/action" status: 200 len: 32 microversion: 2.1 time: 0.413394 Aug 21 01:31:03.706075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2778/4925] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:31:03 2022] POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:31:03.711622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:03.712259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:03.740402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.754682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.755167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:03.755933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.756403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.756857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:03.939197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:03.940711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:03.956856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.958349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.958912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:03.960711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:03.962654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:03.963190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:04.394197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:04.416040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:04.426327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:04.428013 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ad5c0cf-db4b-4dfd-ad17-da64f94a1988 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.493775 Aug 21 01:31:04.428628 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2779/4926] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:03 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:04.449784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:04.450428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:04.457862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:04.458763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:04.458763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:04.459516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:04.460073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:04.460497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:04.609238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:04.620366 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93eb8780-0033-4ade-9e69-039e76a5af2e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.914721 Aug 21 01:31:04.629726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2148/4927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:03 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:04.642281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc2f704f-b6d6-48d2-9fd6-84415de04d53 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fde50d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:04.714618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc2f704f-b6d6-48d2-9fd6-84415de04d53 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.083042 Aug 21 01:31:04.715455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2149/4928] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:04 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:04.810108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:04.820851 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a095ca6f-3009-4723-ad55-1bdd9aa85c1f tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1527 microversion: 2.1 time: 0.377247 Aug 21 01:31:04.824189 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2780/4929] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:04 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1527 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:04.852135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:04.853174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:04.861633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:04.862503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:04.863179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:04.871546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:04.872361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:04.873188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:05.456679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:05.457589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:05.464543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:05.471653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:05.473401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:05.473855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:05.479732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:05.480278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:05.480724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:05.492661 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-edfc7396-cb00-431a-9588-58f57ff742c6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1527 microversion: 2.1 time: 0.641394 Aug 21 01:31:05.493574 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2150/4930] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:04 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1527 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:06.158158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:06.165611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:06.166828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:06.174237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:06.176152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:06.185568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8226c95-5be3-4d7a-8ee2-674b8a27fa8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.734710 Aug 21 01:31:06.190468 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2781/4931] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:05 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:06.191982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.202348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.202957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:06.205229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:06.206218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:06.207272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.207771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.208215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:06.227800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.245162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.245842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:06.246700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.247264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.247741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:06.271722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] HTTP exception thrown: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Request method failure captured: Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 HTTP/1.1 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYrC3LZiKiBEDppbPud9d1j1Fs8aTy_WBZOo8-4jyx_-AUcxoAm8_vPg7-2ybS4Bi333AYeIVy976oObWKhq28aXnXexwZ7l0BvDDEIKJkJsElcgbodfWrfkGIBwgzbpmNAJnj5S3aso3Dbe1m92MkaLSA7Yf5QM2IYzbMFjIOxBTY0 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9a073fbd601544e5a39dff3bf0703583 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a073fbd601544e5a39dff3bf0703583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a073fbd601544e5a39dff3bf0703583", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a073fbd601544e5a39dff3bf0703583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a073fbd601544e5a39dff3bf0703583"}]}] Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9a073fbd601544e5a39dff3bf0703583 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1536292511-project Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e7850bbac189450495a33daf0b0d7429 Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511-project Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af9b6b5a-55c1-4697-b926-96d5ea024124'} Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:31:06.290005 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:06.294346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Returning 404 to user: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:31:06.301291 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef45c4ff-d2ab-4091-85b6-f7b8df09a70a tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 404 len: 111 microversion: 2.1 time: 0.777509 Aug 21 01:31:06.304067 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2151/4932] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:31:05 2022] DELETE /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 111 bytes in 791 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:06.322904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04208422-201f-41bc-8e4a-40bcd9a70132 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf85310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:06.436251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04208422-201f-41bc-8e4a-40bcd9a70132 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.131002 Aug 21 01:31:06.445636 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2152/4933] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:06 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:06.451041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:06.451935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:06.459620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.460565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.461656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:06.462624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:06.463301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:06.463895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.231966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:07.251916 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0e20320-edc3-4e4c-91d7-fbfdd784f891 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 1.058112 Aug 21 01:31:07.255192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2782/4934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:06 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:07.262242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:07.263700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:07.270731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:07.276757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.277623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.279691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.280495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.281756 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a85b4ee-e3a5-425b-8c7c-a61a7107c184 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1527 microversion: 2.1 time: 0.834667 Aug 21 01:31:07.282340 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2153/4935] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:06 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1527 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:07.282468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.299506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.304516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Action: 'update', calling method: >, body: {"server": {"name": "af9b6b5a-55c1-4697-b926-96d5ea024124_new"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:07.308598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:07.326135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.326645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.327084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.327811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.328256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.334485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.390474 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] HTTP exception thrown: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Request method failure captured: Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: request: PUT /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 HTTP/1.1 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 64 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYrC3LZiKiBEDppbPud9d1j1Fs8aTy_WBZOo8-4jyx_-AUcxoAm8_vPg7-2ybS4Bi333AYeIVy976oObWKhq28aXnXexwZ7l0BvDDEIKJkJsElcgbodfWrfkGIBwgzbpmNAJnj5S3aso3Dbe1m92MkaLSA7Yf5QM2IYzbMFjIOxBTY0 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9a073fbd601544e5a39dff3bf0703583 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a073fbd601544e5a39dff3bf0703583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9a073fbd601544e5a39dff3bf0703583", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9a073fbd601544e5a39dff3bf0703583"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9a073fbd601544e5a39dff3bf0703583"}]}] Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9a073fbd601544e5a39dff3bf0703583 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1536292511-project Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e7850bbac189450495a33daf0b0d7429 Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1536292511-project Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: {"server": {"name": "af9b6b5a-55c1-4697-b926-96d5ea024124_new"}} Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af9b6b5a-55c1-4697-b926-96d5ea024124', 'body': {'server': {'name': 'af9b6b5a-55c1-4697-b926-96d5ea024124_new'}}} Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:31:07.394772 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:07.399016 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:07.400883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] Returning 404 to user: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:31:07.401780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8262fad-9b28-4d72-b781-65bc97ca5040 tempest-ServersNegativeTestMultiTenantJSON-1536292511 tempest-ServersNegativeTestMultiTenantJSON-1536292511-project] 10.222.0.46 "PUT /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 404 len: 111 microversion: 2.1 time: 0.101897 Aug 21 01:31:07.407335 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2154/4936] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:31:07 2022] PUT /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:31:07.423605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:07.432972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:07.449893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.450382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.460900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.463375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.463860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.464303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.526415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:31:07.586738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:07.606024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:07.607956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:07.609498 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-603e21fa-dcf8-421a-8f92-da420ab745e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.353013 Aug 21 01:31:07.610855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2783/4937] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:07 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:07.617969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e0e934b-7a70-47be-84a0-464717c57f10 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9b8fd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:07.733551 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e0e934b-7a70-47be-84a0-464717c57f10 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.117135 Aug 21 01:31:07.735473 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2784/4938] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:07 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:07.738920 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-351f2f63-d080-4a5c-82c4-c0b71a9c5edf tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 204 len: 0 microversion: 2.1 time: 0.323545 Aug 21 01:31:07.739802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2155/4939] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:31:07 2022] DELETE /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:31:07.753410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:07.754121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:07.761971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.762581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.763082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.767057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:07.771498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:07.772271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:07.992315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:07.993600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:08.012175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.014655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.016543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.018736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.020107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.021070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.085891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:31:08.090857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:08.100403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc954b47-c41f-4133-b3b3-b9d288b4d140 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1533 microversion: 2.1 time: 0.353411 Aug 21 01:31:08.108273 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2785/4940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:07 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1533 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:08.275999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:08.276746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:08.287526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ccc85e8-88f7-4caf-85af-7a8f86a0286e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 204 len: 0 microversion: 2.1 time: 0.298870 Aug 21 01:31:08.290752 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2156/4941] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:31:07 2022] DELETE /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:31:08.295702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.296206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.296638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.301523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.303555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:08.304259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.304406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:08.304707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.310893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.311378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.311811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.312512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.313105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.313753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.344325 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:08.566870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:08.578803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8dfdbe8d-63a0-4d44-b897-d3bb84a1e21d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.306464 Aug 21 01:31:08.579974 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2786/4942] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:08 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:08.639133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:08.640442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:08.653469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.654353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.655078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.656199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:08.656961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:08.657763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:08.855887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:08.869072 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2647c33-d4fa-4ff0-9209-a0b675fd0c5d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1514 microversion: 2.1 time: 0.573352 Aug 21 01:31:08.886586 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2157/4943] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:08 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1514 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:08.894176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b39fcaf1-5ef8-4d44-a2f9-f6730d8bc679 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8aa60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:08.970682 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b39fcaf1-5ef8-4d44-a2f9-f6730d8bc679 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.082706 Aug 21 01:31:08.971269 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2158/4944] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:08 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:08.989476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:09.006052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:09.011800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:09.014547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2753d4b8-031b-488a-9ace-c7251e4c74be tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.380064 Aug 21 01:31:09.019192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2787/4945] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:08 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:31:09.145251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:09.146076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:09.155112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.155854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.156498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:09.157649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.158378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.159056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:09.602786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:09.603479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:09.622752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.623197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.623649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:09.624393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.628865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.629433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:09.679394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:09.699866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7edc1b71-ec9b-4795-a019-95e9fee0bdf8 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1533 microversion: 2.1 time: 0.571325 Aug 21 01:31:09.703818 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2159/4946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:09 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1533 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:09.895242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:09.910475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:09.921228 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:09.926366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.930209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.930979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:09.932026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:09.933056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:09.933935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:10.092103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:10.095138 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:10.105801 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99ef1ce5-5289-4232-9779-450d23a04c6b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.507442 Aug 21 01:31:10.108879 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2788/4947] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:09 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:10.116178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85aec7e0-ff9d-4d83-a58b-95b2bf270b1f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9b8f1f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:10.217309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85aec7e0-ff9d-4d83-a58b-95b2bf270b1f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.106856 Aug 21 01:31:10.220584 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2789/4948] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:10 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:10.242408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:10.243561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:10.251651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:10.252423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:10.253120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:10.254087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:10.254760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:10.255401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:10.587005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:10.612656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:10.622799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:10.631890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-22c6b286-823f-47b7-bc92-1e161ced9081 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.407011 Aug 21 01:31:10.645716 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2790/4949] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:10 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:10.721769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:10.722399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:10.752547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:10.753093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:10.753533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:10.754308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:10.754758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:10.755172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:11.147358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:11.160254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74e2ef89-2205-4786-a9a0-9474ddd3a0b6 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1533 microversion: 2.1 time: 0.442383 Aug 21 01:31:11.180176 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2791/4950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:10 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1533 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:11.189430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:11.189981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:11.196951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:11.197896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:11.198504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:11.199372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:11.199786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:11.200516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:11.201674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:11.209848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e1d07a3-1de4-4a97-8ac5-1db9e5840241 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1514 microversion: 2.1 time: 1.318766 Aug 21 01:31:11.210441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2160/4951] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:09 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1514 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:11.238968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7dfca91-565b-4033-aaba-4d57ea6a7827 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fd025700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:11.292733 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7dfca91-565b-4033-aaba-4d57ea6a7827 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1452 microversion: 2.1 time: 0.062968 Aug 21 01:31:11.294119 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2161/4952] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:11 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:11.670510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:11.671284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:11.680525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:11.687999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:11.689025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:11.690006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:11.690619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:11.691221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.047734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.059753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.061636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.063174 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-469e2055-c88a-495a-b110-46305388f6e3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.400641 Aug 21 01:31:12.064745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2162/4953] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:11 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:31:12.110508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.120134 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb30dbf2-f381-4988-9740-8655db6d2335 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.938713 Aug 21 01:31:12.121039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2792/4954] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:11 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:12.190058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:12.190671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:12.198611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.199194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.199690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.200660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.202307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.202901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.232536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:12.235903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:12.245907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.247943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.248799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.252283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.252864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.253376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.420656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.448526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af3b140e73141479d1a6e7d7b7266f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9700d334841645fca1319e2b2bfbc03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:12.458518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5a012e5-6d54-4aad-9390-b98dcd8d40d3 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 200 len: 1472 microversion: 2.1 time: 0.214983 Aug 21 01:31:12.462468 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2793/4955] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:12 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:12.467466 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-191b0404-68f2-4f27-8989-3f043f04eb2a tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 200 len: 1491 microversion: 2.1 time: 0.280953 Aug 21 01:31:12.469722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2163/4956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:12 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 1491 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:12.487123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58b97db-cd17-42da-9acb-63690515d5d4", "name": "network-vif-deleted", "tag": "f416f883-7091-4354-b912-0e20d1ac2bc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:12.493694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2ec2acd-19f5-4057-a3dc-b747c9fde1d3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc403102af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:12.548612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.549988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.554153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.593163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] Creating event network-vif-deleted:f416f883-7091-4354-b912-0e20d1ac2bc6 for instance a58b97db-cd17-42da-9acb-63690515d5d4 on n-h1-master-1 Aug 21 01:31:12.601231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9c493f14-2c94-4de8-b253-537ef4892dc8 req-9c7bf66b-eb5a-492b-a0dc-7e33f8b5124f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135186 Aug 21 01:31:12.602361 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2794/4957] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:12.614856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2ec2acd-19f5-4057-a3dc-b747c9fde1d3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1461 microversion: 2.1 time: 0.139365 Aug 21 01:31:12.632930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53682bc2-c50d-494b-8794-1b6b004a7b8e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8991670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:12.644730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2164/4958] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:12 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:12.760259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53682bc2-c50d-494b-8794-1b6b004a7b8e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 200 len: 1461 microversion: 2.1 time: 0.130160 Aug 21 01:31:12.761263 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2795/4959] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:12 2022] GET /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:12.803505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:12.806698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:12.818097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.818586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.819205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:12.820169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:12.820805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:12.821388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.028097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:13.038568 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4fd6799-a9fa-41c1-b715-fad717b71538 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1468 microversion: 2.1 time: 0.265876 Aug 21 01:31:13.053416 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2165/4960] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:12 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:13.062745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1910476693"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:13.067308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:13.075416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.075904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.076341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.077336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.077982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.079545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.088568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:13.089580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:13.100048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.100821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.101401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.102385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.103003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.103722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.352111 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0368299c-a51b-4dd3-9ffc-77be1b1d4ea8 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "POST /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f/action" status: 202 len: 0 microversion: 2.1 time: 0.295585 Aug 21 01:31:13.357244 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2796/4961] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:31:13 2022] POST /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:31:13.376911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:13.379734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:13.396702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.397228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.397661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.401036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.402722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.403242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.414501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:13.430432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:13.432335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:13.435157 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-260ec158-bef6-4c95-a343-be1450447c85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.350692 Aug 21 01:31:13.439571 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2166/4962] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:13 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:13.451522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28a147a5-b105-453a-98e9-21273692e57f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8db80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:13.515462 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28a147a5-b105-453a-98e9-21273692e57f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.074413 Aug 21 01:31:13.527734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2167/4963] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:13 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:13.541314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:13.552073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: a58b97db-cd17-42da-9acb-63690515d5d4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:13.563024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.563691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.564200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.566067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.566631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.567169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.592256 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] HTTP exception thrown: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Request method failure captured: Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 HTTP/1.1 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoOrMn6SPy1-Jb0-b7WWKVruiOKJweGG0sF3JepTh8d4ZfriiYYzAyibCEZA94Oim1d7PPr953rF2dJcIbrwov4uZmYai8hyBMapB4eK9AXlVz99F2SGC_LyEM1wFk1JX8l10uZwy6OxPuVLgt2pxc2wNitGbFgW-ZXEI2te8xNX7Y Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c92a6cc6152c46bb982b30251f7aad18 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c92a6cc6152c46bb982b30251f7aad18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c92a6cc6152c46bb982b30251f7aad18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c92a6cc6152c46bb982b30251f7aad18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c92a6cc6152c46bb982b30251f7aad18"}]}] Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c92a6cc6152c46bb982b30251f7aad18 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesSnapshotTestJSON-212505533-project Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f0524cc60bd640ca9ae88845970eb013 Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesSnapshotTestJSON-212505533-project Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a58b97db-cd17-42da-9acb-63690515d5d4'} Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:13.594450 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. Aug 21 01:31:13.599186 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.602682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Returning 404 to user: Instance a58b97db-cd17-42da-9acb-63690515d5d4 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:31:13.603804 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-100342b2-1a53-43c2-9c28-b1bb3bf5755b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4" status: 404 len: 111 microversion: 2.1 time: 0.073212 Aug 21 01:31:13.605533 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2168/4964] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:13 2022] GET /compute/v2.1/servers/a58b97db-cd17-42da-9acb-63690515d5d4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:13.612991 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:13.613881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] [instance: af9b6b5a-55c1-4697-b926-96d5ea024124] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:13.620339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.620997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.621945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.622859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:13.623590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:13.624278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:13.643351 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] HTTP exception thrown: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Request method failure captured: Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 HTTP/1.1 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYqu89JTO9TUCehDHgrqH5UpHoMcsO8UH6u6Vzhrtdl84pL_OVPr6zEd48ls1biT0ee7n5RwIRGOOEUqVO7wErQbeW-WluwIoei8JO-ASYC8JW2Qoqpe85Y20IsnJP_UIarJ4Yh7-ZLfShj6gEx9AA0U9NlJWSlMJUc7_x5CjWefq5U Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9700d334841645fca1319e2b2bfbc03b Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1600484602 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9700d334841645fca1319e2b2bfbc03b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9700d334841645fca1319e2b2bfbc03b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9700d334841645fca1319e2b2bfbc03b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9700d334841645fca1319e2b2bfbc03b"}]}] Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1600484602 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9700d334841645fca1319e2b2bfbc03b Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1600484602 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1600484602-project Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9af3b140e73141479d1a6e7d7b7266f2 Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1600484602-project Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: exception: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'af9b6b5a-55c1-4697-b926-96d5ea024124'} Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:13.645564 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. Aug 21 01:31:13.649669 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:13.650383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:13.650493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] Returning 404 to user: Instance af9b6b5a-55c1-4697-b926-96d5ea024124 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:31:13.650585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a011033e-f752-4ca6-95e6-3c1ac5b0f114 tempest-ServersNegativeTestMultiTenantJSON-1600484602 tempest-ServersNegativeTestMultiTenantJSON-1600484602-project] 10.222.0.46 "GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124" status: 404 len: 111 microversion: 2.1 time: 0.043824 Aug 21 01:31:13.655092 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2169/4965] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:13 2022] GET /compute/v2.1/servers/af9b6b5a-55c1-4697-b926-96d5ea024124 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:31:13.658690 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a9257d3-2c26-4a5d-abd8-354488a2c267 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.299867 Aug 21 01:31:13.659304 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2797/4966] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:13 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:14.464046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:14.464705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:14.480391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:14.482105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:14.482809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:14.483807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:14.485094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:14.486248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:14.549308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d311ea13-1e43-4839-aa61-448530d6f21f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89d1a60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:14.617472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d311ea13-1e43-4839-aa61-448530d6f21f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.079063 Aug 21 01:31:14.631050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2798/4967] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:14 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:14.639901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9b6b5a-55c1-4697-b926-96d5ea024124", "name": "network-vif-deleted", "tag": "7df07498-d7ca-4095-b03c-ff3cc82b9120"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:14.676362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:14.678217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:14.678914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:14.708285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] Creating event network-vif-deleted:7df07498-d7ca-4095-b03c-ff3cc82b9120 for instance af9b6b5a-55c1-4697-b926-96d5ea024124 on n-h1-master-1 Aug 21 01:31:14.719935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-384b6308-1ff0-428b-bc0b-81fd99917e57 req-e2f68127-aee0-4ff7-ad6f-5c69f51134d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084759 Aug 21 01:31:14.724205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2799/4968] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:14.737627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:14.739030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:14.756272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:14.758759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:14.763832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:14.767611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:14.768348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:14.769033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:14.797551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:14.820935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:14.824010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:14.825419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d386889-ee8f-4fd2-a02b-9c88a32bc288 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.366647 Aug 21 01:31:14.837959 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2170/4969] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:14 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:15.160990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:15.171743 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0116ea3d-baa6-4b71-ba04-b09a58f74d4f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.445674 Aug 21 01:31:15.173136 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2800/4970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:14 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:15.635920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6349b588-8deb-4d52-ac13-7e0922d5c56d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc403102af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:15.811887 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6349b588-8deb-4d52-ac13-7e0922d5c56d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.175835 Aug 21 01:31:15.817193 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2171/4971] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:15 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:15.853090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:15.853716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:15.866383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:15.866875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:15.867312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:15.868026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:15.868531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:15.868928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:16.196739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:16.198008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:16.212744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:16.215866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:16.216705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:16.219821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:16.220373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:16.226201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:16.226953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:16.235374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:16.236838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:16.238103 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3afd1efb-064f-4776-a0da-b91ccf078f15 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.392516 Aug 21 01:31:16.242025 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2801/4972] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:15 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:16.569758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:16.585839 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e7f6f91-97da-4f2b-8017-f5422d4fce0d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.395550 Aug 21 01:31:16.597103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2172/4973] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:16 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:16.831774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-342ac15f-5204-491b-8e24-29a179cf76a5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa5c38b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:16.952142 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-342ac15f-5204-491b-8e24-29a179cf76a5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.121972 Aug 21 01:31:16.960477 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2802/4974] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:16 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:17.272936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:17.272936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:17.283903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:17.291826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:17.292399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:17.293186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:17.293651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:17.304739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:17.616094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:17.618711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:17.636115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:17.642892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:17.645254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:17.649673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:17.652459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:17.655526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:17.790876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:17.805685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:17.811258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:17.814856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1527da9e-0cb1-4303-be27-562c3349c8ea tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.550346 Aug 21 01:31:17.816110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2173/4975] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:17 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:17.828877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-unplugged", "status": "completed", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:17.857056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:17.860451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:17.862763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:17.897753 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] Creating event network-vif-unplugged:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:31:17.910412 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ca4c2c05-af87-4a48-87f4-6d2c7c950869 req-92d6eff3-7018-429d-9af0-acce8fdd1531 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092034 Aug 21 01:31:17.912296 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2174/4976] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:17.972397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c191e010-9a9d-4d52-98b8-3eb1870d25d5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcfa8160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:18.097092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c191e010-9a9d-4d52-98b8-3eb1870d25d5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.131763 Aug 21 01:31:18.107493 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2175/4977] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:17 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:18.561904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:18.570910 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae2dafc8-37e0-4f34-ad4f-8ea075ed86ce tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.960782 Aug 21 01:31:18.571505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2803/4978] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:17 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:18.843065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:18.844527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:18.859960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:18.862329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:18.863096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:18.866056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:18.866801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:18.868264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:19.114232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-22f72a18-2d20-47eb-a5b8-185decb41bfb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89ac160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:19.232950 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-22f72a18-2d20-47eb-a5b8-185decb41bfb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.120875 Aug 21 01:31:19.235246 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2804/4979] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:19 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:19.417735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:19.430744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:19.432249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:19.445083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e9a9b292-cd71-49d2-bed5-d9b02ba4cb9a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.596607 Aug 21 01:31:19.449047 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2176/4980] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:18 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:19.597875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:19.599096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:19.611176 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=58 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:19.622365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:19.623700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:19.627027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:19.629906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:19.633234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:19.634783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:19.992574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47da2114-3503-4a69-b870-e602ca1c881f", "name": "network-vif-plugged", "status": "completed", "tag": "9137795b-604d-4524-ae27-148d09ea2939"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:20.101883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:20.106870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:20.108577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:20.166539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] Creating event network-vif-plugged:9137795b-604d-4524-ae27-148d09ea2939 for instance 47da2114-3503-4a69-b870-e602ca1c881f on n-h1-master-1 Aug 21 01:31:20.186648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-67ddcfc9-3f39-4c4b-98a3-c63b4c9d4cdf req-1f5516ca-ce50-40fb-862e-a918eefdd73a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198797 Aug 21 01:31:20.188020 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2177/4981] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:31:20.258449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-add15694-86b6-422b-8849-8e3a637be788 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4032dc9d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:20.384624 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-add15694-86b6-422b-8849-8e3a637be788 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.135960 Aug 21 01:31:20.387991 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2178/4982] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:20 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:20.407631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:20.421900 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-694a62c1-deff-4857-9033-763139936205 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.830066 Aug 21 01:31:20.437703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2805/4983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:19 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:20.477105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:20.478109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:20.492930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:20.496864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:20.499607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:20.504267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:20.505103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:20.505763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:20.850755 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:20.860713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:20.868968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:20.869936 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-890369fe-da12-4a98-be28-d8dc1c128857 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1744 microversion: 2.20 time: 0.398830 Aug 21 01:31:20.872160 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2179/4984] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:20 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1744 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:21.404626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-478800ed-c22e-4ddc-b874-e4f05f704c20 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f88cdaf0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:21.449122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:21.449732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:21.468853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:21.480348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:21.480984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:21.481765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:21.482317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:21.482603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:21.512883 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-478800ed-c22e-4ddc-b874-e4f05f704c20 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.111509 Aug 21 01:31:21.517279 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2806/4985] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:21 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:21.896736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:21.897549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:21.909531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:21.910284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:21.911516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:21.915033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:21.915669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:21.916267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:22.056049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:22.094092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a34802c2-b737-4f0f-a967-626d8d064ff1 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.648803 Aug 21 01:31:22.117846 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2180/4986] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:21 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:22.532251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e6d55bb-a264-4f27-bbca-fa53d5b1fdb6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf858b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:22.634947 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e6d55bb-a264-4f27-bbca-fa53d5b1fdb6 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.108075 Aug 21 01:31:22.636156 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2181/4987] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:22 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:22.859687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:22.872733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:22.880136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:22.884864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24a7ff49-1ac8-4909-bdf2-f566c60a589a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1744 microversion: 2.20 time: 0.991068 Aug 21 01:31:22.905297 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2807/4988] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:21 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1744 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:23.121502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:23.122483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:23.133811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:23.138075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:23.138626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:23.141485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:23.142072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:23.144905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:23.607445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:23.623989 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e3cb88f-dccf-42f9-9215-c28ff4accef3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.506953 Aug 21 01:31:23.627374 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2182/4989] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:23 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:23.653039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b73884c-1095-4d18-9def-86ac75961baa tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa5c34c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:23.782919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b73884c-1095-4d18-9def-86ac75961baa tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.134868 Aug 21 01:31:23.783979 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2808/4990] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:23 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:23.920310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:23.920875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:23.940590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:23.941123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:23.941558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:23.947524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:23.948368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:23.948998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:23.965691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "name": "network-vif-plugged", "status": "completed", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:23.995285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:23.997683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:24.001140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:24.043988 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] Creating event network-vif-plugged:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h2-master-1 Aug 21 01:31:24.054892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ef4c61a1-1a51-4173-89c3-3162c7002a02 req-b5c8ba8a-c081-443a-af3f-e0e9b81e0ec1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093947 Aug 21 01:31:24.065174 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2809/4991] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:24.650471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:24.651955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:24.668724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:24.669484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:24.670668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:24.675772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:24.676512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:24.677810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:24.712680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:24.723451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:24.724983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:24.751765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d235ad4-40c6-4411-bab3-7d4b48c1c2db tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1744 microversion: 2.20 time: 0.813352 Aug 21 01:31:24.753054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2183/4992] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:23 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1744 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:24.801897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72c07cde-f25c-4d28-8d7f-4bb4c2b3797a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fd1505e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:24.858639 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72c07cde-f25c-4d28-8d7f-4bb4c2b3797a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1453 microversion: 2.1 time: 0.064120 Aug 21 01:31:24.863703 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2184/4993] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:24 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:25.605983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-705502901", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "095566ea-71ad-4f76-928b-7397311acb2f"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:25.709912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] validate_networks() for [('095566ea-71ad-4f76-928b-7397311acb2f', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:31:26.006327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:26.024097 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad36b155-1bb7-46f1-a7e6-70cf11759347 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 1.379698 Aug 21 01:31:26.038970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2810/4994] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:24 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:26.038970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:26.038970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:26.051284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:26.052025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:26.052586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:26.056578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:26.057218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:26.057760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:27.177549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:27.185543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:31:27.186524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:31:27.187220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:31:27.188180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:31:27.188749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:31:27.203858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:27.211072 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:27.212180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:27.212357 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-790b1bb4-f217-4a57-98b2-3e4b122c6e6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.186075 Aug 21 01:31:27.214094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:27.216695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:27.219005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:27.221369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:27.221995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:27.232761 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2811/4995] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:26 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:27.267151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7360339f-63b9-4a3d-9309-a5713c46d70b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f88cd430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:27.320147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Getting quotas for project c92a6cc6152c46bb982b30251f7aad18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:31:27.337817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Getting quotas for user f0524cc60bd640ca9ae88845970eb013 and project c92a6cc6152c46bb982b30251f7aad18. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:31:27.383772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:31:27.386555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:31:27.490597 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1cfe3140-dc36-418f-89b7-3e6775c8fd9b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889834 Aug 21 01:31:27.496323 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2185/4996] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:31:27.509335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:27.517751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:27.535334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:27.537369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:27.542959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:27.544818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:27.545459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:27.546065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:27.613087 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:28.268521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:28.285783 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-355eb720-6674-48db-81a2-6c40f6d3d696 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.783727 Aug 21 01:31:28.288233 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2186/4997] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:27 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:28.306293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b116d47-8b1d-483a-95b2-92542a23da34 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:28.309787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b116d47-8b1d-483a-95b2-92542a23da34 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:28.445423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b116d47-8b1d-483a-95b2-92542a23da34 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:28.453966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b116d47-8b1d-483a-95b2-92542a23da34 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1218 microversion: 2.1 time: 0.162025 Aug 21 01:31:28.456454 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2187/4998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:28 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:28.500921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:28.510008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:28.521752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:28.535364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:28.538976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:28.539955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:28.540577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:28.541204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:29.011510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:29.021544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:29.030824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:29.038903 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b84dabc-f6b9-4304-9af6-7607189e458c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 0.580224 Aug 21 01:31:29.042447 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2188/4999] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:28 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:29.310598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:29.311369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:29.336516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:29.346240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:29.347876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:29.352811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:29.357512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:29.363435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:30.254163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:30.263651 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cec7c427-3712-4dfc-ad0c-0b7d12576e29 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1737 microversion: 2.1 time: 0.957280 Aug 21 01:31:30.268282 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2189/5000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:29 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1737 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:30.298654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:30.300142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:30.330625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:30.331861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:30.332468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:30.333426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:30.334047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:30.334909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:30.615423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:30.624208 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63854723-58e5-4f7e-a9ca-b162e9ef0b2c tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1276 microversion: 2.1 time: 0.354769 Aug 21 01:31:30.629338 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2190/5001] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:30 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:30.651756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:30.652227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:30.677939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:30.679856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:30.681338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:30.684248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:30.686883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:30.692755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:31.440578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:31.460429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:31.463538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:31.470713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4694fb2-3b50-4a8c-a386-b8b53b78ce97 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 0.837069 Aug 21 01:31:31.472409 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2191/5002] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:30 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:31.510793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:31.511620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:31.532555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:31.535109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:31.535668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:31.537174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:31.538682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:31.540578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:32.022550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:32.039931 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b0ffd70-f3d6-42d9-85b6-fd68047cf527 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1717 microversion: 2.1 time: 0.561761 Aug 21 01:31:32.040526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2192/5003] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:31 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1717 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:32.139871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:32.161017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:32.161017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:33.220144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:33.247536 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66d890a2-ed2a-4406-88db-79d082d9883b tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1276 microversion: 2.1 time: 1.173469 Aug 21 01:31:33.248591 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2193/5004] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:32 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1276 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:33.262402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:33.264526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:33.295727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:33.297063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:33.305552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:33.306818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:33.384645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:33.388195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:34.512456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:34.525316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:34.542687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:34.555951 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f744fd7-c913-455b-bc16-ce54b5fff9b3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.304656 Aug 21 01:31:34.556565 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2194/5005] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:33 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:34.592822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:34.593698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:34.621074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:34.621562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:34.621991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:34.634489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:34.635278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:34.635893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:34.847262 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Cannot 'detach_volume' instance 1287227d-49d9-42ee-b8f4-a6e86d34697e while it is in vm_state rescued Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments/443f04fe-5595-49d4-98c4-3f5e370c8ae3 HTTP/1.1 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'detach_volume' instance 1287227d-49d9-42ee-b8f4-a6e86d34697e while it is in vm_state rescued Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '1287227d-49d9-42ee-b8f4-a6e86d34697e', 'id': '443f04fe-5595-49d4-98c4-3f5e370c8ae3'} Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1287227d-49d9-42ee-b8f4-a6e86d34697e while it is in vm_state rescued Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:34.855145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1287227d-49d9-42ee-b8f4-a6e86d34697e while it is in vm_state rescued Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 409 to user: Cannot 'detach_volume' instance 1287227d-49d9-42ee-b8f4-a6e86d34697e while it is in vm_state rescued {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df775126-2b25-4051-b4b4-f8e6e0f50004 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments/443f04fe-5595-49d4-98c4-3f5e370c8ae3" status: 409 len: 152 microversion: 2.1 time: 0.299481 Aug 21 01:31:34.859805 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2195/5006] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:31:34 2022] DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments/443f04fe-5595-49d4-98c4-3f5e370c8ae3 => generated 152 bytes in 302 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:31:34.883370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:34.884000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:34.907744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:34.908631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:34.909346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:34.910320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:34.910947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:34.911694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:35.465415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:35.477663 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-79488a56-1871-4dd9-8766-78a385b946e9 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 0.616425 Aug 21 01:31:35.494132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2196/5007] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:34 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:35.500255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:35.505529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:35.530525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:35.533505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:35.534175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:35.537917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:35.538550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:35.539146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:35.791302 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a442963-521f-4a9c-b77a-a1a4d7b21f63 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/action" status: 202 len: 0 microversion: 2.1 time: 0.295511 Aug 21 01:31:35.792093 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2197/5008] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:31:35 2022] POST /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:31:35.800567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:35.809632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:35.831614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:35.831944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:35.832185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:35.832830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:35.833285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:35.833701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:36.043680 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:36.773278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:36.782818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:36.792491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:36.807310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-109bbcde-bfcd-4b9f-b545-ba4b78d65aaf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.013801 Aug 21 01:31:36.809952 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2198/5009] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:35 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:36.814999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:36.832023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:36.851614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:36.852328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:36.853230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:36.854166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:36.856830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:36.857516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:37.217473 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:37.263812 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:37.803635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:37.818042 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5bb7271e-09bb-43e7-930c-cea1e7ca9ac7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1725 microversion: 2.1 time: 1.006709 Aug 21 01:31:37.819383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2199/5010] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:36 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1725 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:37.824499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:37.833758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:37.854696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:37.855585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:37.856246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:37.857235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:37.857934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:37.858595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:38.450503 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:38.877047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:38.886576 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bb19442-2502-4622-93e4-15ef86c24473 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 1.065831 Aug 21 01:31:38.895490 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2200/5011] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:37 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:38.927126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcf60e5-f47e-4178-8ff2-a6641c9365b1", "tag": "1118d24c-6e51-43c5-8506-795c847b9fc5"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:38.945602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:38.946176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:38.946622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:38.977497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] Creating event network-changed:1118d24c-6e51-43c5-8506-795c847b9fc5 for instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 on n-h2-master-1 Aug 21 01:31:38.999673 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-302fce4c-d684-44db-bc0f-19661ea31f6c req-d551c5fc-b5a5-46cf-b188-4a89b714783d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080922 Aug 21 01:31:38.999673 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2201/5012] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:39.014339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:39.016721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:39.032663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:39.036189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:39.036680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:39.037465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:39.037935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:39.039246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:39.559537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:39.599875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:39.601433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:39.602690 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-efb0a8e5-4cc4-42de-8658-23dfe9698e16 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 0.602465 Aug 21 01:31:39.603516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2202/5013] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:38 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:39.640989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:39.643715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:39.659060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:39.659557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:39.659999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:39.660730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:39.661322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:39.661935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:39.692538 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:40.047733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:40.067912 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6773e1a4-a3c8-4f56-b48f-f368b8fbd1e7 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1725 microversion: 2.1 time: 0.432965 Aug 21 01:31:40.069616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2203/5014] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:39 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1725 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:40.075564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:40.076574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:40.089159 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:31:40.092759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:40.094733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:40.096051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:40.097139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:40.097818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:40.098481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:40.642993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:40.668188 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a79b5660-c7e1-44ba-99fa-03247c099e39 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 0.597271 Aug 21 01:31:40.688172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2204/5015] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:40 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:40.703889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:40.705071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:40.744758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:40.751535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:40.751535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:40.751535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:40.751535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:40.751535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:41.684227 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:41.710406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:41.714470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:41.724702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0163b4b2-4b50-4b96-b695-6808c52254fa tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.034344 Aug 21 01:31:41.729466 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2205/5016] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:40 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:41.754673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:41.755329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:41.791689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:41.794391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:41.795074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:41.796514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:41.800328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:41.806195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:41.869158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7360339f-63b9-4a3d-9309-a5713c46d70b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1462 microversion: 2.1 time: 14.621781 Aug 21 01:31:41.870247 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2812/5017] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:27 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1462 bytes in 14637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:41.916827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:41.921878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:41.961431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:41.965767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:41.969450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:41.973907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:41.977112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:41.977834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:42.638696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:42.652399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dc7e80cf-bf37-4bb1-899b-6e8edf1a1eb9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1731 microversion: 2.1 time: 0.918870 Aug 21 01:31:42.653377 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2206/5018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:41 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1731 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:42.668932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f414ae2-2a4f-4348-a2ca-867d299b4e89 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf9c550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:42.777402 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f414ae2-2a4f-4348-a2ca-867d299b4e89 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 200 len: 1462 microversion: 2.1 time: 0.117161 Aug 21 01:31:42.778063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2207/5019] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:42 2022] GET /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:42.799137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:42.801409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:42.822048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:42.827718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:42.828451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:42.831102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:42.833965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:42.836410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.142804 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f69b9fd-415a-452a-9565-d41725ceb224 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358255 Aug 21 01:31:43.144098 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2208/5020] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:31:42 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:43.150832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:43.151453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:43.165320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.165822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.166261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.169164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.169693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.170420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.314642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:43.326621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db55f170-9750-4edd-811a-7a8d660cf3bd tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 1.455261 Aug 21 01:31:43.330205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2813/5021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:41 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:43.338914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:43.339805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:43.347829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.348640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.349319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.350227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.350874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.351620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.657650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:43.675120 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5d022ab-9b23-4b6e-9c0f-2992d710b9b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1467 microversion: 2.1 time: 0.340265 Aug 21 01:31:43.679261 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2814/5022] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:43 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1467 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:43.705489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-427518879"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:43.708024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:43.724651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.725213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.725642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:43.726381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:43.726832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:43.727262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:44.253778 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62f231f7-849e-46a4-ada9-a891d2d4750f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "POST /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9/action" status: 202 len: 0 microversion: 2.1 time: 0.553280 Aug 21 01:31:44.262151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2815/5023] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:31:43 2022] POST /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:31:44.275594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-84bf8fc8-3fc2-4bce-9b5a-be383f7fce03 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc40330d940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:44.364648 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-84bf8fc8-3fc2-4bce-9b5a-be383f7fce03 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.100313 Aug 21 01:31:44.373649 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2816/5024] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:44 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:44.390352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcf60e5-f47e-4178-8ff2-a6641c9365b1", "name": "network-vif-plugged", "status": "completed", "tag": "1118d24c-6e51-43c5-8506-795c847b9fc5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:44.432488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:44.433627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:44.458621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:44.486618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] Creating event network-vif-plugged:1118d24c-6e51-43c5-8506-795c847b9fc5 for instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 on n-h2-master-1 Aug 21 01:31:44.499335 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d493766e-53e7-4fc3-ac9f-75dd89caad00 req-15b9eae3-eb5e-4ed8-8b76-0ffd306a2c42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121945 Aug 21 01:31:44.503305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2817/5025] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:44.516913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:44.518023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:44.528115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:44.532434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:44.533243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:44.535422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:44.536370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:44.540317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:45.326969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:45.336543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b4a9014-b545-428d-af1c-78652a3f6aa1 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 0.831676 Aug 21 01:31:45.343041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2818/5026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:44 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:45.380796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9c39609-85e4-45d9-b24f-f0171d7eedf2 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f894dd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:45.450111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:45.467157 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9c39609-85e4-45d9-b24f-f0171d7eedf2 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.091383 Aug 21 01:31:45.468423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2819/5027] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:45 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:45.472693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:45.476568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:45.479958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab9b7b22-ac20-471f-a3c1-e0920b9d65b6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 2.334448 Aug 21 01:31:45.497207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2209/5028] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:43 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:46.303962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:46.342277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:46.347175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:46.347873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:46.367641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:46.368648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:46.383242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:46.384105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:46.384750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:46.387277 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] Creating event network-changed:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:31:46.388483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:46.390583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:46.391119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:46.416193 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8998012b-03a2-4234-a0fd-479a954f6bef req-a20cefee-1c0e-48f6-b46f-e10c4feeed79 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117145 Aug 21 01:31:46.417556 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2820/5029] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:46.504852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ceff1a0c-e88b-472d-8512-63687867436b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89ac5e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:46.684401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ceff1a0c-e88b-472d-8512-63687867436b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.189020 Aug 21 01:31:46.697935 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2821/5030] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:46 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:46.707049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:46.719184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:46.745014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:46.754562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:46.756434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:46.758047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:46.760182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:46.763048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:47.451258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:47.463405 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eed36c2e-9bb6-47cf-8204-c6a6bd3f7bd5 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1318 microversion: 2.1 time: 1.101468 Aug 21 01:31:47.477002 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2210/5031] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:46 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1318 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:47.496054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47da2114-3503-4a69-b870-e602ca1c881f", "name": "network-vif-unplugged", "status": "completed", "tag": "9137795b-604d-4524-ae27-148d09ea2939"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:47.534039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:47.535016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:47.535623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:47.551947 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] Creating event network-vif-unplugged:9137795b-604d-4524-ae27-148d09ea2939 for instance 47da2114-3503-4a69-b870-e602ca1c881f on n-h1-master-1 Aug 21 01:31:47.619754 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4705176b-c824-4a88-b32a-8b57422672b1 req-99424226-1c3e-4f0e-a7df-dc1ffe99946d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141377 Aug 21 01:31:47.630731 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2211/5032] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:47.703028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b17edc6d-230c-46e4-839c-6e605e1979dd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc403122dc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:47.772299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:47.799925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:47.808154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:47.809729 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41c71dbc-1086-447f-a7c5-39c6dbb17336 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.110243 Aug 21 01:31:47.813498 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2822/5033] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:46 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:47.875987 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b17edc6d-230c-46e4-839c-6e605e1979dd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.178108 Aug 21 01:31:47.878126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2212/5034] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:47 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:48.458214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:48.479017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:48.483122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:48.485398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:48.505087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:48.507265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:48.530854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:48.540620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:48.541625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:48.544254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] Creating event network-changed:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:31:48.545435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:48.546578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:48.556083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:48.590077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-79da9d74-63ef-4ecd-8132-287ad940c2aa req-f9c13324-5c59-4790-b851-61c1040e4e60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121967 Aug 21 01:31:48.594973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2823/5035] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:31:48.841232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:48.850406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:48.967896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:48.969085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:48.973509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:48.974868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:48.975513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:48.977141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:49.989095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:50.022269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:50.023913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:50.025201 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-501b634b-b5f4-4868-aee5-1c61ddf56d3a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 1.188397 Aug 21 01:31:50.034720 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2824/5036] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:48 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:50.043099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-334b2324-7f99-4de8-ad75-6137f7a9baa4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc40330d1f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:50.180888 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-334b2324-7f99-4de8-ad75-6137f7a9baa4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.144342 Aug 21 01:31:50.187170 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2825/5037] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:50 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:50.377814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:50.395081 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6dd1f41d-3e5c-49a2-9c0c-b0d2f20dd456 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1507 microversion: 2.1 time: 1.892011 Aug 21 01:31:50.398642 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2213/5038] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:31:48 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1507 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:50.423403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea609a3c-f78d-4553-ae63-5d40e073a778", "device": "/dev/sdb"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:50.428995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:50.454434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:50.463320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:50.463937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:50.464830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:50.468052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:50.468726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:51.056119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:51.057061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:51.069836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:51.070967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:51.071624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:51.073359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:51.074320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:51.074929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:51.139374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c015d42b-8e0f-4484-bd71-6a5b63ceec5a tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "POST /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717122 Aug 21 01:31:51.140300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2826/5039] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:31:50 2022] POST /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:51.203746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bcea07e-6abe-491e-af75-d63be4a4b2bb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc40330d940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:51.297756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bcea07e-6abe-491e-af75-d63be4a4b2bb tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.099621 Aug 21 01:31:51.298997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2827/5040] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:51 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:51.457217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:51.471846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:51.478033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:51.488207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b36ddeea-69c6-43e2-8227-190e2255f315 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 0.436046 Aug 21 01:31:51.502441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2214/5041] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:51 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:52.321749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bb55820-8028-4aaf-9687-2606f4329290 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9e15670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:52.436253 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bb55820-8028-4aaf-9687-2606f4329290 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.121613 Aug 21 01:31:52.438185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2828/5042] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:52 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:52.515926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:52.516653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:52.527515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:52.530666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:52.531441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:52.537707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:52.538562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:52.539217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:53.013994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:53.034467 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:53.036985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:53.038506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7487a782-ef7d-4178-8a83-bad37a20e5f3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1739 microversion: 2.20 time: 0.527114 Aug 21 01:31:53.039711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2215/5043] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:52 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:53.453963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2e5e296-8eb0-4e82-8cc8-30d129c10a29 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8a1f8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:53.551801 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2e5e296-8eb0-4e82-8cc8-30d129c10a29 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.104263 Aug 21 01:31:53.555038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2829/5044] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:53 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:54.008512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-plugged", "status": "completed", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:54.037225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:54.046199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:54.046851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:54.066289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:54.067293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:54.087407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:54.089194 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] Creating event network-vif-plugged:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:31:54.091418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:54.094005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:54.097689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:54.100985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:54.101556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:54.102988 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ae89a71d-1018-4c5f-8aa4-856957bd59cd req-b0969333-7b08-4242-a2f1-0bc89a63a44c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097949 Aug 21 01:31:54.104309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2216/5045] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:54.570532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd173d3e-a40b-4ac8-93ab-3ecf704fc200 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf13f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:54.721048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd173d3e-a40b-4ac8-93ab-3ecf704fc200 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.155175 Aug 21 01:31:54.721640 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2217/5046] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:54 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:31:55.342744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:55.392418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:55.394333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:55.398334 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e510bb39-6a51-4c11-8d82-6ef9c25f0a59 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1721 microversion: 2.20 time: 1.337858 Aug 21 01:31:55.427504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2830/5047] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:54 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1721 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:31:55.737417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0242c217-8641-473c-afe8-ab8b6dc9ff7d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf09f70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:55.824311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0242c217-8641-473c-afe8-ab8b6dc9ff7d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.088637 Aug 21 01:31:55.825105 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2218/5048] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:55 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:56.429590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:56.430460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:56.453812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:56.454533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:56.455163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:56.456699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:56.457353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:56.457939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:56.842380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0842d55-8d13-4e14-82e8-87b5854e344f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf534c0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:56.989452 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0842d55-8d13-4e14-82e8-87b5854e344f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.151717 Aug 21 01:31:56.997858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2219/5049] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:56 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:57.266732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:57.275561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:57.288902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:57.298495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac6caa5d-45b7-4893-b697-faa969e99821 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1721 microversion: 2.20 time: 0.874876 Aug 21 01:31:57.304382 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2831/5050] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:56 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1721 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:58.008666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5077fb5f-042e-4b13-8686-714684f83a74 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4032dc8b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:58.026334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "name": "network-vif-unplugged", "status": "completed", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:58.076724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:58.077927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:58.078661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:58.130629 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] Creating event network-vif-unplugged:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h2-master-1 Aug 21 01:31:58.156626 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5077fb5f-042e-4b13-8686-714684f83a74 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.153506 Aug 21 01:31:58.159856 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2220/5051] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:58 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:58.160176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a50f7c41-dbbc-4a7b-a9c0-7b9c053831f4 req-cab781a0-01b5-4367-8dc8-2f439e8ecbec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137549 Aug 21 01:31:58.161073 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2832/5052] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:31:58.333836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:58.334564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:58.345114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:58.345608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:58.346037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:58.346737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:58.358054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:58.362005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:58.794384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:58.823864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:58.831873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:31:58.835553 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-671530aa-fc15-403c-b124-1baec6efd21a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1721 microversion: 2.20 time: 0.503965 Aug 21 01:31:58.836363 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2221/5053] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:58 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1721 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:31:59.178594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dee0ba9c-3e24-4920-8e01-c660b6c3478d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f929daf0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:59.287158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dee0ba9c-3e24-4920-8e01-c660b6c3478d tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.118172 Aug 21 01:31:59.287756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2833/5054] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:31:59 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:31:59.862774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:31:59.863588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:31:59.885185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0581bf82-61f0-4095-bb70-84c2b023411b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: .version_select at 0x7fc4032dca60>, body: {"keypair": {"name": "tempest-keypair-1168462904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFquPUjnCbu7zuwlrVpBZg94rBCG97A5xxfXWX+9kYvT8k1xoWVAPR3N9jthajdMfawTQKTO1HfEgkvGXJVTK+QKX7loWM7TXhA/aEILuNUUKQ+FcZHq4SmVmB9QH5is5g=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:31:59.897435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:59.897934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:59.898376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:59.899090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:31:59.899550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:31:59.899986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:31:59.967155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0581bf82-61f0-4095-bb70-84c2b023411b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:00.011348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0581bf82-61f0-4095-bb70-84c2b023411b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:00.132067 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0581bf82-61f0-4095-bb70-84c2b023411b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.877844 Aug 21 01:32:00.137904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2222/5055] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:31:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:32:00.304598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b348d76-7025-4aa6-bb04-4a9bde2c979c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf69e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:00.403682 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b348d76-7025-4aa6-bb04-4a9bde2c979c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.105626 Aug 21 01:32:00.404596 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2223/5056] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:00 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:00.425805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:00.441419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:00.446163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:00.451454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-38b02de2-d890-4f0b-8325-22bad10ab148 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1724 microversion: 2.20 time: 0.592920 Aug 21 01:32:00.455908 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2834/5057] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:31:59 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1724 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:00.484503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffd3ad10-490d-4c8e-879c-bc433fdd2333"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:00.486991 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:00.507275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:00.510717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:00.511458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:00.512383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:00.515024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:00.519401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:01.419485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd459524-a118-4f40-88c3-8117e8032ced tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89574c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:01.512105 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd459524-a118-4f40-88c3-8117e8032ced tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.096768 Aug 21 01:32:01.513438 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2835/5058] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:01 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:01.635370 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59787772-e26a-4e48-b7a5-4d332b032c13 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.143914 Aug 21 01:32:01.639839 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2224/5059] 10.222.0.46 () {62 vars in 1364 bytes} [Sun Aug 21 01:32:00 2022] POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 188 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:32:02.159911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:02.160674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:02.194111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:02.194626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:02.195286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:02.196520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:02.208717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:02.209347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:02.272674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122482) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 21 01:32:02.482015 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e4d1eb0-55c8-42ac-ae13-c27b27621f9d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/action" status: 202 len: 0 microversion: 2.20 time: 0.325479 Aug 21 01:32:02.490417 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2836/5060] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:32:02 2022] POST /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:02.492085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:02.493051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:02.509588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:02.515753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:02.518270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:02.524541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:02.525475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:02.528121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf9b9915-1fec-4f8e-bcdd-68a36126d10c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f950d280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:02.529434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:02.958621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:03.005750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:03.013745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:03.025461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8a82e156-a635-4783-9a88-6bc22f50de11 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1750 microversion: 2.20 time: 0.537805 Aug 21 01:32:03.034659 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2225/5061] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:02 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1750 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:03.275841 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf9b9915-1fec-4f8e-bcdd-68a36126d10c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.751762 Aug 21 01:32:03.280208 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2837/5062] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:02 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:04.056239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:04.056926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:04.074480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:04.076741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:04.079412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:04.082577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:04.083876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:04.086920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:04.300184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cbe20ca7-c61b-4122-93f9-074c2543ddcf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f885bee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:04.444523 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cbe20ca7-c61b-4122-93f9-074c2543ddcf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.156190 Aug 21 01:32:04.445757 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2838/5063] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:04 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:04.476294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:04.493780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:04.498300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:04.508886 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffe09fdb-2a2a-4ffa-948c-c9f37f3db449 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1750 microversion: 2.20 time: 0.456353 Aug 21 01:32:04.509485 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2226/5064] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:04 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1750 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:04.632068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1455697023", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cb5e4a9-bcd5-4245-8211-d0350dfa789c"}], "security_groups": [{"name": "tempest-securitygroup--44013583"}], "key_name": "tempest-keypair-1168462904", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:04.870948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] validate_networks() for [('4cb5e4a9-bcd5-4245-8211-d0350dfa789c', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:32:05.462213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bfe5be72-9db3-4422-b94f-603c29f3ab36 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf1cb80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:05.565603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bfe5be72-9db3-4422-b94f-603c29f3ab36 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.109813 Aug 21 01:32:05.566186 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2227/5065] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:05 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:05.576837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:05.580797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:05.601691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:05.602177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:05.602609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:05.618607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:05.619096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:05.619527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:05.728192 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:06.004506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:32:06.005129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:32:06.005548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:32:06.006356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:32:06.006963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:32:06.030893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:06.031435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:06.031872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:06.032604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:06.040116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:06.042172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:06.107423 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:06.144739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:06.173374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:06.246126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:32:06.253453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:32:06.497574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3324b03b-12dc-4ce3-8fac-922735160c8f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.855838 Aug 21 01:32:06.499742 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2839/5066] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:32:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:32:06.516692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:06.530513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:06.532184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:06.533469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-420bea3e-84a8-4835-9c08-db0565bea066 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1750 microversion: 2.20 time: 0.962495 Aug 21 01:32:06.541332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05969efd-138f-4e4e-89c4-81b2a2e31ccf tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:06.542079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05969efd-138f-4e4e-89c4-81b2a2e31ccf tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:06.580426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2228/5067] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:05 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1750 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:06.601972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c49e8408-9e40-4cf0-a0d2-a0c86aa8c49a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf1cd30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:06.706724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c49e8408-9e40-4cf0-a0d2-a0c86aa8c49a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.124321 Aug 21 01:32:06.707311 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2229/5068] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:06 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:06.771546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05969efd-138f-4e4e-89c4-81b2a2e31ccf tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:06.780801 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05969efd-138f-4e4e-89c4-81b2a2e31ccf tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1242 microversion: 2.1 time: 0.263501 Aug 21 01:32:06.805530 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2840/5069] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:06 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:07.561658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:07.563183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:07.581587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:07.587370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:07.591863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:07.595436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:07.596270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:07.598703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:07.721809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42f696bc-a3ab-4c96-bad6-97f4abd5573a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8991040>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:07.841868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42f696bc-a3ab-4c96-bad6-97f4abd5573a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.123923 Aug 21 01:32:07.844655 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2841/5070] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:07 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:07.855143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:07.857847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:07.879986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:07.880544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:07.881019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:07.884373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:07.885326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:07.885765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:07.965367 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:08.092688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:08.103592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff313c9d-2f7f-4199-afa3-a17506f8a5d8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1294 microversion: 2.1 time: 0.257639 Aug 21 01:32:08.110101 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2842/5071] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:07 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:08.280061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:08.293037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:08.302091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:08.303957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e7becc4-170b-4f18-9e3d-3a816e3f9b44 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.747455 Aug 21 01:32:08.305103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2230/5072] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:07 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:08.858470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c0342531-fb94-4336-8492-655b10765edf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f89ac310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:08.958864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c0342531-fb94-4336-8492-655b10765edf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.104740 Aug 21 01:32:08.959372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2843/5073] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:08 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:09.143853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:09.145315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:09.163948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:09.164665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:09.165529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:09.166431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:09.169360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:09.170003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:09.334284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:09.335289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:09.344861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:09.350712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:09.353742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:09.354895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:09.355525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:09.357491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:09.417841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:09.430611 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7fab4887-1d6d-4a19-817c-a24f9a4711c2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1300 microversion: 2.1 time: 0.291577 Aug 21 01:32:09.456903 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2231/5074] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:09 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1300 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:09.847296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:09.864071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:09.865921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:09.867944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1f2d24d-dc4a-4d48-8275-a21306012af2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.537648 Aug 21 01:32:09.869655 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2844/5075] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:09 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:09.973826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3fd9e733-d54d-42c0-9dac-22dca9fe2d7f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf09af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:10.068991 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:10.098922 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3fd9e733-d54d-42c0-9dac-22dca9fe2d7f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.128826 Aug 21 01:32:10.099681 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2232/5076] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:09 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:10.463640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:10.464430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:10.479709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:10.480369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:10.480955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:10.487017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:10.488053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:10.497107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:10.899530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:10.899951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:10.910500 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:10.913579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:10.914100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:10.914600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:10.915131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:10.916600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:10.924613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:10.925315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:10.932467 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fd3edda-d57c-400a-b927-6c917554a302 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.472711 Aug 21 01:32:10.933131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2845/5077] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:10 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:11.116714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-75beb46d-458d-4e06-9d4b-593bebf70442 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9b8fd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:11.267411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-75beb46d-458d-4e06-9d4b-593bebf70442 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.154981 Aug 21 01:32:11.268651 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2846/5078] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:11 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:11.353101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:11.353887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:11.365558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:11.371027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:11.371751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:11.373548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:11.385593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:11.386378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:11.714432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'services' on Instance uuid 1287227d-49d9-42ee-b8f4-a6e86d34697e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:32:12.134284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1cf0595e-0dc7-4a95-a730-485d4e1efa20 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments/443f04fe-5595-49d4-98c4-3f5e370c8ae3" status: 202 len: 0 microversion: 2.1 time: 0.771426 Aug 21 01:32:12.160913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2847/5079] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:32:11 2022] DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments/443f04fe-5595-49d4-98c4-3f5e370c8ae3 => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:32:12.181781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:12.185868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:12.211456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:12.211863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:12.212296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:12.213036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:12.220634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:12.225202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:12.713235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:12.730754 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfd0e8b5-30f1-4072-a367-57b3280ebd7b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.561739 Aug 21 01:32:12.735968 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2848/5080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:12 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:12.764037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:12.773763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:12.781818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:12.782629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:12.785334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:12.793293 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd9adf3b-0a97-4dbc-a152-34b23a23dbd3 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 1.899056 Aug 21 01:32:12.796000 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2233/5081] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:10 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:12.819314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-779c83f3-6ee2-4fa6-bead-56fbdcaa75c5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf1c940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:12.820268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:12.824045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:12.824676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:12.826653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:12.828897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:12.829583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:12.912006 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-779c83f3-6ee2-4fa6-bead-56fbdcaa75c5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.113982 Aug 21 01:32:12.916865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2234/5082] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:12 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:12.953855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea6580b0-0cec-4393-b02c-278210cd7b09 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210763 Aug 21 01:32:12.960102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2849/5083] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:12 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:13.784580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:13.786241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:13.826524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:13.827801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:13.829409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:13.838685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:13.839461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:13.840063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:13.841036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:13.841675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:13.842320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:13.845320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:13.893052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:13.902407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:13.903912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:13.925293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:14.035748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:14.052831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:14.056942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:14.058597 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08f33757-6497-4cfa-851d-a9f84aa8ba06 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.236693 Aug 21 01:32:14.081083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2850/5084] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:13 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:14.090685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7c30297-403e-471c-a620-07f7a8247d04 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9e15160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:14.187057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7c30297-403e-471c-a620-07f7a8247d04 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.102937 Aug 21 01:32:14.189200 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2851/5085] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:14 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:14.211258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:14.217324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:14.249938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:14.258518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:14.260687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:14.263845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:14.265974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:14.267296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:14.389464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be8fc027-9dd7-4fa1-a276-aa9d705d7c85 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197626 Aug 21 01:32:14.399074 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2852/5086] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:14 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:14.410658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80c4bd7-a53e-411c-b9cb-d82036ff2fcf", "tag": "7c81f76e-de50-4444-86c9-38f8489e940b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:14.431931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:14.434902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:14.437836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:14.465134 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] Creating event network-changed:7c81f76e-de50-4444-86c9-38f8489e940b for instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf on n-h1-master-1 Aug 21 01:32:14.478948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f562335e-1e03-4a0a-9e8f-3f090be43564 req-75076b8c-f2fa-4d54-bcd3-60ecac18a6c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071779 Aug 21 01:32:14.480267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2853/5087] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:14.537968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:14.549140 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a0db349-a335-4064-a67b-ed56702f7ff1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.792393 Aug 21 01:32:14.549744 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2235/5088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:13 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:15.091609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:15.093327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:15.110876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.111720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.112432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.113591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.114302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.116344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.211686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ceade81d-8971-40fc-a929-6315f15aa469 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf699d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:15.293709 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ceade81d-8971-40fc-a929-6315f15aa469 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.094038 Aug 21 01:32:15.294380 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2236/5089] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:15 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:15.406412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:15.408760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:15.444829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.445410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.445801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.448392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.450565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.454458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.534342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b822a13-6be4-45d7-8b5e-18e1b5a231fb tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132671 Aug 21 01:32:15.542196 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2237/5090] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:15 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:15.570644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:15.571535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:15.576732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:15.585706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.586547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.588146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.589431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:15.590955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:15.591663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:15.593294 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-76f2af9b-5724-47b9-b440-5fd345253ec8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.506913 Aug 21 01:32:15.613269 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2854/5091] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:15 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:15.614663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:15.615919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:15.950502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:15.960289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86356a77-074d-4ada-ab79-1b08fa65b14b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.393654 Aug 21 01:32:15.962476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2238/5092] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:15 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:16.311706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fdf54fb2-6abe-4ff0-8f62-db639fe4c372 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4031d3af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:16.337451 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:16.420371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fdf54fb2-6abe-4ff0-8f62-db639fe4c372 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.114249 Aug 21 01:32:16.422533 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2855/5093] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:16 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:16.550432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:16.554849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:16.568420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.570528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.571164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:16.573531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.575177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.575778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:16.620673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:16.621329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:16.629469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.630521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.631513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:16.632401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.633057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.633793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:16.648728 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60b7c6f8-8a1e-48fc-8d3c-c38782ca704d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103460 Aug 21 01:32:16.653677 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2239/5094] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:16 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:16.775716 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:16.983824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:16.984955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:16.995498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.995498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.995498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:16.997107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:16.997813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:16.998514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:17.330380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:17.351309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:17.357151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:17.359925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7ff773a-f3d3-48be-b3a2-6605c5982ac5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.743240 Aug 21 01:32:17.363050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2856/5095] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:16 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:17.435218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:17.437458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f879d89f-b999-4d8d-8f7a-ec6b9ecefb04 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4031d34c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:17.448594 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f8eae9f-aac8-4b1e-9452-9e6dba7947e7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.469216 Aug 21 01:32:17.449787 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2240/5096] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:16 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:17.518132 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f879d89f-b999-4d8d-8f7a-ec6b9ecefb04 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.086284 Aug 21 01:32:17.520398 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2857/5097] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:17 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:17.667452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:17.670574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:17.689027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:17.689834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:17.690453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:17.691154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:17.691595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:17.692009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:17.769977 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-951140fe-fdc6-4411-ad32-974d3be0a47a tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110477 Aug 21 01:32:17.770786 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2241/5098] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:17 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:18.385643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:18.386522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:18.399715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.401696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.402385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.406101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.406834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.407490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.470796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:18.473617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:18.492477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.493249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.493887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.494651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.495102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.495520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.665984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:18.676142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:18.677681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:18.678892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebe7d76d-bfd6-4b7a-8005-620a35b87923 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.299235 Aug 21 01:32:18.679464 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2858/5099] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:18 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:18.692400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8dcfe6ac-53a1-49fa-ae78-573d2c69387e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4031d39d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:18.757954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:18.767653 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-351a5886-4694-44c6-b338-354a66f92e3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.301926 Aug 21 01:32:18.770099 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2242/5100] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:18 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:18.777208 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8dcfe6ac-53a1-49fa-ae78-573d2c69387e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.096663 Aug 21 01:32:18.777997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2859/5101] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:18 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:18.784383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:18.788097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:18.795325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.795971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.800146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.801166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:18.801746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:18.802275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:18.836273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ef59147-f4c1-4c22-977d-e999b1ed2369 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056122 Aug 21 01:32:18.842273 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2243/5102] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:18 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:19.257301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80c4bd7-a53e-411c-b9cb-d82036ff2fcf", "name": "network-vif-plugged", "status": "completed", "tag": "7c81f76e-de50-4444-86c9-38f8489e940b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:19.303758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:19.310436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:19.312183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:19.368646 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] Creating event network-vif-plugged:7c81f76e-de50-4444-86c9-38f8489e940b for instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf on n-h1-master-1 Aug 21 01:32:19.377190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-43416b71-fbe8-4ad4-95d9-6742b31a106b req-7dfd72c4-9234-4b1f-b984-5144a6585aa5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123903 Aug 21 01:32:19.382238 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2860/5103] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:19.707861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:19.708610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:19.728894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:19.729527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:19.731054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:19.733913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:19.734513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:19.736083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:19.796082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0c539c2-33d8-433f-ba45-7c9fbd1738aa tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4031950d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:19.878877 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0c539c2-33d8-433f-ba45-7c9fbd1738aa tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.090175 Aug 21 01:32:19.880513 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2861/5104] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:19 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:19.886961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:19.887816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:19.913661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:19.915708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:19.916164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:19.919598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:19.920375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:19.922493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:20.000831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:20.010776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:20.022898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:20.029309 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22083449-ca06-4a47-99f6-766bcf6b3d79 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.326285 Aug 21 01:32:20.034647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2244/5105] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:19 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:20.048708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:20.060313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:20.080204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:20.081060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:20.081610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:20.082420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:20.085944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:20.086466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:20.160521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:20.169123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-debb9072-cfb8-45e2-9e4e-fbdca3926095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1366 microversion: 2.1 time: 0.287255 Aug 21 01:32:20.169917 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2862/5106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:19 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:20.179821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-960fe8b0-35bb-45dc-8782-33d3c3d81f42 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141433 Aug 21 01:32:20.180420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2245/5107] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:20 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:20.896578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d45f539d-e88d-4ac6-852b-06cee847b96f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa5c3b80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:20.964750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d45f539d-e88d-4ac6-852b-06cee847b96f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.075349 Aug 21 01:32:20.965947 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2863/5108] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:20 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:21.063793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:21.064560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:21.099311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.103171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.104503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.106659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.109812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.110541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.191986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:21.195617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:21.210381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.210886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.211339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.212066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.213900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.214674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.300069 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f523028-56e1-46d6-aaf4-637d4e881cd0 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110839 Aug 21 01:32:21.302402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2864/5109] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:21 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:21.319048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:21.320077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:21.336498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.337465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.338903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.340435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.342350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.343175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.352136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:21.368032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:21.370081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:21.372684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e13472e8-392f-4335-a0a7-9609d55302df tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.315016 Aug 21 01:32:21.399006 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2246/5110] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:21 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:21.595606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:21.608576 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-583a5f64-33bf-454e-956e-788923e58a5c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1556 microversion: 2.1 time: 0.304131 Aug 21 01:32:21.624220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2865/5111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:21 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1556 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:21.631519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:21.632023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:21.648668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.649285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.649598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.650302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:21.660916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:21.668781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:21.853450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6276dbc-229c-4fa5-96dd-9558bd6cada5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227575 Aug 21 01:32:21.854052 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2247/5112] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:32:21 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:21.980235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc39fdbb-e3c6-4e50-b74a-aacd438ac8b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f894d700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:22.041435 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc39fdbb-e3c6-4e50-b74a-aacd438ac8b3 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1452 microversion: 2.1 time: 0.065645 Aug 21 01:32:22.042230 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2866/5113] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:21 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:22.323629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:22.326685 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:22.355447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.359290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.359982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.362112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.362812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.364385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.403765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:22.406114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:22.417694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.420724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b80ef69-735d-4d55-9fb6-b065a645d4ad tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106944 Aug 21 01:32:22.421854 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2248/5114] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:32:22 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:32:22.422643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.423112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.424163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.424627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.425077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.723720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:22.730066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:22.782602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.783107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.783553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.784271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.784730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.785177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.805399 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:22.877506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Cannot 'reboot' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action HTTP/1.1 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 28 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: {"reboot": {"type": "HARD"}} Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'reboot' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '8c5b2e5d-8a33-43bb-8900-cd033579d74b', 'body': {'reboot': {'type': 'HARD'}}} Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:32:22.879395 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:22.884812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 409 to user: Cannot 'reboot' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:22.896271 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8340d0d-4ece-4302-80eb-a772791eccd3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action" status: 409 len: 145 microversion: 2.1 time: 0.166918 Aug 21 01:32:22.897556 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2249/5115] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:32:22 2022] POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action => generated 145 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:32:22.908390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:22.911157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:22.946140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.948954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.949448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.950190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:22.950649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:22.951178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:22.957992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:22.985813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:22.987346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:23.001808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6680f5c4-8100-4d7e-9e14-5aad3f7ba490 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.602146 Aug 21 01:32:23.007813 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Cannot 'rebuild' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:23.008696 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2867/5116] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:22 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action HTTP/1.1 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 65 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: exception: Cannot 'rebuild' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '8c5b2e5d-8a33-43bb-8900-cd033579d74b', 'body': {'rebuild': {'imageRef': '64873b6f-4787-4a40-b75c-af37e7532ab1'}}} Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:32:23.025279 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued Aug 21 01:32:23.031157 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:23.033456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 409 to user: Cannot 'rebuild' instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b while it is in vm_state rescued {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:23.034499 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec63347b-9208-4d01-a772-a7d6ecd5fd2b tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action" status: 409 len: 146 microversion: 2.1 time: 0.132275 Aug 21 01:32:23.035678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2250/5117] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:32:22 2022] POST /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 21 01:32:23.045996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:23.046533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:23.056221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4ae295e-67ba-4cfb-81ba-1858588b036a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf1ce50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:23.058278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.058774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.061393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.062106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.065099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.077670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.151347 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:23.158892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4ae295e-67ba-4cfb-81ba-1858588b036a tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1461 microversion: 2.1 time: 0.106486 Aug 21 01:32:23.160723 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2251/5118] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:23 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1461 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:23.177487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca93f2b5-898c-49cb-b23a-738558763c48 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf69820>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:23.180727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:23.251084 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca93f2b5-898c-49cb-b23a-738558763c48 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 200 len: 1461 microversion: 2.1 time: 0.079045 Aug 21 01:32:23.253008 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2252/5119] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:23 2022] GET /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:23.272504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:23.273663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:23.293034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.293921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.294615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.297197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.298508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.299893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.419108 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d989664b-f3f5-4aa6-864b-96620fd4a493 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 204 len: 0 microversion: 2.1 time: 0.376923 Aug 21 01:32:23.420657 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2868/5120] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:23 2022] DELETE /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:23.434597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:23.435681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:23.450007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.452658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.453789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.457290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:23.457980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:23.458624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:23.512069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:23.530714 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2a671180-ea5a-43b0-a9aa-0e99761ac68f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1481 microversion: 2.1 time: 0.267340 Aug 21 01:32:23.535168 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2253/5121] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:23 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1481 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:23.694082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:23.703570 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f611029a-487a-4924-8094-a99b43ebf585 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1691 microversion: 2.1 time: 0.278875 Aug 21 01:32:23.709470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2869/5122] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:23 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:24.041099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:24.044545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:24.058411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.058830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.059265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.059978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.061508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.061931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.453325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:24.464946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:24.466851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:24.468562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-591cb806-c688-413d-b395-7b46876f7da7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.439460 Aug 21 01:32:24.482743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2254/5123] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:24 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:24.557883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:24.559420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:24.578428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.580039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.581759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.583613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.591649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.592412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.734750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:24.736074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:24.758911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.759491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.760456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.763129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:24.763812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:24.767696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:24.956321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:24.994428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca343ea8-f2ae-47ae-8b46-6077b21f0450 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1468 microversion: 2.1 time: 0.442241 Aug 21 01:32:25.000703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2870/5124] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:24 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:25.020136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-294f3e64-0553-495e-ac75-bf3b697dfb69 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8834550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.143791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:25.198746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a790e3d-848e-456b-9ea9-befc5ec20ab5 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1691 microversion: 2.1 time: 0.467995 Aug 21 01:32:25.218911 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2255/5125] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:24 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1691 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:25.226415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80c4bd7-a53e-411c-b9cb-d82036ff2fcf", "tag": "7c81f76e-de50-4444-86c9-38f8489e940b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:25.241910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:25.242973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:25.243557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:25.258114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] Creating event network-changed:7c81f76e-de50-4444-86c9-38f8489e940b for instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf on n-h1-master-1 Aug 21 01:32:25.266551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-aac34319-e406-447b-bcd0-3c8d93e8dd76 req-b651a126-a08a-4237-a9a4-4e5d6590b82d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045790 Aug 21 01:32:25.268983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2256/5126] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:25.333400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-294f3e64-0553-495e-ac75-bf3b697dfb69 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?changes-since=2022-08-21T01%3A30%3A00Z" status: 200 len: 2375 microversion: 2.1 time: 0.317229 Aug 21 01:32:25.334039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2871/5127] 10.222.0.46 () {58 vars in 1199 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?changes-since=2022-08-21T01%3A30%3A00Z => generated 2375 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:25.361938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7eba0216-004e-41e6-b1b9-78ab1529a13c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fdf02790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.464048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7eba0216-004e-41e6-b1b9-78ab1529a13c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1675117434" status: 200 len: 485 microversion: 2.1 time: 0.117576 Aug 21 01:32:25.474069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2257/5128] 10.222.0.46 () {58 vars in 1231 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1675117434 => generated 485 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:25.482546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-847d1f3f-8791-4647-be81-44662c6d2f54 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fa541ca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.495162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.496270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:25.512966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:25.514357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:25.517148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:25.518479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:25.520172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:25.521619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:25.610885 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-847d1f3f-8791-4647-be81-44662c6d2f54 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?server=0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 956 microversion: 2.1 time: 0.136668 Aug 21 01:32:25.615370 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2872/5129] 10.222.0.46 () {58 vars in 1209 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?server=0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 956 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:32:25.626991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-733f02ad-3b50-4802-ad62-fec948b6c157 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f894dd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.702659 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-733f02ad-3b50-4802-ad62-fec948b6c157 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 485 microversion: 2.1 time: 0.080055 Aug 21 01:32:25.711289 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2873/5130] 10.222.0.46 () {58 vars in 1317 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f => generated 485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:32:25.719844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85e6e34f-43a3-42ae-8faa-f519aaf59c85 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8a939d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.781057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85e6e34f-43a3-42ae-8faa-f519aaf59c85 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 485 microversion: 2.1 time: 0.067732 Aug 21 01:32:25.782263 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2874/5131] 10.222.0.46 () {58 vars in 1303 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f => generated 485 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:25.800582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff5c4195-2486-4015-9d84-43599bade60b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9e15700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:25.801713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:25.814932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:25.817363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:25.818671 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9839c291-0d58-4dad-89e6-f209daea5c04 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1752 microversion: 2.20 time: 0.328494 Aug 21 01:32:25.833438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2258/5132] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1752 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:25.902001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff5c4195-2486-4015-9d84-43599bade60b tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.108757 Aug 21 01:32:25.903110 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2875/5133] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:25.924451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b156d5a-c273-44b0-b98b-3cbda19c0d70 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf8d700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.056359 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b156d5a-c273-44b0-b98b-3cbda19c0d70 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.141244 Aug 21 01:32:26.057409 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2259/5134] 10.222.0.46 () {58 vars in 1149 bytes} [Sun Aug 21 01:32:25 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:26.072212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9e5cf4f-d6f4-4733-8bee-a07d92a5da31 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8a93940>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.147937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9e5cf4f-d6f4-4733-8bee-a07d92a5da31 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.080649 Aug 21 01:32:26.148333 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2876/5135] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:26.163418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a230a6a-e2b4-4625-b6be-916173f7e0f0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf1cdc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.220390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.221728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:26.237591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:26.237874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:26.238321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:26.243187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:26.243802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:26.244261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:26.424336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a230a6a-e2b4-4625-b6be-916173f7e0f0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?changes-since=2022-08-21T01%3A29%3A56Z" status: 200 len: 6328 microversion: 2.1 time: 0.266505 Aug 21 01:32:26.440949 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2260/5136] 10.222.0.46 () {58 vars in 1220 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-21T01%3A29%3A56Z => generated 6328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:26.451291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-44d04518-34e2-4da6-b431-11ca9eeaf86c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4032dcdc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.581114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:26.595818 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-44d04518-34e2-4da6-b431-11ca9eeaf86c tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1675117434" status: 200 len: 665 microversion: 2.1 time: 0.151782 Aug 21 01:32:26.596525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2261/5137] 10.222.0.46 () {58 vars in 1252 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1675117434 => generated 665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:26.633847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4207291-b511-4b4f-a0a8-9cf3e9bafaf4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fd025c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.634383 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-621e7dd3-2654-4f76-bf56-9c9bfc38b16e tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1691 microversion: 2.1 time: 0.415236 Aug 21 01:32:26.638403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2877/5138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1691 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:26.750120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4207291-b511-4b4f-a0a8-9cf3e9bafaf4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1465 microversion: 2.1 time: 0.124928 Aug 21 01:32:26.764157 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2262/5139] 10.222.0.46 () {58 vars in 1338 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:26.771463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c1cc8df-30d6-4c06-96d5-4242fa68b3cf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f894d670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.843600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:26.844474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:26.856096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:26.856901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:26.857821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:26.862752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c1cc8df-30d6-4c06-96d5-4242fa68b3cf tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1465 microversion: 2.1 time: 0.097090 Aug 21 01:32:26.863367 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2878/5140] 10.222.0.46 () {58 vars in 1324 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F47da2114-3503-4a69-b870-e602ca1c881f => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:26.874773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:26.875262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:26.875704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:26.882858 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b55e242e-7091-40f5-8458-f86c67db2298 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8a939d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.065079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b55e242e-7091-40f5-8458-f86c67db2298 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.185074 Aug 21 01:32:27.066007 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2879/5141] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:27.086562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74103848-896c-4e83-8d1d-55ed97fd6b9e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f929dd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.230101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74103848-896c-4e83-8d1d-55ed97fd6b9e tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.148068 Aug 21 01:32:27.231439 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2880/5142] 10.222.0.46 () {58 vars in 1170 bytes} [Sun Aug 21 01:32:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:27.251061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-920289b7-6a6f-4ef5-9fd4-a2e804834a25 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9b8f0d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.314849 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-920289b7-6a6f-4ef5-9fd4-a2e804834a25 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1" status: 200 len: 784 microversion: 2.1 time: 0.069715 Aug 21 01:32:27.315608 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2881/5143] 10.222.0.46 () {58 vars in 1233 bytes} [Sun Aug 21 01:32:27 2022] GET /compute/v2.1/images/64873b6f-4787-4a40-b75c-af37e7532ab1 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:32:27.331483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7ee31b87-c91b-4396-afdf-d801074766d7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f9e15e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.430626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7ee31b87-c91b-4396-afdf-d801074766d7 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.103771 Aug 21 01:32:27.433096 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2882/5144] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:32:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:27.452313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46bb5cc0-b9fd-4bbb-8a5a-4eb80e9527c0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f8847790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.947632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:27.957930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:27.965080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:27.972587 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62a413e8-2faf-4291-ad73-832e9afcaeef tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 1.133142 Aug 21 01:32:27.973628 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2263/5145] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:26 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:27.988898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:27.989906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:27.998479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:27.999061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:28.002132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:28.003085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:28.003633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:28.004964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:28.535642 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46bb5cc0-b9fd-4bbb-8a5a-4eb80e9527c0 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890" status: 204 len: 0 microversion: 2.1 time: 1.089371 Aug 21 01:32:28.536278 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2883/5146] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:27 2022] DELETE /compute/v2.1/images/73a29d47-fc35-4c29-b82c-e189efe02890 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:32:28.598127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:28.613968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-79130e08-684d-4a25-a239-09c8626f323c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1691 microversion: 2.1 time: 0.638895 Aug 21 01:32:28.627834 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2264/5147] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:27 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1691 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:28.627834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6b5da71-43a1-47d7-9ba8-2ff5bc517302 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc4032dcb80>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:28.821134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-unplugged", "status": "completed", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:28.864149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:28.864624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:28.868685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:28.889923 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] Creating event network-vif-unplugged:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:32:28.897055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bcb85459-d0dc-4427-a9ae-d6bf501b3935 req-ea59a37f-4d3d-4cd1-90ed-05f6ae4d80f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.359237 Aug 21 01:32:28.898448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2884/5148] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:29.002023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:29.002745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:29.018345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.019234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.019942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.021698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.022704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.023302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.464585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:29.475597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:29.484859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:29.486581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a0da8bd-aa05-4dfc-b2fe-3d7cb007a2b9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.490858 Aug 21 01:32:29.489282 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2885/5149] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:28 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:29.743287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Calling method '.version_select at 0x7fc3f929dc10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:29.745094 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:32:29.745094 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:32:29.747204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.748114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.748958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.769834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.770871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.771629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.786308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.787297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.788030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.797799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4cc45a90-4ec3-4f50-87a9-1a11fd491e53 tempest-PortsAdminExtendedAttrsTestJSON-57369758 tempest-PortsAdminExtendedAttrsTestJSON-57369758-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.306439 Aug 21 01:32:29.807325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2886/5150] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:32:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:29.815364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:29.816260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:29.842344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.842890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.843337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.846232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:29.846735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:29.847172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:29.894820 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6b5da71-43a1-47d7-9ba8-2ff5bc517302 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9" status: 204 len: 0 microversion: 2.1 time: 1.277317 Aug 21 01:32:29.895726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2265/5151] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:28 2022] DELETE /compute/v2.1/images/d02196f4-d7f7-4ffe-b04a-15ebaaad4df9 => generated 0 bytes in 1280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:29.906459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59a5cc2c-493c-4bf6-b23b-1a632999b591 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf29700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:30.167209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:30.180833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9bf1e784-3e98-4895-8a74-171d8e0b2e8d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1691 microversion: 2.1 time: 0.368650 Aug 21 01:32:30.184478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2887/5152] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:29 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1691 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:30.521556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:30.522476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:30.555053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.556129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.556734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:30.563931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.564707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.566600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:30.573705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59a5cc2c-493c-4bf6-b23b-1a632999b591 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f" status: 204 len: 0 microversion: 2.1 time: 0.673387 Aug 21 01:32:30.580293 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2266/5153] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:29 2022] DELETE /compute/v2.1/images/651b3696-c3dc-4caa-86bc-59ade179289f => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:30.586426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:30.587097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:30.606221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.607346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.607898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:30.609487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.611237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.612422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:30.677997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:30.929404 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-032083c3-e6bf-42cc-85c1-7b6df0fe1ba5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 204 len: 0 microversion: 2.1 time: 0.348063 Aug 21 01:32:30.930399 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2267/5154] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:30 2022] DELETE /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:30.946264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:30.946980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:30.972362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.975656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.976159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:30.976938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:30.977401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:30.977829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:31.048571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:31.069130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:31.074810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:31.081924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff14d31b-8786-4d2a-a286-0720f8cd1c6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.562684 Aug 21 01:32:31.086889 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2888/5155] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:30 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:31.207496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:31.208756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:31.224106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:31.225201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:31.225941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:31.227010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:31.227613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:31.228417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:31.377190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:31.388153 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-484b2447-f5e1-4e22-b96b-4c54b161e525 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1623 microversion: 2.1 time: 0.184287 Aug 21 01:32:31.393764 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2889/5156] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:31 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1623 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:31.405450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "name": "network-vif-unplugged", "status": "completed", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:31.429877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:31.431458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:31.437629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:31.475298 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] Creating event network-vif-unplugged:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:32:31.498902 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f17bd99c-7f12-4371-9c81-856d0ae67796 req-60842d23-92c9-4e30-903e-2ee7ddf345a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103543 Aug 21 01:32:31.501507 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2890/5157] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:32.114590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:32.118919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:32.175577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:32.183614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:32.188270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:32.189559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:32.193048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:32.194569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:32.450726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:32.464897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:32.468326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:32.472273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ff72142d-a8af-462c-8da2-0e0ca33116a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.365966 Aug 21 01:32:32.473393 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2891/5158] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:32 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:32.494515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:32.495747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:32.505311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:32.506483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:32.507126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:32.508628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:32.509297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:32.509974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:32.620717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:32.631610 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89411a9e-89d5-4edb-a8c7-b04c6be2a8fc tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 200 len: 1623 microversion: 2.1 time: 0.156891 Aug 21 01:32:32.632240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2892/5159] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:32 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 1623 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:32.848997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:32.861932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:32.862650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:32.863242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:32.868393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:32.877702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] Creating event network-changed:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h1-master-1 Aug 21 01:32:32.879461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71eaf999-17f8-4044-901d-1597ac7d96fd tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1473 microversion: 2.1 time: 1.944537 Aug 21 01:32:32.880667 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2268/5160] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:30 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1473 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:32.884808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a7174c77-30df-4f3c-92f2-99c3910c2c18 req-285768c5-8a81-4f1f-8ff7-362066adf857 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133533 Aug 21 01:32:32.885446 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2893/5161] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:32:33.500493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:33.501185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:33.518286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:33.518788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:33.519232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:33.519958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:33.524699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:33.525187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:33.530421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-712542597", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "725af498-d659-458b-87b7-9b6796fcde5b"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:33.643259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] validate_networks() for [('725af498-d659-458b-87b7-9b6796fcde5b', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:32:34.076078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:34.088371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:34.092256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:34.098727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e9840e4-d95b-4a0d-9896-17c5e9f648fc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.603895 Aug 21 01:32:34.099318 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2269/5162] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:33 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:34.143750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:34.144366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 1287227d-49d9-42ee-b8f4-a6e86d34697e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:34.170143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.172364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.173398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.174374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.175456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.176063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.209878 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e HTTP/1.1 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '1287227d-49d9-42ee-b8f4-a6e86d34697e'} Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:34.212309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 404 to user: Instance 1287227d-49d9-42ee-b8f4-a6e86d34697e could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a8e8827a-f5e2-44f3-b125-79267a4f098d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e" status: 404 len: 111 microversion: 2.1 time: 0.112698 Aug 21 01:32:34.219816 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2270/5163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:34 2022] GET /compute/v2.1/servers/1287227d-49d9-42ee-b8f4-a6e86d34697e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:34.224438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:34.225381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:34.258711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.260127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.260253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.265249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.267088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.302072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.344317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:32:34.345322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:32:34.346056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:32:34.346679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:32:34.347323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:32:34.368042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.369549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.370285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.371956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.373369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.374541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:34.464375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Getting quotas for project 733c772be3394dc98abd7d2f740ec890. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:34.471503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Getting quotas for user de660ed43ffe4456aae3ac3262602b9e and project 733c772be3394dc98abd7d2f740ec890. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:34.538718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:32:34.547616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:32:34.617337 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:34.668357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:34.673996 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2a928db-32a4-4e5e-87a8-e604b6ee410f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151306 Aug 21 01:32:34.676380 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2894/5164] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:32:34.681488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf66d6a7-b24e-4a90-b88d-8c2150537ed5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 200 len: 1431 microversion: 2.1 time: 0.466398 Aug 21 01:32:34.688501 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2271/5165] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:34 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 1431 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:34.703128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fe623b6a-81ab-4df4-8f1e-a80fc38b4cf4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '.version_select at 0x7fc3f89ac160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:34.710781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2f2e9d3-a2e3-4b15-b0b1-c1eb26adaa7c tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:34.711419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2f2e9d3-a2e3-4b15-b0b1-c1eb26adaa7c tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:34.777955 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fe623b6a-81ab-4df4-8f1e-a80fc38b4cf4 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322368897" status: 202 len: 0 microversion: 2.1 time: 0.095887 Aug 21 01:32:34.779912 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2895/5166] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322368897 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:32:34.839196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2f2e9d3-a2e3-4b15-b0b1-c1eb26adaa7c tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:34.849172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2f2e9d3-a2e3-4b15-b0b1-c1eb26adaa7c tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1213 microversion: 2.1 time: 0.155766 Aug 21 01:32:34.851300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2272/5167] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:34 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1213 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:34.961789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1287227d-49d9-42ee-b8f4-a6e86d34697e", "name": "network-vif-deleted", "tag": "c38b12ec-b0f1-456b-a96c-84991bb0b9c3"}, {"server_uuid": "47da2114-3503-4a69-b870-e602ca1c881f", "name": "network-vif-deleted", "tag": "9137795b-604d-4524-ae27-148d09ea2939"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:34.995664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:34.996315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:34.996876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.026622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Creating event network-vif-deleted:c38b12ec-b0f1-456b-a96c-84991bb0b9c3 for instance 1287227d-49d9-42ee-b8f4-a6e86d34697e on n-h1-master-1 Aug 21 01:32:35.030003 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] Creating event network-vif-deleted:9137795b-604d-4524-ae27-148d09ea2939 for instance 47da2114-3503-4a69-b870-e602ca1c881f on n-h1-master-1 Aug 21 01:32:35.049430 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3fedfe17-d59e-4b1b-b0f7-3af3005ec321 req-1e280e48-e73f-4b07-96fd-0a6ea96a71c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091707 Aug 21 01:32:35.056565 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2896/5168] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:35.124546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:35.125030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:35.133374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.134320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.134961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.135841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.136446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.137952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.713636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:35.715198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 47da2114-3503-4a69-b870-e602ca1c881f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:35.730547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.732235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.735516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.736492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.737183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.740229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.799933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] HTTP exception thrown: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Request method failure captured: Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f HTTP/1.1 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYqTdYgnskc6pRUj6j0gL1mEZgfHYh0zvpkVnha18sny4T6P31VSMXug-sgogUU1lWUNJf9uDrM31Mrl8KVPA7xi0UNMd41xY1sYhaZOh2yerzCEfC5ivcOSpXwsAQw4VkT2-3zx116IOWvvbElW-GlaY79kT_yPHcX3yv1lcIhhFFQ Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 7111e801da7a46f99a04f9a6d4a59312 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7111e801da7a46f99a04f9a6d4a59312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7111e801da7a46f99a04f9a6d4a59312", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7111e801da7a46f99a04f9a6d4a59312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7111e801da7a46f99a04f9a6d4a59312"}]}] Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 7111e801da7a46f99a04f9a6d4a59312 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ListImageFiltersTestJSON-483971258-project Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: aa5eb68dbbb34d1b9bc4ec9ebac6ff08 Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ListImageFiltersTestJSON-483971258-project Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '47da2114-3503-4a69-b870-e602ca1c881f'} Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:35.807239 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. Aug 21 01:32:35.812840 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:32:35.817826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Returning 404 to user: Instance 47da2114-3503-4a69-b870-e602ca1c881f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:35.818693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3702c00b-df60-4d6a-b84c-1bfca9590a90 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f" status: 404 len: 111 microversion: 2.1 time: 0.110364 Aug 21 01:32:35.837667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2897/5169] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:35 2022] GET /compute/v2.1/servers/47da2114-3503-4a69-b870-e602ca1c881f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:35.893665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:35.893665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:35.898972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.899474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.914007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:35.923325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:35.929989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:35.931242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.011188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:36.020504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:36.021424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:36.028142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:36.034416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7fe37b42-8737-4fcd-8b2c-14bac62eca34 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.912107 Aug 21 01:32:36.036490 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2273/5170] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:35 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:36.048470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:36.049110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:36.073270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.073973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.078745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.079688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.081093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.082360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.188281 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:36.258708 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bbc53881-3c2a-4ac0-8ff3-93e7657b6add tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 204 len: 0 microversion: 2.1 time: 0.414212 Aug 21 01:32:36.259440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2898/5171] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:35 2022] DELETE /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:36.270382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:36.271392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:36.281103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.281951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.282729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.283986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.284747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.285424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.339433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:36.354248 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f436071e-d124-4263-ae8f-bd3802313403 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1209 microversion: 2.1 time: 0.311280 Aug 21 01:32:36.356503 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2274/5172] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:36 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1209 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:36.421959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:36.423418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:36.435191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.436413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.437279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.441044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:36.443986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:36.444671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:36.621243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lazy-loading 'services' on Instance uuid fdcf60e5-f47e-4178-8ff2-a6641c9365b1 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:32:36.626289 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:36.726926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:36.754531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a30ad509-2316-4826-b5b7-cdb05aeb0427 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1474 microversion: 2.1 time: 0.490181 Aug 21 01:32:36.775066 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8cc3cec-5841-4d1d-9413-d6b339bd7eda tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1/os-volume_attachments/ea609a3c-f78d-4553-ae63-5d40e073a778" status: 202 len: 0 microversion: 2.1 time: 0.357291 Aug 21 01:32:36.775965 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2275/5173] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:32:36 2022] DELETE /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1/os-volume_attachments/ea609a3c-f78d-4553-ae63-5d40e073a778 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:32:36.779113 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2899/5174] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:36 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1474 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:37.067399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:37.068432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:37.082167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.082960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.086616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.087603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.088237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.088856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.380417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:37.381115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:37.397454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.397965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.398401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.402368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.406434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.407303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.604082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:37.623697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a2cfda4-d9ba-4228-b838-64123be6067b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1265 microversion: 2.1 time: 0.250081 Aug 21 01:32:37.629748 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2900/5175] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:37 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:37.787019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:37.787682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:37.822153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.824539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.826442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.829108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:37.831898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:37.833523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:37.886372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:37.901740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:37.903565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:37.905288 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2cc54de-fd15-47e2-80b2-d11473ea5f0a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.844526 Aug 21 01:32:37.906429 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2276/5176] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:37 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:38.400524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:38.415865 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a3d05dd-4abf-45cb-8f0e-62c1633fd059 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1474 microversion: 2.1 time: 0.636016 Aug 21 01:32:38.416705 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2901/5177] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:37 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1474 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:38.660900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:38.661962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:38.677829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:38.678637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:38.681210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:38.682154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:38.683797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:38.684430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:38.821710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:38.838966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51da651d-ae18-4dbd-8a88-d0a738abc0b6 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1265 microversion: 2.1 time: 0.182197 Aug 21 01:32:38.839771 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2277/5178] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:38 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:38.937351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:38.946117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:38.960219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:38.976632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:38.980129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:38.982993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:38.983724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:38.984924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:39.418083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:39.440323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:39.443723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:39.444460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:39.447851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:39.451687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f8d7647-bc29-48c9-a577-4fe5aa645c3c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.526469 Aug 21 01:32:39.454859 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2902/5179] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:38 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:39.458858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:39.459474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:39.462108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:39.465752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:39.466296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:39.466756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:39.863605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:39.866368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:39.890630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:39.891129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:39.898326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:39.903053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:39.904386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:39.908790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:40.072437 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:40.086349 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f6b98c4-2c1d-4098-b20a-efdf2d3685d4 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1474 microversion: 2.1 time: 0.646365 Aug 21 01:32:40.089622 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2278/5180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:39 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1474 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:40.474598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:40.482972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:40.485998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:40.490170 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77bde2d4-1af4-4219-8326-c3e40500fa06 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1271 microversion: 2.1 time: 0.633153 Aug 21 01:32:40.491302 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2903/5181] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:39 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1271 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:40.519096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:40.519710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:40.520939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:40.524384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:40.525770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:40.526688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:40.891045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:40.902616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:40.910971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:40.912955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acf4ef5a-3398-4f7f-a202-d5c74ef404ec tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.434589 Aug 21 01:32:40.933251 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2279/5182] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:40 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:41.114177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:41.114799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:41.156241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.157415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.157853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.163584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.164051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.168952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.493034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5eb68dbbb34d1b9bc4ec9ebac6ff08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7111e801da7a46f99a04f9a6d4a59312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:41.512346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:41.512959 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd205e94-c767-4250-b228-98f9739dbde5 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 200 len: 1432 microversion: 2.1 time: 0.402111 Aug 21 01:32:41.513248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:41.526031 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2904/5183] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:41 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 1432 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:41.526333 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:41.534650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.534650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.535601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.537343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.538726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.540101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.669846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cce03c2-e65b-4683-ab7e-7576c8b938c9", "name": "network-vif-deleted", "tag": "e94c02f6-6e9a-44a9-bd64-34684345b72f"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:41.724738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.727184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.727184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.778131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] Creating event network-vif-deleted:e94c02f6-6e9a-44a9-bd64-34684345b72f for instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 on n-h2-master-1 Aug 21 01:32:41.792051 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e1b2515e-a853-4835-b22d-5c2adbc25be5 req-4fb5b01e-dd76-4d2a-9f36-9146e7f3856c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124403 Aug 21 01:32:41.793954 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2905/5184] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:41.951178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:41.951965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:41.971717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.972326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.972761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:41.982192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:41.982739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:41.983119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:42.803529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:42.812591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:42.820637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a04edbfc-3c18-48e2-b1d9-5ff383a9a464 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 1.310407 Aug 21 01:32:42.822729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2280/5185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:41 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:42.839258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:42.840377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:42.841759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] [instance: 0cce03c2-e65b-4683-ab7e-7576c8b938c9] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:42.842697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:42.843992 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f69cbee-fc90-4fea-87df-e4c5aef890bb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.898322 Aug 21 01:32:42.857241 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2906/5186] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:41 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:42.896417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:42.899995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:42.901806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:42.905379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:42.906203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:42.908862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:42.993415 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] HTTP exception thrown: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Request method failure captured: Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 HTTP/1.1 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYqTdYgnskc6pRUj6j0gL1mEZgfHYh0zvpkVnha18sny4T6P31VSMXug-sgogUU1lWUNJf9uDrM31Mrl8KVPA7xi0UNMd41xY1sYhaZOh2yerzCEfC5ivcOSpXwsAQw4VkT2-3zx116IOWvvbElW-GlaY79kT_yPHcX3yv1lcIhhFFQ Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 7111e801da7a46f99a04f9a6d4a59312 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7111e801da7a46f99a04f9a6d4a59312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7111e801da7a46f99a04f9a6d4a59312", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7111e801da7a46f99a04f9a6d4a59312"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7111e801da7a46f99a04f9a6d4a59312"}]}] Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 7111e801da7a46f99a04f9a6d4a59312 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-483971258 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListImageFiltersTestJSON-483971258-project Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: aa5eb68dbbb34d1b9bc4ec9ebac6ff08 Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListImageFiltersTestJSON-483971258-project Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '0cce03c2-e65b-4683-ab7e-7576c8b938c9'} Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:42.995353 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Returning 404 to user: Instance 0cce03c2-e65b-4683-ab7e-7576c8b938c9 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fb0c082-0800-4c84-8cae-26e155a24b46 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9" status: 404 len: 111 microversion: 2.1 time: 0.172842 Aug 21 01:32:43.001092 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2281/5187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:42 2022] GET /compute/v2.1/servers/0cce03c2-e65b-4683-ab7e-7576c8b938c9 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:43.006587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-995fefe1-03c9-4f8b-99ae-6b6543b01c3f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f929d790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:43.101119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefa8a57-038e-4859-b589-c7de4c167ce2", "tag": "77b5de5e-3466-47be-8099-c65b5049ab7b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:43.136165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:43.136595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:43.140030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:43.197255 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] Creating event network-changed:77b5de5e-3466-47be-8099-c65b5049ab7b for instance cefa8a57-038e-4859-b589-c7de4c167ce2 on n-h2-master-1 Aug 21 01:32:43.220739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a2e7f76c-911f-45c1-b07d-aff8bc6608da req-5198e4f5-4550-4e46-a0d9-7779897b3903 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123446 Aug 21 01:32:43.222013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2282/5188] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:43.685113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-995fefe1-03c9-4f8b-99ae-6b6543b01c3f tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20" status: 204 len: 0 microversion: 2.1 time: 0.682471 Aug 21 01:32:43.685811 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2907/5189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:43 2022] DELETE /compute/v2.1/images/d9346d9e-6f4f-47ea-945b-234d5df24e20 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:32:43.695020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cdd34058-b2f0-48e3-9b18-ef8f7fab6ab2 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3fcf53700>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:43.842046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:43.843894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:43.863445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:43.864261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:43.865341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:43.867204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:43.870562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:43.885497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:44.429969 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cdd34058-b2f0-48e3-9b18-ef8f7fab6ab2 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d" status: 204 len: 0 microversion: 2.1 time: 0.739341 Aug 21 01:32:44.431636 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:44.433906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2283/5190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:43 2022] DELETE /compute/v2.1/images/95482f4b-30e8-4863-83b7-3eb985ecad0d => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:44.449235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:44.452348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:44.478344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:44.479486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:44.481684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:44.484480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:44.485313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:44.486586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:44.521189 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:44.706921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:44.724966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7a6e533-e4b0-4b0a-a7cf-511aec463b89 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 0.887240 Aug 21 01:32:44.748875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2908/5191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:43 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:44.748875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d350356-a2fa-4733-b8a4-14230b4f6c49 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] Calling method '.version_select at 0x7fc3f950df70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:44.848172 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:44.891719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:44.918493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:44.928308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:44.933975 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02b6f253-1c1b-4a17-93ba-40f86b73ca1e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.496926 Aug 21 01:32:44.937184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2284/5192] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:44 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:45.620520 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d350356-a2fa-4733-b8a4-14230b4f6c49 tempest-ListImageFiltersTestJSON-483971258 tempest-ListImageFiltersTestJSON-483971258-project] 10.222.0.46 "DELETE /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755" status: 204 len: 0 microversion: 2.1 time: 0.879584 Aug 21 01:32:45.622975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2909/5193] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:44 2022] DELETE /compute/v2.1/images/18848eff-6c0d-4df2-a518-d06e7a039755 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:45.764725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:45.765368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:45.791502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:45.796224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:45.801873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:45.802648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:45.810112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:45.813440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:45.962411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:45.963091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:45.990126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:45.990624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:45.996302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:45.999877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:46.005641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:46.006528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:46.652655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:46.698451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:46.700615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:46.739082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-afae9b3e-0324-42a8-8a14-ae2aafbd9eba tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.745360 Aug 21 01:32:46.751214 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2910/5194] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:45 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:46.759664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:46.832803 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28de8030-9c3c-4ced-8b88-9b60d3423990 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 1.072929 Aug 21 01:32:46.861454 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2285/5195] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:45 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:47.766939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:47.767717 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:47.795986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:47.799509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:47.800184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:47.806646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:47.807399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:47.809824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:47.869502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:47.870214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:47.898180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:47.900272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:47.901047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:47.902539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:47.903972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:47.905941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:48.330724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:48.351629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:48.359212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:48.366671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c46e87c2-dbca-41ce-b725-679d16491b1a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.601245 Aug 21 01:32:48.369144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2911/5196] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:47 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:48.630892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:48.667745 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d765d601-d232-4755-9b3a-515633ab6d1d tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 0.799573 Aug 21 01:32:48.671477 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2286/5197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:47 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:49.409636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:49.412970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:49.455460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:49.462125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:49.462898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:49.463845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:49.468001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:49.469675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:50.313363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84b9e7e3-aadf-47bd-89c0-997ccba58e66 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc3fcf62310>, body: {"keypair": {"name": "tempest-keypair-294959964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu9EF6Go5vOPjUwK8y8vtYJpT0hGzFhdhLSNkFUnyzqRbYiBHiBQbgZvQwbaKtOtsPbfS7slMAyy6cMi+HezoDdI82PT/qubIn4E5L9cfB/pFNUdXX0F5bWxnY7kWTloQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:50.385011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-84b9e7e3-aadf-47bd-89c0-997ccba58e66 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:50.409835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-84b9e7e3-aadf-47bd-89c0-997ccba58e66 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:50.507988 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84b9e7e3-aadf-47bd-89c0-997ccba58e66 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.863604 Aug 21 01:32:50.512139 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2287/5198] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 870 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 21 01:32:50.538361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:50.541166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:50.566898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:50.568960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:50.571187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:50.576271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:50.579463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:50.583182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:50.942727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:50.983051 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-633f38a9-20ac-4fe4-9118-dce18809aa58 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 0.464128 Aug 21 01:32:50.987264 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2288/5199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:50 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:51.006894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca6ecdba-f7d8-4625-8d33-6e551726f8d4 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3fd80f9d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.025111 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca6ecdba-f7d8-4625-8d33-6e551726f8d4 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-294959964" status: 200 len: 512 microversion: 2.2 time: 0.036264 Aug 21 01:32:51.026117 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2289/5200] 10.222.0.46 () {60 vars in 1255 bytes} [Sun Aug 21 01:32:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-294959964 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:51.039254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d232d8e9-540f-4150-b0fa-4531f82d4d44 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3fdf255e0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.070908 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d232d8e9-540f-4150-b0fa-4531f82d4d44 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-294959964" status: 204 len: 0 microversion: 2.2 time: 0.036099 Aug 21 01:32:51.073445 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2290/5201] 10.222.0.46 () {60 vars in 1258 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-294959964 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:32:51.089547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3de0052-b933-4567-8277-ab09f86818aa tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc3fddac940>, body: {"keypair": {"name": "tempest-keypair-1055056020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcvJ/ySihAXW9AZhMNNCM4pY69YY1Lo6xH/9F8Nb3bSoxpxiV4scW9SOCxZFACMZszfAsdudIvBI9x95KBIb6apJ3RJqBcyiIhYSPuQlp9SNiJOK2hRrp1VDWbeNX+u7w=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.112851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a3de0052-b933-4567-8277-ab09f86818aa tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:51.119388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a3de0052-b933-4567-8277-ab09f86818aa tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:51.158887 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3de0052-b933-4567-8277-ab09f86818aa tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.076093 Aug 21 01:32:51.162171 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2291/5202] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 21 01:32:51.189075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8c21ba0-8198-47c2-99c6-ee149cb7a3e5 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3fda35550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.209416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:51.222750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:51.230082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:51.231862 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04759265-768b-4b3f-b396-c412a2a2b22c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 1.832928 Aug 21 01:32:51.252718 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2912/5203] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:49 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:51.256689 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8c21ba0-8198-47c2-99c6-ee149cb7a3e5 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055056020" status: 204 len: 0 microversion: 2.2 time: 0.086119 Aug 21 01:32:51.260160 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2292/5204] 10.222.0.46 () {60 vars in 1261 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055056020 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:51.270210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d69a4ec-ca31-49c6-86ef-4372236d6ec3 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc3f938b040>, body: {"keypair": {"name": "tempest-keypair-902721215", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.303872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0d69a4ec-ca31-49c6-86ef-4372236d6ec3 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:51.319867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0d69a4ec-ca31-49c6-86ef-4372236d6ec3 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:51.377230 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d69a4ec-ca31-49c6-86ef-4372236d6ec3 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.111580 Aug 21 01:32:51.378265 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2913/5205] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:32:51.381894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefa8a57-038e-4859-b589-c7de4c167ce2", "name": "network-vif-plugged", "status": "completed", "tag": "77b5de5e-3466-47be-8099-c65b5049ab7b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.389803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad299824-0b89-42a1-9dd7-74511e30a044 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f95cfa60>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.415601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:51.416122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:51.423467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:51.448176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad299824-0b89-42a1-9dd7-74511e30a044 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-902721215" status: 204 len: 0 microversion: 2.2 time: 0.062956 Aug 21 01:32:51.457131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2914/5206] 10.222.0.46 () {60 vars in 1258 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-902721215 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:32:51.463022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10d9ed1b-a263-4664-b95d-281e69e60083 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc40326b700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-176045966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sijYJ1MskWmyzAPvwl/tDbOGZctNfvd8C2/G2a8YEfeSApl5k7RcdI/PAZcVe7U2HAgv7pHWOO5VFqh42JGGS3RYNSEgkdlbXNZji5vhsKln+uhf1y7P+wUBeA1yQyw=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.467215 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] Creating event network-vif-plugged:77b5de5e-3466-47be-8099-c65b5049ab7b for instance cefa8a57-038e-4859-b589-c7de4c167ce2 on n-h2-master-1 Aug 21 01:32:51.484362 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4d66f908-fac1-4eaf-a473-3ecba73a981d req-3d5cd43e-2980-4f73-853e-7828b6b70476 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106740 Aug 21 01:32:51.488300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2293/5207] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:51.518740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-10d9ed1b-a263-4664-b95d-281e69e60083 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:51.534265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-10d9ed1b-a263-4664-b95d-281e69e60083 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:51.582306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10d9ed1b-a263-4664-b95d-281e69e60083 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.123670 Aug 21 01:32:51.599274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19abafd9-b1dd-48d8-a6bb-580e8baf7846 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc3fdf25ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-467475282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjhGTVG3lZjwiiZCOdbuHy295ubDKid8sIyQJPFVv4uw6CoXvlm9czPzVuzX1kVV3zm8wsHMsL9pZ2WHH3RWIYCYk33ZHdLoeVo9CQFy8ISfJMMWglY41jawhY3U8LgNg=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.603474 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2915/5208] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:32:51.639226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-19abafd9-b1dd-48d8-a6bb-580e8baf7846 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:51.645686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-19abafd9-b1dd-48d8-a6bb-580e8baf7846 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:51.680806 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19abafd9-b1dd-48d8-a6bb-580e8baf7846 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.085248 Aug 21 01:32:51.693396 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2294/5209] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:32:51.697068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a548b4a-8dd9-48cd-863a-2672fdea6902 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc40310ed30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-208468807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTKZKt3w6rK6gKd6Cp3bcoexT/xxlqyhn9AH9fQZaOatc7PyR2ji7xMkGaUkdJ0m5GC2EDH+MoW6V/F3ozRVKWBs6WeoanhJHLL1TQa3tyI34ousAqS5qCeiYldk162Xg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:51.734089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6a548b4a-8dd9-48cd-863a-2672fdea6902 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:51.750158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-6a548b4a-8dd9-48cd-863a-2672fdea6902 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:51.805203 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a548b4a-8dd9-48cd-863a-2672fdea6902 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.113278 Aug 21 01:32:51.817814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d96d7c5e-335a-403b-bcca-dc62e76c4635 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc403122c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.822293 n-d-master-1 devstack@n-api.service[122483]: WARNING oslo_db.sqlalchemy.utils [None req-d96d7c5e-335a-403b-bcca-dc62e76c4635 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:32:51.822882 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2916/5210] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:32:51.835821 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d96d7c5e-335a-403b-bcca-dc62e76c4635 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.022690 Aug 21 01:32:51.842815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2295/5211] 10.222.0.46 () {60 vars in 1177 bytes} [Sun Aug 21 01:32:51 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:51.848067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f83ae0fd-dea3-4cab-8a8d-9ff79fa8fe62 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f8957820>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.885116 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f83ae0fd-dea3-4cab-8a8d-9ff79fa8fe62 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-208468807" status: 204 len: 0 microversion: 2.2 time: 0.040877 Aug 21 01:32:51.890643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2917/5212] 10.222.0.46 () {60 vars in 1318 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-208468807 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:32:51.898623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38f2b2a1-6daa-4c40-8947-b27770ff3733 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3fda35670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.931551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38f2b2a1-6daa-4c40-8947-b27770ff3733 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-467475282" status: 204 len: 0 microversion: 2.2 time: 0.041145 Aug 21 01:32:51.932173 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2296/5213] 10.222.0.46 () {60 vars in 1318 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-467475282 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:51.941264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-376d7ce7-02a3-4145-b405-652eb48b8e60 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f95cf310>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:51.991572 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-376d7ce7-02a3-4145-b405-652eb48b8e60 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-176045966" status: 204 len: 0 microversion: 2.2 time: 0.054204 Aug 21 01:32:51.992501 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2918/5214] 10.222.0.46 () {60 vars in 1318 bytes} [Sun Aug 21 01:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-176045966 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:52.006053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4215eb87-65c2-42ee-8c1c-b4ff00a636a6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc40327ed30>, body: {"keypair": {"name": "tempest-keypair-949060188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHn+ZzGW9QutywSfpAVpc2li2Lv5Nc2nvNvkC2EDq/KZ0ru478eBtyke2f/9Fyl8vv9odUzF4Xt/u7XbTLYPf+n1V2UNC8+qx1jmKIX1xnH01G1u1CMaLdN01A7qGPPYg=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:52.011487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.017708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:52.036165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.038099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.038894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.042532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.043938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.044636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.049295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4215eb87-65c2-42ee-8c1c-b4ff00a636a6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:52.065082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4215eb87-65c2-42ee-8c1c-b4ff00a636a6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:52.121163 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4215eb87-65c2-42ee-8c1c-b4ff00a636a6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.119740 Aug 21 01:32:52.128719 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2297/5215] 10.222.0.46 () {62 vars in 1199 bytes} [Sun Aug 21 01:32:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 21 01:32:52.134030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.134733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:52.142283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.142882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.143334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.144067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.144524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.144990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.194073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:52.284258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:52.298114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb44b95c-bad5-4db0-8583-81dd00285ee2 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 0.290242 Aug 21 01:32:52.299007 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2919/5216] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:52 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:52.304447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d94011e-c188-4ea3-8ba3-6ee550897786 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f9c5d160>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.314952 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d94011e-c188-4ea3-8ba3-6ee550897786 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-949060188" status: 200 len: 512 microversion: 2.2 time: 0.014681 Aug 21 01:32:52.316100 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2920/5217] 10.222.0.46 () {60 vars in 1255 bytes} [Sun Aug 21 01:32:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-949060188 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:52.321289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.322137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:52.329154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.329641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.330075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.330880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.331289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.331763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.348701 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2eb23abc-d9f9-4e73-86a5-865b2f6cd7b9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 204 len: 0 microversion: 2.1 time: 0.218107 Aug 21 01:32:52.352349 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2298/5218] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:52 2022] DELETE /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:52.359220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a98676b0-f4b3-4c9e-b92d-26024669d57b tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3fddac0d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.369204 n-d-master-1 devstack@n-api.service[122483]: WARNING oslo_db.sqlalchemy.utils [None req-a98676b0-f4b3-4c9e-b92d-26024669d57b tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:32:52.383793 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a98676b0-f4b3-4c9e-b92d-26024669d57b tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.032441 Aug 21 01:32:52.391525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2299/5219] 10.222.0.46 () {60 vars in 1177 bytes} [Sun Aug 21 01:32:52 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:52.398271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.403934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:52.425734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.427620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.429678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.431665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:52.432217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:52.432718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:52.579249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:52.592455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:52.597504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:52.599380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3cae2bda-42f0-4467-941c-89d6527a545b tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.281835 Aug 21 01:32:52.600308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2921/5220] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:52 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:52.625225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33c0b765-2058-420f-b0b3-49596368d9d6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f9c5db80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:52.633496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:52.642497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b95f785-c8eb-4742-8df8-d3750afadbee tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1509 microversion: 2.1 time: 0.250261 Aug 21 01:32:52.643180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2300/5221] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:52 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:52.664158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33c0b765-2058-420f-b0b3-49596368d9d6 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949060188" status: 204 len: 0 microversion: 2.2 time: 0.046846 Aug 21 01:32:52.664890 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2922/5222] 10.222.0.46 () {60 vars in 1258 bytes} [Sun Aug 21 01:32:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949060188 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:52.675229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Action: 'create', calling method: .version_select at 0x7fc40327e160>, body: {"keypair": {"name": "tempest-keypair-1231153300", "type": "x509"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:52.699977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:52.705890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:52.722842 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:52.738471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.processutils [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnwrw_g__/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnwrw_g__/temp.key -subj /CN=2be6987e355045b4b02c543fea7b1540 -extensions v3_req_client {{(pid=122483) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 21 01:32:53.101081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.102268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:53.104540 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:53.111464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.112512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.113287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.114185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.114829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.115418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.187493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:53.270150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.processutils [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnwrw_g__/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnwrw_g__/temp.key -subj /CN=2be6987e355045b4b02c543fea7b1540 -extensions v3_req_client" returned: 0 in 0.531s {{(pid=122483) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 21 01:32:53.272231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.processutils [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnwrw_g__/temp.key -password pass: {{(pid=122483) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 21 01:32:53.340947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.processutils [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnwrw_g__/temp.key -password pass:" returned: 0 in 0.068s {{(pid=122483) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 21 01:32:53.397202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a85a09ee-161b-40d9-ac4b-fc0a63964660 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 204 len: 0 microversion: 2.1 time: 0.298772 Aug 21 01:32:53.401847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2923/5223] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:53 2022] DELETE /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:53.414650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.416148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:53.430375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.430807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:32:53.431341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.431575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.432450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.433638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.434100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.437945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Getting quotas for user 2be6987e355045b4b02c543fea7b1540 and project 6d1b3e7181814594b611ccd258364084. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:32:53.453210 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:53.462014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d74e8aa-ad6f-465e-8273-767731f7efe1 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.791265 Aug 21 01:32:53.463493 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2301/5224] 10.222.0.46 () {62 vars in 1198 bytes} [Sun Aug 21 01:32:52 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 793 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:53.471687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.472405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:53.480359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.481060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.482229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.483227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.483756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.484357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.612606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:53.618894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3838033-6155-4cfa-83f3-8a8697875acc tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1313 microversion: 2.1 time: 0.218348 Aug 21 01:32:53.619964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2924/5225] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:53.629825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87e30822-f904-405f-9523-2395fa08881d tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f937e9d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.640747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87e30822-f904-405f-9523-2395fa08881d tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1231153300" status: 200 len: 1534 microversion: 2.2 time: 0.019113 Aug 21 01:32:53.641444 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2925/5226] 10.222.0.46 () {60 vars in 1258 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1231153300 => generated 1534 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:53.647012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.647804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:53.657028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.657760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.658271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.659137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.659656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.660149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.703412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:53.713064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffc23bf4-1053-45a3-a9b8-ed9e71f68173 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1513 microversion: 2.1 time: 0.248345 Aug 21 01:32:53.716821 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2302/5227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:53.720009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a57856b-4333-4235-8b11-b4084b6937a9 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc403122ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.724801 n-d-master-1 devstack@n-api.service[122483]: WARNING oslo_db.sqlalchemy.utils [None req-7a57856b-4333-4235-8b11-b4084b6937a9 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:32:53.730888 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a57856b-4333-4235-8b11-b4084b6937a9 tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.015098 Aug 21 01:32:53.731851 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2303/5228] 10.222.0.46 () {60 vars in 1177 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:53.848003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:53.864080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:53.866094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:53.867606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5e32ac8-9941-4d24-9d8e-a068e51696e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.225161 Aug 21 01:32:53.868605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2926/5229] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:53.874160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb33e00d-0db2-4c6d-b573-2b790d1f0b4d tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] Calling method '.version_select at 0x7fc3f89575e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.905724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb33e00d-0db2-4c6d-b573-2b790d1f0b4d tempest-KeyPairsV22TestJSON-500516258 tempest-KeyPairsV22TestJSON-500516258-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231153300" status: 204 len: 0 microversion: 2.2 time: 0.035527 Aug 21 01:32:53.906653 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2927/5230] 10.222.0.46 () {60 vars in 1261 bytes} [Sun Aug 21 01:32:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231153300 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:53.966097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:53.966727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:53.974202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.975020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.975357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:53.976059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:53.976514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:53.977013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.139549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:54.149593 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7da6460b-c4e7-4084-9b01-b7302d91909c tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1509 microversion: 2.1 time: 0.416496 Aug 21 01:32:54.150412 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2304/5231] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:53 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:54.640545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:54.641126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:54.651655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.652240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.652699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.653963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.654466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.655324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.737686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:54.741058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:54.752161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.753403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.754382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.756348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.757224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.758007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.826997 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:32:54.843309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:54.853678 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1611e592-6ec6-4b28-a86c-17faddd80a71 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1496 microversion: 2.1 time: 0.217782 Aug 21 01:32:54.863250 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2928/5232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:54 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1496 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:54.902500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:54.903308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:54.912054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.912559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.913325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:54.914085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:54.914536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:54.915000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.108759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:55.119557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:55.153960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:55.158462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0e8f876a-7b7d-4e51-8a98-5b4570d5aec0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.262903 Aug 21 01:32:55.160560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2929/5233] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:54 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:55.182618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:55.187270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:55.200901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.200901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.200901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.205075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.206457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.207807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.212876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:55.223670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-997fdb59-667c-4c65-a438-b6a31f09662e tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1513 microversion: 2.1 time: 0.491323 Aug 21 01:32:55.241883 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2305/5234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:54 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:55.526714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:55.541602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-733c80c3-7263-468f-8602-2d21945d619d tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 200 len: 1509 microversion: 2.1 time: 0.374133 Aug 21 01:32:55.561767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:55.561767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:55.564096 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2930/5235] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:55 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:55.567779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.568264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.568701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.569455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.569906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.570330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.639674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:55.820744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d65fe4b-97fa-4bc4-bafd-4462ce77a23b tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 204 len: 0 microversion: 2.1 time: 0.263784 Aug 21 01:32:55.830148 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2306/5236] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:55 2022] DELETE /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:55.841046 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:55.841613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:55.861027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.861635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.862073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:55.863023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:55.863235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:55.863845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.013750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c5b2e5d-8a33-43bb-8900-cd033579d74b", "name": "network-vif-deleted", "tag": "b1f8ca0f-1b24-43ee-a952-eb8abde0ea79"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:56.061716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.062189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.062943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.078992 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] Creating event network-vif-deleted:b1f8ca0f-1b24-43ee-a952-eb8abde0ea79 for instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b on n-h1-master-1 Aug 21 01:32:56.086289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d4c8ad45-11ff-4a87-b4c7-ef5843b282b0 req-c45c2fe6-ea5d-41c9-9a9c-a587d19819e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080461 Aug 21 01:32:56.087478 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2307/5237] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:56.190374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:56.194554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:56.217701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:56.219405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.220621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.222797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.231146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.234761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28a77d28-7791-44c3-9ae1-4f130cef4b63 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1502 microversion: 2.1 time: 0.404133 Aug 21 01:32:56.236350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.236832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.237287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2931/5238] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:55 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:56.254100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:56.256706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:56.277931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.279367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.281319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.283767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.285613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.286717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.677941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:56.697774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:56.701218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:56.707956 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab07c505-1ded-4c82-97b4-e5f94659486c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.523881 Aug 21 01:32:56.708963 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2308/5239] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:56 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:56.759939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:56.769108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 8c5b2e5d-8a33-43bb-8900-cd033579d74b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:56.795478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.798672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.812050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.815270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.817637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.818479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.838609 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b HTTP/1.1 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '8c5b2e5d-8a33-43bb-8900-cd033579d74b'} Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:56.842694 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. Aug 21 01:32:56.850368 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:32:56.852383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 404 to user: Instance 8c5b2e5d-8a33-43bb-8900-cd033579d74b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:32:56.853539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-546f41eb-a54a-48dd-8d03-4b9e868240a9 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b" status: 404 len: 111 microversion: 2.1 time: 0.131354 Aug 21 01:32:56.854103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:56.855273 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2309/5240] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:56 2022] GET /compute/v2.1/servers/8c5b2e5d-8a33-43bb-8900-cd033579d74b => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:32:56.876718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61340dd9-8bd8-47c3-bbd6-6c5a08fc185d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1513 microversion: 2.1 time: 0.631818 Aug 21 01:32:56.879627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:56.880255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:56.882742 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2932/5241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:56 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1513 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:56.892549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.893080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.893524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.900074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:56.900996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:56.901681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:56.940246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:32:57.103681 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffd49ab8-19b2-4e65-8213-32c693a707ef tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 204 len: 0 microversion: 2.1 time: 0.242652 Aug 21 01:32:57.104708 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2310/5242] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:32:56 2022] DELETE /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:32:57.114303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:57.114928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:57.150383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.150878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.151299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.154216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.156217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.156807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.260348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:57.261579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:57.270399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.271298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.271960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.273110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.274814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.275461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.479160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:57.490168 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-805c90d7-bc58-40fe-8c1e-9daf613d62fa tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.380413 Aug 21 01:32:57.503567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2933/5243] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:57 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:57.555682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:57.570207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d854f76-e975-4401-9acd-4022da383a97 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1502 microversion: 2.1 time: 0.315432 Aug 21 01:32:57.571228 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2311/5244] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:57 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:57.734208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:57.734963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:57.744218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.745480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.746546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.747848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.748549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.749290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.906289 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:57.906925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:57.920292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.921433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.921893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:57.923319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:57.923984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:57.924735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.016303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:58.028712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a9652cac-0e0c-4c7f-b109-6159d23bc769 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1303 microversion: 2.1 time: 0.127117 Aug 21 01:32:58.039974 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2312/5245] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:57 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:58.155783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:58.172026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:58.174693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:58.175976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a651d636-32bf-4335-8994-b3e2f89cc8cf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.446088 Aug 21 01:32:58.176871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2934/5246] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:57 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:32:58.226266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcf60e5-f47e-4178-8ff2-a6641c9365b1", "name": "network-vif-deleted", "tag": "1118d24c-6e51-43c5-8506-795c847b9fc5"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:32:58.240963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:58.241577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:58.242138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.276477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] Creating event network-vif-deleted:1118d24c-6e51-43c5-8506-795c847b9fc5 for instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 on n-h2-master-1 Aug 21 01:32:58.289010 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bb1a4259-6db8-401d-837c-e01648ce616c req-20e870af-b380-4d7e-bb99-3a127cc402fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064580 Aug 21 01:32:58.290245 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2313/5247] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:32:58.511567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:58.512328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:58.522241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:58.522966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:58.523707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.525122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:58.525653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:58.526193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.593203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:58.594237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:58.603415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:58.603859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:58.607132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.608102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:58.608578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:58.609030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:58.801546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:58.812203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6716821e-c220-44e4-a836-63b172292460 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1502 microversion: 2.1 time: 0.223349 Aug 21 01:32:58.831224 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2314/5248] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:58 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:32:59.050819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:59.054850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:59.056085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:59.064749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.069696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b044ade7-16f5-450a-a633-87d955271d0f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.562449 Aug 21 01:32:59.084607 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.085316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2935/5249] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:58 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:59.086066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.087061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.087734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.088458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.199642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:59.201720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:59.214599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:59.226954 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6e28c54e-8485-4850-9280-0496fd8afc02 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1303 microversion: 2.1 time: 0.181077 Aug 21 01:32:59.228637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.229650 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2315/5250] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:59 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:32:59.230277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.231588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.232434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.233150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.233800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.568999 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:59.581612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:59.585828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:32:59.587058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d8ba156-e3de-4674-a4f2-677f6fa2c7f4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.391616 Aug 21 01:32:59.589451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2936/5251] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:32:59 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:32:59.834964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:59.835875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:59.842184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:32:59.842680 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:32:59.851743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.855765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.856868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.857512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.857958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.858686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.859046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.859191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.859550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.867128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:32:59.867901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:32:59.868505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:32:59.931753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54a9d977-8790-4cff-a569-ed2235ff41d9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/ips" status: 200 len: 150 microversion: 2.1 time: 0.093423 Aug 21 01:32:59.937273 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2937/5252] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:32:59 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/ips => generated 150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:33:00.091731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:00.093028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:00.105078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:00.105919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:00.107505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:00.110987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:00.111854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:00.112619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:00.802837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:00.815397 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55b77bbe-1be5-4137-8d59-d84b0171364f tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 0.727575 Aug 21 01:33:00.817718 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2938/5253] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:00 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:00.830457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:00.831359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:00.839716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:00.840492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:00.841278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:00.842195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:00.843163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:00.843769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:00.898956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:00.899980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:00.900854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:00.901514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lazy-loading 'fault' on Instance uuid fdcf60e5-f47e-4178-8ff2-a6641c9365b1 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:33:01.003769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0524cc60bd640ca9ae88845970eb013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92a6cc6152c46bb982b30251f7aad18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:01.026951 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a18ac0c-c1ca-435c-b790-d85183c88b04 tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 200 len: 1308 microversion: 2.1 time: 0.207792 Aug 21 01:33:01.028287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2939/5254] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:00 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:01.033641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:01.035482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:01.059436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:01.060951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:01.065584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:01.066632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:01.070940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:01.071884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:01.116753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:01.128925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8071b8ae-ce66-4161-a18b-e26450372f8f tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1502 microversion: 2.1 time: 1.299215 Aug 21 01:33:01.143004 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2316/5255] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:32:59 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1502 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:01.767095 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:01.841422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:01.842042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:01.850329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:01.850818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:01.851256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:01.851969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:01.852421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:01.864988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:02.251980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:02.274458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:02.299261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:02.301045 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49839429-798c-4dc5-acfb-96ce213b66bc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 1.271068 Aug 21 01:33:02.310019 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2940/5256] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:01 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:02.327589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:02.328533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] [instance: fdcf60e5-f47e-4178-8ff2-a6641c9365b1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:02.415380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:02.416061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:02.418407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:02.420074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:02.425602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:02.427468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:02.508663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] HTTP exception thrown: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Request method failure captured: Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 HTTP/1.1 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYoOrMn6SPy1-Jb0-b7WWKVruiOKJweGG0sF3JepTh8d4ZfriiYYzAyibCEZA94Oim1d7PPr953rF2dJcIbrwov4uZmYai8hyBMapB4eK9AXlVz99F2SGC_LyEM1wFk1JX8l10uZwy6OxPuVLgt2pxc2wNitGbFgW-ZXEI2te8xNX7Y Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c92a6cc6152c46bb982b30251f7aad18 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c92a6cc6152c46bb982b30251f7aad18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c92a6cc6152c46bb982b30251f7aad18", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c92a6cc6152c46bb982b30251f7aad18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c92a6cc6152c46bb982b30251f7aad18"}]}] Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c92a6cc6152c46bb982b30251f7aad18 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-212505533 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesSnapshotTestJSON-212505533-project Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f0524cc60bd640ca9ae88845970eb013 Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesSnapshotTestJSON-212505533-project Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: exception: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'fdcf60e5-f47e-4178-8ff2-a6641c9365b1'} Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:02.515209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. Aug 21 01:33:02.520984 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:02.525911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] Returning 404 to user: Instance fdcf60e5-f47e-4178-8ff2-a6641c9365b1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:02.538746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10ee1e1a-623b-41ca-8a29-7a028a2d384d tempest-VolumesSnapshotTestJSON-212505533 tempest-VolumesSnapshotTestJSON-212505533-project] 10.222.0.46 "GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1" status: 404 len: 111 microversion: 2.1 time: 0.222661 Aug 21 01:33:02.545299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2941/5257] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:02 2022] GET /compute/v2.1/servers/fdcf60e5-f47e-4178-8ff2-a6641c9365b1 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:02.564479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:02.581023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:02.607562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:02.608591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:02.609312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:02.616588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:02.621084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:02.621831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:02.889596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:02.903720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0eca059e-53ce-4c67-bedd-649b68707c35 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 200 len: 1460 microversion: 2.1 time: 0.354843 Aug 21 01:33:02.906658 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2942/5258] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:02 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 1460 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:02.967839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:02.983518 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-113ef604-3759-4660-b298-419c596656ec tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1521 microversion: 2.1 time: 1.145309 Aug 21 01:33:02.985105 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2317/5259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:01 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1521 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:03.062272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefa8a57-038e-4859-b589-c7de4c167ce2", "name": "network-vif-deleted", "tag": "77b5de5e-3466-47be-8099-c65b5049ab7b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:03.104040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.107001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.108558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.175072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] Creating event network-vif-deleted:77b5de5e-3466-47be-8099-c65b5049ab7b for instance cefa8a57-038e-4859-b589-c7de4c167ce2 on n-h2-master-1 Aug 21 01:33:03.188077 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0358f3a2-6ea3-4c2e-81b5-4c6ce8cb22e2 req-d62ebd27-6413-4f56-9226-230793b925b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132859 Aug 21 01:33:03.202658 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2943/5260] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:03.227033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31952e84-7058-411a-a758-7a23e11b89e8"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:03.230542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:03.250386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.251006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.253264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.255632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.256536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.257740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.337002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:03.338260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:03.355826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.356756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.357563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.358529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.359194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.359806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.397643 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:03.450509 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=24 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:03.889235 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0355d3c-ee39-4317-a622-94898eb2a095 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665653 Aug 21 01:33:03.891118 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2318/5261] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:33:03 2022] POST /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:03.917623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2f87fc-4faf-4318-9068-90ccce7924e4", "name": "network-vif-deleted", "tag": "dc3ed71f-0da2-43a9-99bc-7c339bcec6b7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:03.968628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:03.975616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:03.979213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:03.987878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:04.014157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:04.021640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:04.024005 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] Creating event network-vif-deleted:dc3ed71f-0da2-43a9-99bc-7c339bcec6b7 for instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 on n-h2-master-1 Aug 21 01:33:04.026259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab065658-f4f5-4b9b-be3a-b549ff2afffe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.693550 Aug 21 01:33:04.030166 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2944/5262] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:03 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:33:04.039328 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d87dd262-6a40-4245-aebe-d43e56905586 req-134dcd1d-74d3-445d-8874-969a828b3837 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142828 Aug 21 01:33:04.040361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2319/5263] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:04.044039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:04.047546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: cefa8a57-038e-4859-b589-c7de4c167ce2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:04.056740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:04.057803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:04.067821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:04.070684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:04.071333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:04.073849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:04.074797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:04.076000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:04.076624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:04.076965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:04.083515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:04.088837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:04.090553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:04.092352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:04.114984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] HTTP exception thrown: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Request method failure captured: Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 HTTP/1.1 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsuS1fJ1Q7Mt4hLY77jbMwjtMufWGo1lfJHokbfOYq4aSi458RZmk50G_nntXSSAL-mOqSHcJdmSlqBhWBApohAIkwIgKV7AWJriBg5B-p-6NcgFGhmvBXxkFdlkcyccnP9YTK1XFebmPoxH1le2BnfLev0kmkNhjImkLu9wumXEno Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 733c772be3394dc98abd7d2f740ec890 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/733c772be3394dc98abd7d2f740ec890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_733c772be3394dc98abd7d2f740ec890", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/733c772be3394dc98abd7d2f740ec890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/733c772be3394dc98abd7d2f740ec890"}]}] Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 733c772be3394dc98abd7d2f740ec890 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesActionsTest-1009621533-project Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: de660ed43ffe4456aae3ac3262602b9e Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesActionsTest-1009621533-project Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: exception: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'cefa8a57-038e-4859-b589-c7de4c167ce2'} Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:04.117638 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. Aug 21 01:33:04.125265 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:04.125953 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:04.141646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Returning 404 to user: Instance cefa8a57-038e-4859-b589-c7de4c167ce2 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:04.146535 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fa81284-42ac-4ca6-a1df-8e93ee838856 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2" status: 404 len: 111 microversion: 2.1 time: 0.113848 Aug 21 01:33:04.150037 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2945/5264] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:04 2022] GET /compute/v2.1/servers/cefa8a57-038e-4859-b589-c7de4c167ce2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:04.214738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:04.219677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:04.220533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:04.221420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lazy-loading 'fault' on Instance uuid 0f2f87fc-4faf-4318-9068-90ccce7924e4 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:33:04.411947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0447e656f9418da68b308f19e8e807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0514462a9a1b45ac9b7b3285fd0bf6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:04.430924 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6542dede-09e8-42df-ab86-f57ba24402f3 tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 200 len: 1311 microversion: 2.1 time: 0.377663 Aug 21 01:33:04.432319 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2320/5265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:04 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:04.486683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1760384396", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "725af498-d659-458b-87b7-9b6796fcde5b"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:04.623307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] validate_networks() for [('725af498-d659-458b-87b7-9b6796fcde5b', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:33:05.056656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:05.057357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:05.079389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:05.079973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:05.084856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:05.085752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:05.086245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:05.091564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:05.571779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:05.583419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:05.585237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:05.586794 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8acca3de-a4a1-4ca2-8681-b830d4edeb5e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.534966 Aug 21 01:33:05.587955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2321/5266] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:05 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:05.608042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "name": "network-vif-plugged", "status": "completed", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:05.634177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:05.651661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:05.652347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:05.690927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] Creating event network-vif-plugged:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h1-master-1 Aug 21 01:33:05.705428 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-711ee15a-57b8-42c7-99ef-becb5dc7c318 req-642a5ad3-7fd7-4ec9-96b9-782f8c6571ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112872 Aug 21 01:33:05.706746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2322/5267] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:05.720051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:05.723466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] [instance: 0f2f87fc-4faf-4318-9068-90ccce7924e4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:05.738443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:05.738926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:05.739374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:05.740100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:05.740556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:05.746785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:05.787090 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] HTTP exception thrown: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Request method failure captured: Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 HTTP/1.1 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYoZSCv_WzObCsa48gnyYPISt8rwHTmxLj04mPfjuxC7yaX0fWXXvhDUht4lUF_YvTUXLCdlpfQjsUlnRrliRP9jHyJto1cP586UWWeKggMNl7BSz4E2KOAON4URWV77BgNPN5WrINqWOED5NKaT7u8CEoOPXzhIk3qdsWdZoDU3YCM Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0514462a9a1b45ac9b7b3285fd0bf6af", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0514462a9a1b45ac9b7b3285fd0bf6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0514462a9a1b45ac9b7b3285fd0bf6af"}]}] Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 0514462a9a1b45ac9b7b3285fd0bf6af Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599666140 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: bd0447e656f9418da68b308f19e8e807 Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599666140-project Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '0f2f87fc-4faf-4318-9068-90ccce7924e4'} Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:05.788874 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:05.794239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] Returning 404 to user: Instance 0f2f87fc-4faf-4318-9068-90ccce7924e4 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:05.795492 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87fdd328-02b7-40e8-a34b-858fe07dc5cd tempest-ServerRescueNegativeTestJSON-1599666140 tempest-ServerRescueNegativeTestJSON-1599666140-project] 10.222.0.46 "GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4" status: 404 len: 111 microversion: 2.1 time: 0.082097 Aug 21 01:33:05.796173 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2323/5268] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:05 2022] GET /compute/v2.1/servers/0f2f87fc-4faf-4318-9068-90ccce7924e4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:06.612295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:06.619646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:06.632414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:06.637520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:06.638528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:06.639640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:06.640279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:06.640920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:06.838182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:33:06.841530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:33:06.843170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:33:06.843778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:33:06.845013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:33:06.908487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:06.918600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:06.919730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:06.920914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:06.921595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:06.922535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:06.992195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Getting quotas for project 733c772be3394dc98abd7d2f740ec890. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:07.056306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Getting quotas for user de660ed43ffe4456aae3ac3262602b9e and project 733c772be3394dc98abd7d2f740ec890. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:07.130743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:07.143677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:07.145944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:33:07.148732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:33:07.150808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:07.152344 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-55375579-5d6a-4f67-982d-bdafb5a8e113 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 0.544264 Aug 21 01:33:07.165176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2324/5269] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:06 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:07.325127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85c959b7-fe48-4021-beae-b1fdeeae78b3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832565 Aug 21 01:33:07.326189 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2946/5270] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:33:07.337775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa21ee89-bf77-439c-bf36-1bd85e43c474 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:07.338468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa21ee89-bf77-439c-bf36-1bd85e43c474 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:07.726549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fa21ee89-bf77-439c-bf36-1bd85e43c474 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:07.741079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa21ee89-bf77-439c-bf36-1bd85e43c474 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1214 microversion: 2.1 time: 0.407576 Aug 21 01:33:07.741678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2325/5271] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:07 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:08.183245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:08.184073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:08.235320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:08.237506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:08.242627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:08.252518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:08.255645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:08.257316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:08.770156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:08.771724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:08.802329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:08.804392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:08.806345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:08.809433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:08.820263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:08.821314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:09.210806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:09.233880 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9ddf977-3a5e-4fcc-96ed-551f6feb0c01 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1210 microversion: 2.1 time: 0.470967 Aug 21 01:33:09.260852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2326/5272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:08 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1210 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:09.684216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:09.743443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:09.754569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:09.765776 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca216052-0f43-4279-8653-219a7b993057 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1808 microversion: 2.20 time: 1.579990 Aug 21 01:33:09.767944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2947/5273] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:08 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1808 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:10.259255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:10.260751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:10.275870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:10.276983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:10.283046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:10.284227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:10.286458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:10.287504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:10.658217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:10.683571 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3eeb4d15-9e91-4b14-8fd2-6b7a47510608 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1272 microversion: 2.1 time: 0.429040 Aug 21 01:33:10.685009 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2327/5274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:10 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:10.796624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:10.797665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:10.826337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:10.827410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:10.829131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:10.841687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:10.842177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:10.848351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:11.713551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:11.714860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:11.732943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:11.736222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:11.737059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:11.738626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:11.740969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:11.741629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:11.905181 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:11.922042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:11.930812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:11.936465 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7dd91a0a-355b-47ab-a97a-74d3f6c2c6e4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1795 microversion: 2.20 time: 1.144591 Aug 21 01:33:11.939433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2948/5275] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:10 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1795 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:12.037577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:12.056342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1bdc405-6c2c-4530-997e-9f34bdc5c122 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1272 microversion: 2.1 time: 0.349187 Aug 21 01:33:12.059593 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2328/5276] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:11 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:13.082718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:13.083552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:13.105875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:13.106619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:13.107275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:13.108029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:13.108490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:13.108972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:13.377365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86d13b37-f9e2-4188-9bde-1ceac085c799 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc4030c1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1286620388", "description": "tempest-description-132090616"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:13.847161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:13.859923 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72e8a577-997a-48ea-a2b7-153d57e37338 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.780989 Aug 21 01:33:13.860537 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2329/5277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:13 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:13.938546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86d13b37-f9e2-4188-9bde-1ceac085c799 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.161175 Aug 21 01:33:13.939203 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2949/5278] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:13.960305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5616c68b-0f75-47db-a9e0-91a8e590d2fc tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc40327e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1491691295", "description": "tempest-description-2047159733"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:14.524652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52175d51-b206-4425-8725-4036f09a32fe", "tag": "a6091a31-9532-488d-aa70-fd22c99effce"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:14.554760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:14.555183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:14.555616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:14.594192 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] Creating event network-changed:a6091a31-9532-488d-aa70-fd22c99effce for instance 52175d51-b206-4425-8725-4036f09a32fe on n-h2-master-1 Aug 21 01:33:14.608912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d2ebe758-6e34-492d-9da9-131e19a3a777 req-fe7bec4b-fd93-4821-b3a2-9bdd5abedf12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089564 Aug 21 01:33:14.610719 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2950/5279] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 21 01:33:14.883414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:14.884125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:14.897386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5616c68b-0f75-47db-a9e0-91a8e590d2fc tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.949332 Aug 21 01:33:14.898065 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2330/5280] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:14.903318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:14.903820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:14.904255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:14.905025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:14.905472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:14.917365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:14.988823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-327274730", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "f29829d4-6e3a-4689-a7ca-2d688b67b933"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:15.154942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] validate_networks() for [('f29829d4-6e3a-4689-a7ca-2d688b67b933', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:33:15.825764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:15.849263 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86f9c409-c1dc-4bad-8ae7-a5838f0bfdd3 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.970303 Aug 21 01:33:15.861713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2951/5281] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:14 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:16.510697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:33:16.511867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:33:16.512549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:33:16.513209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:33:16.513661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:33:16.534395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:16.534895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:16.535337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:16.536976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:16.537452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:16.537877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:16.571821 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Getting quotas for project 910d1339e7a24cfd863d2c04610a7b1b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:16.578928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Getting quotas for user 521136ba1dcc454292aaa65a23b2be68 and project 910d1339e7a24cfd863d2c04610a7b1b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:16.598710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:33:16.601163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:33:16.643500 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:16.715898 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cd2a8558-6f75-4f58-862a-28240626ea64 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731935 Aug 21 01:33:16.717283 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2331/5282] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:33:16.729236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2a44ed7-e2b9-4808-88f7-9a268aa85331 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:16.733740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a2a44ed7-e2b9-4808-88f7-9a268aa85331 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:16.872474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:16.873380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:16.891843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:16.892256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:16.892700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:16.901555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:16.902072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:16.902560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:16.953908 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:16.992599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2a44ed7-e2b9-4808-88f7-9a268aa85331 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:17.035686 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2a44ed7-e2b9-4808-88f7-9a268aa85331 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1215 microversion: 2.1 time: 0.306965 Aug 21 01:33:17.036455 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2952/5283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:16 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:17.339952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:17.355095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-433bc750-6aad-4d56-91a6-1de450fda9b7 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.485080 Aug 21 01:33:17.363518 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2332/5284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:16 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:18.065034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:18.066207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:18.088944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:18.092721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:18.094891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:18.099040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:18.102833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:18.106133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:18.384003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:18.384604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:18.415556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:18.417250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:18.420992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:18.422789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:18.423714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:18.424375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:18.959260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:18.968292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c206b2c7-f652-43e2-a4f5-bd93e2735227 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.588173 Aug 21 01:33:18.988637 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2333/5285] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:18 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:19.029104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:19.041221 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55c86ea0-5f98-484b-92df-2e1b917beffa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1267 microversion: 2.1 time: 0.984527 Aug 21 01:33:19.044002 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2953/5286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:18 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1267 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:19.990031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:19.993141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:20.009687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:20.010188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:20.010635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:20.011820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:20.017122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:20.017870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:20.065988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:20.067585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:20.074869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:20.102216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:20.112756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:20.124542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:20.129296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:20.129964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:20.694284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:20.705532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2bfea8fe-ed81-4c7b-b0c3-1c8aa7ac8c57 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.644328 Aug 21 01:33:20.733936 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2954/5287] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:20 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:21.219247 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:21.230064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c82f5e9c-914d-4f7e-9651-6d4ae9796926 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 1.244659 Aug 21 01:33:21.246162 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2334/5288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:19 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:21.728604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:21.729440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:21.743142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:21.743638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:21.744072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:21.744823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:21.745272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:21.745690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:22.251854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:22.253570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:22.280102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:22.287133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:22.288436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:22.292173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:22.295582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:22.299440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:22.571456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:22.588390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f502831-d114-4706-a1e4-6489f44e4c34 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.864302 Aug 21 01:33:22.595448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2955/5289] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:21 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:22.617605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1ac0e-0532-40f0-892a-a5d368004a40", "tag": "61d3fb21-23b0-49c2-b939-dc4cd28231d9"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:22.662427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:22.663300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:22.664066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:22.686809 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] Creating event network-changed:61d3fb21-23b0-49c2-b939-dc4cd28231d9 for instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 on n-h1-master-1 Aug 21 01:33:22.702397 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2596f373-8763-4cfc-912a-ea88a7ca048a req-57576382-c8bc-4653-8263-3265225abad6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095991 Aug 21 01:33:22.714563 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2956/5290] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:22.871505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2826d9b2-5d9a-4939-99e1-b82d004a6701 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: .version_select at 0x7fc3f938b5e0>, body: {"keypair": {"name": "tempest-keypair-20368198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUUMJfqk37TFPTarTGeDFbrkiBT4EaLGHVY6jmMtlmpo2sJScsBgOcoUpi+M8btHRchUq9C8HsbEZpUjazLwwfmh6HKf4unodTIWEkVz9mB8XXUwoboBL9yPCCRqIaxig=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:22.931708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2826d9b2-5d9a-4939-99e1-b82d004a6701 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:22.945769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2826d9b2-5d9a-4939-99e1-b82d004a6701 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:22.959060 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:23.015735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2826d9b2-5d9a-4939-99e1-b82d004a6701 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.155437 Aug 21 01:33:23.017451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2957/5291] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:33:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:33:23.054611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:23.071160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-789224a0-e251-4305-840d-f0be00b49564 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.823324 Aug 21 01:33:23.073500 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2335/5292] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:22 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:23.461418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52175d51-b206-4425-8725-4036f09a32fe", "name": "network-vif-plugged", "status": "completed", "tag": "a6091a31-9532-488d-aa70-fd22c99effce"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:23.478028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:23.478657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:23.479208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:23.529491 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] Creating event network-vif-plugged:a6091a31-9532-488d-aa70-fd22c99effce for instance 52175d51-b206-4425-8725-4036f09a32fe on n-h2-master-1 Aug 21 01:33:23.547518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c94ccb7a-e260-409e-8c92-5cbaf1aa08eb req-6c5f0eba-6c1a-4570-8d88-de08bfe542b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093178 Aug 21 01:33:23.557486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2958/5293] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:23.626070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:23.628295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:23.638590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:23.641349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:23.642463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:23.643373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:23.644281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:23.644891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:23.978934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:24.005671 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d65a33f9-ff2b-48c2-aeee-06ad1a2cf27d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.383650 Aug 21 01:33:24.006560 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2336/5294] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:23 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:24.096160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:24.097640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:24.110842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:24.112917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:24.114189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:24.123769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:24.124675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:24.125353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:24.682172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:24.695020 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96e65fb4-fa88-4dcc-84c6-675e2d314d00 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1314 microversion: 2.1 time: 0.604230 Aug 21 01:33:24.696240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2959/5295] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:24 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:25.028566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:25.029868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:25.048107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:25.048602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:25.049064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:25.063572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:25.068695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:25.069455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:25.485303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:25.495075 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ab632f6-7fbd-48d3-ac4e-d0d8e3333703 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.471599 Aug 21 01:33:25.517762 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2337/5296] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:25 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:25.727035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:25.727652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:25.741943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:25.742439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:25.745318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:25.748918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:25.749871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:25.750478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:26.362861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:26.391672 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9adde525-e281-4e29-812a-0c4e68da2876 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1498 microversion: 2.1 time: 0.668978 Aug 21 01:33:26.413030 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2960/5297] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:25 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1498 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:26.533610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:26.534350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:26.545667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:26.546483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:26.546928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:26.547644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:26.548099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:26.548517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:26.581420 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:26.591579 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:27.277969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:27.288160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c7c7240-e4b8-4abf-a0e4-4462b0e67a16 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.761937 Aug 21 01:33:27.293408 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2338/5298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:26 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:27.364945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:27.365447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:27.411146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:27.411759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:27.413348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:27.414975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:27.415435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:27.417170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:27.475272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:33:27.670131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d3ba20c-240c-44ac-bbf0-bfd932438671 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "DELETE /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 204 len: 0 microversion: 2.1 time: 0.312953 Aug 21 01:33:27.674353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2961/5299] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:33:27 2022] DELETE /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:33:27.686763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:27.687862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:27.714734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:27.715275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:27.715722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:27.718874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:27.719353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:27.722156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:28.088733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab1ac0e-0532-40f0-892a-a5d368004a40", "name": "network-vif-plugged", "status": "completed", "tag": "61d3fb21-23b0-49c2-b939-dc4cd28231d9"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:28.115949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:28.117965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:28.119556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:28.177746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:28.187212 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] Creating event network-vif-plugged:61d3fb21-23b0-49c2-b939-dc4cd28231d9 for instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 on n-h1-master-1 Aug 21 01:33:28.191401 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4fbf3b1-a8a6-4d30-8ca2-491eff0245d0 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1504 microversion: 2.1 time: 0.515381 Aug 21 01:33:28.194211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2339/5300] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:27 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:28.213846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0dc9a72e-440f-4482-ad37-1c2b3394b227 req-6664fd30-4521-494c-b7af-d6ac134922c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126569 Aug 21 01:33:28.219214 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2962/5301] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:33:28.312687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:28.313508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:28.322134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:28.326715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:28.327205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:28.328349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:28.329271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:28.329964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:28.373535 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:28.691524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-492907805", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cb5e4a9-bcd5-4245-8211-d0350dfa789c"}], "security_groups": [{"name": "tempest-securitygroup--1467621541"}], "key_name": "tempest-keypair-20368198", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:29.163724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:29.179384 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-547119c6-7f51-48ec-bf78-a46681f74b77 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.870636 Aug 21 01:33:29.182205 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2340/5302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:28 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:29.220068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:29.221036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:29.231612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] validate_networks() for [('4cb5e4a9-bcd5-4245-8211-d0350dfa789c', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:33:29.233383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:29.234144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:29.235316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:29.236822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:29.237761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:29.239167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:29.718745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:29.732015 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-429bda80-05f5-4ac2-9a8a-1eb31fd86063 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1504 microversion: 2.1 time: 0.516444 Aug 21 01:33:29.739111 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2341/5303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:29 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:30.202314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:30.203049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:30.216156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.217936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.219509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:30.220503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.223714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.224244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:30.266706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:33:30.267720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:33:30.268373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:33:30.269337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:33:30.269914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:33:30.285450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.289538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.290186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:30.291347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.297614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.298320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:30.345527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:30.351908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:30.381107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:33:30.383541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:33:30.490508 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef72a1eb-f8d0-4a5d-8a80-09ca700113db tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.801991 Aug 21 01:33:30.492893 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2963/5304] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:33:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:33:30.504656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7abffafd-e24c-4c74-947c-f29fecda383d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:30.505298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7abffafd-e24c-4c74-947c-f29fecda383d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:30.791789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7abffafd-e24c-4c74-947c-f29fecda383d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:30.803255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7abffafd-e24c-4c74-947c-f29fecda383d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1239 microversion: 2.1 time: 0.302463 Aug 21 01:33:30.808474 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2964/5305] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:30 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1239 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:30.823025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:30.829614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:30.854843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.856337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.858771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:30.860553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:30.863147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:30.870592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:31.100438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de660ed43ffe4456aae3ac3262602b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c772be3394dc98abd7d2f740ec890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:31.132081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8bd1692-d94d-45dc-ac2f-e3f702f17721 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 200 len: 1462 microversion: 2.1 time: 0.310318 Aug 21 01:33:31.132081 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2965/5306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:30 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:31.174396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:31.186128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88860c2a-d013-4ae4-919e-d18d76528ef3 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1315 microversion: 2.1 time: 0.989377 Aug 21 01:33:31.186734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2342/5307] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:30 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:31.375087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52175d51-b206-4425-8725-4036f09a32fe", "name": "network-vif-deleted", "tag": "a6091a31-9532-488d-aa70-fd22c99effce"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:31.422555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:31.423233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:31.423653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:31.477548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] Creating event network-vif-deleted:a6091a31-9532-488d-aa70-fd22c99effce for instance 52175d51-b206-4425-8725-4036f09a32fe on n-h2-master-1 Aug 21 01:33:31.495922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0b5975f3-c92b-411a-975b-98a9744c4946 req-bc10104d-0bf7-4a75-adb9-8871d75b776c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359410 Aug 21 01:33:31.499437 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2966/5308] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:31.830453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:31.831176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:31.842501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:31.842998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:31.843433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:31.844145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:31.844597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:31.845039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:32.021158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:32.036247 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04d1d546-3ae2-450a-9eda-b3e130f2c89a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1235 microversion: 2.1 time: 0.211480 Aug 21 01:33:32.050637 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2343/5309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:31 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1235 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:32.154181 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:32.154890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] [instance: 52175d51-b206-4425-8725-4036f09a32fe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:32.167834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:32.168330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:32.168821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:32.169522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:32.169991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:32.170417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:32.213211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:32.214217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:32.214621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] HTTP exception thrown: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Request method failure captured: Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe HTTP/1.1 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsuS1fJ1Q7Mt4hLY77jbMwjtMufWGo1lfJHokbfOYq4aSi458RZmk50G_nntXSSAL-mOqSHcJdmSlqBhWBApohAIkwIgKV7AWJriBg5B-p-6NcgFGhmvBXxkFdlkcyccnP9YTK1XFebmPoxH1le2BnfLev0kmkNhjImkLu9wumXEno Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 733c772be3394dc98abd7d2f740ec890 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/733c772be3394dc98abd7d2f740ec890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_733c772be3394dc98abd7d2f740ec890", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/733c772be3394dc98abd7d2f740ec890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/733c772be3394dc98abd7d2f740ec890"}]}] Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 733c772be3394dc98abd7d2f740ec890 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesActionsTest-1009621533 Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesActionsTest-1009621533-project Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: de660ed43ffe4456aae3ac3262602b9e Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesActionsTest-1009621533-project Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '52175d51-b206-4425-8725-4036f09a32fe'} Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:32.216348 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. Aug 21 01:33:32.221201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:33:32.224273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:32.228483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:32.229020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:32.229764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] Returning 404 to user: Instance 52175d51-b206-4425-8725-4036f09a32fe could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:32.229911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:32.230506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:32.231041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:32.231832 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2651f0c4-bc48-4d86-90b7-43d085996d17 tempest-VolumesActionsTest-1009621533 tempest-VolumesActionsTest-1009621533-project] 10.222.0.46 "GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe" status: 404 len: 111 microversion: 2.1 time: 0.082478 Aug 21 01:33:32.242064 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2967/5310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:32 2022] GET /compute/v2.1/servers/52175d51-b206-4425-8725-4036f09a32fe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:33.058885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:33.060382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:33.099923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:33.107016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:33.107945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:33.109109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:33.109810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:33.110511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:33.306625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:33.326374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-49d7753b-cff1-46ed-93fe-1a99927036bb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1504 microversion: 2.1 time: 1.117085 Aug 21 01:33:33.326735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:33.329048 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2344/5311] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:32 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1504 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:33.341759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1af08c8b-a565-480f-a236-295293c29ede tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1297 microversion: 2.1 time: 0.284841 Aug 21 01:33:33.351508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1286620388"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:33.352357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:33.361077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2968/5312] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:33 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1297 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:33.380409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:33.381203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:33.382667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:33.384450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:33.386587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:33.388622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:33.783035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Adding security group 9a728ede-8707-42ac-9738-bcf40e181eeb to port 61d3fb21-23b0-49c2-b939-dc4cd28231d9 Aug 21 01:33:34.387045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:34.388637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:34.398206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:34.403529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:34.404270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:34.405685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:34.407827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:34.409155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:34.427939 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:34.908901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:34.928434 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa7b1e1a-b13d-47e0-92a7-b65dfceaf480 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.562157 Aug 21 01:33:34.930898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2969/5313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:34 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:35.950552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:35.952798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:35.960640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:35.961143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:35.978251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:35.979100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:35.979481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:35.979904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:36.278457 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-835b614b-8d9b-4d99-850c-60a7930ef002 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/action" status: 202 len: 0 microversion: 2.1 time: 2.930719 Aug 21 01:33:36.281178 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2345/5314] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:33:33 2022] POST /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/action => generated 0 bytes in 2935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:36.301518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1491691295"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:36.303936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:36.339950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:36.342942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:36.349173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:36.353039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:36.354295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:36.356100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:36.875668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:36.887641 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7583b174-3ed1-46d4-a61e-c4773e9400bc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.941484 Aug 21 01:33:36.897254 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2970/5315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:35 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:36.905871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1ac0e-0532-40f0-892a-a5d368004a40", "tag": "61d3fb21-23b0-49c2-b939-dc4cd28231d9"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:36.949610 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Adding security group 8db4b3d9-cc73-433e-ad5e-22ec29fd039a to port 61d3fb21-23b0-49c2-b939-dc4cd28231d9 Aug 21 01:33:36.978265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:36.979632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:36.983160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:37.035587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] Creating event network-changed:61d3fb21-23b0-49c2-b939-dc4cd28231d9 for instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 on n-h1-master-1 Aug 21 01:33:37.051964 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6cf5c863-83e1-4a7d-be25-775aaf59a24b req-454805fd-94ec-49d3-8f8a-487bcf369e35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152995 Aug 21 01:33:37.073993 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2971/5316] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:37.175465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87407c97-fde2-40e6-a122-e67a22a2617b", "tag": "70468df7-3606-46d2-a1d1-389a31372724"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:37.250450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:37.251029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:37.251413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:37.278550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] Creating event network-changed:70468df7-3606-46d2-a1d1-389a31372724 for instance 87407c97-fde2-40e6-a122-e67a22a2617b on n-h2-master-1 Aug 21 01:33:37.291626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d222f9f1-fec3-4d8c-992c-d3694cf260e2 req-a628c53f-4692-4ff4-86d3-2854740eb78f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203556 Aug 21 01:33:37.292624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2972/5317] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:37.921230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:37.921924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:37.933651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:37.934071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:37.934522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:37.937263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:37.941569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:37.942068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:38.259909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:38.274692 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-849ea9ff-cc0c-4c79-a1a6-a839ef2076c5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.353846 Aug 21 01:33:38.274692 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2973/5318] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:37 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:38.527313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1355259208", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:38.646771 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:33:38.763818 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-89da3fc5-469a-46c3-b1ab-7a6c7b997d3c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/action" status: 202 len: 0 microversion: 2.1 time: 2.478307 Aug 21 01:33:38.764456 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2346/5319] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:33:36 2022] POST /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/action => generated 0 bytes in 2480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:38.773557 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:38.774055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:38.792166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:38.793166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:38.793842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:38.794788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:38.796338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:38.800400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:39.703410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f716ece-d07e-4eed-a209-e209cc7abf41 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.934551 Aug 21 01:33:39.704831 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2347/5320] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:33:38 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40/os-security-groups => generated 1158 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:39.710386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1ac0e-0532-40f0-892a-a5d368004a40", "tag": "61d3fb21-23b0-49c2-b939-dc4cd28231d9"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:39.754620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:39.755177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:39.755615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:39.807713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] Creating event network-changed:61d3fb21-23b0-49c2-b939-dc4cd28231d9 for instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 on n-h1-master-1 Aug 21 01:33:39.823160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e46db379-a422-4262-b8a0-d0410cc92dc2 req-f1e6d601-1748-45ea-b0ea-3d5608ef971c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116721 Aug 21 01:33:39.825748 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2348/5321] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:39.836593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:39.840334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:39.855028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:39.855537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:39.856102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:39.858824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:39.859394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:39.860637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:39.982779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:33:39.983274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:33:39.983651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:33:39.984053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:33:39.984456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:33:40.000098 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=21 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:40.010742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:40.011257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:40.011685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:40.012414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:40.037008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:40.037651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:40.104737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:40.147515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:40.197627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:33:40.203166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:33:40.395950 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5158090-7f6a-494c-8ecd-2c476c133b35 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120852 Aug 21 01:33:40.403721 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2974/5322] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:33:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:33:40.449828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35d18a30-2114-4ca5-90bd-6f45cde185cb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc40311f550>, body: {"security_group": {"name": " tempest-securitygroup -139001211 ", "description": "tempest-description-987192274"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:41.135009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:41.147500 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04ee2436-9d0a-4eea-9ce6-fa9930cc43a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 1.319556 Aug 21 01:33:41.153082 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2349/5323] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:39 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:41.169413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4fc96585-4a05-4d78-9dea-2cd4fdf09374 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:41.173619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4fc96585-4a05-4d78-9dea-2cd4fdf09374 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:41.456964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4fc96585-4a05-4d78-9dea-2cd4fdf09374 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:41.465104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4fc96585-4a05-4d78-9dea-2cd4fdf09374 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1193 microversion: 2.1 time: 0.310559 Aug 21 01:33:41.489169 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2350/5324] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:41 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1193 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:41.540848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:41.541628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:41.554513 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-35d18a30-2114-4ca5-90bd-6f45cde185cb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.149158 Aug 21 01:33:41.556353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2975/5325] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:40 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:41.570533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b9c3f4f-e15c-4fde-ac3e-4780b9d50a02 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9ef41f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:41.580276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:41.580865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:41.604005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:41.609353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:41.609753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:41.610187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:41.759640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3cf83bbb-0eb5-48ff-b1cd-5c04f1cb8f6d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments/ffd3ad10-490d-4c8e-879c-bc433fdd2333" status: 200 len: 194 microversion: 2.20 time: 0.264604 Aug 21 01:33:41.773740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b9c3f4f-e15c-4fde-ac3e-4780b9d50a02 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c" status: 200 len: 222 microversion: 2.1 time: 0.208583 Aug 21 01:33:41.774480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2976/5326] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:33:41 2022] GET /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c => generated 222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:41.785814 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2351/5327] 10.222.0.46 () {60 vars in 1454 bytes} [Sun Aug 21 01:33:41 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments/ffd3ad10-490d-4c8e-879c-bc433fdd2333 => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:41.787495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2112062a-1615-4677-98e0-b7cd88fc4842 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fa282dc0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:41.950644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:41.951261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:41.961802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:41.969688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:41.970505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:41.981026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:41.990413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:41.996863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:42.188378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lazy-loading 'services' on Instance uuid d1d362bd-347a-4615-94d8-891d6017d171 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:33:42.513705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d118775d-fc91-40cf-9a22-953cd4c79fdd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments/ffd3ad10-490d-4c8e-879c-bc433fdd2333" status: 202 len: 0 microversion: 2.20 time: 0.567149 Aug 21 01:33:42.516551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2352/5328] 10.222.0.46 () {60 vars in 1457 bytes} [Sun Aug 21 01:33:41 2022] DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments/ffd3ad10-490d-4c8e-879c-bc433fdd2333 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:33:42.544097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:42.546252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:42.572119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:42.573130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:42.574087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:42.577505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:42.578159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:42.583185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:42.963176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2112062a-1615-4677-98e0-b7cd88fc4842 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c" status: 202 len: 0 microversion: 2.1 time: 1.179793 Aug 21 01:33:42.964386 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2977/5329] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:33:41 2022] DELETE /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:42.971266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:42.973129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:43.015958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:43.016969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:43.018761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:43.019716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:43.021308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:43.040432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:43.163667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:43.181990 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ea92425-753f-4604-bb07-2a96e04856ef tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.663439 Aug 21 01:33:43.201037 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2353/5330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:42 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:43.223130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:43.241409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:43.270903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:43.271409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:43.278267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:43.280296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:43.282116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:43.285059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:43.465482 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80db372c-1000-4fe7-9810-2d08f341c6f8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.262382 Aug 21 01:33:43.476378 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2354/5331] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:43 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:43.499343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fe3e1af0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:43.542772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:43.560724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a294a52-9548-448b-94bc-e88fc16ae5a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1245 microversion: 2.1 time: 0.594393 Aug 21 01:33:43.568703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2978/5332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:42 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1245 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:43.700660 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:33:43.701690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:33:43.702453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.702453 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c HTTP/1.1 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '736bb70f-d0b6-48e0-a557-681ccfbd6c1c'} Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:33:43.705209 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] Aug 21 01:33:43.710534 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:43.715034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:33:43.715034 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-77b91c76-0fc7-4cd7-b327-3a59f01c97e5'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:43.716230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-227df207-7f2f-48f1-9e15-4c38c026306b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c" status: 404 len: 194 microversion: 2.1 time: 0.235409 Aug 21 01:33:43.717012 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2355/5333] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:33:43 2022] GET /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c => generated 194 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:43.727559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5e49640-3e30-447d-b25b-7476f1503379 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc3f9c5da60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-677244335", "description": "tempest-description-344151420"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:44.208610 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:44.209301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:44.263462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.268853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.273782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:44.278685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.296320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.296809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:44.610763 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5e49640-3e30-447d-b25b-7476f1503379 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.888358 Aug 21 01:33:44.611386 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2979/5334] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:43 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:44.617307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:44.622016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:44.662285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.665146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.665628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:44.666385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.666852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.667583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:44.789266 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fafd465-3110-4e8b-8eb3-f77e96266f75 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175572 Aug 21 01:33:44.789784 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2980/5335] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:44 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:44.814327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:44.814944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:44.840934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.842894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.845366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:44.856921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:44.858028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:44.859478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:45.043492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:45.070731 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a265b565-0e46-4312-a1c4-ac32533c27e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.855992 Aug 21 01:33:45.070731 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2356/5336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:44 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:45.097338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2d6d174-e84a-46ec-9f27-6111dd244f1b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc403283af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2113179785", "description": "tempest-description-658727789"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:45.102377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:45.114989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8fe13bd-0f46-4369-b1a9-d24299874efb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1251 microversion: 2.1 time: 0.324033 Aug 21 01:33:45.131833 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2981/5337] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:44 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1251 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:45.802468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:45.804895 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:45.817769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:45.828818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:45.831976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:45.836411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:45.841542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:45.844976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:45.902692 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d2d6d174-e84a-46ec-9f27-6111dd244f1b tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.834415 Aug 21 01:33:45.903504 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2357/5338] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:45.916211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5070559f-781b-4c27-bc9b-f0fdaf113a02 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc3fdcc88b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-143042440", "description": "tempest-description-459792452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:46.052432 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19088c71-63cf-419c-b15d-361a14cdb8ac tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.253960 Aug 21 01:33:46.061830 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2982/5339] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:45 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:33:46.091222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:46.096527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:46.139757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:46.145382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:46.147146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:46.148036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:46.149515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:46.150268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:46.379308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5070559f-781b-4c27-bc9b-f0fdaf113a02 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.467319 Aug 21 01:33:46.380332 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2358/5340] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:45 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:46.387624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:46.389351 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:46.411926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:46.412736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:46.413453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:46.415184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:46.417380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:46.418016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:46.828039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:46.842566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a354948d-f50d-4902-9459-1096a33bb5c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.755116 Aug 21 01:33:46.859316 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2983/5341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:46 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:46.878712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34627cc8-88d8-4365-b706-1e4458a16031 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fa2821f0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:47.033376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:47.050919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0c2a7dd-5858-41a7-82ea-ccc87a394798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.665633 Aug 21 01:33:47.053032 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2359/5342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:46 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:47.075593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:47.078838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:47.083292 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=53 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:47.096860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:47.098008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:47.099768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:47.100690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:47.101325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:47.102122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:47.233984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec85773c-42b1-45e8-b268-e9afe521c6e7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163297 Aug 21 01:33:47.236257 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2360/5343] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:47 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 21 01:33:47.866196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:47.867168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:47.889338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:47.890049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:47.906555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:47.907624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:47.913267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:47.914540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:47.921006 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34627cc8-88d8-4365-b706-1e4458a16031 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 1.060055 Aug 21 01:33:47.929642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2984/5344] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:33:46 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:47.950948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-95e9abc5-668c-4d13-be1f-051999f75d04 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc4030c1430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:48.596585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-95e9abc5-668c-4d13-be1f-051999f75d04 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1" status: 202 len: 0 microversion: 2.1 time: 0.658930 Aug 21 01:33:48.597479 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2985/5345] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:33:47 2022] DELETE /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:48.614924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:48.619029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:48.671525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:48.691465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:48.691914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:48.702403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:48.705443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:48.708702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:49.273528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:49.315541 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15ee9800-f170-4b98-b898-6cd75fe98a9a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.716376 Aug 21 01:33:49.335819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2986/5346] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:48 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:49.343494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:49.363448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:49.388987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:49.391856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:49.392332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:49.393107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:49.402532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:49.403027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:49.439513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:49.459413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5952c584-3107-44fe-b565-916d5ad412c1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 1.596399 Aug 21 01:33:49.490561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2361/5347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:47 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:49.506752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdc900d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:49.580375 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9dce2d42-eaf3-476d-9901-33928b5fe283 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.243295 Aug 21 01:33:49.581016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2987/5348] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:49 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:49.597414 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:33:49.598023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:33:49.598551 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.598551 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 HTTP/1.1 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '5c721cd1-3bf5-42fe-aac7-13e0767f0bf1'} Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:33:49.600407 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-328ac358-5cc2-47e6-8360-f06396bf0542'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bb2bcc6-39bf-450c-bf84-895ed5eb167f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1" status: 404 len: 194 microversion: 2.1 time: 0.110446 Aug 21 01:33:49.607154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2362/5349] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:33:49 2022] GET /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:49.610740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f9791b2-7c22-4296-860c-ed186bb4da82 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fd80fca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:49.621220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87407c97-fde2-40e6-a122-e67a22a2617b", "name": "network-vif-plugged", "status": "completed", "tag": "70468df7-3606-46d2-a1d1-389a31372724"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:49.659784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:49.660262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:49.660696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:49.703638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] Creating event network-vif-plugged:70468df7-3606-46d2-a1d1-389a31372724 for instance 87407c97-fde2-40e6-a122-e67a22a2617b on n-h2-master-1 Aug 21 01:33:49.716921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e3da0ebf-ce7b-4fac-adcb-37919eb6714d req-001931a0-feb9-4812-96de-b541efb610c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127900 Aug 21 01:33:49.721325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2988/5350] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:49.850055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b09348-5990-422e-ac54-2790744e847a", "tag": "149369af-1652-443f-9495-7d862ac3b90b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:49.949518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:49.952212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:49.953094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:50.002530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] Creating event network-changed:149369af-1652-443f-9495-7d862ac3b90b for instance f5b09348-5990-422e-ac54-2790744e847a on n-h2-master-1 Aug 21 01:33:50.009935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-822c852e-ff33-4ea2-9be3-e3b198148fb8 req-1d77ec5a-47c8-4014-91e6-a0597a64964c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174391 Aug 21 01:33:50.011224 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2989/5351] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:50.372013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:50.375226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:50.396945 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:50.397819 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=5 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:50.428733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:50.429309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:50.429752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:50.430633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:50.433716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:50.435068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:50.599620 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f9791b2-7c22-4296-860c-ed186bb4da82 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34" status: 202 len: 0 microversion: 2.1 time: 0.992550 Aug 21 01:33:50.603189 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2363/5352] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:33:49 2022] DELETE /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:50.605351 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:50.605966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:50.631220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:50.632476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:50.632966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:50.633671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:50.634144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:50.634566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:50.654229 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:51.224096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:51.241251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-666d63b7-2e0e-4b51-a52b-b44a802d118a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.884394 Aug 21 01:33:51.243534 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2990/5353] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:50 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:51.253032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:51.268445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:51.300589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:51.303037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:51.306846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:51.312795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:51.320547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:51.322527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:51.323777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:51.326217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-233e6a9e-bb35-49f6-bf24-6657e96af826 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1365 microversion: 2.1 time: 0.724476 Aug 21 01:33:51.326904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2364/5354] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:50 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1365 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:51.331721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdcc88b0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:51.373031 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffe07d7b-391d-459f-9f8f-208a2a65493c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127566 Aug 21 01:33:51.374528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2991/5355] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:51 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:51.414175 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:33:51.415023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:33:51.415830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.415830 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 HTTP/1.1 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2935ca2e-6d07-4ae0-b6ba-8330aa5eda34'} Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:33:51.418743 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] Aug 21 01:33:51.423255 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:51.433696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:33:51.433696 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-8d0bc1d6-3fda-40b9-a058-228c68e10dd5'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:51.440107 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-39a2f41a-68c8-48ca-b86e-6debe4c7b9ed tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34" status: 404 len: 194 microversion: 2.1 time: 0.111925 Aug 21 01:33:51.441249 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2365/5356] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:33:51 2022] GET /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:51.450007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c8779dd-6818-4570-81c5-f8c8498d3e21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fa166f70>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:52.262062 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:52.269490 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:52.270118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:52.301899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:52.302382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:52.311747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:52.321169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:52.324444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:52.324926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.041164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:53.058356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e1fdbb7-2e0d-4bfb-abfd-a55d463034c4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.795059 Aug 21 01:33:53.076714 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2366/5357] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:52 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:53.088792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:53.090160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:53.104996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.107417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.108444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.109753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.111771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.112862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.741958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:53.765520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da9545a8-9847-4f14-a5cb-7f20aeb6ad3b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1554 microversion: 2.1 time: 0.686287 Aug 21 01:33:53.767833 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2367/5358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:53 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1554 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:53.774237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:53.778546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:53.790145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.791322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.792917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.794424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.796439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.798225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.871143 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-31fb780d-e86b-401d-bdcc-079c34df8042 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101856 Aug 21 01:33:53.874703 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2368/5359] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:53 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:53.882428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:53.889314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:53.905198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.910470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.912147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:53.923645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:53.926140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:53.930148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:54.091454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c8779dd-6818-4570-81c5-f8c8498d3e21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc" status: 202 len: 0 microversion: 2.1 time: 2.645867 Aug 21 01:33:54.092826 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2992/5360] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:33:51 2022] DELETE /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc => generated 0 bytes in 2648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:33:54.097715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:54.098561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:54.116455 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:54.145099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:54.153046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:54.161106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:54.164022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:54.168451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:54.171044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:54.218151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6d45b63-d89e-4d2c-8349-d9b965f6f496 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.339627 Aug 21 01:33:54.228303 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2369/5361] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:33:53 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/os-interface => generated 284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:54.233858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fde4fa60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:54.335507 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:33:54.336345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 32124e13-8cb0-476e-a563-9db5c16303bc not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:33:54.337098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.337098 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc HTTP/1.1 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '32124e13-8cb0-476e-a563-9db5c16303bc'} Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:33:54.339887 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] Aug 21 01:33:54.345172 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:33:54.350782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:33:54.350782 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-67c95ce3-e0f3-4bb6-bc06-f65ca2f2f84f'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:33:54.350782 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-015e13b0-687e-40d7-a853-e028a8a39c8a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc" status: 404 len: 194 microversion: 2.1 time: 0.120623 Aug 21 01:33:54.350782 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2370/5362] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:33:54 2022] GET /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:33:54.360686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-edff4573-98c6-41a7-90ae-2af7a631c731 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdca70d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:54.821300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:54.835548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b74ec274-6012-4b3f-8b66-72fcb6d8c29e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.741443 Aug 21 01:33:54.836506 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2993/5363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:54 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:55.027100 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-edff4573-98c6-41a7-90ae-2af7a631c731 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.670268 Aug 21 01:33:55.028676 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2371/5364] 10.222.0.46 () {58 vars in 1158 bytes} [Sun Aug 21 01:33:54 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:55.044224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d6d8976-86ab-410a-8639-18cb836e42b0 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc3fde4f550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1155445871", "description": "tempest-description-931605190"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:55.501765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d6d8976-86ab-410a-8639-18cb836e42b0 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.461564 Aug 21 01:33:55.516180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2372/5365] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:33:55.527654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bd73210-a4c1-4261-a20a-5585d7872c43 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc3fda00940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1583662931", "description": "tempest-description-1289178244"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:55.562387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:55.564620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:55.585635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:55.586461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:55.586745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:55.587244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:55.587693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:55.588300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:55.697139 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-090249d3-1070-44e6-b214-587d09326412 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.812736 Aug 21 01:33:55.703796 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2994/5366] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:54 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 197 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:33:55.866251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:55.867357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:55.883537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:55.884456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:55.886686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:55.887846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:55.890231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:55.890861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:56.064824 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bd73210-a4c1-4261-a20a-5585d7872c43 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.547049 Aug 21 01:33:56.067372 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2373/5367] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:33:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:56.504219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-174513061", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "f29829d4-6e3a-4689-a7ca-2d688b67b933"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:56.645675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] validate_networks() for [('f29829d4-6e3a-4689-a7ca-2d688b67b933', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:33:56.718878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:56.739374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25756b17-7edb-4667-9bcd-1913150ccb20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.877201 Aug 21 01:33:56.757904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2995/5368] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:55 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:56.771856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:56.777214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:56.798026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:56.799887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:56.803434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:56.804503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:56.807477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:56.808155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:56.821031 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:33:56.892851 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-79706a46-1e14-448b-8035-6c5ae1004699 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.133297 Aug 21 01:33:56.902294 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2996/5369] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:33:56 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:57.036109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:57.036704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:57.084591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.085134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.085554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:57.101230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.103305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.104055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:57.149543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:33:57.298144 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c8b490c-ea78-4e55-9c7d-daa4797ffde9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 204 len: 0 microversion: 2.20 time: 0.276473 Aug 21 01:33:57.302357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2997/5370] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:33:57 2022] DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:33:57.317820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:57.319225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:57.331917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.333924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.334564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:57.335464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.336161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.339357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:57.754710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:57.770801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:57.772752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:57.779305 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-323523cb-94b8-4176-8b7c-57f550a5f400 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.473880 Aug 21 01:33:57.780179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2998/5371] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:57 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:33:57.803035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:57.805517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:57.817690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.818600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.819273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:57.820287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:57.820991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:57.821645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.023179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:33:58.024414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:33:58.025064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:33:58.025960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:33:58.026654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:33:58.110645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:58.114323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:58.116324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.120893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:58.131481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:58.132291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.257601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Getting quotas for project 910d1339e7a24cfd863d2c04610a7b1b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:33:58.285695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Getting quotas for user 521136ba1dcc454292aaa65a23b2be68 and project 910d1339e7a24cfd863d2c04610a7b1b. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:33:58.312715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:33:58.323528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:33:58.345275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:58.356171 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-685aa46f-d041-4f89-9e9c-55358ccece5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.561243 Aug 21 01:33:58.356789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 2999/5372] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:57 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:33:58.374138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87407c97-fde2-40e6-a122-e67a22a2617b", "tag": "70468df7-3606-46d2-a1d1-389a31372724"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:33:58.421183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:58.421659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:58.422091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.431892 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f68672eb-fd04-429f-ab05-98f9397d85e7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932060 Aug 21 01:33:58.433149 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2374/5373] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:33:58.445464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b59e5bd3-9a49-4c02-bd97-dafa0fa00fad tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:58.451598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b59e5bd3-9a49-4c02-bd97-dafa0fa00fad tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:58.468218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] Creating event network-changed:70468df7-3606-46d2-a1d1-389a31372724 for instance 87407c97-fde2-40e6-a122-e67a22a2617b on n-h2-master-1 Aug 21 01:33:58.481177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bf2a4593-cd85-458e-83a2-cdfe20556a20 req-07086ba2-e598-4eec-bcb4-a74a87979ce5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122881 Aug 21 01:33:58.483000 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3000/5374] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:33:58.814153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:58.814153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:58.841671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:58.843222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:58.846202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.849186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:58.857308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:58.858497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:58.922470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b59e5bd3-9a49-4c02-bd97-dafa0fa00fad tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:58.935417 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b59e5bd3-9a49-4c02-bd97-dafa0fa00fad tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1215 microversion: 2.1 time: 0.495042 Aug 21 01:33:58.937827 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2375/5375] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:58 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1215 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:33:59.308715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:59.327168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:59.330799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:33:59.339420 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6b0b1b7-5b51-4748-8d94-1272ae362628 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.536404 Aug 21 01:33:59.340971 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3001/5376] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:33:58 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:33:59.378570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:59.379307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:59.390648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:59.396147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:59.400628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:59.401914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:59.402680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:59.404754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:33:59.960580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:33:59.962795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:33:59.975764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:33:59.979224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:33:59.987500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:00.014065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:00.026925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:00.027956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:00.377423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:00.389454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81271452-daba-41a9-b3d0-b40a0a55ca88 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1267 microversion: 2.1 time: 0.432978 Aug 21 01:34:00.395229 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3002/5377] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:59 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1267 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:00.410121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:00.410749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:00.427331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:00.428526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:00.430152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:00.431633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:00.434963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:00.435821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:00.441041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:00.459765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cedf6567-c102-4408-99f5-036cc3e8d22f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 1.086957 Aug 21 01:34:00.467134 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2376/5378] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:33:59 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:00.827009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:00.847169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:00.853914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:00.861207 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b78c7cc5-96f1-4597-84f2-65edaf0d51a6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 0.464831 Aug 21 01:34:00.877388 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3003/5379] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:00 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:01.418595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:01.419180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:01.452497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.464446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.468636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:01.470522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.478904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.488069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:01.489783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:01.490890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:01.507272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.520759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.521259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:01.522026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.522635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.522916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:01.746012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:01.754089 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e17f7888-a031-407b-9893-020184f5b96d tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1273 microversion: 2.1 time: 0.339633 Aug 21 01:34:01.773217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2377/5380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:01 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:01.939409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:01.940239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:01.967319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.970057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.971583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:01.979781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:01.993766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:01.997421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:02.202936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:02.214750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d26c09b1-2961-48d6-86cf-f02e3d26dc29 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.729129 Aug 21 01:34:02.218743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3004/5381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:01 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:02.785219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:02.786731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:02.802246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:02.814969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:02.815710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:02.817596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:02.819447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:02.820187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:03.791171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:03.823326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c50a09a-36d9-45f3-90f5-73ab2c6bb4e1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1273 microversion: 2.1 time: 1.041947 Aug 21 01:34:03.837950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3005/5382] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:02 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1273 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:03.859173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:03.865505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:03.883618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:03.884348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:03.884969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:03.885892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:03.889283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:03.889946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:04.594404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:04.627889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:04.655239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1b7f284-f0a0-4d90-a263-94ba1006d7ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.810845 Aug 21 01:34:04.672167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:04.674182 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3006/5383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:03 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:04.696310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b09348-5990-422e-ac54-2790744e847a", "name": "network-vif-plugged", "status": "completed", "tag": "149369af-1652-443f-9495-7d862ac3b90b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:04.712266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:04.724386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6e089de-565b-4760-b271-de84509b9cdb tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1723 microversion: 2.20 time: 2.791405 Aug 21 01:34:04.731280 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2378/5384] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:01 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1723 bytes in 2805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:34:04.752604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:04.753142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:04.753608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:04.808687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] Creating event network-vif-plugged:149369af-1652-443f-9495-7d862ac3b90b for instance f5b09348-5990-422e-ac54-2790744e847a on n-h2-master-1 Aug 21 01:34:04.836121 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-14eb9207-ad26-4f18-980b-216974667156 req-c14f0fee-b415-4321-aa03-aaa21d243a2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155514 Aug 21 01:34:04.840539 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3007/5385] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:04.847230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:04.849088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:04.866437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:04.874794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:04.877333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:04.878375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:04.879082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:04.881670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:05.685605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:05.687273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:05.711975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:05.723346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:05.725953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:05.727375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:05.732352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:05.735317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:06.378462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:06.397076 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36434bd9-1c0e-4ee8-82b9-7f24c5c2b928 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 0.720119 Aug 21 01:34:06.398090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3008/5386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:05 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:06.408562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:06.413120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:06.434601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:06.435343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:06.435916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:06.441665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:06.442708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:06.445357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:06.747863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:06.748809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:06.761074 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b917d94-1b54-46e3-a406-eee16d8ff7eb tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1273 microversion: 2.1 time: 1.919408 Aug 21 01:34:06.782661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2379/5387] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:04 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1273 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:06.812991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:06.820215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:06.829588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60ea7b61-6bfc-4540-9712-c10a231e42a7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 200 len: 1656 microversion: 2.20 time: 0.427780 Aug 21 01:34:06.833060 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3009/5388] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:06 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 1656 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:06.982079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d362bd-347a-4615-94d8-891d6017d171", "name": "network-vif-deleted", "tag": "007ab3cf-e68f-48fe-8254-d6575b8e12c0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:07.002616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:07.003096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:07.003528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:07.076711 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] Creating event network-vif-deleted:007ab3cf-e68f-48fe-8254-d6575b8e12c0 for instance d1d362bd-347a-4615-94d8-891d6017d171 on n-h1-master-1 Aug 21 01:34:07.101668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b6e020a9-b497-4875-a153-d09a2fb1084c req-e3871862-951b-4886-8185-799141e5b744 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124200 Aug 21 01:34:07.109095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2380/5389] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:07.422304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:07.422718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:07.444594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:07.445111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:07.445541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:07.452185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:07.453201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:07.453301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:07.789541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:07.791496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:07.808729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:07.809456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:07.809909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:07.810609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:07.811065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:07.814967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:08.192304 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:08.406136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:08.411235 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32cb3df3-ae2f-4d7b-aa18-f11b6b73161c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.627373 Aug 21 01:34:08.419358 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2381/5390] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:07 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:08.429083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:08.429999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:08.445875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:08.450484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:08.452525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:08.460458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:08.462786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:08.465198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:08.482712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:08.501558 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0451b10-8f66-4093-b6e6-aa9f9aa7055a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1293 microversion: 2.1 time: 1.082203 Aug 21 01:34:08.531414 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3010/5391] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:07 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1293 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:08.548718 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 HTTP/1.1 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd1d362bd-347a-4615-94d8-891d6017d171'} Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:08.551235 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:34:08.554913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:08.556813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:08.558961 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36c525e0-cbeb-482f-ab99-333628e950b8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 404 len: 111 microversion: 2.20 time: 0.137237 Aug 21 01:34:08.560143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2382/5392] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:08 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:34:08.571941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5b1d99f-e0fa-47e1-9532-7d65d5ee564c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '.version_select at 0x7fc3f9e90280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:08.624326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5b1d99f-e0fa-47e1-9532-7d65d5ee564c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907058602" status: 204 len: 0 microversion: 2.20 time: 0.059788 Aug 21 01:34:08.627499 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3011/5393] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907058602 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:34:09.442023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:09.443248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:09.451819 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:09.457351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:09.458974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:09.460213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:09.463121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:09.465261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:09.466036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:09.533811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:09.535874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:09.561534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:09.563820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:09.566465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:09.571616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:09.575065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:09.579379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:10.080618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:10.098618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8f23baf-c3fe-4edd-b0b7-15a245d475b4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.659607 Aug 21 01:34:10.104120 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2383/5394] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:09 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:10.950800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:10.971748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42a4e398-2daa-4daa-99b1-9d31b44ace94 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1474 microversion: 2.1 time: 1.442946 Aug 21 01:34:10.972939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3012/5395] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:09 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1474 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:10.992538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c8c62271-a960-4305-8e8e-5478420df43d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: .version_select at 0x7fc3fdf7a940>, body: {"keypair": {"name": "tempest-keypair-1587815751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwGsj8hrCj4k5Ial/Eq22z6y0oHWS6XfStI0z05wItXmB7GZMwpXb+vwfP2oaeNmzT24Q0jDUHdgDuOeDO2ins/gA1zhrP+2o/Rcaq1hOukaX+Xo0eXKXmJF5PNJDutkA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:11.062649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c8c62271-a960-4305-8e8e-5478420df43d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for project 22b84439bde64075ab7459b430b0e612. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:11.071398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-c8c62271-a960-4305-8e8e-5478420df43d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for user 61445b694d0c484c99648ec99f21a34a and project 22b84439bde64075ab7459b430b0e612. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:11.124095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:11.124713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:11.125224 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c8c62271-a960-4305-8e8e-5478420df43d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.151621 Aug 21 01:34:11.126906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2384/5396] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:34:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:34:11.142737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:11.143236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:11.143673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:11.144389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:11.156713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:11.159029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:11.204148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1219770189", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:11.227578 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:11.341214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:34:11.685511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:11.698101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-407cef96-5d3f-4bf5-8ced-0e94a962a920 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.577514 Aug 21 01:34:11.700822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3013/5397] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:11 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:11.712216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3e142e-6a06-4498-afce-151bc2f10635", "tag": "73c0b635-3dde-4ef7-94ae-abfe7bcec0fb"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:11.737725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:11.747786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:11.749671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:11.788014 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] Creating event network-changed:73c0b635-3dde-4ef7-94ae-abfe7bcec0fb for instance 3d3e142e-6a06-4498-afce-151bc2f10635 on n-h1-master-1 Aug 21 01:34:11.801249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-49cf6d21-2693-429f-b95a-b5cbb2136932 req-a56f93df-6e24-4ffa-bcd9-8680724bd3d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098737 Aug 21 01:34:11.802887 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3014/5398] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:12.723275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:12.726916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:12.748870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:12.752679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:12.757010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:12.762856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:12.764134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:12.764678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:13.165083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:13.176321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-313d1f49-d4ed-4091-b672-ea9354878de2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.459247 Aug 21 01:34:13.177691 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3015/5399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:12 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:13.246293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:34:13.247464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:34:13.248164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:34:13.249004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:34:13.249813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:34:13.265915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:13.269373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:13.270106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:13.271169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:13.271843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:13.274370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:13.322002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:13.338382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:13.371754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:34:13.383421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:34:13.495201 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb501bb0-4cce-4a35-bc90-e18ee02a3776 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.292771 Aug 21 01:34:13.498970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2385/5400] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:34:13.509452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:13.510627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:13.541789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:34:14.139197 n-d-master-1 devstack@n-api.service[122482]: INFO nova.scheduler.client.report [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Deleted allocations for instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 Aug 21 01:34:14.149561 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Instance Mapping does not exist while attempting local delete cleanup. Aug 21 01:34:14.151403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa7f83a4-dd65-4429-878d-5dce60c9b6b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201" status: 204 len: 0 microversion: 2.1 time: 0.647737 Aug 21 01:34:14.157867 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3016/5401] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:34:13 2022] DELETE /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:34:14.162338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:14.163551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:14.177448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 HTTP/1.1 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: exception: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'cbcb9e85-e4b4-424b-b478-227f1bd1c201'} Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:14.179622 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:14.183590 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:14.183590 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:14.183590 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:14.183590 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:34:14.183590 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:14.189149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:14.192158 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd706b12-08b3-48d7-ad15-de03734d1a70 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201" status: 404 len: 111 microversion: 2.1 time: 0.034411 Aug 21 01:34:14.196081 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2386/5402] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:14 2022] GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:14.211490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:14.214243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:14.241580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:14.242116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:14.242615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:14.243298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:14.243755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:14.244179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:14.327639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1448767", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:14.423484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:34:15.466644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:15.479497 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fda3c8f4-fb72-4778-9031-e19631e332df tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 1.283456 Aug 21 01:34:15.484676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3017/5403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:14 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:16.196079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:34:16.197026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:34:16.197892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:34:16.199484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:34:16.200419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:34:16.241872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:16.246820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:16.249589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:16.250554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:16.251162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:16.252761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:16.328525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:16.342696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:16.380560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:34:16.402618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:34:16.504746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:16.505457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:16.526659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:16.529396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:16.529856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:16.533538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:16.534044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:16.536757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:16.594161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b74d3be-550f-4cea-af93-0ad2aff73130 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.277268 Aug 21 01:34:16.595476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2387/5404] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:34:16.613929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f6057498-1f6d-45f5-b97e-a78da4ade849 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:16.629159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f6057498-1f6d-45f5-b97e-a78da4ade849 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:16.886963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f6057498-1f6d-45f5-b97e-a78da4ade849 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:16.895209 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f6057498-1f6d-45f5-b97e-a78da4ade849 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1218 microversion: 2.1 time: 0.293141 Aug 21 01:34:16.899289 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2388/5405] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:16 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:17.026044 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-517140077", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a2de5a34-25c8-417b-a28b-2cd78053fb82"}], "security_groups": [{"name": "tempest-securitygroup--1897973640"}], "key_name": "tempest-keypair-1587815751", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:17.053540 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:17.142986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:17.155302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1e605bd-886c-44b4-9f1c-eb5ff21917db tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.654592 Aug 21 01:34:17.156016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3018/5406] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:16 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:17.467543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] validate_networks() for [('a2de5a34-25c8-417b-a28b-2cd78053fb82', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:34:17.850969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e142e-6a06-4498-afce-151bc2f10635", "name": "network-vif-plugged", "status": "completed", "tag": "73c0b635-3dde-4ef7-94ae-abfe7bcec0fb"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:17.885593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:17.886195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:17.886624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:17.956108 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] Creating event network-vif-plugged:73c0b635-3dde-4ef7-94ae-abfe7bcec0fb for instance 3d3e142e-6a06-4498-afce-151bc2f10635 on n-h1-master-1 Aug 21 01:34:17.984098 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f3d6a0cb-d2c9-4ded-ba78-01fc3ac7ea2a req-9eee68d8-5c79-48b6-902a-1d3add768e80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138416 Aug 21 01:34:17.990575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3019/5407] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:34:18.005557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:18.012141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:18.043862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:18.047920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:18.048717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:18.049803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:18.050421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:18.050998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:18.262814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:18.278792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-45bf7850-e463-473b-8f2a-d0232f693a52 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1270 microversion: 2.1 time: 0.286152 Aug 21 01:34:18.283307 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3020/5408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:17 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:18.305802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:18.308546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:18.364880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:18.365350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:18.365791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:18.366508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:18.371696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:18.374478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:18.740293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:18.749905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-165709fa-46a3-4ffa-aad2-eadf4b9655b5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.460375 Aug 21 01:34:18.757320 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3021/5409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:18 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:19.304345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:19.304345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:19.345836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.346343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.346800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:19.347557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.348013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.348437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:19.602383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:34:19.602901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:34:19.603267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:34:19.605125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:34:19.605731 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:34:19.627261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.628534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.631310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:19.632268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.634513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.635157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:19.671233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for project 22b84439bde64075ab7459b430b0e612. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:19.677652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:19.691850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80256f79-ff66-43e6-945b-af6e21d6544b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1288 microversion: 2.1 time: 0.393889 Aug 21 01:34:19.692454 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3022/5410] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:19 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1288 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:19.711625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Getting quotas for user 61445b694d0c484c99648ec99f21a34a and project 22b84439bde64075ab7459b430b0e612. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:19.778563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:19.779132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:34:19.779266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:19.791662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.792142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.792571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:19.793326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:19.793778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:19.795075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:34:19.804682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:20.062353 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97d55996-999d-45e3-a617-e01b28ae1207 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.041586 Aug 21 01:34:20.063651 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2389/5411] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:34:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:34:20.075239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:20.078763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:20.284515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:20.296668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:20.303994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:20.313698 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-604bbe90-c90f-4e7d-a1e9-93e375bba2a5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1281 microversion: 2.20 time: 0.242887 Aug 21 01:34:20.328200 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2390/5412] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:20 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1281 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:20.452044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:20.474140 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0d7da44-08a3-4a9e-937a-64789bb2ad4f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1315 microversion: 2.1 time: 0.699854 Aug 21 01:34:20.477624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3023/5413] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:19 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:20.714573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:20.715802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:20.733492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:20.733802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:20.737818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:20.746114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:20.748730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:20.750404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:20.991202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:20.993727 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=79 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:21.001178 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6719559-90c2-4d5a-a7c3-fc58d51f3370 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1276 microversion: 2.1 time: 0.291743 Aug 21 01:34:21.006164 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2391/5414] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:20 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:21.339519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:21.340240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:21.496935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:21.497971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:21.522854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:21.523997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:21.527960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:21.530959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:21.536661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:21.538979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:21.592918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:21.616089 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:21.628206 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:21.633035 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8767cf7-3a53-4448-83d1-995d59b2add0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1281 microversion: 2.20 time: 0.294845 Aug 21 01:34:21.638599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3024/5415] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:21 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:22.027916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:22.029167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:22.046747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.047244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.049562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.052691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.062397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.062947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.211036 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:22.230511 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30d1f2f3-aa83-49bf-a3a4-3b80ba522c33 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1503 microversion: 2.1 time: 0.728234 Aug 21 01:34:22.246183 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2392/5416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:21 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1503 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:22.255990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1155445871"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:22.257456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:22.265574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.266296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.266910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.268338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.268988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.269566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.402459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:22.413185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-88328f9b-01ce-46d0-bcbc-38699fc6bb11 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.389839 Aug 21 01:34:22.428154 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3025/5417] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:22 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:22.658240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:22.658907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:22.668382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.669291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.670222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.671141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:22.671774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:22.672378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:22.829701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:22.851756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:22.856629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:22.870729 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Adding security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 to port 73c0b635-3dde-4ef7-94ae-abfe7bcec0fb Aug 21 01:34:22.874162 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-554d2fed-6ade-42d1-b87e-8d1aeb1177c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1333 microversion: 2.20 time: 0.220340 Aug 21 01:34:22.874770 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3026/5418] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:22 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1333 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:34:23.451488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:23.452115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:23.473132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:23.473705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:23.474125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:23.474839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:23.477356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:23.480878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:23.778527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:23.787819 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-058d98c8-73ea-4087-94ce-cc68d7c548cd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.342529 Aug 21 01:34:23.790554 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3027/5419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:23 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:23.900348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:23.901291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:23.912592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:23.914126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:23.914798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:23.917839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:23.920626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:23.921324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:24.155312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:24.180719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:24.187393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:24.190264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-606dd56a-1b17-4628-a62b-2cbfcbf0ffc7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1339 microversion: 2.20 time: 0.294127 Aug 21 01:34:24.196167 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3028/5420] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:23 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:24.459068 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-090e3494-e54b-4e3d-9ec4-779e77aa89ef tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action" status: 202 len: 0 microversion: 2.1 time: 2.209756 Aug 21 01:34:24.461375 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2393/5421] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:34:22 2022] POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action => generated 0 bytes in 2213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:34:24.474246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9e909d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:24.562870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3e142e-6a06-4498-afce-151bc2f10635", "tag": "73c0b635-3dde-4ef7-94ae-abfe7bcec0fb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:24.602458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:24.604489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:24.604489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:24.643847 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] Creating event network-changed:73c0b635-3dde-4ef7-94ae-abfe7bcec0fb for instance 3d3e142e-6a06-4498-afce-151bc2f10635 on n-h1-master-1 Aug 21 01:34:24.655708 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-602c3dea-d127-4289-8236-4a59e60fa6b6 req-ed2b0735-b03c-4f55-9273-17fe1545b0a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096601 Aug 21 01:34:24.656760 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2394/5422] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:24.811346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:24.812894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:24.831331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:24.832245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:24.833138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:24.837317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:24.838603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:24.840698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:24.873380 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use.", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:24.874289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.874289 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3 HTTP/1.1 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: exception: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7b34b133-5e72-438e-86ba-facb33e3f2f3'} Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:24.876784 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] Aug 21 01:34:24.879938 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:24.883557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 400 to user: Security Group 7b34b133-5e72-438e-86ba-facb33e3f2f3 in use. Aug 21 01:34:24.883557 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-145f5b43-feda-49cf-a85b-13984e8598b2'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:24.884839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d21d598-9b53-442d-92bd-07d58181c61f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3" status: 400 len: 185 microversion: 2.1 time: 0.418263 Aug 21 01:34:24.885932 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3029/5423] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:24 2022] DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3 => generated 185 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:34:24.908328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:24.918883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:24.927417 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:24.948517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:24.949064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:24.950460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:24.952654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:24.953537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:24.954131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:25.162445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a47a4b9a-4676-4e20-be0d-4316eadc2fd8 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action" status: 202 len: 0 microversion: 2.1 time: 0.271395 Aug 21 01:34:25.166529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3030/5424] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:34:24 2022] POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:25.181775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:25.183781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:25.236729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:25.749048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:25.765113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9af0fc1d-2b46-4ee7-a4d6-4b042ac58afa tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1574 microversion: 2.1 time: 0.593222 Aug 21 01:34:25.767667 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3031/5425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:25 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1574 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:25.774530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:25.775691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:25.789942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:25.790679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:25.796262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:25.799909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:25.801593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:25.802728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:26.038210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:26.053602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:26.063623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:26.066679 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54e2ae90-7aeb-4282-91ab-16847735a54d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1339 microversion: 2.20 time: 0.297121 Aug 21 01:34:26.088089 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3032/5426] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:25 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:26.756118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fccb3c-7d46-4681-be80-c584e8e08216", "tag": "d86509cb-06dd-4215-ab7e-48940ac948c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:26.778775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:26.784636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:26.786130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:26.812543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] Creating event network-changed:d86509cb-06dd-4215-ab7e-48940ac948c6 for instance 27fccb3c-7d46-4681-be80-c584e8e08216 on n-h1-master-1 Aug 21 01:34:26.827289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d1bdca29-5610-4fbe-87dd-cd32385bc90a req-96d91174-db72-40e8-b6ca-49e1d944755d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074948 Aug 21 01:34:26.828674 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3033/5427] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:26.839932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:26.846155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:26.863310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:26.868163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:26.869085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:26.870131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:26.870803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:26.876828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:26.938118 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:27.342642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:27.357195 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d0e3717-05bd-4ee5-b0be-98e8c6bc7c87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 2.549094 Aug 21 01:34:27.357817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2395/5428] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:24 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:27.375210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:27.377552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:27.394538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:27.396181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:27.397892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:27.399896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:27.401456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:27.406671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:27.411844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:27.418059 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf7ae2b1-5c30-461b-a3e7-becdbef3c304 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1574 microversion: 2.1 time: 0.587906 Aug 21 01:34:27.424712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3034/5429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:26 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1574 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:27.622469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:27.643464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:27.650947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:27.653609 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19bb8076-0871-455e-8b93-2945133bf657 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1339 microversion: 2.20 time: 0.291618 Aug 21 01:34:27.656423 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2396/5430] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:27 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:28.381452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:28.382412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:28.401146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.406940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.410317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:28.414300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.415407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.416232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:28.457597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:28.458918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:28.472324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.474599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.477180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:28.480003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.486954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.488594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:28.806874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:28.820385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ac6b11f-e47c-4add-9dab-7e5e8b1daac7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.445221 Aug 21 01:34:28.821560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3035/5431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:28 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:28.833760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:28.836467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:28.873896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.875105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.875904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:28.877096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:28.877680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:28.878243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:29.242062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:29.264201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:29.269829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:29.271441 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-044c1473-3077-4f6f-ab69-30727079b68e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.448372 Aug 21 01:34:29.271955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3036/5432] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:28 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:29.382445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:29.397577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-20cec5b4-9cc1-43bb-8dd7-3f566175ea44 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1574 microversion: 2.1 time: 0.950961 Aug 21 01:34:29.398950 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2397/5433] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:28 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1574 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:29.841646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:29.842952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:29.860624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:29.862194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:29.879386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:29.881579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:29.885024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:29.890032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:30.153884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:30.162916 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b49898f-7ce1-47ec-97f9-f1cee8a2108d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.326073 Aug 21 01:34:30.165985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3037/5434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:29 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:30.299645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:30.300185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:30.307410 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:30.311097 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=26 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:30.320283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:30.321471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:30.322139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:30.323555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:30.325011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:30.325891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:30.420424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:30.421120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:30.434784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:30.435280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:30.435719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:30.436434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:30.436914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:30.437346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:30.723240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:30.734267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:30.735950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:30.737191 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6935b5dd-3359-48fd-a1f4-d3ae75cb344f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.445236 Aug 21 01:34:30.743312 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2398/5435] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:30 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:30.763876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:30.776135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e44e8ab-6b34-4d49-bc58-a1aa8d8ef7f4 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1574 microversion: 2.1 time: 0.359046 Aug 21 01:34:30.781713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3038/5436] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:30 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1574 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:31.191335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:31.192105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:31.202642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:31.204724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:31.206616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:31.208527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:31.209031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:31.209499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:31.765533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:31.766339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:31.774233 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:31.823031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:31.823548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:31.824167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:31.824668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:31.825210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:31.825587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:32.109224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:32.118137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:32.127250 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e94ba81-5149-42aa-a648-294faf000662 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.937572 Aug 21 01:34:32.129523 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2399/5437] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:31 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:32.142635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:32.142635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:32.146524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:32.148289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:32.152055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ecf8aaeb-0fc7-4ade-975c-38b5ca878801 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.394439 Aug 21 01:34:32.152713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:32.153227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:32.153823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:32.154522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:32.154972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:32.155386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:32.164809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3039/5438] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:31 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:34:32.896551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:32.928608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:32.929158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:32.929600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:32.965054 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] Creating event network-changed:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h2-master-1 Aug 21 01:34:32.976882 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-04653c33-1662-4165-9969-d039edcdcb77 req-f8b4130b-852c-4962-97df-dddee3a7da6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084791 Aug 21 01:34:32.977688 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3040/5439] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:34:33.152951 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:33.153855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:33.161924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:33.162568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:33.163712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:33.164568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:33.165214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:33.166017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:33.393481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:33.421865 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b88fb124-fcd3-475e-8b3c-fccbb0529d63 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1574 microversion: 2.1 time: 1.291234 Aug 21 01:34:33.422676 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2400/5440] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:32 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1574 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:33.432801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:33.436528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:33.459582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:33.460448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:33.461100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:33.462018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:33.463076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:33.466344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:33.585002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:33.596746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0bb6f075-10f5-4936-a5a8-bfdba8e7efe9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.450357 Aug 21 01:34:33.597362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3041/5441] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:33 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:33.834158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:33.851120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:33.852650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:33.866369 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db72c884-ae9c-4dd1-84bb-aa0c4e17adbf tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.442427 Aug 21 01:34:33.869444 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2401/5442] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:33 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:33.964107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fccb3c-7d46-4681-be80-c584e8e08216", "name": "network-vif-plugged", "status": "completed", "tag": "d86509cb-06dd-4215-ab7e-48940ac948c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:33.989232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:33.989880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:33.990382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.043059 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] Creating event network-vif-plugged:d86509cb-06dd-4215-ab7e-48940ac948c6 for instance 27fccb3c-7d46-4681-be80-c584e8e08216 on n-h1-master-1 Aug 21 01:34:34.070881 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b44087ff-9e7d-4b53-bd8f-5826f2cade26 req-dce651ec-90f8-4ba3-9657-fe562bc85c53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114865 Aug 21 01:34:34.073429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3042/5443] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:34.446232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:34.447000 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:34.459839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.460457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.466599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.468280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.468995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.469612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.624271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:34.626510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:34.655230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.657230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.659104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.661299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.662346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.663493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.724104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:34.737633 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-401bd744-0fe2-4838-9138-088921507136 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1572 microversion: 2.1 time: 0.295585 Aug 21 01:34:34.740642 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2402/5444] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:34 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1572 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:34.762601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1583662931"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:34.763359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:34.771471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.772041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.772536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.773359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.774311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.774795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.926997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:34.951494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4092b762-e7b8-4a1e-b36e-8f232a78c5f4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1318 microversion: 2.1 time: 0.335612 Aug 21 01:34:34.952839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3043/5445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:34 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:34.960898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:34.961521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:34.968899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.969672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.969800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:34.970791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:34.971387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:34.971959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:35.072592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Adding security group 3983a685-9b0e-4780-a33f-4bca68208a33 to port 73c0b635-3dde-4ef7-94ae-abfe7bcec0fb Aug 21 01:34:35.285863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:35.304438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:35.307453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:35.311431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c67b83e-12a9-4b34-b9e5-999c0b121a2c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.357532 Aug 21 01:34:35.314053 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3044/5446] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:34 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:35.677506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-41450033-cc26-4106-877a-49c687d57aab tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action" status: 202 len: 0 microversion: 2.1 time: 0.919493 Aug 21 01:34:35.678644 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2403/5447] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:34:34 2022] POST /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:34:35.687900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9dd78b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:35.733455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3e142e-6a06-4498-afce-151bc2f10635", "tag": "73c0b635-3dde-4ef7-94ae-abfe7bcec0fb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:35.756534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:35.757047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:35.757493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:35.799005 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] Creating event network-changed:73c0b635-3dde-4ef7-94ae-abfe7bcec0fb for instance 3d3e142e-6a06-4498-afce-151bc2f10635 on n-h1-master-1 Aug 21 01:34:35.829350 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cb9b73e1-a693-4a14-89dd-6be606b3efa5 req-5e1021a8-faa3-4431-b28b-c0e1d6383515 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099523 Aug 21 01:34:35.845258 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2404/5448] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:35.937504 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use.", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:35.938404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.938404 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33 HTTP/1.1 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: exception: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3983a685-9b0e-4780-a33f-4bca68208a33'} Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:35.940713 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] Aug 21 01:34:35.944048 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:35.948119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 400 to user: Security Group 3983a685-9b0e-4780-a33f-4bca68208a33 in use. Aug 21 01:34:35.948119 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-999eab76-a0e1-4909-b0d5-8b0db5cd1713'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:35.949338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-321cbf2e-4cc4-406b-9c11-e57556e2dfd5 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33" status: 400 len: 185 microversion: 2.1 time: 0.265420 Aug 21 01:34:35.950137 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3045/5449] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:35 2022] DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33 => generated 185 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:34:35.959960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:35.960939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:35.973154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:35.974464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:35.982100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:35.990431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:35.997431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:35.999514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.000510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.001260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.001936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.002577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.007749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.008852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.010241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.010911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.097920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:34:36.300502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9fde399b-5e74-4e20-b510-dd5a0f36c5d6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 204 len: 0 microversion: 2.1 time: 0.344722 Aug 21 01:34:36.305661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2405/5450] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:34:35 2022] DELETE /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:34:36.310543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:36.311256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:36.321731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:36.331620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.332135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.332473 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72e97092-7d53-4f17-928d-938d5eeb11c7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1498 microversion: 2.1 time: 0.362932 Aug 21 01:34:36.332587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.333280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.334019 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3046/5451] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:35 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:36.339816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:36.340562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:36.346223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.346974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.348021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.348750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.349660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.350683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.351435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.352064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.643198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:36.665169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:36.676308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:36.678879 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d32bc8a1-a126-43c6-ae5a-f13302b2c8f1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.343687 Aug 21 01:34:36.679596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3047/5452] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:36 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:36.691231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:36.697860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:36.720664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.721125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.721570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:36.722287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:36.722739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:36.723178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.033863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:37.044288 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5a1b665-0282-4bac-8e8f-7a905b088ae6 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1647 microversion: 2.1 time: 0.738164 Aug 21 01:34:37.065646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:37.066203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2406/5453] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:36 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1647 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:37.073889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a6ac2e0-595c-4876-9920-0010ece46574 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1498 microversion: 2.1 time: 0.391999 Aug 21 01:34:37.074404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3048/5454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:36 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1498 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:37.094562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:37.095431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:37.103652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.106617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.107675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.118435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.119111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.119814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.171095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:34:37.253801 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:37.341950 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c50d802-c199-4f3d-859a-29145773c018 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 204 len: 0 microversion: 2.1 time: 0.251107 Aug 21 01:34:37.343013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2407/5455] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:34:37 2022] DELETE /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:34:37.351184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:37.351719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:37.364571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.365087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.365520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.366227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.366674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.367092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.660905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:37.672141 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26cdb7cf-e4ef-4655-974a-eb41031e09a3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1504 microversion: 2.1 time: 0.324823 Aug 21 01:34:37.673451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3049/5456] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:37 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:37.714623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:37.715487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:37.730596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.731248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.731802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:37.732633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:37.739089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:37.739667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:38.078548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:38.080079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:38.093719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:38.094216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:38.094658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:38.095374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:38.095823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:38.096246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:38.249198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:38.270093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:38.277422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:38.278940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f14d08f-821d-433f-9c73-7a07e60ea34c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.569153 Aug 21 01:34:38.280149 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2408/5457] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:37 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:38.408870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:38.418102 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-895090a4-8a70-43ba-a025-e8ad876dbd21 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1647 microversion: 2.1 time: 0.343341 Aug 21 01:34:38.430504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3050/5458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:38 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1647 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:38.698338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:38.699329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:38.713013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:38.713947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:38.714602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:38.715610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:38.716304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:38.727167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:39.108720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:39.118434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-381864cf-a457-46ac-a683-7c18efdfc048 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1504 microversion: 2.1 time: 0.424438 Aug 21 01:34:39.124551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2409/5459] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:38 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:39.310686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:39.311312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:39.321200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:39.325467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:39.326207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:39.327112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:39.328430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:39.329899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:39.441830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:39.442663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:39.450705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:39.451496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:39.452121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:39.453185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:39.453811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:39.454860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:39.640901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:39.652884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:39.662692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:39.664435 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-217cad83-3f8c-4e63-8e79-157353a958e0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.357458 Aug 21 01:34:39.665963 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3051/5460] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:39 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:40.048298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "name": "network-vif-plugged", "status": "completed", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:40.088698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.089435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.090070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:40.114969 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] Creating event network-vif-plugged:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h2-master-1 Aug 21 01:34:40.150745 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-878d6e49-cf90-4e92-98f5-141fbd23b3d6 req-0ed31cbe-8793-40a1-aa51-988d18c7f0e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107877 Aug 21 01:34:40.154595 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3052/5461] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:34:40.170312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:40.173695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:40.191346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.192094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.194415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:40.195564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.197977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.200005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:40.472517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:40.490672 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:40.494673 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce08bbe1-3064-40fa-8116-3ef42ce465ec tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 200 len: 1462 microversion: 2.1 time: 0.338402 Aug 21 01:34:40.510193 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3053/5462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:40 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 1462 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:40.517040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fccb3c-7d46-4681-be80-c584e8e08216", "name": "network-vif-deleted", "tag": "d86509cb-06dd-4215-ab7e-48940ac948c6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:40.537574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.538443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.539072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:40.578912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] Creating event network-vif-deleted:d86509cb-06dd-4215-ab7e-48940ac948c6 for instance 27fccb3c-7d46-4681-be80-c584e8e08216 on n-h1-master-1 Aug 21 01:34:40.591262 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-058b899e-6902-4587-89d7-29c99ec7d1c2 req-bad6f7da-0f1c-4c07-b75e-e3c62f12d76c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078825 Aug 21 01:34:40.593169 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3054/5463] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:40.671436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:40.688245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:40.688702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6090cc36-29cd-46c2-a15b-b60d0ade8549 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1647 microversion: 2.1 time: 1.243245 Aug 21 01:34:40.689132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:40.701291 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2410/5464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:39 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1647 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:40.707094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.707674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.709270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:40.710646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:40.711536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:40.716467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.184641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:41.204836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:41.216122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:41.222258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f2337d1-4406-4824-a345-e5b60b02b67e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.537836 Aug 21 01:34:41.225997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3055/5465] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:40 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:34:41.516619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:41.517880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:41.532365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:41.538168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:41.540156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.542974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:41.543646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:41.544558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.623218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 HTTP/1.1 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '27fccb3c-7d46-4681-be80-c584e8e08216'} Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:41.625216 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:34:41.629305 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:41.632623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:41.638358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b2c6fe7-2d11-48b1-b1f8-05f7caf5c0a9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 404 len: 111 microversion: 2.1 time: 0.123779 Aug 21 01:34:41.641366 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2411/5466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:41 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:41.660604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2ed4feb-46f6-4f21-b790-43c637559cc0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: .version_select at 0x7fc3fa2658b0>, body: {"keypair": {"name": "tempest-key-312588634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD329EKtxUV4s4HTxKUgS7HUcMYJy5ryBNRkio2n46zx+T0Hk7C7U+dd+Es9zGpDWan1FzspG7mLIEYa7o01IUgrqfEZfUWgdHQax5g7tFNYyRhiENJbt2ItJelvoYFSMQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:41.715485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:41.716115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:41.736563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:41.737252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:41.737692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.743083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:41.745330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:41.747518 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a2ed4feb-46f6-4f21-b790-43c637559cc0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:41.750673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.784149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a2ed4feb-46f6-4f21-b790-43c637559cc0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:41.884476 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2ed4feb-46f6-4f21-b790-43c637559cc0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.227336 Aug 21 01:34:41.889391 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3056/5467] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:34:41 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:41.900051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2fb83bfc-4a8e-4a0a-a608-0e0abe0b5c8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '.version_select at 0x7fc3f95913a0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:41.905328 n-d-master-1 devstack@n-api.service[122482]: WARNING oslo_db.sqlalchemy.utils [None req-2fb83bfc-4a8e-4a0a-a608-0e0abe0b5c8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 21 01:34:41.906812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:41.907297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:41.907986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:41.913472 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2fb83bfc-4a8e-4a0a-a608-0e0abe0b5c8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019949 Aug 21 01:34:41.914827 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3057/5468] 10.222.0.46 () {58 vars in 1137 bytes} [Sun Aug 21 01:34:41 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:41.921455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lazy-loading 'fault' on Instance uuid 3d3e142e-6a06-4498-afce-151bc2f10635 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:34:42.187016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:42.212540 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f25eecba-238a-4241-9e05-a6c7e29d3fde tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 200 len: 1305 microversion: 2.1 time: 0.492365 Aug 21 01:34:42.218237 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2412/5469] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:41 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 1305 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:42.252146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:42.253568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:42.282546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:42.283744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:42.288416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:42.291928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:42.294565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:42.297078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:42.305588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1748012524", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-key-312588634", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:42.457050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:34:42.701792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:42.716563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:42.720244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:42.726137 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-285350f8-35a0-45e3-bf34-f41936524a4c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1407 microversion: 2.20 time: 0.480240 Aug 21 01:34:42.728376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3058/5470] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:42 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:42.748208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e142e-6a06-4498-afce-151bc2f10635", "name": "network-vif-deleted", "tag": "73c0b635-3dde-4ef7-94ae-abfe7bcec0fb"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:42.774277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:42.775188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:42.775970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:42.800705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] Creating event network-vif-deleted:73c0b635-3dde-4ef7-94ae-abfe7bcec0fb for instance 3d3e142e-6a06-4498-afce-151bc2f10635 on n-h1-master-1 Aug 21 01:34:42.820519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a05d0168-9ccd-44d4-87f4-376f4372161a req-314231d2-240f-41a5-ad5c-c3ccc4cc1fbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078731 Aug 21 01:34:42.824464 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3059/5471] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:43.250654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:43.251636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:43.282966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:43.285734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:43.286191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:43.287074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:43.300943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:43.303149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:43.359520 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 HTTP/1.1 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3d3e142e-6a06-4498-afce-151bc2f10635'} Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:43.363399 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:43.371591 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26afa13c-19d6-4d7e-8484-d40fdc0cf121 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 404 len: 111 microversion: 2.1 time: 0.118068 Aug 21 01:34:43.373075 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3060/5472] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:43 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:34:43.402946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-faf03c92-ca86-46ca-8164-ad8a0fe4edee tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc4031a1790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:44.397860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:34:44.398411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:34:44.398753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:34:44.399226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:34:44.399730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:34:44.411405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:44.426811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:44.427407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:44.428252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:44.428737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:44.429195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:44.542082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:34:44.568195 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:34:44.637880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:34:44.641954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:34:44.710537 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-faf03c92-ca86-46ca-8164-ad8a0fe4edee tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3" status: 202 len: 0 microversion: 2.1 time: 1.328054 Aug 21 01:34:44.715167 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3061/5473] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:43 2022] DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3 => generated 0 bytes in 1333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:44.726334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:44.728267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:44.742132 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bdfeee8-2817-4419-a0e8-fb5eabfda394 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.439405 Aug 21 01:34:44.752158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2413/5474] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:34:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:34:44.761210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:44.762864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:44.763449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:44.771230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f33c661-4d30-47e1-90b4-09ad00b45aa7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fe371670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:44.773459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:44.773972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:44.774485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:45.094224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:45.108344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:45.113021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:45.115516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cce3dfae-671c-461d-bd8d-1a5d6ed40862 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1598 microversion: 2.20 time: 0.399200 Aug 21 01:34:45.117520 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3062/5475] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:34:44 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1598 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:34:45.124392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a6e7087-571f-4bbb-854f-a00447ffdf4c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:45.125171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a6e7087-571f-4bbb-854f-a00447ffdf4c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:45.259550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f33c661-4d30-47e1-90b4-09ad00b45aa7 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33" status: 202 len: 0 microversion: 2.1 time: 0.505807 Aug 21 01:34:45.260891 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2414/5476] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:44 2022] DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:45.265764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:45.266401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:45.290485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:45.292434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:45.293153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:45.294386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:45.308433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:45.309083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:45.310166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a6e7087-571f-4bbb-854f-a00447ffdf4c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:45.319353 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a6e7087-571f-4bbb-854f-a00447ffdf4c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1228 microversion: 2.1 time: 0.199262 Aug 21 01:34:45.341376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3063/5477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:45 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1228 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:45.351751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bebf8e6-2233-4330-8fc2-0cbeb83e3391 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'create', calling method: .version_select at 0x7fc3f9da4d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1846350769", "description": "tempest-description-513463285"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:45.493595 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76c06b5c-a254-48f0-9364-b25ac4535784 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.227453 Aug 21 01:34:45.493595 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2415/5478] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:34:45 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:34:45.968216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7bebf8e6-2233-4330-8fc2-0cbeb83e3391 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.625320 Aug 21 01:34:45.970418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3064/5479] 10.222.0.46 () {60 vars in 1180 bytes} [Sun Aug 21 01:34:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:45.986226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e94ade2e-d627-414c-97cc-3b2b8060b1e2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Action: 'update', calling method: .version_select at 0x7fc3fdf7ae50>, body: {"security_group": {"name": "tempest-sg-hth-839034435", "description": "tempest-description-hth-645390013"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:46.355958 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:46.356751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:46.381996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:46.386136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:46.388973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:46.390071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:46.392696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:46.395618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:46.661246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:46.677197 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0ccb0af-ad2c-4506-ade2-003cc4d90372 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1280 microversion: 2.1 time: 0.333117 Aug 21 01:34:46.678063 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3065/5480] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:46 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1280 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:46.822147 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e94ade2e-d627-414c-97cc-3b2b8060b1e2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd" status: 200 len: 216 microversion: 2.1 time: 0.841363 Aug 21 01:34:46.823282 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2416/5481] 10.222.0.46 () {60 vars in 1290 bytes} [Sun Aug 21 01:34:45 2022] PUT /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd => generated 216 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:46.855414 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-455af410-f16f-41ec-9669-393ab1cdd91a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9de6550>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:46.974316 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-455af410-f16f-41ec-9669-393ab1cdd91a tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd" status: 200 len: 216 microversion: 2.1 time: 0.131689 Aug 21 01:34:46.975226 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3066/5482] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:34:46 2022] GET /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd => generated 216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:46.989839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ba4cb09-afc7-4eb2-baf1-48c433583b47 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdd19040>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:47.700506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:47.701517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:47.735025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:47.745856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:47.786349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:47.787636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:47.788120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:47.788557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:47.904335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:47.921739 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-93d241b4-c768-459e-bb35-34f84c4e8564 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1286 microversion: 2.1 time: 0.226405 Aug 21 01:34:47.922350 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3067/5483] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:47 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1286 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:48.093179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ba4cb09-afc7-4eb2-baf1-48c433583b47 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd" status: 202 len: 0 microversion: 2.1 time: 1.108746 Aug 21 01:34:48.095567 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2417/5484] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:46 2022] DELETE /compute/v2.1/os-security-groups/f666f30c-95e0-4998-a295-6e42ba3aa1cd => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:48.106335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.108394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:48.154256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.155077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.155715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:48.156652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.157889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.158518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:48.187593 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 HTTP/1.1 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3d3e142e-6a06-4498-afce-151bc2f10635'} Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:48.197271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.200686 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.203622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.204706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-342b1667-a260-49e4-b087-3ef8ace66af1 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 404 len: 111 microversion: 2.1 time: 0.105042 Aug 21 01:34:48.205951 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3068/5485] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.214105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.214706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 3d3e142e-6a06-4498-afce-151bc2f10635] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:48.224141 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:48.225949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.226729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.227382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:48.228437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.229104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.229740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:48.263664 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 HTTP/1.1 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '3d3e142e-6a06-4498-afce-151bc2f10635'} Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.266879 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. Aug 21 01:34:48.270719 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.281955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Instance 3d3e142e-6a06-4498-afce-151bc2f10635 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.284301 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f15a1a34-96a9-4cc6-b330-700970734622 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635" status: 404 len: 111 microversion: 2.1 time: 0.074247 Aug 21 01:34:48.287054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2418/5486] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:48 2022] GET /compute/v2.1/servers/3d3e142e-6a06-4498-afce-151bc2f10635 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.294792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fa2a3790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.336457 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:48.337374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 3983a685-9b0e-4780-a33f-4bca68208a33 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:48.338041 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.338041 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33 HTTP/1.1 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: exception: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '3983a685-9b0e-4780-a33f-4bca68208a33'} Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:48.341257 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] Aug 21 01:34:48.344273 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.351096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 3983a685-9b0e-4780-a33f-4bca68208a33 does not exist Aug 21 01:34:48.351096 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-614cd0d1-14ae-4704-8fc8-7f2b564b88b4'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.353129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ab70ff9-b0db-44b9-a137-8f3dae0abd31 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33" status: 404 len: 194 microversion: 2.1 time: 0.062913 Aug 21 01:34:48.363119 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3069/5487] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/3983a685-9b0e-4780-a33f-4bca68208a33 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.372872 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fe145430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.513505 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:48.523160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:48.523955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.523955 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3 HTTP/1.1 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7b34b133-5e72-438e-86ba-facb33e3f2f3'} Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:48.532398 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] Aug 21 01:34:48.536301 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.546024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 7b34b133-5e72-438e-86ba-facb33e3f2f3 does not exist Aug 21 01:34:48.546024 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-848b6e31-22a7-4587-934e-364b588d9fd5'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.546024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ea21d90-10d8-4c51-8a60-d1910a89b773 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3" status: 404 len: 194 microversion: 2.1 time: 0.176986 Aug 21 01:34:48.548145 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2419/5488] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/7b34b133-5e72-438e-86ba-facb33e3f2f3 => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:34:48.555877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9d90e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.590601 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:48.591564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 32124e13-8cb0-476e-a563-9db5c16303bc not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:48.592358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.592358 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc HTTP/1.1 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: exception: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '32124e13-8cb0-476e-a563-9db5c16303bc'} Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:48.595053 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] Aug 21 01:34:48.598920 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.605881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 32124e13-8cb0-476e-a563-9db5c16303bc does not exist Aug 21 01:34:48.605881 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-a241221c-79d5-4af8-afa6-ec9a9858c4aa'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.607036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-770d50d5-5a3e-43a0-b768-91b5895a4084 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc" status: 404 len: 194 microversion: 2.1 time: 0.056516 Aug 21 01:34:48.611289 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3070/5489] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/32124e13-8cb0-476e-a563-9db5c16303bc => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.616499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdf7a670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.745817 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:48.746625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:48.747154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.747154 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 HTTP/1.1 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2935ca2e-6d07-4ae0-b6ba-8330aa5eda34'} Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:48.749199 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] Aug 21 01:34:48.752892 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.757469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 does not exist Aug 21 01:34:48.757469 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-3a68d62b-5cbd-43d7-b8e4-60911bbe54dc'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.758664 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7e44975-4cc6-485c-bce9-1a270bee0e94 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34" status: 404 len: 194 microversion: 2.1 time: 0.146366 Aug 21 01:34:48.759628 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2420/5490] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/2935ca2e-6d07-4ae0-b6ba-8330aa5eda34 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.774611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc4030bcca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.837687 n-d-master-1 devstack@n-api.service[122482]: DEBUG neutronclient.v2_0.client [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist", "detail": ""}} {{(pid=122482) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:48.838337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.security_group_api [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 not found {{(pid=122482) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:48.838860 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.838860 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 HTTP/1.1 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: exception: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5c721cd1-3bf5-42fe-aac7-13e0767f0bf1'} Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:48.840723 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 does not exist Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: Neutron server returns request_ids: ['req-d5cc030d-fc8c-41e2-a84a-1cc20d26f4b9'] {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-702347d8-2e94-440a-9b64-751d26a1d265 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1" status: 404 len: 194 microversion: 2.1 time: 0.077467 Aug 21 01:34:48.844676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3071/5491] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/5c721cd1-3bf5-42fe-aac7-13e0767f0bf1 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:48.861849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fe145e50>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.949500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:48.952001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:48.978362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.978878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.979326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:48.987244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:48.989332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:48.992734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:49.199980 n-d-master-1 devstack@n-api.service[122483]: DEBUG neutronclient.v2_0.client [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist", "detail": ""}} {{(pid=122483) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 21 01:34:49.201455 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.security_group_api [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Neutron security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c not found {{(pid=122483) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 21 01:34:49.202116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.202116 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c HTTP/1.1 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: exception: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '736bb70f-d0b6-48e0-a557-681ccfbd6c1c'} Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 21 01:34:49.204208 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] Aug 21 01:34:49.207363 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:34:49.212051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Security group 736bb70f-d0b6-48e0-a557-681ccfbd6c1c does not exist Aug 21 01:34:49.212051 n-d-master-1 devstack@n-api.service[122483]: Neutron server returns request_ids: ['req-79a5a08a-3a0e-40ac-9b65-1c7b7d6178f2'] {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:49.213260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-47f5e9b3-45e7-4806-8b41-bb83c982a49e tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c" status: 404 len: 194 microversion: 2.1 time: 0.363709 Aug 21 01:34:49.217160 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2421/5492] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:48 2022] DELETE /compute/v2.1/os-security-groups/736bb70f-d0b6-48e0-a557-681ccfbd6c1c => generated 194 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:49.246847 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:49.285892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:49.288333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:49.290529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:49.314084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:49.324729 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f7a5060-db58-48b7-994e-d103606ce93a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.382663 Aug 21 01:34:49.328308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] Creating event network-changed:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h2-master-1 Aug 21 01:34:49.343789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3072/5493] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:48 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:49.343789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:49.343789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:49.344076 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-527d76d1-840c-496f-8830-65dc86e15990 req-a6c15142-2f5f-409c-8fe3-fdb4346201db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124984 Aug 21 01:34:49.345613 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2422/5494] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:49.349142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:49.349657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:49.350046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:49.356117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:49.356717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:49.357186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:49.409551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:34:49.559636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e86d081-5629-468a-a4dc-62be28706c73 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 204 len: 0 microversion: 2.1 time: 0.227966 Aug 21 01:34:49.560688 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3073/5495] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:34:49 2022] DELETE /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:34:49.569390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:49.570197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:49.590180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:49.590749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:49.591252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:49.592028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:49.592548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:49.593076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:50.149201 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:50.158666 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e132c6d-8833-4fed-830d-3f9ec8be454f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1648 microversion: 2.1 time: 0.593624 Aug 21 01:34:50.159628 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2423/5496] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:49 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1648 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:50.353353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:50.354180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:50.368087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:50.368850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:50.369604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:50.370512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:50.371149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:50.371746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:50.552063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:50.569232 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-90c89023-847c-4430-8fcc-a9f105eac6f1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.221325 Aug 21 01:34:50.570722 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3074/5497] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:50 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:51.184585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:51.185256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:51.198975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:51.199401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:51.199983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:51.200826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:51.201187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:51.201580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:51.597811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:51.598334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:51.615893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:51.621709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:51.622462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:51.624681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:51.627023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:51.627799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:51.933931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:51.943591 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a748d4b-2175-4dab-9951-b1a91b1771ad tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.350523 Aug 21 01:34:51.946975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3075/5498] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:51 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:52.052448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:52.066129 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-44558973-e60b-42ba-9e5f-5548bd953201 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1648 microversion: 2.1 time: 0.886653 Aug 21 01:34:52.067162 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2424/5499] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:51 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1648 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:52.971125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:52.972298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:53.004625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:53.005802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:53.006994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:53.007905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:53.013283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:53.013930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:53.034700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c5e011-1206-4174-b6ff-b9e68b33d8d1", "tag": "6330a947-6b96-4198-bedf-0c77c3d2bc80"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:53.057711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:53.058200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:53.058634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:53.131055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] Creating event network-changed:6330a947-6b96-4198-bedf-0c77c3d2bc80 for instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 on n-h1-master-1 Aug 21 01:34:53.144710 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-390e369d-45d2-46ca-8bee-767bf47c22c4 req-80d15e3d-31c9-4493-a8b2-0ef7df9ea941 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115028 Aug 21 01:34:53.146103 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2425/5500] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:34:53.151469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:53.152345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:53.158999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:53.159721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:53.160302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:53.161224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:53.161818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:53.162381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:53.386431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:53.395698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3d2f20a-c0cf-444d-989b-cb7d279cc3cf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.428350 Aug 21 01:34:53.409964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3076/5501] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:52 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:54.154378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:54.173153 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dfdc6b0e-8db8-478c-9875-757a8c78d92c tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1648 microversion: 2.1 time: 1.024543 Aug 21 01:34:54.173153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2426/5502] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:53 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1648 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:54.435604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:54.436214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:54.464966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:54.467964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:54.468693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:54.471013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:54.472751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:54.475154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:54.835691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:54.844940 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-390953c8-8d97-48cf-8e2a-43ad26efba1b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.416033 Aug 21 01:34:54.858069 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3077/5503] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:54 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:55.201137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:55.203144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab1ac0e-0532-40f0-892a-a5d368004a40", "name": "network-vif-deleted", "tag": "61d3fb21-23b0-49c2-b939-dc4cd28231d9"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:55.204795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:55.217727 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:55.228844 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:55.231536 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:55.232885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.234672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.236744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:55.239124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.240802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.242403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:55.254493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.255934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.256424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:55.270025 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] Creating event network-vif-deleted:61d3fb21-23b0-49c2-b939-dc4cd28231d9 for instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 on n-h1-master-1 Aug 21 01:34:55.278116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-041d20c2-00bd-4134-9550-6e88b052b02b req-13fe833f-ad2d-44d6-aafd-6c4544d5238d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088305 Aug 21 01:34:55.279570 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2427/5504] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:55.297630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.298132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.298607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:55.299148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lazy-loading 'fault' on Instance uuid 4ab1ac0e-0532-40f0-892a-a5d368004a40 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:34:55.321274 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:34:55.350580 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521136ba1dcc454292aaa65a23b2be68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910d1339e7a24cfd863d2c04610a7b1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:55.359552 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61787049-54b8-49c2-888e-29e532a44241 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 200 len: 1305 microversion: 2.1 time: 0.167669 Aug 21 01:34:55.360326 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3078/5505] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:55 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:55.868181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:55.869080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:55.898034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.900010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.902381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:55.908056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:55.910569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:55.911740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:56.382920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:56.383574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] [instance: 4ab1ac0e-0532-40f0-892a-a5d368004a40] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:56.400646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:56.402093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:56.402721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:56.427815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:56.429351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:56.430263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:56.430663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:56.442336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-137ae4cc-3120-4f61-b366-328e883996fb tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.580126 Aug 21 01:34:56.446908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2428/5506] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:55 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:34:56.486718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] HTTP exception thrown: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Request method failure captured: Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 HTTP/1.1 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtYw6RJtNFAf6V_RRt3Mka3sxI3aU89Ee_LSSGijf219IMCbGO_bmJt9SBR-SJRXKQe7xDm1ULErLsWvs9G3h5kGK9wWuUCRWHgct7FXYDfYtoEiuKyMaqhW_beZ4hbWy3cwZG_B4xhtuENwwU1xdX7bbZ2Men1p2vl1KVbhoSEwDY Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_910d1339e7a24cfd863d2c04610a7b1b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/910d1339e7a24cfd863d2c04610a7b1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/910d1339e7a24cfd863d2c04610a7b1b"}]}] Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 910d1339e7a24cfd863d2c04610a7b1b Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-173502637 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 521136ba1dcc454292aaa65a23b2be68 Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-SecurityGroupsTestJSON-173502637-project Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '4ab1ac0e-0532-40f0-892a-a5d368004a40'} Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:34:56.494521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Returning 404 to user: Instance 4ab1ac0e-0532-40f0-892a-a5d368004a40 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:34:56.500579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a18b1a1-37b3-4930-860f-6fbe2fd774a2 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40" status: 404 len: 111 microversion: 2.1 time: 0.119662 Aug 21 01:34:56.506579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2017e081-0ab6-4b48-b890-d543b0a27e9f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3fdf15940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:56.520334 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3079/5507] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:56 2022] GET /compute/v2.1/servers/4ab1ac0e-0532-40f0-892a-a5d368004a40 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:34:57.214083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2017e081-0ab6-4b48-b890-d543b0a27e9f tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/8db4b3d9-cc73-433e-ad5e-22ec29fd039a" status: 202 len: 0 microversion: 2.1 time: 0.711398 Aug 21 01:34:57.214852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2429/5508] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:56 2022] DELETE /compute/v2.1/os-security-groups/8db4b3d9-cc73-433e-ad5e-22ec29fd039a => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:57.224547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d17d12e-e2f7-4781-b703-d7db06680d03 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] Calling method '.version_select at 0x7fc3f9b0b4c0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:57.476291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:57.477818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:57.491397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:57.492462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:57.493174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:57.494073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:57.495983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:57.496577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:57.734462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d17d12e-e2f7-4781-b703-d7db06680d03 tempest-SecurityGroupsTestJSON-173502637 tempest-SecurityGroupsTestJSON-173502637-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/9a728ede-8707-42ac-9738-bcf40e181eeb" status: 202 len: 0 microversion: 2.1 time: 0.514807 Aug 21 01:34:57.739584 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3080/5509] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 01:34:57 2022] DELETE /compute/v2.1/os-security-groups/9a728ede-8707-42ac-9738-bcf40e181eeb => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:34:57.845966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:57.859572 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad023c7e-b66e-4a86-86e9-28738f447641 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.386891 Aug 21 01:34:57.860230 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2430/5510] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:57 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:34:58.081301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c5e011-1206-4174-b6ff-b9e68b33d8d1", "name": "network-vif-plugged", "status": "completed", "tag": "6330a947-6b96-4198-bedf-0c77c3d2bc80"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:34:58.134150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:58.145257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:58.145937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:58.187558 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] Creating event network-vif-plugged:6330a947-6b96-4198-bedf-0c77c3d2bc80 for instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 on n-h1-master-1 Aug 21 01:34:58.202821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3a7173a7-e49b-4256-8e78-3eec31b0f010 req-dde6679f-879a-4aba-8f83-92a61da7869f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125915 Aug 21 01:34:58.207582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3081/5511] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:34:58.881160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:34:58.881936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:34:58.895421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:58.897122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:58.898738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:58.904169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:34:58.905049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:34:58.909511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:34:59.217324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:34:59.226455 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae47c6ac-265e-47e2-aa08-eaa55e5e10ea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1328 microversion: 2.1 time: 0.349859 Aug 21 01:34:59.240812 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2431/5512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:34:58 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1328 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:00.249627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:00.250320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:00.270609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.271117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.271557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.272275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.272720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.273163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.323828 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:00.554381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:00.566386 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53466524-02de-462c-aef1-2b0668be4c02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1509 microversion: 2.1 time: 0.321940 Aug 21 01:35:00.568341 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3082/5513] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:00 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:00.593302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:00.593920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:00.605809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.606303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.606746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.607461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.607918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.608343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.842165 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:00.853166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4f38021-43c2-4f03-967d-6de95eb45a41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1509 microversion: 2.1 time: 0.261483 Aug 21 01:35:00.854055 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2432/5514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:00 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:00.878050 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:00.878819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:00.888354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.891230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.891875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.893057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:00.897519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:00.898206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:00.963155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:01.288946 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2388ee2b-726e-4fa7-8bb6-bc0f8e79c073 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 204 len: 0 microversion: 2.1 time: 0.370997 Aug 21 01:35:01.294365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3083/5515] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:00 2022] DELETE /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:35:01.312848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:01.312848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:01.339535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:01.347730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:01.355190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:01.356783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:01.359661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:01.360506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:02.542764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:02.551445 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b7d792d-29b1-4201-ac1a-41d779f59307 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1515 microversion: 2.1 time: 1.248318 Aug 21 01:35:02.557313 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2433/5516] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:01 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1515 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:03.589827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:03.590532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:03.610400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:03.612228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:03.615455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:03.616236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:03.616704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:03.629469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:03.744876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:03.757074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee884e8b-7813-409d-939c-f416477fa188 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1473 microversion: 2.1 time: 0.180193 Aug 21 01:35:03.758326 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3084/5517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:03 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:04.335916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c5e011-1206-4174-b6ff-b9e68b33d8d1", "name": "network-vif-deleted", "tag": "6330a947-6b96-4198-bedf-0c77c3d2bc80"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:04.385610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:04.386344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:04.390042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:04.407143 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] Creating event network-vif-deleted:6330a947-6b96-4198-bedf-0c77c3d2bc80 for instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 on n-h1-master-1 Aug 21 01:35:04.421231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-90849d00-92ea-4f92-82b6-e8116d7db353 req-0c50f6e5-9dfd-42c6-b0a9-ec81eb87671d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086928 Aug 21 01:35:04.425645 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2434/5518] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:04.783080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:04.783694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:04.836554 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:04.842099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:04.847630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:04.891090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:04.891926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:04.892555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:05.056328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:05.057661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:05.060436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:05.060946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lazy-loading 'fault' on Instance uuid b3c5e011-1206-4174-b6ff-b9e68b33d8d1 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:35:05.175625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:05.190912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6265e5de-1ad8-4e48-91ab-cb63acb18a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 200 len: 1318 microversion: 2.1 time: 0.412506 Aug 21 01:35:05.194587 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3085/5519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:04 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:06.222565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:06.223915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:06.267776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:06.267776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:06.267776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:06.267776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:06.267776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:06.268212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:06.326287 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 HTTP/1.1 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b3c5e011-1206-4174-b6ff-b9e68b33d8d1'} Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:06.330982 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:06.334531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:35:06.343351 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4470f5e-0ce2-4a93-8633-7fdb49c4f6ba tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 404 len: 111 microversion: 2.1 time: 0.126903 Aug 21 01:35:06.355543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0af160a1-f20e-4325-90a0-76626fa60f3a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '.version_select at 0x7fc3fa2659d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:06.362124 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2435/5520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:06 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:35:06.407314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0af160a1-f20e-4325-90a0-76626fa60f3a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-key-312588634" status: 202 len: 0 microversion: 2.1 time: 0.058667 Aug 21 01:35:06.413217 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3086/5521] 10.222.0.46 () {58 vars in 1206 bytes} [Sun Aug 21 01:35:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-312588634 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:35:06.553488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-239175574", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:06.706724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:35:07.395230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:35:07.396689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:35:07.398115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:35:07.399366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:35:07.400426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:35:07.419583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:07.420674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:07.421885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:07.423187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:07.423904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:07.424720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:07.448477 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:07.505782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:35:07.531930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:35:07.573704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:35:07.599944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:07.763078 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3fedeafd-9d58-4fd6-ad6c-ca32d46eac67 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215503 Aug 21 01:35:07.764960 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2436/5522] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:35:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:35:07.777571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e85dd4f6-b238-4db6-a636-8781806aba75 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:07.778410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e85dd4f6-b238-4db6-a636-8781806aba75 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:07.929638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e85dd4f6-b238-4db6-a636-8781806aba75 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:07.952580 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e85dd4f6-b238-4db6-a636-8781806aba75 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1208 microversion: 2.1 time: 0.179510 Aug 21 01:35:07.969275 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3087/5523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:07 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:08.976645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:08.977295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:08.987393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:08.987877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:08.990383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:08.992997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:08.996276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:08.996925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:09.106851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:09.122157 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc709483-0ae9-4501-b2bd-3f81f0459203 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1204 microversion: 2.1 time: 0.150469 Aug 21 01:35:09.122983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2437/5524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:08 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1204 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:10.148376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:10.150287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:10.163442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:10.164179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:10.168187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:10.169249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:10.169884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:10.172752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:10.403508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:10.423190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b85fa58-e74f-4db0-810c-85d7ed521125 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1268 microversion: 2.1 time: 0.278978 Aug 21 01:35:10.426950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3088/5525] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:10 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1268 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:11.266452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:11.267083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:11.277685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.283280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.283845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.284720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.285379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.285900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.344919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a81a1621-c6cc-4efb-82b7-02f3e2ec11ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/ips" status: 200 len: 149 microversion: 2.1 time: 0.083420 Aug 21 01:35:11.349540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2438/5526] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:35:11 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/ips => generated 149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:11.363880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31952e84-7058-411a-a758-7a23e11b89e8"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:11.366667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:11.384464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.401913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.403608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.404724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.405423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.406054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.444279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:11.445668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:11.463487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.465966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.466522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.467357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.469178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.469844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.688536 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/os-volume_attachments HTTP/1.1 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 74 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: {"volumeAttachment": {"volumeId": "31952e84-7058-411a-a758-7a23e11b89e8"}} Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': '87407c97-fde2-40e6-a122-e67a22a2617b', 'body': {'volumeAttachment': {'volumeId': '31952e84-7058-411a-a758-7a23e11b89e8'}}} Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:35:11.709075 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf Aug 21 01:35:11.714137 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:11.716507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 400 to user: Invalid volume: volume 31952e84-7058-411a-a758-7a23e11b89e8 is already attached to instances: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:35:11.717635 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60adb78e-dd74-4d82-b17a-dc124dcdb772 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.358249 Aug 21 01:35:11.720820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3089/5527] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:35:11 2022] POST /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b/os-volume_attachments => generated 174 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:35:11.734103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:11.735013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:11.758750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.769162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.769860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.770731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:11.771300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:11.771825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:11.870746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:11.987139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:11.995298 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c435b0f-5834-4aa1-a815-28a71927ed8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1308 microversion: 2.1 time: 0.554883 Aug 21 01:35:11.998301 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2439/5528] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:11 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:12.230302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-186afe15-0d27-4268-aae0-8192269a0a0a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 204 len: 0 microversion: 2.1 time: 0.505069 Aug 21 01:35:12.231585 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3090/5529] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:11 2022] DELETE /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:35:12.239833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:12.240641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:12.258419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:12.262245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:12.264590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:12.273362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:12.276638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:12.277316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:13.022137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:13.022944 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:13.043864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:13.044354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:13.044830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:13.054935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:13.057953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:13.058580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:13.066458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:13.080368 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fba2d08-bec6-4c5e-9667-72e656b8b8b8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1679 microversion: 2.1 time: 0.844042 Aug 21 01:35:13.100592 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2440/5530] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:12 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1679 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:13.530217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edecf1d-b517-47fc-8e15-b8eb23378a34", "tag": "34df5097-9e89-4418-bea0-520e945e9c93"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:13.562800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:13.563275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:13.563711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:13.610380 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] Creating event network-changed:34df5097-9e89-4418-bea0-520e945e9c93 for instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 on n-h1-master-1 Aug 21 01:35:13.615929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-474a3fa6-d5c9-4a63-b8c1-d59e836e8eaa req-20c6210b-d2e3-4ab0-b2b8-4e74dff5bcae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089685 Aug 21 01:35:13.616543 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2441/5531] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:13.675034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:13.685579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b42509b2-3bb4-43c4-9464-3560ca042d99 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1308 microversion: 2.1 time: 0.668858 Aug 21 01:35:13.685990 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3091/5532] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:13 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:14.113447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:14.114401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:14.131887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:14.138158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:14.138628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:14.141016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:14.149077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:14.158037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:14.707132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:14.707745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:14.711785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:14.720530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:14.721057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:14.721485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:14.722187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:14.726557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:14.728195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:14.731437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f1770dd5-bcad-4476-91bf-b97c86e41441 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1679 microversion: 2.1 time: 0.626919 Aug 21 01:35:14.734436 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2442/5533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:14 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1679 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:15.723572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:15.734783 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-47e2af4c-6a6f-4b32-86ea-e0becc2c6dbe tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1308 microversion: 2.1 time: 1.032056 Aug 21 01:35:15.735695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3092/5534] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:14 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:15.756968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:15.759486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:15.782954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:15.783475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:15.783915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:15.791067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:15.791564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:15.794931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:16.756416 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:16.757154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:16.779713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:16.780041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:16.788654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:16.789872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:16.790343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:16.790918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:17.448924 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:17.559312 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:17.735943 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:17.746843 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71985da9-3292-4e57-8eda-20f09299d3c4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1679 microversion: 2.1 time: 1.994640 Aug 21 01:35:17.760520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2443/5535] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:15 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1679 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:17.948547 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:18.031412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edecf1d-b517-47fc-8e15-b8eb23378a34", "name": "network-vif-plugged", "status": "completed", "tag": "34df5097-9e89-4418-bea0-520e945e9c93"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:18.051582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:18.052285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:18.053036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:18.117158 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] Creating event network-vif-plugged:34df5097-9e89-4418-bea0-520e945e9c93 for instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 on n-h1-master-1 Aug 21 01:35:18.175813 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3172b561-534d-46a2-a7da-7b388b11dc7a req-279231d4-5096-4cca-a215-86612318074e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128787 Aug 21 01:35:18.180167 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2444/5536] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:18.376447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:18.385626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4598577-a96e-4371-8b36-ddafafcdb46a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1308 microversion: 2.1 time: 1.633790 Aug 21 01:35:18.390248 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3093/5537] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:16 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1308 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:18.785913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:18.786830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:18.789406 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:18.824827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:18.825581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:18.826178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:18.827599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:18.828653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:18.829315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:18.919075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87407c97-fde2-40e6-a122-e67a22a2617b", "name": "network-vif-deleted", "tag": "70468df7-3606-46d2-a1d1-389a31372724"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:18.941714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:18.943986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:18.949185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:18.991356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] Creating event network-vif-deleted:70468df7-3606-46d2-a1d1-389a31372724 for instance 87407c97-fde2-40e6-a122-e67a22a2617b on n-h2-master-1 Aug 21 01:35:19.009345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3cf7ffd7-b975-49b0-836e-fcc9e64b16e2 req-76a45392-96ac-43b4-a27c-f50f6a07929c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098817 Aug 21 01:35:19.010965 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3094/5538] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:19.094177 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:19.107968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8986dc89-52af-47d6-beab-21b5ec344733 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1611 microversion: 2.1 time: 0.325918 Aug 21 01:35:19.123616 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2445/5539] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:18 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1611 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:19.411496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:19.412751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:19.443365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:19.446232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:19.448208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:19.453024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:19.464910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:19.465762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:20.131418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:20.132226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:20.151940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:20.154690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:20.158230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:20.161770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:20.162259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:20.162701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:20.282575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:20.283290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:20.283865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:20.285551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lazy-loading 'fault' on Instance uuid 87407c97-fde2-40e6-a122-e67a22a2617b {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:35:20.292129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:20.323791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ecfb79e0-d144-47b3-a6e6-21ca52f4e418 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1308 microversion: 2.1 time: 0.905989 Aug 21 01:35:20.324370 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3095/5540] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:19 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1308 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:20.848962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:20.858276 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a0a9abe-06cd-4d39-b678-f67c6caba042 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 200 len: 1329 microversion: 2.1 time: 0.731003 Aug 21 01:35:20.865155 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2446/5541] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:20 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 1329 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:21.347530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:21.348157 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:21.369501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:21.370031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:21.370475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:21.371203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:21.371654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:21.379085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:21.835357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:21.846228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f362cf1-8cd9-455f-b997-605020ff99df tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1489 microversion: 2.1 time: 0.503015 Aug 21 01:35:21.856373 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2447/5542] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:21 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1489 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:21.891005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:21.891920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:21.908540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:21.910125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:21.912125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:21.913005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:21.916950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:21.918070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:21.954398 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b HTTP/1.1 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '87407c97-fde2-40e6-a122-e67a22a2617b'} Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:21.956493 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:35:21.960515 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:21.965796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:35:21.967358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-754d983f-106f-4929-abd9-c53db6ae9aa3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 404 len: 111 microversion: 2.1 time: 0.080434 Aug 21 01:35:21.971785 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2448/5543] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:21 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:35:21.979797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-093301f0-382a-4927-8615-635e2891fe03 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '.version_select at 0x7fc3fea144c0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:21.999829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1103327180", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "cdfeb67f-1897-4c8c-9a18-dbdfaaf2c155"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:22.043083 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-093301f0-382a-4927-8615-635e2891fe03 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20368198" status: 202 len: 0 microversion: 2.1 time: 0.066714 Aug 21 01:35:22.044258 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2449/5544] 10.222.0.46 () {58 vars in 1215 bytes} [Sun Aug 21 01:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20368198 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:35:22.185071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] validate_networks() for [('cdfeb67f-1897-4c8c-9a18-dbdfaaf2c155', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:35:22.259243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-239175574", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:22.352196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:35:24.182096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:35:24.183355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:35:24.184000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:35:24.184559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:35:24.185168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:35:24.204900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.208019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.208640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.209564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.214053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.214700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.286208 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Getting quotas for project 1a83ba47ffad4cb4a82638934e637155. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:35:24.304030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Getting quotas for user 0c6bcee78c3148b5a6caa34678b1cc10 and project 1a83ba47ffad4cb4a82638934e637155. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:35:24.339388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:35:24.341348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:35:24.342021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:35:24.343060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:35:24.343722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:35:24.358917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Going to run 3 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:35:24.366435 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:24.370413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.372062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.372683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.376150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.377482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.378831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.446202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:35:24.460305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:35:24.469178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=ee365ba1-bb33-4165-a526-b052a0faa834,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:24.495432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:35:24.500005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:24.574344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=d1a0a0c2-81b8-47b8-8f5f-c8382e81e653,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:24.675191 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5b75f6b-c232-42b2-a97f-536f60439f8b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.422142 Aug 21 01:35:24.682857 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2450/5545] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:35:24.688139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-139e35ea-6541-4f0d-95d9-9987f800f351 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:24.701046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-139e35ea-6541-4f0d-95d9-9987f800f351 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:24.746575 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d96e8e8-8ead-42e5-863c-94e6d5580228 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.457439 Aug 21 01:35:24.747902 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3096/5546] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:35:24.760084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:24.765938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:24.766727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:35:24.833459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.837423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.838051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.839327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:24.842596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:24.843209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:24.845677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-139e35ea-6541-4f0d-95d9-9987f800f351 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:24.857764 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-139e35ea-6541-4f0d-95d9-9987f800f351 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1208 microversion: 2.1 time: 0.173424 Aug 21 01:35:24.858368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2451/5547] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:24 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:24.915404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5bfd307f-5b20-4881-832d-4afe6babf488 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.158610 Aug 21 01:35:24.919526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3097/5548] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:35:24 2022] GET /compute/v2.1/servers => generated 1018 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:24.928254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5348a563-e3de-4551-ac53-c953b0ed4227 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:24.929023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5348a563-e3de-4551-ac53-c953b0ed4227 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:25.015930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:25.016581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:25.024131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.025138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.026373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:25.027307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.028109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.028743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:25.145403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5348a563-e3de-4551-ac53-c953b0ed4227 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:25.166868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5348a563-e3de-4551-ac53-c953b0ed4227 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1223 microversion: 2.1 time: 0.241984 Aug 21 01:35:25.168032 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2452/5549] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:24 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1223 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:25.219589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lazy-loading 'services' on Instance uuid e80c4bd7-a53e-411c-b9cb-d82036ff2fcf {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:35:25.367339 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:25.383097 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d10514a-c829-4d53-8a0d-8f5877738638 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments/31952e84-7058-411a-a758-7a23e11b89e8" status: 202 len: 0 microversion: 2.1 time: 0.373539 Aug 21 01:35:25.389128 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3098/5550] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:35:25 2022] DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments/31952e84-7058-411a-a758-7a23e11b89e8 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:35:25.392757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:25.395880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:25.424071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.424581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.425136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:25.425734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.426262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.426734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:25.510182 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45f3beea-b3a5-4ac9-b11a-3ad5803c8c51 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121485 Aug 21 01:35:25.513130 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2453/5551] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:25 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:25.879212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:25.880960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:25.885052 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:25.903205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.905317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.911035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:25.912247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:25.913016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:25.913733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:26.037022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:26.048414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b43c3c4b-f680-426f-b421-5800ae515580 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1212 microversion: 2.1 time: 0.173517 Aug 21 01:35:26.049841 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3099/5552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:25 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1212 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:26.200798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a499bc26-c1e7-4d79-9712-397177bd2e45 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:26.201291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a499bc26-c1e7-4d79-9712-397177bd2e45 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:26.454152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a499bc26-c1e7-4d79-9712-397177bd2e45 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:26.464790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a499bc26-c1e7-4d79-9712-397177bd2e45 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1223 microversion: 2.1 time: 0.269175 Aug 21 01:35:26.466437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2454/5553] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:26 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1223 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:26.532069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:26.534574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:26.560143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:26.560654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:26.562541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:26.567103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:26.567593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:26.568025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:26.655845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7e13db6-1840-414a-a337-f56d539a583e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136665 Aug 21 01:35:26.656889 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3100/5554] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:26 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:27.072378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:27.073028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:27.111011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.111562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.112004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.114148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.114640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.115066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.390232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:27.425105 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05a31cfd-a593-4d9e-b1d3-77f870f12380 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1278 microversion: 2.1 time: 0.351103 Aug 21 01:35:27.426563 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2455/5555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:27 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:27.495227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:27.496533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:27.504917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.509813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.512328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.513284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.522333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.526393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.674204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:27.686030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:27.695944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:27.705836 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad9af543-fa73-4049-8bc7-f27a6f99021b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1219 microversion: 2.1 time: 0.218968 Aug 21 01:35:27.709062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3101/5556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:27 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:27.720608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.733908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.737046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.744252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:27.751999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:27.755249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:27.874449 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81f1a6b2-979e-4851-946e-8fd795de0280 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209739 Aug 21 01:35:27.875793 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2456/5557] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:27 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:28.454691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:28.455426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:28.464179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.477429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.478273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:28.479217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.479897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.480556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:28.647417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:28.655803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14cf935a-cc4a-45d8-97d2-9c5bedda2a02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1266 microversion: 2.1 time: 0.206708 Aug 21 01:35:28.695232 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3102/5558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:28 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:28.734179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:28.734757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:28.754962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.757081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.760967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:28.762694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.763892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.773509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:28.888839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:28.891640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:28.914749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.920460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.923433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:28.924940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:28.930669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:28.934392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:29.032710 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-410f4923-e0eb-4e69-8666-594da95b2c7d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148836 Aug 21 01:35:29.034092 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3103/5559] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:28 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:29.186915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:29.200751 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa65e158-1ded-4052-bae9-3ebbc7ae02b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1275 microversion: 2.1 time: 0.472508 Aug 21 01:35:29.229760 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2457/5560] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:28 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1275 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:29.702716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:29.706676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:29.719070 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:29.720859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:29.723696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:29.724709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:29.725623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:29.727942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:30.046048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:30.048937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:30.065625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:30.066357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:30.066940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:30.067819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:30.068414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:30.069010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:30.182639 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-baac1e0a-97ce-4958-9f12-d745a9ab9ba9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140777 Aug 21 01:35:30.202510 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2458/5561] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:30 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:30.233760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:30.234384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:30.253104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:30.253872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:30.254463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:30.255326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:30.258483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:30.259106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:30.566813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:30.575893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f18c1756-8173-4f5a-ba05-2ac8ee0f5105 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1281 microversion: 2.1 time: 0.347198 Aug 21 01:35:30.581973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2459/5562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:30 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1281 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:31.155291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:31.169824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-86134194-09d6-41cc-b359-4e52064eecbc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 1.471576 Aug 21 01:35:31.174061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3104/5563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:29 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:31.195664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:31.200749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:31.225914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:31.226705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:31.227328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:31.228058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:31.228526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:31.228968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:31.237272 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:31.325379 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d33743a2-e002-4d3e-8a57-944c26214e21 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134406 Aug 21 01:35:31.327541 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2460/5564] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:31 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:31.610695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:31.611219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:31.620056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:31.620542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:31.621002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:31.621706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:31.622152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:31.622571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:31.825597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:31.838416 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05e98e5b-b499-47ce-9061-4c55dc6a22ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1281 microversion: 2.1 time: 0.231773 Aug 21 01:35:31.839717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3105/5565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:31 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:32.198805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:32.202908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:32.211945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.212593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.213137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:32.213921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.215147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.215978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:32.339025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:32.342112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:32.360449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.360970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.376058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:32.377068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.377617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.378151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:32.501370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5191ea17-9883-4e8a-a70f-511663f581f1 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156445 Aug 21 01:35:32.502258 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3106/5566] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:32 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:32.861645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:32.862641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:32.873992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.876988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.877761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:32.878755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:32.881054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:32.881647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:33.016538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:33.031721 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-31b8f6e5-fb13-4a04-89a1-3d3c0fbac3e7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.836919 Aug 21 01:35:33.044794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2461/5567] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:32 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:33.248747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a87078-a715-45ea-a043-48cedfd3fc69", "tag": "1eb849d4-4971-477b-af99-345dead52731"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:33.289380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:33.290129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:33.290736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:33.322925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] Creating event network-changed:1eb849d4-4971-477b-af99-345dead52731 for instance 84a87078-a715-45ea-a043-48cedfd3fc69 on n-h2-master-1 Aug 21 01:35:33.336128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f6429f65-2b66-46d1-89c9-f30bedf6371c req-30d2642a-c141-4bbc-99e7-9e094e47a1a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103190 Aug 21 01:35:33.338969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2462/5568] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:33.521727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:33.525921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:33.548440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:33.549636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:33.554530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:33.561927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:33.571376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97f71817-3c3e-48e7-bef4-91c3928a23bf tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.713810 Aug 21 01:35:33.572660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:33.573412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:33.574421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:33.577143 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3107/5569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:32 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:33.666686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b722ed1-93c6-4f5b-aeae-bdfdb24c48b5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156226 Aug 21 01:35:33.673181 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2463/5570] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:33 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:34.057762 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:34.058393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:34.064969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.073056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.073786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.075323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.079212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.080237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.331990 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:34.519215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:34.537780 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bec3f085-f8bc-4feb-9962-fb7f4dab3a49 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.484219 Aug 21 01:35:34.540944 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3108/5571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:34 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:34.597980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:34.598674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:34.605147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee365ba1-bb33-4165-a526-b052a0faa834", "tag": "6585923d-78f8-4dca-8d13-b385e6493e36"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:34.616043 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:34.620084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.620559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.625038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.625502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.625917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.626313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.627218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.630475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.631275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.654280 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] Creating event network-changed:6585923d-78f8-4dca-8d13-b385e6493e36 for instance ee365ba1-bb33-4165-a526-b052a0faa834 on n-h2-master-1 Aug 21 01:35:34.659314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3b2eb262-2517-41bf-940a-c92796e16e1a req-34f1d4c5-34c4-4494-826f-396b92918f85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058458 Aug 21 01:35:34.660470 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3109/5572] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:34.691162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:34.694034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:34.703245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.704157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.704835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.705922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:34.706925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:34.707561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:34.799930 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3a10853-c71c-4641-a146-3740a65bcb3f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116390 Aug 21 01:35:34.803227 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3110/5573] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:34 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:35.034523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:35.048289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c584da3e-0991-4f9e-a323-fdb6ede6dc46 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.454181 Aug 21 01:35:35.051708 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2464/5574] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:34 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:35.371103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a0a0c2-81b8-47b8-8f5f-c8382e81e653", "tag": "0555336b-8a50-406f-9415-51d212867def"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:35.394805 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:35.398083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:35.398757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:35.399351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:35.424428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] Creating event network-changed:0555336b-8a50-406f-9415-51d212867def for instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 on n-h1-master-1 Aug 21 01:35:35.432379 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-de275694-1f8d-45c7-8a0c-643c9f809ece req-a4107f9d-3e60-41d5-b0b1-70eb8df1dedd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064826 Aug 21 01:35:35.441965 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3111/5575] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:35.560472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:35.561114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:35.570349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:35.570837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:35.571272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:35.571996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:35.585329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:35.585891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:35.813895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:35.818503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:35.822409 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-050f56a9-1ce8-4c1a-bc35-6767a57d19dc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.265972 Aug 21 01:35:35.822890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:35.835733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:35.836706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:35.837482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:35.838602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:35.839256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:35.839927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:35.844453 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2465/5576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:35 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:35.882905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7774bb7-2b17-4101-9598-96cb19f43102 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069900 Aug 21 01:35:35.884660 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3112/5577] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:35 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:36.074871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:36.075748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:36.084051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.084834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.085507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.086513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.087145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.087752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.459990 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:36.541290 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:36.571570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f494997-c66d-474d-bba9-c39364cd5982 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.503541 Aug 21 01:35:36.589807 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2466/5578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:36 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:36.720193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba37066-7117-456d-8b6e-52d114948027", "tag": "b86d20aa-f462-472e-b130-ba60b0053da3"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:36.737318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.737791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.742561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.761205 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] Creating event network-changed:b86d20aa-f462-472e-b130-ba60b0053da3 for instance cba37066-7117-456d-8b6e-52d114948027 on n-h2-master-1 Aug 21 01:35:36.767630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-39225121-211d-4a92-81a1-be3b9233ff94 req-5fb1b975-50c6-4259-a108-8fe2f2f77a3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051292 Aug 21 01:35:36.769029 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3113/5579] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:36.849903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:36.850514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:36.868137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.868857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.869120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.869849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.870300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.870725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.900261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:36.903186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:36.923332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.928541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.933466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:36.938180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:36.939346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:36.939798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.041423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d2b5b48-c521-4b37-8081-52617c4c6c4f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148696 Aug 21 01:35:37.043770 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3114/5580] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:35:36 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:35:37.150063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:37.150892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:37.160794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.161526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.162177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.163279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.164163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.164822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.205326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:37.307849 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:37.423749 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d807cf3-2809-4ac1-a2c2-ad17f6e9b3e3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 204 len: 0 microversion: 2.1 time: 0.285809 Aug 21 01:35:37.431244 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3115/5581] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:37 2022] DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:35:37.447604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:37.448697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:37.469009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.469501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.469932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.475009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.475484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.475995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.602672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:37.613513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-37306fb3-4c88-4445-8af4-193f1cac3f5a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.767756 Aug 21 01:35:37.615520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2467/5582] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:36 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:37.622108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:37.622957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:37.641665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.646553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.647332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.649105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:37.649793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:37.650902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:37.983353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:37.993672 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-753f0f90-1c03-47a5-b4d2-8b40dd4d9112 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1681 microversion: 2.1 time: 0.560147 Aug 21 01:35:37.997431 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3116/5583] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:37 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1681 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:38.638963 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:38.643159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:38.650544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:38.651321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:38.651935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:38.652850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:38.655987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:38.656664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:38.797699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:38.812886 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9993fcad-4b2f-4134-ac89-4e50e4978f3c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 1.194502 Aug 21 01:35:38.815817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2468/5584] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:37 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:38.982622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:38.992012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd875d0c-3afd-4de7-af4e-0af9fe033d77 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.357963 Aug 21 01:35:38.993811 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3117/5585] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:38 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:39.034837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:39.035998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:39.048450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:39.051062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:39.053160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:39.053972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:39.056198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:39.056810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:39.762431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:39.771960 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67fd54c6-46fa-4658-9e5b-6356eb1c9e9b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1681 microversion: 2.1 time: 0.742214 Aug 21 01:35:39.775434 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2469/5586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:39 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1681 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:39.838320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:39.838937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:39.851722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:39.852214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:39.852645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:39.856313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:39.858334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:39.858777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.014882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:40.016299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:40.028919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:40.029441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:40.029934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.034541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:40.035171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:40.035623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.195510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:40.204993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9c72cff-7867-48b4-86fa-773535563fe0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.371798 Aug 21 01:35:40.206477 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3118/5587] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:39 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:40.483347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:40.495015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a0a0c2-81b8-47b8-8f5f-c8382e81e653", "name": "network-vif-plugged", "status": "completed", "tag": "0555336b-8a50-406f-9415-51d212867def"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:40.502088 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a00829b1-8d44-4714-9178-e63a857bdf82 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.489005 Aug 21 01:35:40.505337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2470/5588] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:40 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:40.518850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:40.519327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:40.519758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.540438 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] Creating event network-vif-plugged:0555336b-8a50-406f-9415-51d212867def for instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 on n-h1-master-1 Aug 21 01:35:40.558629 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2398c117-a9b6-4a29-b3e9-febb6a129675 req-8e3ae09d-32c2-490d-9cff-2f8d72cc3cfb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067600 Aug 21 01:35:40.559492 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3119/5589] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:40.796058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:40.796671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:40.802905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:40.803565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:40.804300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.805202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:40.805652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:40.806218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:40.963370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:40.974736 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d9be578-cff4-4ae0-8821-d7ba87c829d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1615 microversion: 2.1 time: 0.182786 Aug 21 01:35:40.976374 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2471/5590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:40 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1615 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:41.232543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:41.233403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:41.243173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:41.244041 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:41.244648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:41.245572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:41.246386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:41.247027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:41.483809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:41.496040 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-35ed4b31-e51d-4b6a-a38b-0b40837e6fc6 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.268767 Aug 21 01:35:41.497482 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3120/5591] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:41 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:41.528736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:41.530170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:41.545933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:41.550123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:41.551341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:41.552568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:41.555062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:41.555702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:41.889664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80c4bd7-a53e-411c-b9cb-d82036ff2fcf", "name": "network-vif-deleted", "tag": "7c81f76e-de50-4444-86c9-38f8489e940b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:41.909985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:41.910956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:41.913640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:41.968532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] Creating event network-vif-deleted:7c81f76e-de50-4444-86c9-38f8489e940b for instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf on n-h1-master-1 Aug 21 01:35:41.970538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:41.981512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bc0fd6e-7dd2-48bc-a9c3-957da42f7cb5 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.459997 Aug 21 01:35:41.982143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2472/5592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:41 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:41.988177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-105a46b4-2c5d-4273-b064-e9e903ed8e8d req-f17a0cda-3be5-44c5-992b-2514c0d679a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097892 Aug 21 01:35:41.992077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3121/5593] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:42.006158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:42.006774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:42.030911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:42.037725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:42.038611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:42.039615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:42.040238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:42.040823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:42.223415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:42.232985 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c7406351-355e-48bf-9f29-a06430ad949f tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 200 len: 1327 microversion: 2.1 time: 0.230830 Aug 21 01:35:42.237407 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2473/5594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:42 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 1327 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:42.519846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:42.521755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:42.569945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:42.570469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:42.570917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:42.577858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:42.579576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:42.583353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.003948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:43.005147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:43.019559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:43.020410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:43.021036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.023050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:43.026075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:43.026680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.059847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:43.069162 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b6f13ea3-2eef-42fa-b034-36cf8755fb44 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.555153 Aug 21 01:35:43.086124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3122/5595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:42 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:43.258982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:43.259704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:43.273806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:43.278454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:43.279186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.283542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:43.284890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:43.287304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.329850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf HTTP/1.1 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: exception: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e80c4bd7-a53e-411c-b9cb-d82036ff2fcf'} Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:43.331584 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:35:43.335536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:35:43.336825 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8845a6f4-5c88-47d6-b3e8-b33c8847513e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 404 len: 111 microversion: 2.1 time: 0.078805 Aug 21 01:35:43.338068 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3123/5596] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:43 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:35:43.346134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8ff7590-cf5d-4bdd-881a-bf7e8d6dd404 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '.version_select at 0x7fc3f9563af0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:43.429055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8ff7590-cf5d-4bdd-881a-bf7e8d6dd404 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168462904" status: 202 len: 0 microversion: 2.1 time: 0.086741 Aug 21 01:35:43.429743 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3124/5597] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168462904 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:35:43.582432 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a87078-a715-45ea-a043-48cedfd3fc69", "name": "network-vif-plugged", "status": "completed", "tag": "1eb849d4-4971-477b-af99-345dead52731"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:43.605960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:43.606444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:43.606877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:43.677473 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] Creating event network-vif-plugged:1eb849d4-4971-477b-af99-345dead52731 for instance 84a87078-a715-45ea-a043-48cedfd3fc69 on n-h2-master-1 Aug 21 01:35:43.693927 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ab789385-64b8-417c-8454-c9aee3ef61b0 req-eeb7e7f4-00fd-4924-ba87-5c9048b0ae10 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115314 Aug 21 01:35:43.694592 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3125/5598] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:43.957471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:43.989869 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eb1783b3-728b-44cb-a766-5f8ed000e7ff tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.988506 Aug 21 01:35:43.992510 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2474/5599] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:42 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:44.098131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:44.098834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:44.115607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:44.116492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:44.117183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:44.118128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:44.119363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:44.120086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:45.024230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:45.025144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:45.037595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:45.040279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:45.042907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:45.043786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:45.044500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:45.045150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:45.175618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:45.191049 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98bd9d3c-b5c8-45b9-b770-e3f978fc60c2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 1.097044 Aug 21 01:35:45.196702 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3126/5600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:44 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:45.295334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:45.315328 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8bb15ed2-d1a1-422c-9143-0a0147578fb8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.304213 Aug 21 01:35:45.315964 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2475/5601] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:45 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:46.072008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fa930d6-aed1-4c75-af73-9a7ce5d3597a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: .version_select at 0x7fc3f92844c0>, body: {"keypair": {"name": "tempest-keypair-566153755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/NWVyo+/WEctVpSoqhQJwoRe0RnBjEW3dDqZtcCjbGGdtBOcP4vsCnK3F/IR+zojZmEsH9CsPccPjTCpjnrHdqhM7DHfR+5RGHcoMUcsxkkuyCcgmNs787my1b0Ahdbg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:46.127324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8fa930d6-aed1-4c75-af73-9a7ce5d3597a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:35:46.140133 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8fa930d6-aed1-4c75-af73-9a7ce5d3597a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:35:46.216732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fa930d6-aed1-4c75-af73-9a7ce5d3597a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149479 Aug 21 01:35:46.219553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3127/5602] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:35:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:46.226868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:46.227714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:46.254777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:46.255291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:46.255719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:46.256453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:46.257001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:46.258052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:46.343572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:46.344464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:46.355175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:46.358525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:46.360082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:46.374100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:46.376934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:46.378884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:46.657645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:46.669869 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-523f9eba-47eb-41e8-a588-8ee3468ea04e tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.453822 Aug 21 01:35:46.682386 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2476/5603] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:46 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:46.824761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee365ba1-bb33-4165-a526-b052a0faa834", "name": "network-vif-plugged", "status": "completed", "tag": "6585923d-78f8-4dca-8d13-b385e6493e36"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:46.841436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:46.849133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:46.849800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:46.864521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] Creating event network-vif-plugged:6585923d-78f8-4dca-8d13-b385e6493e36 for instance ee365ba1-bb33-4165-a526-b052a0faa834 on n-h2-master-1 Aug 21 01:35:46.871024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5c130492-21d7-4f8a-8da4-a11edf5bd806 req-80a0d8fa-d818-4e65-b38d-ffaaaeda1584 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054461 Aug 21 01:35:46.871947 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2477/5604] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:35:47.316729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:47.328425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a2407168-133a-4d2c-87b2-f009dfb43d73 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1308 microversion: 2.1 time: 0.990724 Aug 21 01:35:47.343605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3128/5605] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:46 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:47.695412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:47.696817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:47.711745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:47.718448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:47.718905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:47.719659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:47.720117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:47.720547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:47.733573 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:47.994946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:48.007161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bb276d6-1a30-4eb1-a8fa-733c29205c08 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.316454 Aug 21 01:35:48.009123 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2478/5606] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:47 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:48.352426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:48.354088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:48.363005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:48.364086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:48.364758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:48.365801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:48.367093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:48.368229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:48.633286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:48.646093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b4f2f92-3321-4e82-ae97-535062ddb03c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1488 microversion: 2.1 time: 0.299934 Aug 21 01:35:48.646709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3129/5607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:48 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1488 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:48.669179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:48.670124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:48.679540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:48.680052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:48.680473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:48.681204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:48.683481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:48.703558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.032307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:49.032953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:49.112606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.114572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.117311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.118065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.118541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.119860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.243251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:49.263207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d252b90-8d1e-450e-bc46-b6adab341798 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1489 microversion: 2.1 time: 0.599994 Aug 21 01:35:49.268497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2479/5608] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:48 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1489 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:49.300191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:49.301571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:49.317026 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:49.319026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.320429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.320916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.325122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.325693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.326123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.488832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:49.501264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fc58ea5-ee6f-42f9-9e93-fe4478b6e3c4 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.476715 Aug 21 01:35:49.501977 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3130/5609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:49 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:49.772069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:49.787539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9cfbc56b-a0af-4f6c-88ba-cefbb4043afc tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1488 microversion: 2.1 time: 0.498963 Aug 21 01:35:49.788424 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2480/5610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:49 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1488 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:49.816102 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:49.816887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:49.825996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.826757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.827338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.828189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:49.828805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:49.829382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:49.866394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:50.051936 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13e76613-bdf1-4c70-b420-540b3e87c277 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 204 len: 0 microversion: 2.1 time: 0.244183 Aug 21 01:35:50.055422 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3131/5611] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:49 2022] DELETE /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:35:50.065042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:50.065668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:50.074482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:50.075285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:50.075729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:50.076476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:50.077116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:50.077762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:50.341808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:50.354874 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf32eb8a-58cc-4e5b-8f8c-5cfdb672eb98 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1494 microversion: 2.1 time: 0.292095 Aug 21 01:35:50.365848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2481/5612] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:50 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1494 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:50.405022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1998690588", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cb5e4a9-bcd5-4245-8211-d0350dfa789c"}], "security_groups": [{"name": "tempest-securitygroup--126444253"}], "key_name": "tempest-keypair-566153755", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:50.522578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:50.523270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:50.538807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:50.540463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:50.543565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:50.545270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:50.546128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:50.546839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:50.572352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] validate_networks() for [('4cb5e4a9-bcd5-4245-8211-d0350dfa789c', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:35:50.852918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:50.865401 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ec97c3da-de4e-4f7e-8ea1-fe7aa45156f5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.346782 Aug 21 01:35:50.880039 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2482/5613] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:50 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:50.965865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba37066-7117-456d-8b6e-52d114948027", "name": "network-vif-plugged", "status": "completed", "tag": "b86d20aa-f462-472e-b130-ba60b0053da3"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:50.980428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:50.981076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:50.981514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:50.998465 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] Creating event network-vif-plugged:b86d20aa-f462-472e-b130-ba60b0053da3 for instance cba37066-7117-456d-8b6e-52d114948027 on n-h2-master-1 Aug 21 01:35:51.015958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d44b3c01-aa27-4e38-b3da-b2b4591655cf req-50fd6482-146a-41fc-b432-a94fa20d7cf3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057621 Aug 21 01:35:51.017248 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2483/5614] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:51.379304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:51.380609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:51.392233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:51.394920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:51.398601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:51.399581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:51.400204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:51.400801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:51.874259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:51.885920 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69962d9e-0760-4459-9219-8092dab3777d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1494 microversion: 2.1 time: 0.511253 Aug 21 01:35:51.887026 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2484/5615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:51 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1494 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:51.891845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:51.892607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:51.899845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:51.900531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:51.901267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:51.902141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:51.902743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:51.903309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:52.164578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:52.197757 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-03dea089-5c26-4372-9167-f93b52ff62b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.287853 Aug 21 01:35:52.208861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2485/5616] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:51 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:52.471892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:35:52.472420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:35:52.473086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:35:52.473595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:35:52.474147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:35:52.503826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:52.509335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:52.509904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:52.510959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:52.511595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:52.512137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:52.569447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:35:52.576529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:35:52.591146 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:52.613836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:35:52.620687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:35:52.750887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca8dcb64-1861-4f70-9088-42e55f61295b tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.355770 Aug 21 01:35:52.759150 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3132/5617] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:35:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:35:52.767679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a90433d8-b970-4da9-b28d-4a791e34a988 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:52.768808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a90433d8-b970-4da9-b28d-4a791e34a988 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:52.912052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:52.913213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:52.918931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a90433d8-b970-4da9-b28d-4a791e34a988 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:52.929010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:52.938340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:52.940550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:52.941319 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a90433d8-b970-4da9-b28d-4a791e34a988 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1241 microversion: 2.1 time: 0.180811 Aug 21 01:35:52.942236 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2486/5618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:52 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1241 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:52.947165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:52.948063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:52.948648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:53.223058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:53.223679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:53.242627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:53.243172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:53.243969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:53.245027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:53.246459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:53.249782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:53.610528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:53.634479 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f616fc19-95cb-47e8-b13d-94faab23e830 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1323 microversion: 2.1 time: 0.416103 Aug 21 01:35:53.638348 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2487/5619] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:53 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:53.753780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:53.765229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fda313a8-6f12-4e99-aec4-f099aca8b652 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1494 microversion: 2.1 time: 0.861450 Aug 21 01:35:53.767567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3133/5620] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:52 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1494 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:53.964181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:53.965492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:53.980625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:53.981372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:53.982020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:53.984382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:53.986399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:53.987144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:54.161707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:54.173694 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aade8105-5939-4206-a8e1-6ab753881cb7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1237 microversion: 2.1 time: 0.214326 Aug 21 01:35:54.176669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2488/5621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:53 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1237 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:54.341497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a87078-a715-45ea-a043-48cedfd3fc69", "name": "network-vif-deleted", "tag": "1eb849d4-4971-477b-af99-345dead52731"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:54.355181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:54.363555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:54.364496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:54.389660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] Creating event network-vif-deleted:1eb849d4-4971-477b-af99-345dead52731 for instance 84a87078-a715-45ea-a043-48cedfd3fc69 on n-h2-master-1 Aug 21 01:35:54.414404 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-313e4039-39b0-4488-bb49-011b16e1bb80 req-300545de-9fc9-4f4b-9e18-c06746ecaee0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077226 Aug 21 01:35:54.415694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3134/5622] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:54.670483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:54.671231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:54.694403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:54.695460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:54.696194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:54.697152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:54.697757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:54.698994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:54.818720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:54.819514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:54.878144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:54.880145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:54.884433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:54.889600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:54.890154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:54.890593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.030858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.031285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.034393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.034886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lazy-loading 'fault' on Instance uuid 84a87078-a715-45ea-a043-48cedfd3fc69 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:35:55.171648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:55.179624 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fc5cb0da-ceaa-44c4-90d6-c49a04f57926 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 200 len: 1298 microversion: 2.1 time: 0.386155 Aug 21 01:35:55.181061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3135/5623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:54 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 1298 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:55.201240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:55.203220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:55.221823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.222325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.222762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.223466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.229938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.230720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.288456 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:55.305258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:55.329631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df6e78b2-0b7c-4995-9fc2-2a5f27f1f571 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 200 len: 1517 microversion: 2.1 time: 0.667830 Aug 21 01:35:55.332937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2489/5624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:54 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 1517 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:55.360419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:55.362358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:55.396538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.400961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.405686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.406480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.406960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.407384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.483642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:55.495645 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-788d0950-4a48-4cb6-8b54-eaa5e635c131 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1311 microversion: 2.1 time: 0.300607 Aug 21 01:35:55.499918 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3136/5625] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:55 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:55.886316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:55.901622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3507d1b9-a949-496f-b5f5-a973b4e536d0 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 200 len: 1516 microversion: 2.1 time: 0.548735 Aug 21 01:35:55.902228 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2490/5626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:55 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 1516 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:55.927919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:55.928962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:55.945883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.950012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.951752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:55.953949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:55.955611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:55.958093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.211212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:56.211212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:56.215982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.217519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.217519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.247369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.249232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.249985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.275526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 HTTP/1.1 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '84a87078-a715-45ea-a043-48cedfd3fc69'} Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:35:56.278446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:35:56.282296 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:35:56.287293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:35:56.289855 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-892abb3b-74d5-4c50-9f0c-a2de64cf5165 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 404 len: 111 microversion: 2.1 time: 0.089780 Aug 21 01:35:56.291827 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2491/5627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:56 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:35:56.301867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:56.301867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:56.315602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.316275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.316513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.317951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.318816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.319454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.360473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:56.504822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5ea80338-f00a-49ff-b8b1-4f2dc7fd5868 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 204 len: 0 microversion: 2.1 time: 0.208035 Aug 21 01:35:56.505688 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2492/5628] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:56 2022] DELETE /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:35:56.519670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:56.520403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:56.527465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.527959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.528392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.529144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.529761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.530415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.720583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:56.734190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e37ad37-08ce-4fe0-9db4-9e7c481e22ba tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 200 len: 1516 microversion: 2.1 time: 0.809297 Aug 21 01:35:56.736670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3137/5629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:55 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 1516 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:56.741795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:56.742860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:56.754334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.757469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.758260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.761512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.762246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.763155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.904523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:56.927588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ef62aca-1f1d-42bb-83ec-d9fbb101df16 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1495 microversion: 2.1 time: 0.412826 Aug 21 01:35:56.949770 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2493/5630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:56 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:56.967586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:56.968399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:56.975708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.977389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.977994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:56.978960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:56.979783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:56.980378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:57.044486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:35:57.107377 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:35:57.183234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:57.196602 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dff0d537-27e1-4f64-b0f7-691b7bf4d850 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.458421 Aug 21 01:35:57.197545 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3138/5631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:56 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:57.246293 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-69a251bd-f47b-4efd-8a27-b71214def1f2 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 204 len: 0 microversion: 2.1 time: 0.295058 Aug 21 01:35:57.251152 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2494/5632] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:35:56 2022] DELETE /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:35:57.263420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:57.264020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:57.276360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:57.277156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:57.277754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:57.279908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:57.280832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:57.281427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:57.647994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:57.662712 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba2aac5e-d993-4c93-abd2-0486581d79ee tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 200 len: 1522 microversion: 2.1 time: 0.410388 Aug 21 01:35:57.668293 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3139/5633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:57 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:57.962784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:57.964108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:57.984281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:57.993407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:57.994417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:57.999086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:58.003802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:58.004908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:58.218245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:58.220008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:58.230544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:58.231030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:58.235000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:58.240444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:58.245640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:58.246577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:58.587849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:58.601957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ce93166c-3d43-46b6-a383-9c45d24acdf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.387512 Aug 21 01:35:58.602804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3140/5634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:58 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:58.617442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:58.627180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d201f586-c9c5-4274-a875-8bd49412dd5e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1495 microversion: 2.1 time: 0.674931 Aug 21 01:35:58.631975 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2495/5635] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:57 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1495 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:35:58.683827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:58.684440 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:58.697268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:58.697677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:58.698116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:58.698838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:58.699287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:58.699706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:58.924605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:35:58.934096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54b4203c-b0bd-4543-8790-d098857b7c9c tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 200 len: 1522 microversion: 2.1 time: 0.254113 Aug 21 01:35:58.948884 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3141/5636] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:58 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:35:59.105196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7440db2c-dbb6-4b47-9b45-337589cdc1a0", "tag": "75d0756d-063b-4e04-8d1e-00db055301ef"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:35:59.129832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:59.130589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:59.131203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:59.152452 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] Creating event network-changed:75d0756d-063b-4e04-8d1e-00db055301ef for instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 on n-h1-master-1 Aug 21 01:35:59.174772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9d8f56dc-4eb8-4774-9a2d-2f35e8ffdce2 req-826dea6d-db2b-4912-9d70-aac310b3b11d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073273 Aug 21 01:35:59.177815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2496/5637] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:35:59.627836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:59.629080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:59.644811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:59.645543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:59.646136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:59.653637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:35:59.654604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:35:59.660471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:59.660977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:59.661456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:59.668543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:59.678445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:59.680871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:35:59.681861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:35:59.682485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:35:59.685177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:00.023884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:00.034312 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7985ca13-9940-4822-b0ee-967b31f7c754 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 200 len: 1453 microversion: 2.1 time: 0.384738 Aug 21 01:36:00.043296 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2497/5638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:59 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 1453 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:00.193445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:00.208387 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-653d0eec-61e0-4c61-afdb-f04cc619cbe2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.586209 Aug 21 01:36:00.210248 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3142/5639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:35:59 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:00.218322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:00.221441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:00.248872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:00.251415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:00.252068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:00.255246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:00.255921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:00.256751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:00.691262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62381770-15f5-4e77-9faa-1a0fb2fe7b1c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1875854250", "availability_zone": "foo_zone"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:00.728156 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:00.728156 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:36:00.739152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.aggregate [None req-62381770-15f5-4e77-9faa-1a0fb2fe7b1c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Generated uuid 9d60fe6b-f907-4221-9f92-e4ca891f14d7 for aggregate {{(pid=122483) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 21 01:36:00.808805 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62381770-15f5-4e77-9faa-1a0fb2fe7b1c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.761097 Aug 21 01:36:00.810860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2498/5640] 10.222.0.46 () {60 vars in 1164 bytes} [Sun Aug 21 01:36:00 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:00.822411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b33c6ddc-acb5-4c0f-908e-0a0122809819 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:00.834859 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:00.834859 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:36:00.852801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:00.865761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbdfc661-15f3-4de6-a49d-a8da5dbfbd1b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 200 len: 1522 microversion: 2.1 time: 0.653883 Aug 21 01:36:00.874062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3143/5641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:00 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:00.924730 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b33c6ddc-acb5-4c0f-908e-0a0122809819 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.107780 Aug 21 01:36:00.926746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2499/5642] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:36:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:00.938419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:00.941875 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:00.941875 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:00.943404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:00.943561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:00.944053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:00.944866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:00.945381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:00.945907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.044548 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05febbba-3629-4e59-a46d-b093d5ae4b88 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111211 Aug 21 01:36:01.045555 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3144/5643] 10.222.0.46 () {58 vars in 1176 bytes} [Sun Aug 21 01:36:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.057769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-883df618-0073-471b-81af-4c06f1fbcb63 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:01.058564 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:01.058564 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:36:01.066868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:01.067475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:01.078966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-883df618-0073-471b-81af-4c06f1fbcb63 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.025590 Aug 21 01:36:01.088079 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2500/5644] 10.222.0.46 () {58 vars in 1143 bytes} [Sun Aug 21 01:36:01 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.098530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.100686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11408db4-6ade-407b-984e-3c2590f76b3c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:01.101572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.102201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.103098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.105349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.107605 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:01.107605 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:36:01.108431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.137554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11408db4-6ade-407b-984e-3c2590f76b3c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.138365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11408db4-6ade-407b-984e-3c2590f76b3c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.145506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11408db4-6ade-407b-984e-3c2590f76b3c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.161674 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 HTTP/1.1 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7edecf1d-b517-47fc-8e15-b8eb23378a34'} Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:01.169282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:36:01.173807 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:01.179443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:01.180470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8d1fc73e-3a25-45e5-8604-5ca99e002e34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 404 len: 111 microversion: 2.1 time: 0.119131 Aug 21 01:36:01.184481 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3145/5645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:01 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:01.230074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:01.231935 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:01.247754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.254012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.254454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.255188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.255629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.256077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.717990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:01.727274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a1e06fa-49f9-4e68-85b6-d89609904f3a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.501160 Aug 21 01:36:01.749469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3146/5646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:01 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:01.758808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edecf1d-b517-47fc-8e15-b8eb23378a34", "name": "network-vif-deleted", "tag": "34df5097-9e89-4418-bea0-520e945e9c93"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:01.773774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.774553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.775504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.790830 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] Creating event network-vif-deleted:34df5097-9e89-4418-bea0-520e945e9c93 for instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 on n-h1-master-1 Aug 21 01:36:01.797846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-24ae0ed4-41aa-4c3f-b0a5-1f0da9f1b0ed req-378627d5-55fa-43b2-a534-6acb2ec81251 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046743 Aug 21 01:36:01.798712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3147/5647] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.810428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee365ba1-bb33-4165-a526-b052a0faa834", "name": "network-vif-deleted", "tag": "6585923d-78f8-4dca-8d13-b385e6493e36"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:01.816381 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11408db4-6ade-407b-984e-3c2590f76b3c tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.727038 Aug 21 01:36:01.817064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2501/5648] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:36:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.823132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:01.823928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:01.824572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:01.824683 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-383191821", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:01.840943 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] Creating event network-vif-deleted:6585923d-78f8-4dca-8d13-b385e6493e36 for instance ee365ba1-bb33-4165-a526-b052a0faa834 on n-h2-master-1 Aug 21 01:36:01.858138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f59d3bab-0981-4e2d-a9a6-08fd977050fc req-65d4e70a-877d-412d-a92d-fe4e100f9cee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057797 Aug 21 01:36:01.859569 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3148/5649] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.872468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-38084418-7eb0-4350-8a84-76fe5229379a tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:01.885876 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:01.885876 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:01.945594 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-38084418-7eb0-4350-8a84-76fe5229379a tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.084144 Aug 21 01:36:01.955397 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3149/5650] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:36:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:01.976178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:01.995401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:36:02.002339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:02.028193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.032159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.032738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.033627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.035564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.036097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.110573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.117709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.121023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.121747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lazy-loading 'fault' on Instance uuid ee365ba1-bb33-4165-a526-b052a0faa834 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:36:02.221286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:02.230231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b207c68d-4eaf-4adb-b5e5-3d1e3bc6215a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 200 len: 1313 microversion: 2.1 time: 0.267979 Aug 21 01:36:02.231363 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3150/5651] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:01 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:02.236117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-126a519b-8233-4d2a-8732-54bd0557bad5 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1418711434", "availability_zone": "foo_zone"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:02.239117 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:02.239117 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:02.347184 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-126a519b-8233-4d2a-8732-54bd0557bad5 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.112156 Aug 21 01:36:02.350889 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3151/5652] 10.222.0.46 () {60 vars in 1173 bytes} [Sun Aug 21 01:36:02 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:02.364794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-665fd6c4-dd49-4939-83d4-9415868f52b7 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:02.374385 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:02.374385 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:02.430464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-665fd6c4-dd49-4939-83d4-9415868f52b7 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.068935 Aug 21 01:36:02.432296 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3152/5653] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:36:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:02.447040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a713edec-637c-4278-957f-61dfd285d17f tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:02.450260 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:02.450260 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:02.471880 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a713edec-637c-4278-957f-61dfd285d17f tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.030560 Aug 21 01:36:02.476025 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3153/5654] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:36:02 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:02.489150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-144765c2-c311-4536-9288-7e4b078e0768 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:02.496599 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:02.496599 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:02.520289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-144765c2-c311-4536-9288-7e4b078e0768 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.521192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-144765c2-c311-4536-9288-7e4b078e0768 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.521914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-144765c2-c311-4536-9288-7e4b078e0768 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.597654 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:02.774723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-144765c2-c311-4536-9288-7e4b078e0768 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.290739 Aug 21 01:36:02.775252 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3154/5655] 10.222.0.46 () {60 vars in 1194 bytes} [Sun Aug 21 01:36:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:02.786848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:02.787898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:02.800628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.811796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.814788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.819444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:02.820182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:02.820818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:02.940755 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:03.056188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:36:03.056895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:36:03.057565 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:36:03.058191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:36:03.058811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:36:03.079696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.080563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.081233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.082200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.082860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.083499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.137154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:36:03.143433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:36:03.176461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:36:03.179055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:36:03.234124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:03.255211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f03e6ac-9f6c-477f-bff1-d7e98bed4cf2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.478653 Aug 21 01:36:03.256886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3155/5656] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:02 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:03.277877 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9e514c3-895a-4355-ad49-0ac69c46ff72 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.278707 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:36:03.278707 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:36:03.305050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-babc8703-e542-4388-a018-da9a338f8891 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484051 Aug 21 01:36:03.311610 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2502/5657] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:36:03.322001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9e514c3-895a-4355-ad49-0ac69c46ff72 tempest-TestAggregatesBasicOps-598711307 tempest-TestAggregatesBasicOps-598711307-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.064962 Aug 21 01:36:03.322942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.323561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:03.338578 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3156/5658] 10.222.0.46 () {58 vars in 1155 bytes} [Sun Aug 21 01:36:03 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 21 01:36:03.343005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.347108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.348375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.350453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.351268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.351398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea315599-d614-4492-81cb-6db2629e5675 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.352984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.357816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea315599-d614-4492-81cb-6db2629e5675 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:03.408468 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] HTTP exception thrown: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 HTTP/1.1 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ee365ba1-bb33-4165-a526-b052a0faa834'} Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.410529 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:03.414070 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.418497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 404 to user: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:03.419634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17db726d-3a77-4d4e-9673-7b18fbf734b1 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 404 len: 111 microversion: 2.1 time: 0.107016 Aug 21 01:36:03.420414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2503/5659] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:03.441216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.463639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:03.465563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:03.483683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.484212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.484653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.487382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.487902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.489241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.598426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea315599-d614-4492-81cb-6db2629e5675 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:03.610367 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea315599-d614-4492-81cb-6db2629e5675 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1208 microversion: 2.1 time: 0.270118 Aug 21 01:36:03.611163 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3157/5660] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1208 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:03.615862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.616157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:03.658509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.659006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.659442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.660163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.660623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.661075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.675870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-43b6c86b-ff7d-4bf0-8f49-02f4cd34cd47 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.247450 Aug 21 01:36:03.688125 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2504/5661] 10.222.0.46 () {58 vars in 1230 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:36:03.706056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c44bbf3-0b13-4253-9f73-623ef0ce8255 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c44bbf3-0b13-4253-9f73-623ef0ce8255 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 21 01:36:03.714122 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 21 01:36:03.718536 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:03.720637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2c44bbf3-0b13-4253-9f73-623ef0ce8255 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:03.722098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2c44bbf3-0b13-4253-9f73-623ef0ce8255 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032874 Aug 21 01:36:03.723421 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2505/5662] 10.222.0.46 () {58 vars in 1182 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:36:03.757289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d7a8c9c-a2a4-4ea1-bb4e-49f4502193f5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/ips" status: 200 len: 150 microversion: 2.20 time: 0.144877 Aug 21 01:36:03.758007 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3158/5663] 10.222.0.46 () {60 vars in 1289 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/ips => generated 150 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:36:03.761866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.768434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:03.769788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:03.779028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.780050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.781898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.783079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.783847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.784414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.821266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:36:03.861725 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45f6effa-64eb-4a0f-8134-60a5ac67c5ae tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.111963 Aug 21 01:36:03.875171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:03.880499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2506/5664] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers => generated 683 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:03.882492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:03.883112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.servers [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Removing options 'limit' from query {{(pid=122482) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 21 01:36:03.896724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:03.912305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.913466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.914058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.914947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:03.917931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:03.918547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:03.987309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:36:04.098878 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2d9fcdd-7c33-487e-86d1-1e729c621f29 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.225118 Aug 21 01:36:04.101235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3159/5665] 10.222.0.46 () {58 vars in 1144 bytes} [Sun Aug 21 01:36:03 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:04.168292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c433c414-de32-4253-a046-b1c09878b2ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c433c414-de32-4253-a046-b1c09878b2ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: action_args: {} Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '-1' Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 21 01:36:04.182667 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c433c414-de32-4253-a046-b1c09878b2ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:04.193962 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c433c414-de32-4253-a046-b1c09878b2ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.067527 Aug 21 01:36:04.202356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-401c22f7-7d7d-4d4f-8a48-4af4f9d3b490 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.208083 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2507/5666] 10.222.0.46 () {58 vars in 1142 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-401c22f7-7d7d-4d4f-8a48-4af4f9d3b490 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: action_args: {} Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise error Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi 'testing' Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 21 01:36:04.208695 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 21 01:36:04.214102 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:04.216622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-401c22f7-7d7d-4d4f-8a48-4af4f9d3b490 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:04.218318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-401c22f7-7d7d-4d4f-8a48-4af4f9d3b490 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.020444 Aug 21 01:36:04.223959 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3160/5667] 10.222.0.46 () {58 vars in 1152 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:36:04.233110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-821aca93-b9cd-4100-acc3-911aa0b00f6b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.246634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-821aca93-b9cd-4100-acc3-911aa0b00f6b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.247458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-821aca93-b9cd-4100-acc3-911aa0b00f6b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:04.261821 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.servers [None req-821aca93-b9cd-4100-acc3-911aa0b00f6b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Flavor 'non_existing_flavor' could not be found {{(pid=122483) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 21 01:36:04.264423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-821aca93-b9cd-4100-acc3-911aa0b00f6b tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.038430 Aug 21 01:36:04.275712 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2508/5668] 10.222.0.46 () {58 vars in 1178 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:36:04.281608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.282469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.283688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:04.286140 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:04.293248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.294173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:04.295617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.296406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.297125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.324234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.331154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.333612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.340044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.342347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.343658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.346990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.348218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.348660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.530933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ecca808d-6ecb-422c-b0e5-3f6100ff3fd5 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.256876 Aug 21 01:36:04.532414 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3161/5669] 10.222.0.46 () {58 vars in 1174 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:36:04.560472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.585757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.588009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.590412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:04.597930 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f677523d-350f-47e5-85e1-a3def744a915 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.320548 Aug 21 01:36:04.598503 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2509/5670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:04.622016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.622804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.627004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.630697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.633069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.633858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:04.634444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.635193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.648206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.650889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.651448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.654357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.654831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.657345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.831016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.842101 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab170f9a-f73e-40cb-a5e4-1fba79725291 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1204 microversion: 2.1 time: 0.214370 Aug 21 01:36:04.842704 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2510/5671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1204 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:04.855660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b2bda86-dce9-48fa-a393-f64e45623084 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.314024 Aug 21 01:36:04.856505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3162/5672] 10.222.0.46 () {58 vars in 1184 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 21 01:36:04.871812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:04.911078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:04.913709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:04.929418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.930601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.931241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.932133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:04.932757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:04.934241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:04.980623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:36:05.052035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:05.063220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.063968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.064573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.623352 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2966b8f2-5c09-4d3a-ba19-a804ca52ff00 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.759071 Aug 21 01:36:05.625478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:05.626108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:05.633800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2511/5673] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:36:04 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:05.648324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.653552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be3b2001-22b5-43a2-848d-f3f024c5e378 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:05.655702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.656331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.658921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.659095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be3b2001-22b5-43a2-848d-f3f024c5e378 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:05.659390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.659832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.660114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be3b2001-22b5-43a2-848d-f3f024c5e378 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013779 Aug 21 01:36:05.674749 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2512/5674] 10.222.0.46 () {58 vars in 1178 bytes} [Sun Aug 21 01:36:05 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:36:05.684232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:05.705487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:05.706461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Searching by: {'deleted': False, 'project_id': '1a83ba47ffad4cb4a82638934e637155'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 01:36:05.715214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.715936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.716562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.718935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.719650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.720277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.769106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 01:36:05.855184 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-373bc147-62a6-4a89-8689-12ceaa37a2d3 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.175309 Aug 21 01:36:05.863773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2513/5675] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 01:36:05 2022] GET /compute/v2.1/servers => generated 683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:05.896395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:05.898119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:05.911344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.914632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.916920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:05.917968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:05.920031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:05.920705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.121077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:06.174268 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc60b34f-52a7-4eca-a92a-7e8a4f8ca654 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1266 microversion: 2.1 time: 0.255734 Aug 21 01:36:06.174980 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2514/5676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:05 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:06.207833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:06.208950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:06.232418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.235444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.241024 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.242458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.242827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.243267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.288112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] HTTP exception thrown: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 HTTP/1.1 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ee365ba1-bb33-4165-a526-b052a0faa834'} Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:06.293905 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 404 to user: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:06.298971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e0f19325-61a9-40e6-9d55-d25a12b99578 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 404 len: 111 microversion: 2.1 time: 0.119464 Aug 21 01:36:06.301285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2515/5677] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:36:06 2022] DELETE /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:06.316071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:06.317214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:06.339322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.340475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.342690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.345483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.349123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.351375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.436826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:36:06.528731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:06.545166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49ea8f97-0408-4d37-b095-c8dd64bd1055 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.923533 Aug 21 01:36:06.555710 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3163/5678] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:05 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:06.724274 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93f416ef-cb11-4687-99fd-64d7d2d7a952 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 204 len: 0 microversion: 2.1 time: 0.415792 Aug 21 01:36:06.726927 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2516/5679] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:36:06 2022] DELETE /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:36:06.735372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:06.735943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:06.744693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.758925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.759533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.760321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.760814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.765655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.770988 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:06.803558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7440db2c-dbb6-4b47-9b45-337589cdc1a0", "name": "network-vif-plugged", "status": "completed", "tag": "75d0756d-063b-4e04-8d1e-00db055301ef"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:06.833731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:36:06.851300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:06.851709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:06.852142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:06.898432 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] Creating event network-vif-plugged:75d0756d-063b-4e04-8d1e-00db055301ef for instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 on n-h1-master-1 Aug 21 01:36:06.928182 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-29441c0a-5b8c-4ead-a1e4-b3cd947b18d9 req-bae168a0-d414-4f1c-b687-4418195089ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132764 Aug 21 01:36:06.935163 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2517/5680] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:06.990773 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:07.057965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-662a7f55-dc5e-4bcb-9287-0d35066fcc92 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 204 len: 0 microversion: 2.1 time: 0.326450 Aug 21 01:36:07.060035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3164/5681] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:36:06 2022] DELETE /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:36:07.071904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:07.077862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: ee365ba1-bb33-4165-a526-b052a0faa834] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:07.086162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.087310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.087903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.088839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.090258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.091283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.114341 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] HTTP exception thrown: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 HTTP/1.1 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ee365ba1-bb33-4165-a526-b052a0faa834'} Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:07.117533 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. Aug 21 01:36:07.121504 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:07.128955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 404 to user: Instance ee365ba1-bb33-4165-a526-b052a0faa834 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:07.130072 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-25fbd2ff-6b64-4b4e-8c34-6787aef4df33 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834" status: 404 len: 111 microversion: 2.1 time: 0.063908 Aug 21 01:36:07.130891 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2518/5682] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:07 2022] GET /compute/v2.1/servers/ee365ba1-bb33-4165-a526-b052a0faa834 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:07.140403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:07.141400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:07.158268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.158659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.159129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.160361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.161232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.162003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.201649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:07.204487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:07.221191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.223223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.226180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.229246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.232472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.233527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.363772 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:07.628674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:07.638753 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2775eaa-738f-4497-887b-bf72ec9fba83 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.445483 Aug 21 01:36:07.641165 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2519/5683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:07 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:07.654495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:07.655336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:07.675459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.675810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.676228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.676979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:07.677429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:07.678354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:07.832090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:07.840702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4df6313-881a-447c-9179-eff6bae64c4a tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 200 len: 1522 microversion: 2.1 time: 0.704442 Aug 21 01:36:07.844165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3165/5684] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:07 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:08.407826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:08.412431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:08.424014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.429878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.430345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:08.431201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.431825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.432193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:08.442385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:08.480124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b75cc7d8-d2d2-4178-bae7-e1212ba2c7b9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.837813 Aug 21 01:36:08.494069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lazy-loading 'flavor' on Instance uuid aa235ebb-ea8f-4024-ad65-d60ec723b710 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:36:08.495147 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2520/5685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:07 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:08.665641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:08.666959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:08.679840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.680431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.687139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:08.689629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.690448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.696122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:08.769989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27fb829e-cb1b-417f-8f33-0f4d3d58a6b0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/action" status: 202 len: 0 microversion: 2.20 time: 0.366037 Aug 21 01:36:08.771504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3166/5686] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:36:08 2022] POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:36:08.780824 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:08.781821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:08.791610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.792302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.792920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:08.793933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:08.794384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:08.795315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:09.327054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:09.336371 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-592ee77b-a7f3-4211-9b14-2fe9a8b4d8dd tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.676523 Aug 21 01:36:09.337054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2521/5687] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:08 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:09.353094 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:09.353718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:09.365713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:09.365939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:09.368013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:09.369040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:09.369775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:09.370391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:09.370963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:09.379644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:09.386761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:09.389499 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f16e715-06e2-4376-b603-09ca3813ff85 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.613596 Aug 21 01:36:09.391728 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3167/5688] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:08 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:09.520096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:09.520844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:09.540316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:09.541725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:09.543013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:09.545173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:09.546858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:09.548382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:09.938904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:09.951974 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e01b94d1-627d-4ffa-843c-79e9f440fc93 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 200 len: 1522 microversion: 2.1 time: 0.613755 Aug 21 01:36:09.954279 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2522/5689] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:09 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:10.125909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "816f2115-61ff-4eb2-83ab-598f529b690b", "tag": "c9620c0a-99e2-4fb7-bc2c-ddb285cadf70"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:10.163153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.163859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.164613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.189181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] Creating event network-changed:c9620c0a-99e2-4fb7-bc2c-ddb285cadf70 for instance 816f2115-61ff-4eb2-83ab-598f529b690b on n-h1-master-1 Aug 21 01:36:10.224498 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bdfbe2d0-86c5-4dc7-9a34-08ba5945588b req-4f5a2fe1-abd3-4a60-944d-2d291b0281b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100314 Aug 21 01:36:10.228748 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2523/5690] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:10.333407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:10.351559 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-411fceff-09f2-4c2c-8f64-c1cf0f89a695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1366 microversion: 2.1 time: 0.836232 Aug 21 01:36:10.353449 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3168/5691] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:09 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1366 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:10.362400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:10.363243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:10.377405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.378239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.378894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.381976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.383291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.384737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.416671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:10.417753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:10.430408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.430994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.436753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.437719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.438297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.438815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.725192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:10.735231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-27b25fc2-9035-46ed-8629-86b37190bd0a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.378245 Aug 21 01:36:10.735908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2524/5692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:10 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:10.750491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba37066-7117-456d-8b6e-52d114948027", "name": "network-vif-deleted", "tag": "b86d20aa-f462-472e-b130-ba60b0053da3"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:10.776317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:10.776825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:10.778969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:10.810454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] Creating event network-vif-deleted:b86d20aa-f462-472e-b130-ba60b0053da3 for instance cba37066-7117-456d-8b6e-52d114948027 on n-h2-master-1 Aug 21 01:36:10.825996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-050b3ce9-0e30-4d93-bd71-786b3f8d1d6b req-783de543-af87-41b6-894f-9ffc66d03819 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084200 Aug 21 01:36:10.826900 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2525/5693] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:10.888743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:10.898200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:10.899738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:10.913279 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1acbb00-d849-44f6-adcc-ef350b09ca8d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.492970 Aug 21 01:36:10.917487 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3169/5694] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:10 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:10.976960 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:10.979426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:11.019002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.019599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.020084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.024275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.024912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.025364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.255544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:11.275446 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6eba217b-cf32-46fe-a3ea-3e3c2761dc49 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 200 len: 1308 microversion: 2.1 time: 0.304333 Aug 21 01:36:11.276150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2526/5695] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:10 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:11.378040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:11.378651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:11.420414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.421192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.423773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.426143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.429001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.430616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.755833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:11.757223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:11.770216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.774147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.774721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.775585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.776207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.808039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.823264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:11.844453 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adeea4e6-9d89-45ef-9e85-738b6393c156 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1556 microversion: 2.1 time: 0.470328 Aug 21 01:36:11.845336 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3170/5696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:11 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1556 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:11.876819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:11.877696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:11.886436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.887189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.888238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:11.889369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:11.894020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:11.894597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.016593 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d9d0de3-7ef4-45b7-9eb4-40f6f192f512 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143745 Aug 21 01:36:12.017531 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3171/5697] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:36:11 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:12.022915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:12.023807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:12.033735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.034891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.035329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.036040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.036991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.037492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.248969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:12.258295 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40a0e87d-c788-4013-9381-c3fc1a26d2e3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.506444 Aug 21 01:36:12.262404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2527/5698] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:11 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:12.271011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:12.286525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a0a0c2-81b8-47b8-8f5f-c8382e81e653", "name": "network-vif-deleted", "tag": "0555336b-8a50-406f-9415-51d212867def"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:12.287116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:12.292929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:12.298840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfad59f9-e38e-442d-ab35-d57be4195a4e tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.276730 Aug 21 01:36:12.300116 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3172/5699] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:12 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:12.311808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:12.313334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:12.314093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.314577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.315010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.321595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.322324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.323155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.324397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.325162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.325726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.363062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:12.364149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:12.365044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:12.365954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lazy-loading 'fault' on Instance uuid d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:36:12.372833 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] Creating event network-vif-deleted:0555336b-8a50-406f-9415-51d212867def for instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 on n-h1-master-1 Aug 21 01:36:12.395161 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1472db13-32c2-461f-aba1-8c2302a5646f req-d5756f69-422a-4111-9677-74fa4c1575a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112893 Aug 21 01:36:12.396151 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2528/5700] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:12.421744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c6bcee78c3148b5a6caa34678b1cc10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a83ba47ffad4cb4a82638934e637155', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:12.444243 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1177d930-d0c2-409f-a744-fcc80bf117a8 tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 200 len: 1313 microversion: 2.1 time: 0.142532 Aug 21 01:36:12.452799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3173/5701] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:12 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:13.288858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:13.290368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:13.297947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.298822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.299507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.300590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.301319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.301973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.322967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:13.324071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:13.333093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.334689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.335349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.336501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.337489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.348801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.542243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:13.554786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:13.556806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:13.559027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3b5c07d-cde4-43f9-9adc-037693e30718 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.240328 Aug 21 01:36:13.560196 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3174/5702] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:13 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:13.566101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:13.566638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: d1a0a0c2-81b8-47b8-8f5f-c8382e81e653] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:13.573792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.574587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.575161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.576712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.577532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.578099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.599678 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] HTTP exception thrown: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 HTTP/1.1 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd1a0a0c2-81b8-47b8-8f5f-c8382e81e653'} Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.602010 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. Aug 21 01:36:13.606398 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.608546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 404 to user: Instance d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:13.611302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02e51d32-b5ab-4614-942e-a51afed2e23d tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653" status: 404 len: 111 microversion: 2.1 time: 0.049928 Aug 21 01:36:13.612165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3175/5703] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:13 2022] GET /compute/v2.1/servers/d1a0a0c2-81b8-47b8-8f5f-c8382e81e653 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:13.623740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:13.625544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] [instance: cba37066-7117-456d-8b6e-52d114948027] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:13.635118 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:13.637035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.637831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.639130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.640174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:13.641266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:13.641832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:13.706310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] HTTP exception thrown: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Request method failure captured: Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 HTTP/1.1 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYvZhYJSxHDpf50x5XcwGTWESSeUAdlN5x7c1l_NFwMgzNTApexgseMOf7rp-JDWtzIUSojWAQ9ufSwW-PEso1_Ep20GbApXGYL3kp5EKw2RBdf-6w7F7xv9to87OfKDApJo_mG30UriPiGTFCG25NaY7B93pi767IwMHyUBvshsbnY Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1a83ba47ffad4cb4a82638934e637155", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1a83ba47ffad4cb4a82638934e637155"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1a83ba47ffad4cb4a82638934e637155"}]}] Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1a83ba47ffad4cb4a82638934e637155 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-811265185 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 0c6bcee78c3148b5a6caa34678b1cc10 Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ListServersNegativeTestJSON-811265185-project Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: exception: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'cba37066-7117-456d-8b6e-52d114948027'} Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.724631 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] Returning 404 to user: Instance cba37066-7117-456d-8b6e-52d114948027 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:13.729324 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31cab48e-eaa1-43d8-abf7-a542184d08ed tempest-ListServersNegativeTestJSON-811265185 tempest-ListServersNegativeTestJSON-811265185-project] 10.222.0.46 "GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027" status: 404 len: 111 microversion: 2.1 time: 0.110222 Aug 21 01:36:13.731069 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3176/5704] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:13 2022] GET /compute/v2.1/servers/cba37066-7117-456d-8b6e-52d114948027 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:14.228164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:14.260034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-05491a5f-eec8-40b4-819d-f36d35190c15 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.976677 Aug 21 01:36:14.271253 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2529/5705] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:13 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:14.586766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:14.587984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:14.604469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:14.605236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:14.605893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:14.608155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:14.609286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:14.611807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:14.731873 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:14.898970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:14.915636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:14.917778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:14.921537 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c390d8c-a759-4c8c-9c3f-e18c89362fd2 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.339505 Aug 21 01:36:14.937752 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3177/5706] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:14 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:15.292198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:15.293330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:15.296290 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:15.309629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:15.321481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:15.321948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:15.322710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:15.323176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:15.323692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:15.728235 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:15.779138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7440db2c-dbb6-4b47-9b45-337589cdc1a0", "tag": "75d0756d-063b-4e04-8d1e-00db055301ef"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:15.795271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:15.808783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:15.814255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:15.829258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:15.836457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] Creating event network-changed:75d0756d-063b-4e04-8d1e-00db055301ef for instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 on n-h1-master-1 Aug 21 01:36:15.840487 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2137356e-8bd5-43eb-82e0-3898dbc5757c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.553031 Aug 21 01:36:15.843490 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2530/5707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:15 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:15.857700 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2104cf10-8ecf-4e6f-8106-5c625715d941 req-4e91dd7d-4884-42cc-bb3a-b44890914f27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080596 Aug 21 01:36:15.872170 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3178/5708] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:15.953856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:15.955029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:15.968501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:15.970365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:15.973957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:15.974969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:15.975702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:15.976302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:16.864572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:16.866281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:16.881346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:16.883949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:16.888368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:16.892037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:16.892806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:16.893478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:16.903427 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:17.492582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:17.509151 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:17.516591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:17.526004 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7520e989-ed52-4324-8d58-a4f3ef71b719 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 1.577775 Aug 21 01:36:17.530014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2531/5709] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:15 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:17.547399 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "816f2115-61ff-4eb2-83ab-598f529b690b", "name": "network-vif-plugged", "status": "completed", "tag": "c9620c0a-99e2-4fb7-bc2c-ddb285cadf70"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:17.604208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:17.605195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:17.606091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:17.641533 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] Creating event network-vif-plugged:c9620c0a-99e2-4fb7-bc2c-ddb285cadf70 for instance 816f2115-61ff-4eb2-83ab-598f529b690b on n-h1-master-1 Aug 21 01:36:17.648642 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3fd3ba38-3636-417f-bcc6-0c97893b76a9 req-18dfc2df-7115-4533-91f4-b1d61a48b5e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116998 Aug 21 01:36:17.650116 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2532/5710] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:18.010922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:18.035676 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a4a177f-9216-4a1c-bb06-0b6f333a2a8f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 1.174619 Aug 21 01:36:18.039048 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3179/5711] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:16 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:18.555402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:18.556103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:18.570745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:18.571476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:18.572058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:18.572952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:18.573582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:18.583576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:19.060828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:19.061456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:19.097359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:19.099441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:19.100631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:19.105856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:19.106847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:19.109396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:19.469050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:19.482911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:19.485576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:19.488786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8233b1a1-1501-4c7b-8f97-bcd70bc4ecf4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.938512 Aug 21 01:36:19.494039 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2533/5712] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:18 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:19.635941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:19.650343 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae2a025c-c6db-43df-8059-a4fffff4c221 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1308 microversion: 2.1 time: 0.594168 Aug 21 01:36:19.665047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3180/5713] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:19 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:20.521887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:20.523152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:20.533202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:20.534113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:20.535093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:20.536427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:20.537348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:20.538095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:20.672297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:20.673834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:20.683221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:20.683982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:20.684608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:20.685677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:20.686314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:20.686965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:20.867283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:20.878538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:20.882137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:20.884437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4deb0d90-1a7e-4844-ad1b-c42feb68c3c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1743 microversion: 2.20 time: 0.370224 Aug 21 01:36:20.885466 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2534/5714] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:20 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1743 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:20.942098 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:20.953222 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7121a3d8-c5f2-4440-b7c6-a90e0337d03e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1488 microversion: 2.1 time: 0.284364 Aug 21 01:36:20.955033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3181/5715] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:20 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1488 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:20.977333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:20.980102 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:21.000492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.001203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.001778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.002641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.003244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.003837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.096629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-306e989d-638e-40b7-9e99-2e74c8cb75a8 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "PUT /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1083 microversion: 2.1 time: 0.123741 Aug 21 01:36:21.105522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2535/5716] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:36:20 2022] PUT /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1083 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:21.121988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:21.123084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:21.129578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.130305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.131187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.132084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.132703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.133327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.383278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:21.407745 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d4935f6d-5ef7-4cca-a8da-e085d63dc916 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1509 microversion: 2.1 time: 0.289609 Aug 21 01:36:21.408644 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3182/5717] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:21 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:21.429728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:21.430341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:21.439936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.440411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.440880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.441574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.442190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.442756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.752242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:21.764576 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe82db1b-d697-4a0f-8ca4-a42116391524 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1509 microversion: 2.1 time: 0.338347 Aug 21 01:36:21.765535 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2536/5718] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:21 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:21.790827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:21.791971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:21.808261 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.813114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.813846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.814933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.815478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.815978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.914601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:21.915892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:21.933358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:36:21.937373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.938123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.938788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:21.942740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:21.944008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:21.944532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:22.074381 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b031a842-09ab-419a-8449-d0e1020a070d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 204 len: 0 microversion: 2.1 time: 0.287871 Aug 21 01:36:22.075274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3183/5719] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:36:21 2022] DELETE /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:36:22.085511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:22.086340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:22.093528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:22.094142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:22.094638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:22.095395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:22.095904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:22.096409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:22.291311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:22.292444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:22.305137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:22.306058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1a8057e-39ef-4b5f-b315-c4770a9aeb02 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1515 microversion: 2.1 time: 0.225179 Aug 21 01:36:22.309643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:22.313796 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ef3a0ac-9ab6-4652-84b8-039bb92013d0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1743 microversion: 2.20 time: 0.409573 Aug 21 01:36:22.314584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2537/5720] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:21 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1743 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:22.317286 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3184/5721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:22 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:23.331586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:23.333853 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:23.339532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:23.340176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:23.345789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:23.346426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:23.347003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:23.347991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:23.352270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:23.352760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:23.357240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:23.359134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:23.359675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:23.360112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:23.367609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:23.371302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:23.385500 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:23.633370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:23.647621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:23.650853 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:23.652552 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2b3738f7-9281-421b-be62-35a4847bb2dc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1743 microversion: 2.20 time: 0.319044 Aug 21 01:36:23.666679 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3185/5722] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:23 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1743 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:23.811886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:23.828950 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9950d7af-e5f5-4398-a8ba-fea73f99e844 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1515 microversion: 2.1 time: 0.500613 Aug 21 01:36:23.829949 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2538/5723] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:23 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:24.188796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99cf8fa8-53a4-4aa6-a40e-9a5d03641821 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Action: 'create', calling method: .version_select at 0x7fc3f87ebf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-73587850"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:24.382592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "name": "network-vif-plugged", "status": "completed", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:24.407028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.407468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.407946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.449204 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] Creating event network-vif-plugged:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h2-master-1 Aug 21 01:36:24.456602 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-711a250e-2d82-43be-8978-f065e86496dc req-67520f5e-be70-4f59-96fe-1410e64edbca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078873 Aug 21 01:36:24.465040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2539/5724] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:24.679795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:24.681403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:24.698779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.699678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.702168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.703032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.705684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.706347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.713770 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99cf8fa8-53a4-4aa6-a40e-9a5d03641821 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.708340 Aug 21 01:36:24.714832 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3186/5725] 10.222.0.46 () {60 vars in 1155 bytes} [Sun Aug 21 01:36:24 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 710 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 21 01:36:24.722221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "816f2115-61ff-4eb2-83ab-598f529b690b", "name": "network-vif-deleted", "tag": "c9620c0a-99e2-4fb7-bc2c-ddb285cadf70"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:24.746236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.749112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.749634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.771975 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] Creating event network-vif-deleted:c9620c0a-99e2-4fb7-bc2c-ddb285cadf70 for instance 816f2115-61ff-4eb2-83ab-598f529b690b on n-h1-master-1 Aug 21 01:36:24.783415 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-75576a3d-c2bd-41fe-b621-43d77ae4cdbe req-dadf085c-ca53-4de0-a678-50e8fad3295e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061631 Aug 21 01:36:24.784160 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3187/5726] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:24.789675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-01f977b8-baa0-40f6-8d0c-8a12451518f6 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f9284c10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:24.874299 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-01f977b8-baa0-40f6-8d0c-8a12451518f6 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 200 len: 343 microversion: 2.1 time: 0.088708 Aug 21 01:36:24.874882 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3188/5727] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:24 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:24.880136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:24.880932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:24.888234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.888717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.889183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.889889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.890333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.890749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.932621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:24.933375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:24.933805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:24.934281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lazy-loading 'fault' on Instance uuid 816f2115-61ff-4eb2-83ab-598f529b690b {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:36:24.985937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:24.986346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:24.994468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3847dbb3-9e07-4c46-820a-ac888fa96c5c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 200 len: 1319 microversion: 2.1 time: 0.118123 Aug 21 01:36:25.001280 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3189/5728] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:24 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 1319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:25.003185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:25.006075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:25.008009 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd1cf05e-183c-432a-9581-5a46af4210c9 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1743 microversion: 2.20 time: 0.333549 Aug 21 01:36:25.008708 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2540/5729] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:24 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1743 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:25.888700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b949a67e-0cad-4feb-9190-42077948fd49 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f87ebe50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:25.938255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b949a67e-0cad-4feb-9190-42077948fd49 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 200 len: 344 microversion: 2.1 time: 0.053439 Aug 21 01:36:25.938860 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3190/5730] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:25 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:25.951927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6bafef00-76d7-4be6-b6e0-d168c016b241 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Action: 'create', calling method: .version_select at 0x7fc3fd9d4670>, body: {"snapshot": {"volume_id": "d802f5ea-9442-4fb3-8079-7103ad008496", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1889353361"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:26.016737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.017393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:26.026506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.027286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.028974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.030230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.030872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.031467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.046921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b HTTP/1.1 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '816f2115-61ff-4eb2-83ab-598f529b690b'} Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:26.048973 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1b837491-8a28-4a40-8ec3-9f455a7f9cab tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 404 len: 111 microversion: 2.1 time: 0.038385 Aug 21 01:36:26.053448 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3191/5731] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:26.060914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.061539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:26.068943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.069424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.069847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.070716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.071163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.071579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.172459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6bafef00-76d7-4be6-b6e0-d168c016b241 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.224391 Aug 21 01:36:26.173324 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2541/5732] 10.222.0.46 () {60 vars in 1162 bytes} [Sun Aug 21 01:36:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:26.184707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-abfba703-b728-484a-adbf-df22ae2e7171 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fd99f670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.239862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-abfba703-b728-484a-adbf-df22ae2e7171 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.059085 Aug 21 01:36:26.240497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2542/5733] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:26.245372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1928221284", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f2701eb-9e92-47af-b786-25b76c8b0934"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:26.278846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:26.299328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:26.301000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:26.304995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a22cf82-d494-443d-bfdd-9c5c8e92c81f tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1743 microversion: 2.20 time: 0.250365 Aug 21 01:36:26.305634 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3192/5734] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:26.307321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] validate_networks() for [('5f2701eb-9e92-47af-b786-25b76c8b0934', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:36:26.331095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd58a2c9-71af-43f8-951e-d882c1f2c1ea tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f87d5280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.390327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd58a2c9-71af-43f8-951e-d882c1f2c1ea tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083274 Aug 21 01:36:26.391179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3193/5735] 10.222.0.46 () {58 vars in 1140 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:26.402807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fd2c7e4-fdec-4189-aa81-5eb3d7a1d34e tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f87fc8b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.457694 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fd2c7e4-fdec-4189-aa81-5eb3d7a1d34e tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.058554 Aug 21 01:36:26.468287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3194/5736] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:26.784927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:36:26.785363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:36:26.785837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:36:26.786267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:36:26.787347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:36:26.797888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.798436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.798938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.799757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:26.800271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:26.800809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:26.820063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:36:26.827016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Getting quotas for user 27a75d14c8494952a4577bff44f15f99 and project 455488ff7064493a91bb38fc683bd233. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:36:26.841262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:36:26.844252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:36:26.920388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32f5bc9c-c595-46be-aacb-f55040466f85 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678661 Aug 21 01:36:26.923495 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2543/5737] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:36:26.934001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51f62654-289b-4fc8-b900-08b1d31e6f78 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:26.935218 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51f62654-289b-4fc8-b900-08b1d31e6f78 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:27.034745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51f62654-289b-4fc8-b900-08b1d31e6f78 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:27.042921 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51f62654-289b-4fc8-b900-08b1d31e6f78 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1209 microversion: 2.1 time: 0.114442 Aug 21 01:36:27.046815 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3195/5738] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:26 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:27.328452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:27.329933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:27.337812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:27.338300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:27.338734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:27.339431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:27.340038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:27.340616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:27.475596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-add07ba0-2c10-4fb0-9995-5d0d6c442904 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f88070d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:27.523357 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-add07ba0-2c10-4fb0-9995-5d0d6c442904 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.052499 Aug 21 01:36:27.524012 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3196/5739] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:27 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:27.547899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:27.559601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:27.562616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:27.564064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a7e98ca-25ca-43f1-bfb7-e1c11a9c2f19 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.240206 Aug 21 01:36:27.569068 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2544/5740] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:27 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:28.069444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:28.070304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:28.086113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:28.086928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:28.087636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:28.089372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:28.090376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:28.091506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:28.198966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:28.208598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef775cd4-440f-4173-9e14-1ac2b257a47b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1261 microversion: 2.1 time: 0.144287 Aug 21 01:36:28.209923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3197/5741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:28 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:28.536091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd533c3f-49bb-4d21-9877-d80e86ae805b tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fdcbb940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:28.588954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:28.589974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:28.602130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:28.602719 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd533c3f-49bb-4d21-9877-d80e86ae805b tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 288 microversion: 2.1 time: 0.070645 Aug 21 01:36:28.603332 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2545/5742] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:28 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 288 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:28.603678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:28.604414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:28.605852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:28.606854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:28.607562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:28.619925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d34b0e7-7393-4cfb-9be8-c1ce58f6dd2f tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fd84c160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:28.702722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d34b0e7-7393-4cfb-9be8-c1ce58f6dd2f tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 202 len: 0 microversion: 2.1 time: 0.091728 Aug 21 01:36:28.706706 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2546/5743] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:36:28 2022] DELETE /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:36:28.715068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f8208b2-70f0-4d96-bb31-29328daa57da tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fdaed160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:28.755634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f8208b2-70f0-4d96-bb31-29328daa57da tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.047428 Aug 21 01:36:28.757259 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2547/5744] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:28 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:28.995998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:29.006755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:29.009470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:29.011614 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5f17bdf-65cf-49a9-a102-68073ec01033 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.427919 Aug 21 01:36:29.027969 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3198/5745] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:28 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:29.230882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:29.231595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:29.243120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:29.244013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:29.244858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:29.246526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:29.250262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:29.250967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:29.502765 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:29.512001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf5887eb-a85e-4c3e-a2c0-6d19f5313999 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.285474 Aug 21 01:36:29.528850 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2548/5746] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:29 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:29.769882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-439a7337-366f-46f0-8792-48fd85326233 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f87f2790>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:29.804968 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-439a7337-366f-46f0-8792-48fd85326233 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.039030 Aug 21 01:36:29.810463 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3199/5747] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:29 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:30.036661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:30.037509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:30.060887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:30.065219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:30.065710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:30.067617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:30.068222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:30.071842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:30.400629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:30.412355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:30.414354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:30.416124 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d221de8e-d893-4c41-86d8-0d8135db25a1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.384476 Aug 21 01:36:30.417078 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2549/5748] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:30 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:30.556997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:30.558995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:30.581870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:30.583159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:30.590155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:30.591755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:30.592511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:30.593132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:30.797768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aeb0ff0-bdbc-4b77-806d-45b725511ce6", "tag": "39d45b73-a167-4fce-9567-15fd88b7b1e4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:30.831395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:30.832115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:30.833015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:30.856912 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] Creating event network-changed:39d45b73-a167-4fce-9567-15fd88b7b1e4 for instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 on n-h2-master-1 Aug 21 01:36:30.873622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:30.880669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-16ddfc14-aeed-4888-b832-69a0c64d98af req-ad8e4d60-74bc-40f2-91c7-4bdf31b2f3cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083095 Aug 21 01:36:30.883554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2550/5749] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:30.889384 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6b67e27-67fb-49db-8ca1-8f4166ace9f9 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.347320 Aug 21 01:36:30.891964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3200/5750] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:30 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:30.907196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62e5a71a-ca72-49dc-9443-428150b42484 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc4032b7160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:30.967771 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62e5a71a-ca72-49dc-9443-428150b42484 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 200 len: 287 microversion: 2.1 time: 0.082917 Aug 21 01:36:30.968503 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2551/5751] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:30 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:31.440510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:31.442413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:31.452803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:31.453764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:31.454746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:31.455789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:31.456394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:31.456981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:31.637647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:31.649903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:31.651922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:31.654042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f5c00c2-4bad-4e3a-ac9b-1eff2de9ead8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.217623 Aug 21 01:36:31.654797 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3201/5752] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:31 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:31.913763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:31.915426 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:31.923114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:31.924138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:31.924826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:31.925783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:31.926378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:31.927332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:31.979883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f5f0828-4c3a-4e07-b492-0b38ae9f6dbb tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f8807670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:32.011770 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3f5f0828-4c3a-4e07-b492-0b38ae9f6dbb tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] HTTP exception thrown: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f5f0828-4c3a-4e07-b492-0b38ae9f6dbb tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Request method failure captured: Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 HTTP/1.1 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYwXtl9tYXWi--TpaEG9sp0dHoFgDc2KFDdI4n9MG0QFCNSKPEwCnIwe28thQpgrneNDekiTR322u3ZDBzOb3A3sMKAK9v2e2D7dgGXXFmZotQ2Nczx7BFry6FLIVOJpYikvBT_NcDVc-0e6ig4J8BOVJyLEDLKwT30JkiswvhZJZfw Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c8849026f4c73ae5afb45243301ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}] Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e9fc462c45eb43179e9cf1d0a67d7a6e Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: exception: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '8dd37aad-0695-42e5-abfe-99ff8239bc04'} Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. (HTTP 404) (Request-ID: req-d1214e07-8e36-49c9-985e-94631f53be39) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:36:32.019662 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. Aug 21 01:36:32.024228 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:32.030578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f5f0828-4c3a-4e07-b492-0b38ae9f6dbb tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Returning 404 to user: Snapshot 8dd37aad-0695-42e5-abfe-99ff8239bc04 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:32.031701 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f5f0828-4c3a-4e07-b492-0b38ae9f6dbb tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04" status: 404 len: 111 microversion: 2.1 time: 0.055589 Aug 21 01:36:32.036829 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3202/5753] 10.222.0.46 () {58 vars in 1251 bytes} [Sun Aug 21 01:36:31 2022] GET /compute/v2.1/os-snapshots/8dd37aad-0695-42e5-abfe-99ff8239bc04 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:32.044651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1746fb67-fb85-4cf0-b1fc-fbc4a239bc7f tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f92849d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:32.185613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:32.197269 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bb0ccd6-f930-47db-9b29-f081ac2d4b18 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.289972 Aug 21 01:36:32.197882 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2552/5754] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:31 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:32.211767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1746fb67-fb85-4cf0-b1fc-fbc4a239bc7f tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 202 len: 0 microversion: 2.1 time: 0.168821 Aug 21 01:36:32.211767 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3203/5755] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:36:32 2022] DELETE /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:36:32.219351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04299e77-87f4-4f3e-8125-1aeed064546b tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f883e9d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:32.281032 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04299e77-87f4-4f3e-8125-1aeed064546b tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 200 len: 343 microversion: 2.1 time: 0.067628 Aug 21 01:36:32.281711 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3204/5756] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:32 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:32.679907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:32.680572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:32.694809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:32.695711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:32.696329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:32.697313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:32.697922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:32.698498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:32.846857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:32.856307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:32.859142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:32.860533 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9c324c74-79eb-4cf4-ad5b-05736bf0df2d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.184926 Aug 21 01:36:32.873368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2553/5757] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:32 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:33.220229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:33.220886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:33.234674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:33.235457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:33.236037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:33.237003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:33.237621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:33.241557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:33.299046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd2eb3ab-e583-49b2-a9e4-ce697c9aa2ea tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fd9c61f0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:33.424374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd2eb3ab-e583-49b2-a9e4-ce697c9aa2ea tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 200 len: 343 microversion: 2.1 time: 0.130839 Aug 21 01:36:33.429722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2554/5758] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:33 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 343 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:33.541961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:33.551494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a48dc7e-3224-40f3-a6f3-a607e68c86e4 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.335738 Aug 21 01:36:33.566177 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3205/5759] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:33 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:33.887409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:33.888160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:33.901951 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:33.902446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:33.902884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:33.903604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:33.904056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:33.905002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:34.239749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:34.258644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:34.264343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:34.266002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6cb1f7e6-d8b5-402c-9622-2f609c13efe1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.382713 Aug 21 01:36:34.273938 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2555/5760] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:33 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:34.466250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7bc3432-4009-467d-805e-ee621afa01a3 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f883ec10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:34.575815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:34.576718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:34.596588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7bc3432-4009-467d-805e-ee621afa01a3 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 200 len: 343 microversion: 2.1 time: 0.151588 Aug 21 01:36:34.603453 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3206/5761] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:34 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 343 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:34.605269 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:34.607055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:34.611074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:34.611521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:34.612263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:34.612718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:34.613175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:34.946445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:34.958264 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-01349842-b6ee-4789-aa97-46d16bab6a8c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.389450 Aug 21 01:36:34.958890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2556/5762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:34 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:35.297747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:35.298699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:35.313630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:35.326668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:35.327527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:35.330497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:35.333767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:35.337354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:35.342059 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:35.610434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0b23cea-9903-4048-9f16-0729f5a9082c tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fd9d4280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:35.620147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:35.633049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:35.650605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:35.657568 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80a73bd6-e530-4489-b7d3-9e7b88e738b5 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.359360 Aug 21 01:36:35.658899 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3207/5763] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:35 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:35.670614 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d0b23cea-9903-4048-9f16-0729f5a9082c tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] HTTP exception thrown: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0b23cea-9903-4048-9f16-0729f5a9082c tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Request method failure captured: Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 HTTP/1.1 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYwXtl9tYXWi--TpaEG9sp0dHoFgDc2KFDdI4n9MG0QFCNSKPEwCnIwe28thQpgrneNDekiTR322u3ZDBzOb3A3sMKAK9v2e2D7dgGXXFmZotQ2Nczx7BFry6FLIVOJpYikvBT_NcDVc-0e6ig4J8BOVJyLEDLKwT30JkiswvhZJZfw Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c8849026f4c73ae5afb45243301ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}] Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e9fc462c45eb43179e9cf1d0a67d7a6e Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: exception: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd802f5ea-9442-4fb3-8079-7103ad008496'} Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. (HTTP 404) (Request-ID: req-ac193dc7-68dd-479d-bb9d-5c6f5784285e) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:36:35.673661 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.677949 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.682693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0b23cea-9903-4048-9f16-0729f5a9082c tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Returning 404 to user: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:35.684278 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0b23cea-9903-4048-9f16-0729f5a9082c tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 404 len: 109 microversion: 2.1 time: 0.078154 Aug 21 01:36:35.685181 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2557/5764] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:35 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:36:35.697838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13dc3f74-411e-4fab-b5b2-9b43c8c56d39 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3f877fd30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:35.737359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-13dc3f74-411e-4fab-b5b2-9b43c8c56d39 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] HTTP exception thrown: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13dc3f74-411e-4fab-b5b2-9b43c8c56d39 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Request method failure captured: Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 HTTP/1.1 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYwXtl9tYXWi--TpaEG9sp0dHoFgDc2KFDdI4n9MG0QFCNSKPEwCnIwe28thQpgrneNDekiTR322u3ZDBzOb3A3sMKAK9v2e2D7dgGXXFmZotQ2Nczx7BFry6FLIVOJpYikvBT_NcDVc-0e6ig4J8BOVJyLEDLKwT30JkiswvhZJZfw Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c8849026f4c73ae5afb45243301ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}] Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e9fc462c45eb43179e9cf1d0a67d7a6e Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: method: Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: exception: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd802f5ea-9442-4fb3-8079-7103ad008496'} Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. (HTTP 404) (Request-ID: req-afd1c272-5421-4ff4-8a67-32c865a8ae87) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:36:35.739761 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.743506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.748813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13dc3f74-411e-4fab-b5b2-9b43c8c56d39 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Returning 404 to user: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:35.748813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13dc3f74-411e-4fab-b5b2-9b43c8c56d39 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 404 len: 109 microversion: 2.1 time: 0.054160 Aug 21 01:36:35.748813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3208/5765] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:36:35 2022] DELETE /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:35.757972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ceb9007a-ce76-4940-b760-69ee56af7757 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Calling method '.version_select at 0x7fc3fdadb280>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:35.792236 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ceb9007a-ce76-4940-b760-69ee56af7757 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] HTTP exception thrown: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ceb9007a-ce76-4940-b760-69ee56af7757 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Request method failure captured: Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 HTTP/1.1 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYwXtl9tYXWi--TpaEG9sp0dHoFgDc2KFDdI4n9MG0QFCNSKPEwCnIwe28thQpgrneNDekiTR322u3ZDBzOb3A3sMKAK9v2e2D7dgGXXFmZotQ2Nczx7BFry6FLIVOJpYikvBT_NcDVc-0e6ig4J8BOVJyLEDLKwT30JkiswvhZJZfw Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_290c8849026f4c73ae5afb45243301ed", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/290c8849026f4c73ae5afb45243301ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/290c8849026f4c73ae5afb45243301ed"}]}] Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 290c8849026f4c73ae5afb45243301ed Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-747415144 Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e9fc462c45eb43179e9cf1d0a67d7a6e Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesSnapshotsTestJSON-747415144-project Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: method: Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: exception: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd802f5ea-9442-4fb3-8079-7103ad008496'} Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. (HTTP 404) (Request-ID: req-14f13ce2-1e97-45c2-acde-14bab3dbcdbb) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 21 01:36:35.795359 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. Aug 21 01:36:35.799010 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:36:35.805040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ceb9007a-ce76-4940-b760-69ee56af7757 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] Returning 404 to user: Volume d802f5ea-9442-4fb3-8079-7103ad008496 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:36:35.805948 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ceb9007a-ce76-4940-b760-69ee56af7757 tempest-VolumesSnapshotsTestJSON-747415144 tempest-VolumesSnapshotsTestJSON-747415144-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496" status: 404 len: 109 microversion: 2.1 time: 0.054393 Aug 21 01:36:35.806527 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2558/5766] 10.222.0.46 () {58 vars in 1245 bytes} [Sun Aug 21 01:36:35 2022] GET /compute/v2.1/os-volumes/d802f5ea-9442-4fb3-8079-7103ad008496 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:36:35.980474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:35.984154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:36.001657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:36.002440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:36.003793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:36.005096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:36.005819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:36.006469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:36.207031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:36.219689 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6791b72a-e2a7-4a9b-9fa2-c989698a70e6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.241266 Aug 21 01:36:36.233707 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3209/5767] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:35 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:36.552396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb0ff0-bdbc-4b77-806d-45b725511ce6", "name": "network-vif-plugged", "status": "completed", "tag": "39d45b73-a167-4fce-9567-15fd88b7b1e4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:36.577009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:36.577498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:36.577934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:36.596226 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] Creating event network-vif-plugged:39d45b73-a167-4fce-9567-15fd88b7b1e4 for instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 on n-h2-master-1 Aug 21 01:36:36.603253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6bd2aa3e-27a7-4f8e-baaf-27b9905ddb6a req-4f63ba48-d09c-4773-9b4d-de48974842ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055680 Aug 21 01:36:36.604661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2559/5768] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:36:36.688034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:36.688856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:36.713465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:36.714225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:36.714844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:36.716923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:36.717667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:36.718396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:37.042335 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:37.073103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:37.085583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:37.087386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:37.089030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa3be372-3226-4b74-94cd-0ab474780f52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.410411 Aug 21 01:36:37.090687 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3210/5769] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:36 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:37.256828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:37.256828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:37.256828 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:37.256828 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:37.284892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:37.285530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:37.287235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:37.288193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:37.290510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:37.291302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:37.497316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:37.514617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-716fbdde-a3cc-4d35-a946-021e557bffd0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.267576 Aug 21 01:36:37.529781 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2560/5770] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:37 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:38.115965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:38.117219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:38.147857 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:38.150939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:38.165942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:38.166695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:38.167643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:38.168149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:38.169459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:38.502159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:38.540656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:38.543154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:38.545757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:38.550335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:38.553537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:38.556265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:38.559246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:38.560293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:38.560779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:38.565352 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f39a917e-49ce-455d-a73e-db54ab4e805c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.448591 Aug 21 01:36:38.566059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:38.566301 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3211/5771] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:38 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:38.905358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:38.920732 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-78a2f95b-1f1f-41de-8273-647a4c552ab0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1309 microversion: 2.1 time: 0.380711 Aug 21 01:36:38.923268 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2561/5772] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:38 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1309 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:39.595157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:39.595732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:39.616608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:39.617052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:39.617491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:39.618206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:39.619705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:39.619705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:39.847109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:39.857738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:39.860489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:39.862227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a553b0e-3bf1-46ac-9f70-b60b0c24e952 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.271256 Aug 21 01:36:39.863460 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3212/5773] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:39 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:39.946511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:39.947127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:39.964356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:39.965486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:39.966184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:39.971351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:39.977741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:39.978471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.241700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:40.250790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1129ad37-b995-4672-b738-f9aa767e57b2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1489 microversion: 2.1 time: 0.310873 Aug 21 01:36:40.251675 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2562/5774] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:39 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1489 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:40.274500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-147901935"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:40.277735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:40.288351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.289005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.289450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.290455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.290903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.291310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.392344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21bbde6e-ff82-4616-9b47-7de86db7c3e0 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "PUT /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1073 microversion: 2.1 time: 0.122124 Aug 21 01:36:40.393410 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3213/5775] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:36:40 2022] PUT /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1073 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:40.411514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:40.412130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:40.422380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.422884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.423322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.424032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.424478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.425152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.651840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:40.667580 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3f42d87a-61ca-4578-8efd-c2a1ac291a34 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1499 microversion: 2.1 time: 0.260498 Aug 21 01:36:40.668522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2563/5776] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:40 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:40.693057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:40.693738 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:40.704829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.705637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.706248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.710620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.711431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.716459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.891052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:40.891667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:40.906268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.909894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.912676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:40.913956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:40.915647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:40.916275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:41.019809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:41.039227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bf0848ae-f5f7-48c0-ac94-cb06a7adad30 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1499 microversion: 2.1 time: 0.350180 Aug 21 01:36:41.041420 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3214/5777] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:40 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1499 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:41.077492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:41.084309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:41.084903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:41.085486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:41.115845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 01:36:41.212390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:41.231127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:41.241427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:41.243844 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64ad1780-48b8-457f-adc4-fbfdc13e8ad0 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.357469 Aug 21 01:36:41.251311 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2564/5778] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:40 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:41.262306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b6ce36b-8134-452b-9d56-41f7d925d038 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "POST /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6/action" status: 202 len: 0 microversion: 2.1 time: 0.188940 Aug 21 01:36:41.266605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3215/5779] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:36:41 2022] POST /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:36:41.282628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:41.283855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:41.292468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:41.293310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:41.294120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:41.295029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:41.295684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:41.296313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:41.502039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:41.511832 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-94308c02-4f89-4bb1-b851-30dd87c23943 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.241280 Aug 21 01:36:41.521913 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2565/5780] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:41 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:42.277002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:42.277676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:42.289354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:42.301165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:42.302068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:42.303045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:42.303670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:42.304290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:42.529249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:42.543462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:42.545994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:42.551025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:42.556253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:42.558278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:42.558942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:42.560358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:42.561380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7119d6f8-3242-40e3-8a3f-ded02a57ef62 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.288712 Aug 21 01:36:42.562777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:42.564183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:42.564610 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3216/5781] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:42 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:42.565314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:42.600430 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:42.842512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:42.854685 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ce14ed6-fe9d-426e-b0cd-511810a6db20 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.315985 Aug 21 01:36:42.868991 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2566/5782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:42 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:43.587804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:43.588551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:43.595247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:43.595737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:43.596165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:43.597076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:43.597522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:43.598163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:43.766358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:43.779128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:43.780694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:43.785455 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-634c7053-e202-4f1e-9703-f8b4f8f19aff tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1738 microversion: 2.20 time: 0.201498 Aug 21 01:36:43.786349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3217/5783] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:43 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:43.882839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:43.883500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:43.890594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:43.891171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:43.891694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:43.892623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:43.893295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:43.894181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:44.092576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:44.107472 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ada56054-786d-4000-95e1-414b327c8951 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.228179 Aug 21 01:36:44.108126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2567/5784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:43 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:44.809807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:44.810586 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:44.818376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:44.818983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:44.819427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:44.820144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:44.820595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:44.821055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:44.977996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:44.998686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:45.001177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:45.002724 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a377585-0923-447b-9722-10a3eed7d706 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1720 microversion: 2.20 time: 0.196913 Aug 21 01:36:45.017244 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3218/5785] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:44 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:45.138734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:45.140414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:45.158037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:45.158610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:45.159752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:45.160662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:45.161422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:45.163650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:45.318798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:45.330696 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-41b9725a-a258-4aba-8ecf-36ba3cad2263 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.206479 Aug 21 01:36:45.331920 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2568/5786] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:45 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:46.029801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:46.030552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:46.038333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:46.039174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:46.040213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:46.041481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:46.042432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:46.043142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:46.216313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:46.241101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:46.242582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:46.243746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e91003ff-6a69-40b8-b916-96d13b175d9c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1720 microversion: 2.20 time: 0.220346 Aug 21 01:36:46.244365 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3219/5787] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:46 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:46.354018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:46.354721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:46.362572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:46.363352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:46.363815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:46.364945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:46.365445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:46.365860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:46.524275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:46.534219 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ba55e8f-0c4e-4de7-9808-a73326fb5ad1 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.184578 Aug 21 01:36:46.534838 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2569/5788] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:46 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:47.267585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:47.268374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:47.276115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.276662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.277120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.278031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.278496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.279178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.425581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:47.434746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:47.436232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:47.437467 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b6746f8e-c5b8-465d-a9c2-481ffce468d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1663 microversion: 2.20 time: 0.174369 Aug 21 01:36:47.438044 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3220/5789] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:47 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:36:47.460668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4db885a7-b1df-49a0-8528-30a3fa769049"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:47.463119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:47.470451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.471158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.471790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.472503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.472984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.473455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.557810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:47.558987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:47.584939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.585435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.585874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.586586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:47.597619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:47.598331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:47.762892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:47.775333 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2714de1f-3260-4413-88d0-b9de4a6ed836 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.222978 Aug 21 01:36:47.775909 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3221/5790] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:47 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:48.010895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fae03644-7bc0-4aa4-aae1-ea90a7fbe9bd tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.554468 Aug 21 01:36:48.014431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2570/5791] 10.222.0.46 () {62 vars in 1364 bytes} [Sun Aug 21 01:36:47 2022] POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments => generated 188 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:36:48.145708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:48.146217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:48.152642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.153156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.153769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.155216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.155858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.156649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.165703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:48.165884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:48.176275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.177167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.177605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.178635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.179245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.179845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.231181 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a807d3c-5cbf-4229-9203-05faa77b3678 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/ips" status: 200 len: 149 microversion: 2.1 time: 0.089801 Aug 21 01:36:48.231778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3222/5792] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:36:48 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:48.480821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "name": "network-vif-unplugged", "status": "completed", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:48.503225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.506692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.509035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.544550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.compute.server_external_events [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] Unable to find a host for instance aa235ebb-ea8f-4024-ad65-d60ec723b710. Dropping event network-vif-unplugged {{(pid=122482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 01:36:48.545665 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-89f729a6-fc52-4299-a965-3ee0eac25937 req-55960ebe-4458-4416-ae18-e719cc0b7bab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068938 Aug 21 01:36:48.546701 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3223/5793] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 01:36:48.564028 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a44cebe8-dfbb-4fee-ad5e-e274d8f4414d tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments/4db885a7-b1df-49a0-8528-30a3fa769049" status: 202 len: 0 microversion: 2.20 time: 0.404711 Aug 21 01:36:48.565249 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2571/5794] 10.222.0.46 () {60 vars in 1457 bytes} [Sun Aug 21 01:36:48 2022] DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments/4db885a7-b1df-49a0-8528-30a3fa769049 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:36:48.754155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:48.754926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:48.769144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.769941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.770778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.771675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.775476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.776198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.790445 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:48.801482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:48.802303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:48.811538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.813452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.814459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.815827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:48.818831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:48.820478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:48.873270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122482) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 21 01:36:49.016867 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e51029d9-c926-4b01-a702-c460820aea6c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/action" status: 202 len: 0 microversion: 2.20 time: 0.266376 Aug 21 01:36:49.021062 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3224/5795] 10.222.0.46 () {62 vars in 1319 bytes} [Sun Aug 21 01:36:48 2022] POST /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:36:49.028728 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:49.029773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:49.037108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:49.046504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:49.047487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:49.048471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:49.050019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:49.050816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:49.051606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:49.052155 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13c2e5dc-2b49-4a66-b889-7f7f5b33586b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.255307 Aug 21 01:36:49.064018 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2572/5796] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:48 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:49.293797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:49.303125 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:49.304658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:49.306045 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e36aad8-34e5-442f-b872-6257c24e1bbe tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1671 microversion: 2.20 time: 0.284005 Aug 21 01:36:49.306937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3225/5797] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:49 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1671 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:50.074191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:50.074902 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:50.087566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.088050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.088480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:50.089219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.089664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.090078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:50.308505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:50.318560 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-165d4fc1-e71b-4251-ab1c-98ff95f6be87 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.248103 Aug 21 01:36:50.319890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2573/5798] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:50 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:50.329705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:50.331615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:50.340357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.349401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.350058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:50.350828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.351628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.352550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:50.727596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:50.737504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:50.741147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:50.742526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f54e086-31e2-4c71-8a17-f2d1e1fef531 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.417056 Aug 21 01:36:50.756576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3226/5799] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:50 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:50.939251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74ec95e6-0c2b-4277-8f23-29c301dd482f"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:50.942595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:50.949609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.950102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.950717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:50.951464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:50.952005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:50.952598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.341297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:51.342675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:51.354711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:51.355627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:51.356211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.357286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:51.357898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:51.358633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.462582 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-27cab5c5-cce2-4615-b3ae-e62e94dcc5f3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526951 Aug 21 01:36:51.463299 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2574/5800] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:36:50 2022] POST /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:51.600934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:51.611573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6aafc320-f381-4ca1-ba10-fd1d5b6fe69c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.275258 Aug 21 01:36:51.612451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3227/5801] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:51 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:51.772002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:51.772891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:51.784485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:51.785014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:51.785454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.786260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:51.786717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:51.787145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.838490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:36:51.859108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:51.861257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:51.861946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:51.890388 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] Creating event network-changed:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h1-master-1 Aug 21 01:36:51.905650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-02f087ac-5492-4a2f-9464-63609e9922a1 req-86c3ee1e-57ef-4e87-9e5d-2de1106bc6c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073724 Aug 21 01:36:51.908600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3228/5802] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:36:52.072495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:52.082398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:52.086734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:52.090353 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d2ff2b6-0c11-4dde-b028-cc1aa1319544 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.327735 Aug 21 01:36:52.093053 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2575/5803] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:51 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:52.642749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:52.654365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:52.679911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:52.680449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:52.685739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:52.686506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:52.686977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:52.687459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:53.116147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:53.116903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:53.135572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:53.136014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:53.137129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:53.137299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:53.137764 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:53.138584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:53.203806 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=6,nova_cell1:UPDATE=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:36:53.499090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:53.511864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f2b7e22-c5d1-4f0b-888c-3696eb6a395d tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.877473 Aug 21 01:36:53.512466 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3229/5804] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:52 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:53.877132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:53.892499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:53.895283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:53.898135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68e1a851-40cb-468d-af98-20afdc3cceb7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.786453 Aug 21 01:36:53.919788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2576/5805] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:53 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:54.537069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:54.537918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:54.549912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:54.550395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:54.550831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:54.551778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:54.561228 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:54.561685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:54.931425 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:54.932052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:54.951825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:54.953180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:54.956117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:54.960653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:54.962251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:54.964710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:54.970706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:54.984447 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba5e0e8a-8c44-41f5-a2c2-f2c9c772d2a7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.451040 Aug 21 01:36:54.999214 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3230/5806] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:54 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:55.505887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:55.527622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:55.529215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:55.530537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-370527f3-223c-4bcd-8353-aaaec3eba426 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.606303 Aug 21 01:36:55.561121 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2577/5807] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:54 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:56.009367 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:56.011014 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:56.021556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:56.022039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:56.022721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:56.024001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:56.024946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:56.025814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:56.327424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:56.344180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-04bb36ef-8ce9-4789-9fef-046746f65aea tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.337717 Aug 21 01:36:56.364872 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3231/5808] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:56 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:56.558216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:56.559439 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:56.573098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:56.573758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:56.575454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:56.576404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:56.580761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:56.581408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:56.900989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:56.914824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:56.916998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:56.919368 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-041da19a-eca2-400e-af62-1075329fb498 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.364497 Aug 21 01:36:56.921498 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2578/5809] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:56 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:57.378750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:57.379344 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:57.401713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:57.402986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:57.405867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:57.410394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:57.412886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:57.416069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:57.853534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:57.871838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d129727-3c48-41ae-8835-c0827f7dad41 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.495719 Aug 21 01:36:57.896485 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3232/5810] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:57 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:36:57.947301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:57.948560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:57.969062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:57.969833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:57.981718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:57.982836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:57.983490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:57.984846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:58.563055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:58.591927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:58.594407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:58.595618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42cb88a8-244b-48a1-b19a-f19966c2ca52 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.652577 Aug 21 01:36:58.596184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2579/5811] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:57 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:36:58.897463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:58.898764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:58.909173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:58.913858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:58.914861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:58.916294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:58.919406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:58.920034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:59.517711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:59.528589 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5afe1dc-8f6a-4d53-b027-726690d4f925 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.636537 Aug 21 01:36:59.531870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3233/5812] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:36:58 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:36:59.619716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:36:59.620386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:36:59.640462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:59.640991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:59.641423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:59.642316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:36:59.642998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:36:59.643580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:36:59.962321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:59.976212 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:59.984265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:36:59.988895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0ae39dac-a78e-4418-a1fd-df860e73c3a4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.371981 Aug 21 01:36:59.991276 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2580/5813] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:36:59 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:00.560713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:00.561889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:00.599462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:00.600304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:00.601105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:00.602293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:00.603087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:00.603828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:00.959898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:00.970821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a75b1714-da57-4192-9874-4a0a667517d2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.420580 Aug 21 01:37:00.973324 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3234/5814] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:00 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:01.018007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:01.018625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:01.029742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:01.030718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:01.031402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:01.032436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:01.033178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:01.034089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:01.486118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:01.501187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:01.510438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:01.512117 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-296e91a0-86a1-4193-ae3c-911bcaf99639 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.498165 Aug 21 01:37:01.518986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2581/5815] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:01 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:01.999492 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:02.002380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:02.020492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:02.027022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:02.029656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:02.032944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:02.033700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:02.034343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:02.274925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:02.290528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d018d60a-b7cb-47da-b3a0-ed40f87bdbb3 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.298923 Aug 21 01:37:02.293998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3235/5816] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:01 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:02.547838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:02.549613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:02.560572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:02.561317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:02.562154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:02.563171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:02.564177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:02.564848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:02.887516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:02.906294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:02.911809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:02.916756 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf9e2c17-e598-4281-9b9d-de746734f76a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.378873 Aug 21 01:37:02.920539 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2582/5817] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:02 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:03.326687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:03.327561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:03.335056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:03.335731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:03.336263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:03.337019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:03.337590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:03.338014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:03.485494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:03.496355 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49f582bd-a39c-471e-8323-a6553396b89c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.173753 Aug 21 01:37:03.513630 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3236/5818] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:03 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:03.947751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:03.948367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:03.955455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:03.955928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:03.956395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:03.957246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:03.957696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:03.958115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:04.468413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:04.481468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:04.483428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:04.485404 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b0aeb49-e7d9-4cf2-a85f-fd0c2cd99b58 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.541471 Aug 21 01:37:04.491007 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2583/5819] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:03 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:04.522348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:04.522977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:04.538856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:04.541039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:04.543152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:04.544025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:04.545780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:04.547312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:04.731052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:04.740559 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1af7ce88-6158-4534-aa5a-d02d6afca971 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.222023 Aug 21 01:37:04.741999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3237/5820] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:04 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:05.511582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:05.512318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:05.515695 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=52 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:05.520998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:05.521611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:05.522151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:05.523029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:05.523604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:05.524123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:05.758089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:05.762398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:05.763371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:05.771414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:05.772082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:05.772615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:05.773597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:05.774288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:05.774937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:05.775100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:05.776868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:05.778846 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65746b7c-eb54-4271-8b81-fe495322ab5c tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.271426 Aug 21 01:37:05.779430 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2584/5821] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:05 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:05.927954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:05.937835 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-848565be-9232-4a39-86fe-b59585097653 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1509 microversion: 2.1 time: 0.179380 Aug 21 01:37:05.938347 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3238/5822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:05 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:06.427220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74ec95e6-0c2b-4277-8f23-29c301dd482f"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:06.430396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:06.439415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.439921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.440314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.441035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.442203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.442779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.544756 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments HTTP/1.1 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 74 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: {"volumeAttachment": {"volumeId": "74ec95e6-0c2b-4277-8f23-29c301dd482f"}} Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': '7440db2c-dbb6-4b47-9b45-337589cdc1a0', 'body': {'volumeAttachment': {'volumeId': '74ec95e6-0c2b-4277-8f23-29c301dd482f'}}} Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:37:06.550915 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 400 to user: Invalid volume: volume 74ec95e6-0c2b-4277-8f23-29c301dd482f is already attached to instances: 7440db2c-dbb6-4b47-9b45-337589cdc1a0 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7afc07f0-80b3-408c-947e-fcc56792ea7c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131646 Aug 21 01:37:06.557002 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2585/5823] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:37:06 2022] POST /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:37:06.665924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:06.666665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:06.674029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.674722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.675302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.676561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.677444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.678019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.702909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "name": "network-vif-plugged", "status": "completed", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:06.723797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.724285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.725001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.749313 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] Creating event network-vif-plugged:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h1-master-1 Aug 21 01:37:06.755894 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c3272284-4d92-43f2-a7fd-c0f6e6bdd507 req-726efa43-4b12-48e3-a442-5c8c34e2af6b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056851 Aug 21 01:37:06.757078 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2586/5824] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:37:06.808793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:06.809512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:06.828747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lazy-loading 'services' on Instance uuid 7440db2c-dbb6-4b47-9b45-337589cdc1a0 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:37:06.829797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.830447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.830902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.831621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.832111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.833268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.938112 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:06.958919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3da54d79-5ca5-4c32-bcc5-54657576d668 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments/74ec95e6-0c2b-4277-8f23-29c301dd482f" status: 202 len: 0 microversion: 2.1 time: 0.297016 Aug 21 01:37:06.959553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3239/5825] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:37:06 2022] DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments/74ec95e6-0c2b-4277-8f23-29c301dd482f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:37:06.971961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:06.974676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:06.989515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.990733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.991583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:06.993031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:06.995001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:06.995639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.076558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.089854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.092135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.094145 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-48f7ec9f-9b1c-4567-80f3-44c6d0c48965 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.293570 Aug 21 01:37:07.097560 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2587/5826] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:06 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:07.110757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:07.113027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:07.134570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.135494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.136121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.137933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.138726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.143435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.179623 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5aac3f28-b717-4b39-ba40-331070b27160 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080881 Aug 21 01:37:07.180532 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2588/5827] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:07 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:07.359953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.368827 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9d0a5e7-91cf-4a18-8183-6d521b3f7578 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1486 microversion: 2.1 time: 0.406359 Aug 21 01:37:07.369703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3240/5828] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:06 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1486 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:07.390793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1194625835"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:07.394273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:07.401077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.401572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.402213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.402909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.403353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.403768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.475574 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa05a4ff-0d0e-4088-8572-62d596f0feca tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "PUT /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1060 microversion: 2.1 time: 0.088687 Aug 21 01:37:07.484973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2589/5829] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 01:37:07 2022] PUT /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1060 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:07.494879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:07.495610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:07.506345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.507116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.507597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.508312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.508945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.509537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.726370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.731651 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-899b0ef8-e37f-44c8-8dcf-067d1f6866bf tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1487 microversion: 2.1 time: 0.241673 Aug 21 01:37:07.732574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3241/5830] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:07 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1487 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:07.753793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:07.755090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:07.762393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.763258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.763872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.764812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.765439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.766327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.925406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:07.935052 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76d036d2-f7fd-4843-88f4-e94397b30441 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1487 microversion: 2.1 time: 0.184738 Aug 21 01:37:07.946202 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2590/5831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:07 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1487 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:07.957215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:07.958365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:07.965944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.967318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.968090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:07.969183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:07.969842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:07.970468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.001969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:37:08.121590 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:08.122265 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55e82cf1-507f-4cc6-9e23-3e4582946ded tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 204 len: 0 microversion: 2.1 time: 0.163477 Aug 21 01:37:08.122883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:08.126778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3242/5832] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:07 2022] DELETE /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:37:08.135836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:08.136550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:08.142936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.144229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.144935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.146194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.146804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.147637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.148167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.148647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.149574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.150859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.151458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.152032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.326805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:08.343338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:08.347968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:08.349969 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-103a81fe-9755-462e-8601-23e6a50679d7 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1729 microversion: 2.20 time: 0.232939 Aug 21 01:37:08.351119 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2591/5833] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:08 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:08.356396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:08.359015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:08.366009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.366808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.367475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.368839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:08.369524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:08.370242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:08.408715 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70287034-5359-4dd8-8ab2-02849edf7625 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056306 Aug 21 01:37:08.410168 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2592/5834] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:08 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:08.493393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:08.504620 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51decd0a-e907-4a1f-9d02-c6f2181d4e57 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1493 microversion: 2.1 time: 0.376334 Aug 21 01:37:08.505271 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3243/5835] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:08 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1493 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:09.372223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:09.372882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:09.386643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.387188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.389749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.389749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.397127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.398031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.404251 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:09.422397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:09.425354 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:09.430486 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:09.443434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.444214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.445111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.446016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.446634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.447212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.515226 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba1aa8f6-8bbb-4507-b058-a51b2dcd237a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097628 Aug 21 01:37:09.515855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3244/5836] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:09 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:37:09.531910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:09.532981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:09.543641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.544625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.545298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.546992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:09.547705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:09.548288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:09.600158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:09.611100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:09.613104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:09.616467 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53ba2be7-aaa5-44e2-9525-2f3de20b15ed tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1716 microversion: 2.20 time: 0.247567 Aug 21 01:37:09.630619 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2593/5837] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:09 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1716 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:09.855128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:09.890309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b98b88fe-13e3-4e43-b24f-e57af875a59e tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1493 microversion: 2.1 time: 0.364092 Aug 21 01:37:09.904505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3245/5838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:09 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1493 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:10.252589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aeb0ff0-bdbc-4b77-806d-45b725511ce6", "name": "network-vif-deleted", "tag": "39d45b73-a167-4fce-9567-15fd88b7b1e4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:10.271411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.272514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.284059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.308450 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] Creating event network-vif-deleted:39d45b73-a167-4fce-9567-15fd88b7b1e4 for instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 on n-h2-master-1 Aug 21 01:37:10.315164 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5d2eaca4-ac58-42c5-ab9f-94c192a07a69 req-68cd8e49-f28a-41b5-b8a2-e8913696bad4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066513 Aug 21 01:37:10.315798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2594/5839] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:10.530150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:10.533088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:10.543556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.544039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.544478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.545224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.545675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.546297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.581758 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fad7730f-a397-422d-8f31-470269dfecd6 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057803 Aug 21 01:37:10.583851 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3246/5840] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:10 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:10.914450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:10.916131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:10.935045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.935548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.936885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.937753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.942205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.945875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.991986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:10.992479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:10.993193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:10.993954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lazy-loading 'fault' on Instance uuid 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:37:11.058351 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:11.065619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-49049717-671d-416b-a1ae-740a7c2fc99c tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 200 len: 1310 microversion: 2.1 time: 0.157571 Aug 21 01:37:11.079303 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2595/5841] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:10 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:11.596616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:11.599373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:11.608254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:11.609851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:11.610573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:11.612532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:11.614008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:11.614617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:11.653389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b907360c-0909-436e-a502-146edf43b87d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060886 Aug 21 01:37:11.654323 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3247/5842] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:11 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:12.089705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.091238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.100011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.100847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.101716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.102863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.102950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.103415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.121957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 HTTP/1.1 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7aeb0ff0-bdbc-4b77-806d-45b725511ce6'} Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.124132 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.128089 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.130338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.131185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-57b9fa18-dd20-452f-9173-aac483692469 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 404 len: 111 microversion: 2.1 time: 0.047295 Aug 21 01:37:12.131743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2596/5843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.145867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.146562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.152673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.153467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.154174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.155124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.155809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.156298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.170803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 HTTP/1.1 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7aeb0ff0-bdbc-4b77-806d-45b725511ce6'} Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.172793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.177336 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.179203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.180284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68d3933c-02fa-476c-b6f9-80c1fa302298 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 404 len: 111 microversion: 2.1 time: 0.038554 Aug 21 01:37:12.181379 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3248/5844] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.189143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.189748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7aeb0ff0-bdbc-4b77-806d-45b725511ce6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.196628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.197407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.198019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.198903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.199555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.200149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.216411 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 HTTP/1.1 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7aeb0ff0-bdbc-4b77-806d-45b725511ce6'} Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.217985 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7aeb0ff0-bdbc-4b77-806d-45b725511ce6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.221711 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-409b3a83-b070-4088-8dc9-af8e1d24f888 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6" status: 404 len: 111 microversion: 2.1 time: 0.034213 Aug 21 01:37:12.223325 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2597/5845] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/7aeb0ff0-bdbc-4b77-806d-45b725511ce6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.229330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.230018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.238988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.239873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.240497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.241413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.242049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.242529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.261530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b HTTP/1.1 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '816f2115-61ff-4eb2-83ab-598f529b690b'} Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.263377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.267066 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.269028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.270285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ddcbe481-4ecb-4448-96b2-0ca44cf92ae2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 404 len: 111 microversion: 2.1 time: 0.045713 Aug 21 01:37:12.273870 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3249/5846] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:37:12.279069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.280434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 816f2115-61ff-4eb2-83ab-598f529b690b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.287599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.288164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.288674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.289850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.290366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.290866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.306021 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b HTTP/1.1 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '816f2115-61ff-4eb2-83ab-598f529b690b'} Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.307907 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 816f2115-61ff-4eb2-83ab-598f529b690b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6b8f564-dbb0-4890-bc16-59c6a8c3a681 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b" status: 404 len: 111 microversion: 2.1 time: 0.034202 Aug 21 01:37:12.312241 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2598/5847] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/816f2115-61ff-4eb2-83ab-598f529b690b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.322697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.323776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.337106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.338125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.338726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.339636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.340660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.341308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.360400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 HTTP/1.1 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '84a87078-a715-45ea-a043-48cedfd3fc69'} Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.362301 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ce14770-dca0-498f-a284-f19e82244772 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 404 len: 111 microversion: 2.1 time: 0.045886 Aug 21 01:37:12.366360 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3250/5848] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:37:12.373059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.374382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 84a87078-a715-45ea-a043-48cedfd3fc69] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.382267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.382763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.383201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.383908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.384358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.384792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.401399 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 HTTP/1.1 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '84a87078-a715-45ea-a043-48cedfd3fc69'} Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.403130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 84a87078-a715-45ea-a043-48cedfd3fc69 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2dda1c95-352b-43c5-92e0-13de47605832 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69" status: 404 len: 111 microversion: 2.1 time: 0.036430 Aug 21 01:37:12.407104 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2599/5849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/84a87078-a715-45ea-a043-48cedfd3fc69 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.415092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.415632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.422412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.422905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.423341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.424071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.424480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.424929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.441338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 HTTP/1.1 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7edecf1d-b517-47fc-8e15-b8eb23378a34'} Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.444120 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-145cafa7-3efd-414f-8395-536ef71c4500 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 404 len: 111 microversion: 2.1 time: 0.035103 Aug 21 01:37:12.448687 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3251/5850] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.455224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.455998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 7edecf1d-b517-47fc-8e15-b8eb23378a34] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.463536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.464340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.464908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.465714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.466263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.466778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.482386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 HTTP/1.1 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7edecf1d-b517-47fc-8e15-b8eb23378a34'} Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.484552 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.489297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 7edecf1d-b517-47fc-8e15-b8eb23378a34 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.490653 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-06a01849-4b7f-485d-82df-715ed45eac36 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34" status: 404 len: 111 microversion: 2.1 time: 0.039646 Aug 21 01:37:12.494602 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2600/5851] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/7edecf1d-b517-47fc-8e15-b8eb23378a34 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.499334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.499836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.506785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.507254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.507869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.508727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.509391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.510585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.529574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 HTTP/1.1 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b3c5e011-1206-4174-b6ff-b9e68b33d8d1'} Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.531664 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.535746 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.537904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.539360 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16d211d9-e79c-4d0f-87ca-715fb5566242 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 404 len: 111 microversion: 2.1 time: 0.043599 Aug 21 01:37:12.540151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3252/5852] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:37:12.548549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.549196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: b3c5e011-1206-4174-b6ff-b9e68b33d8d1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.556722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.558064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.558503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.559222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.559669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.560086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.578703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 HTTP/1.1 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b3c5e011-1206-4174-b6ff-b9e68b33d8d1'} Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.580262 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance b3c5e011-1206-4174-b6ff-b9e68b33d8d1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff5c7cd4-c2eb-4958-aec4-b4bb684f785f tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1" status: 404 len: 111 microversion: 2.1 time: 0.037295 Aug 21 01:37:12.584721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2601/5853] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/b3c5e011-1206-4174-b6ff-b9e68b33d8d1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.603828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.606186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.616543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.617920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.618574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.619480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.620123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.623008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.636864 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 HTTP/1.1 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '27fccb3c-7d46-4681-be80-c584e8e08216'} Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.640886 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.645107 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.646914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.648058 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7d61017-fc4b-4b73-a636-43a24436e2b7 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 404 len: 111 microversion: 2.1 time: 0.054011 Aug 21 01:37:12.648672 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3253/5854] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.657622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.658648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: 27fccb3c-7d46-4681-be80-c584e8e08216] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.666120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.666604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.666737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.667685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.668386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.669009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.669426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.672817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.684321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.684839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.685271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.686308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.686961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.687620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.688476 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 HTTP/1.1 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '27fccb3c-7d46-4681-be80-c584e8e08216'} Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.690210 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.694498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance 27fccb3c-7d46-4681-be80-c584e8e08216 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.695453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f207b08-a847-448f-8e0f-48bf970a696b tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216" status: 404 len: 111 microversion: 2.1 time: 0.042317 Aug 21 01:37:12.696390 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2602/5855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/27fccb3c-7d46-4681-be80-c584e8e08216 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:12.705323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.706007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.714589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 HTTP/1.1 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: exception: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'cbcb9e85-e4b4-424b-b478-227f1bd1c201'} Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.717145 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.720992 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.725116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.727452 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5ea57bfb-481c-497b-a42d-757a65ebb28a tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201" status: 404 len: 111 microversion: 2.1 time: 0.026629 Aug 21 01:37:12.729790 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2603/5856] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:37:12.738826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.739733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: cbcb9e85-e4b4-424b-b478-227f1bd1c201] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.753857 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 HTTP/1.1 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: exception: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'cbcb9e85-e4b4-424b-b478-227f1bd1c201'} Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:12.755786 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:12.759729 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:12.759729 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:12.759729 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:12.759729 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. Aug 21 01:37:12.759729 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:12.761473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance cbcb9e85-e4b4-424b-b478-227f1bd1c201 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:12.762839 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4346a19-f65c-44fc-85b7-1fdc15054eda tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201" status: 404 len: 111 microversion: 2.1 time: 0.030214 Aug 21 01:37:12.764825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2604/5857] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/cbcb9e85-e4b4-424b-b478-227f1bd1c201 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:37:12.770823 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa076bef-443e-4642-a9d5-a8e71ae4ca26 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108717 Aug 21 01:37:12.776066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3254/5858] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:12.776631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.777372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.786506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.787313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.788082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.789403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.790162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.790748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.828537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:37:12.949855 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-542508e6-d3cd-467c-a31e-c1b42d3eb977 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 204 len: 0 microversion: 2.1 time: 0.180434 Aug 21 01:37:12.951132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2605/5859] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:12 2022] DELETE /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:37:12.959497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:12.960446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:12.970828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.971573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.972682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:12.973478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:12.974142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:12.975664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:13.297868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:13.307626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df592803-de0a-490d-94d7-501d98e568f6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1480 microversion: 2.1 time: 0.352289 Aug 21 01:37:13.308417 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3255/5860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:12 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1480 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:13.789885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:13.792246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:13.802188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:13.802852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:13.803503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:13.804610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:13.805831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:13.806511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:13.844803 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f5d1605-fe71-42e3-81ac-df2def9ecc70 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060738 Aug 21 01:37:13.849869 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2606/5861] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:37:13 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:37:13.927387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:13.928000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:13.935090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:13.935643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:13.936072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:13.936761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:13.937224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:13.937637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:13.965002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:37:14.077033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb698bbe-abf4-466f-aa0d-ace717b84051 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 204 len: 0 microversion: 2.1 time: 0.153192 Aug 21 01:37:14.078408 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3256/5862] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:37:13 2022] DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:37:14.087545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:14.088456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:14.095603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:14.096337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:14.097007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:14.098007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:14.098952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:14.099376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:14.337742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:14.338708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:14.349315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:14.350052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:14.351062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:14.352422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:14.353208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:14.354330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:14.360446 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:14.377633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:14.392547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a868aebf-05a9-4c1d-936d-296771e6a53d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1680 microversion: 2.1 time: 0.309475 Aug 21 01:37:14.401182 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2607/5863] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:14 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1680 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:15.061230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:15.075013 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a93aad25-acf7-40cb-9b86-dc13726b4420 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1480 microversion: 2.1 time: 0.742011 Aug 21 01:37:15.076355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3257/5864] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:14 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1480 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:15.419400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:15.420941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:15.428923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:15.429411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:15.429838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:15.430543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:15.430989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:15.431409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:15.718251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:15.733692 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-920f3ebf-7110-454d-9c8c-b48770d5f024 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1680 microversion: 2.1 time: 0.313401 Aug 21 01:37:15.734610 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2608/5865] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:15 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:15.988205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b09348-5990-422e-ac54-2790744e847a", "name": "network-vif-deleted", "tag": "149369af-1652-443f-9495-7d862ac3b90b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:16.024050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:16.024531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:16.025026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:16.047986 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] Creating event network-vif-deleted:149369af-1652-443f-9495-7d862ac3b90b for instance f5b09348-5990-422e-ac54-2790744e847a on n-h2-master-1 Aug 21 01:37:16.073865 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d8e72e70-d5b1-4ad7-80d1-4c533d62796e req-237dabb2-4fae-46fd-8e1c-614c4ef020d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089885 Aug 21 01:37:16.074877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3258/5866] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:16.096930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:16.097977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:16.109191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:16.109927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:16.114894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:16.115898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:16.116527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:16.117138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:16.246251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27a75d14c8494952a4577bff44f15f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455488ff7064493a91bb38fc683bd233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:16.277628 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-03e86c8f-db85-48a4-80bd-483d0a4c71c2 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 200 len: 1278 microversion: 2.1 time: 0.183389 Aug 21 01:37:16.278668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2609/5867] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:16 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:16.763028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:16.764404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:16.775391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:16.776196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:16.782576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:16.783618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:16.785721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:16.786153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:16.914675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:16.928812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30e85c7b-9863-450d-ac4a-5406259df650 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 200 len: 1613 microversion: 2.1 time: 0.175803 Aug 21 01:37:16.941404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3259/5868] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:16 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 1613 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:17.299388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:17.300751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] [instance: f5b09348-5990-422e-ac54-2790744e847a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:17.314849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:17.315337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:17.315768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:17.331550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7440db2c-dbb6-4b47-9b45-337589cdc1a0", "name": "network-vif-deleted", "tag": "75d0756d-063b-4e04-8d1e-00db055301ef"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:17.333601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:17.334139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:17.334591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:17.355360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:17.360333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:17.361012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:17.362133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] HTTP exception thrown: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Request method failure captured: Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a HTTP/1.1 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYtxLt-WARSaTlf5UaoNFMGaK3noirKpgJMp-9Bz-eFB53lrYZJ_WNCRGxHTifXt8GpQWt-JBhZEFWLLdWsedvaEv5cSMftChkAGFfLMWQp6axpqUp0UXL2v8iYERv6hhDvGRLptgrW6OfiE4TdwTNVBaJjACVEH-_rSdBZ7PA7SL4E Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_455488ff7064493a91bb38fc683bd233", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/455488ff7064493a91bb38fc683bd233"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/455488ff7064493a91bb38fc683bd233"}]}] Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersTestJSON-2106832332 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 455488ff7064493a91bb38fc683bd233 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersTestJSON-2106832332 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 27a75d14c8494952a4577bff44f15f99 Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersTestJSON-2106832332-project Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f5b09348-5990-422e-ac54-2790744e847a'} Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:17.365900 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] Returning 404 to user: Instance f5b09348-5990-422e-ac54-2790744e847a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:17.371408 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-31fe6760-c77d-4a96-9a86-54e1f17a2ec6 tempest-ServersTestJSON-2106832332 tempest-ServersTestJSON-2106832332-project] 10.222.0.46 "GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a" status: 404 len: 111 microversion: 2.1 time: 0.073157 Aug 21 01:37:17.373814 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2610/5869] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:17 2022] GET /compute/v2.1/servers/f5b09348-5990-422e-ac54-2790744e847a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:17.403636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] Creating event network-vif-deleted:75d0756d-063b-4e04-8d1e-00db055301ef for instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 on n-h1-master-1 Aug 21 01:37:17.426072 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c4b2a060-9295-4149-8bd6-1be4f8e6cbad req-4fbfc05f-8c1b-483c-a096-50d37adb11f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101064 Aug 21 01:37:17.427304 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3260/5870] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:17.952579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:17.954436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:17.980060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:17.980566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:17.982575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:17.984786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:17.985520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:17.986134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:18.008223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 HTTP/1.1 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7440db2c-dbb6-4b47-9b45-337589cdc1a0'} Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:18.010693 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:37:18.015922 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:18.017580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:18.018936 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f7c0675-c31b-484f-81fc-d3b02e8f4d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 404 len: 111 microversion: 2.1 time: 0.070886 Aug 21 01:37:18.030978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37f4d8ac-e8c2-4f4b-97c8-2429df6ee842 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '.version_select at 0x7fc3f883eca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:18.034854 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2611/5871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:17 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:37:18.060997 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37f4d8ac-e8c2-4f4b-97c8-2429df6ee842 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566153755" status: 202 len: 0 microversion: 2.1 time: 0.033580 Aug 21 01:37:18.061804 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3261/5872] 10.222.0.46 () {58 vars in 1218 bytes} [Sun Aug 21 01:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566153755 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:37:20.246360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08c63e7b-62db-4940-a167-8b3a39d03cc5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: .version_select at 0x7fc3fda0b310>, body: {"keypair": {"name": "tempest-keypair-1663981610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNykT2MI9nyhOkmsuSd2UJV3+axDWys3cbx7eEqLmaMJd4ZFwg6AiF1L0uQAk/xuHeQEm0+cPB8+7yUZgMSJMU0fAUiB50IUsgU48vANR11Ui4+fq1WFETyBsBMfYLuvTA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:20.273570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-08c63e7b-62db-4940-a167-8b3a39d03cc5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:37:20.285511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-08c63e7b-62db-4940-a167-8b3a39d03cc5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:37:20.315647 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08c63e7b-62db-4940-a167-8b3a39d03cc5 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073703 Aug 21 01:37:20.322858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2612/5873] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:37:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:24.511502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-292583067", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cb5e4a9-bcd5-4245-8211-d0350dfa789c"}], "security_groups": [{"name": "tempest-securitygroup--1524058444"}], "key_name": "tempest-keypair-1663981610", "user_data": "}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:24.762227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] validate_networks() for [('4cb5e4a9-bcd5-4245-8211-d0350dfa789c', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:37:25.625525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:37:25.626112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:37:25.626408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:37:25.626818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:37:25.627227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:37:25.646982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:25.647458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:25.647915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:25.648640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:25.649119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:25.655835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:25.686018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:37:25.698299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Getting quotas for user 05c1f10a225e4f14885bf583527e93a0 and project 522827f3647e4cdfa81257e8a048278b. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:37:25.728801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:37:25.744616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:37:25.869911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-500c0424-64fe-44cb-b0c3-ea0be828dab0 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.368195 Aug 21 01:37:25.870477 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3262/5874] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:37:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:37:25.882085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76bb7a89-251a-48c7-9ddf-b601e9514998 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:25.883581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76bb7a89-251a-48c7-9ddf-b601e9514998 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:26.034252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76bb7a89-251a-48c7-9ddf-b601e9514998 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:26.049592 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76bb7a89-251a-48c7-9ddf-b601e9514998 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1241 microversion: 2.1 time: 0.169040 Aug 21 01:37:26.053788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2613/5875] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:25 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:26.799259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-610930100", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": "none"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:26.891267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:37:26.891984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:37:26.892664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:37:26.893281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:37:26.894064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:37:26.916822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:26.917985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:26.919005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:26.919975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:26.920620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:26.921226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:26.946820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Getting quotas for project 5fccfb6e12034a7fb9cab13a9e9530d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:37:26.953926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Getting quotas for user 7b11b9adba9849b9ab5fd32b35c8ecf0 and project 5fccfb6e12034a7fb9cab13a9e9530d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:37:26.972936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:37:26.976554 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:37:27.044173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4caa5c24-9f1b-4d67-816a-1f2eb7791ff0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.415185 Aug 21 01:37:27.045818 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3263/5876] 10.222.0.46 () {62 vars in 1188 bytes} [Sun Aug 21 01:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 21 01:37:27.058542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:27.059334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:27.078658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:27.080147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:27.094106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:27.094969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:27.095669 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:27.110096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:27.112406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:27.113814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:27.169169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:27.181893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:27.183563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:27.184726 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-654cc5f7-a3b9-4ff3-b4d1-62796637ddab tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1277 microversion: 2.54 time: 0.130233 Aug 21 01:37:27.193168 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2614/5877] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:27 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:27.288173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:27.301518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f2e214c-f1a6-4ab0-98e4-0a72c0465ebe tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1293 microversion: 2.1 time: 0.227530 Aug 21 01:37:27.303026 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3264/5878] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:27 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:28.208189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:28.208824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:28.210856 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:28.217046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:28.217751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:28.218367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:28.219075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:28.219503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:28.220111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:28.313780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:28.325702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:28.326311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:28.326706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:28.328045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:28.329243 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed88e6cd-2cac-4f9b-a2bb-54ab93fa7de0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1329 microversion: 2.54 time: 0.125414 Aug 21 01:37:28.346903 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2615/5879] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:28 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1329 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:28.347153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:28.593267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:28.625096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9bc723ad-881a-4f89-ad04-555daebf3144 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1299 microversion: 2.1 time: 0.301701 Aug 21 01:37:28.635312 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3265/5880] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:28 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:29.355942 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:29.356555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:29.369114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:29.370524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:29.371375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:29.373126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:29.375831 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:29.377458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:29.512470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:29.528281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:29.530586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:29.532026 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-96be1d04-5602-4fc4-b019-080e5537c3c5 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1335 microversion: 2.54 time: 0.181074 Aug 21 01:37:29.533357 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2616/5881] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:29 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:29.653946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:29.654644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:29.689850 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:29.696906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:29.700519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:29.703154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:29.703816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:29.706129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:30.029242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:30.043880 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-931abca5-d143-42db-85d7-6f09b0afd55c tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.397954 Aug 21 01:37:30.045475 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3266/5882] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:29 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:30.223667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2437ef23-9df7-4d80-a153-5da68d8eebce", "tag": "81dc824e-1d8e-4462-815d-adf38fecbae4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:30.236689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:30.237118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:30.237741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:30.255355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] Creating event network-changed:81dc824e-1d8e-4462-815d-adf38fecbae4 for instance 2437ef23-9df7-4d80-a153-5da68d8eebce on n-h2-master-1 Aug 21 01:37:30.268923 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-56b4887a-0ce1-4270-82c8-c0e9da9b8e93 req-29de6a02-ce6b-42a5-a7c2-dc11c5e92522 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049359 Aug 21 01:37:30.270100 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2617/5883] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:30.557307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:30.557307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:30.563520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:30.564002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:30.564436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:30.565184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:30.565921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:30.566378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:30.698756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:30.710066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:30.712270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:30.714793 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-949f821c-7a14-46e9-a7ab-28fb66089262 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1335 microversion: 2.54 time: 0.162292 Aug 21 01:37:30.715935 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3267/5884] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:30 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:31.076428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:31.079474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:31.135138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:31.137128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:31.137760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:31.146062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:31.147026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:31.147682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:31.375015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:31.383303 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6220507f-5d14-4382-973a-1dac49d19311 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.321817 Aug 21 01:37:31.397203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2618/5885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:31 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:31.740316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:31.741027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:31.751129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:31.752088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:31.752710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:31.753745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:31.755100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:31.756958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:31.833361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:31.843037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:31.845190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:31.846798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51ea5481-67a4-4536-865b-c45be1b7c66f tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1356 microversion: 2.54 time: 0.110759 Aug 21 01:37:31.848050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3268/5886] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:31 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:31.873263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2360945b-59ac-4470-9a58-3f66dd210c3e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Action: 'create', calling method: .version_select at 0x7fc3fda4e160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-777464048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSZMqvwrsuqcuLpIviVaxgSHpf/q1aiq33iRPqTcHW5/nfLliK4HS87ucOIzEUrk6BJhy6M3xLIh4dU2Cy2QbTqKx1rcuwDHsXqwOb/2FZowL/7GjsFKxtVre0A3hFKkA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:31.904038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2360945b-59ac-4470-9a58-3f66dd210c3e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Getting quotas for project 5fccfb6e12034a7fb9cab13a9e9530d7. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:37:31.911533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2360945b-59ac-4470-9a58-3f66dd210c3e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Getting quotas for user 7b11b9adba9849b9ab5fd32b35c8ecf0 and project 5fccfb6e12034a7fb9cab13a9e9530d7. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:37:31.934461 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:31.971359 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2360945b-59ac-4470-9a58-3f66dd210c3e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.102126 Aug 21 01:37:31.972322 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2619/5887] 10.222.0.46 () {62 vars in 1200 bytes} [Sun Aug 21 01:37:31 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 21 01:37:31.985000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-777464048", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:31.988568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:32.002491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.003364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.003799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.004507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.005009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.005432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.122871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:37:32.123788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:37:32.124469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:37:32.125136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:37:32.125777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:37:32.267734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:32.277034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.277877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.278558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.279579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.280348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.281430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.321854 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21bb3b9b-3a86-417f-a491-a8c027216c2d tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "POST /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec/action" status: 202 len: 1138 microversion: 2.54 time: 0.340665 Aug 21 01:37:32.323054 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3269/5888] 10.222.0.46 () {62 vars in 1320 bytes} [Sun Aug 21 01:37:31 2022] POST /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec/action => generated 1138 bytes in 343 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 21 01:37:32.342017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:32.342624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:32.350271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.351189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.354267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.355194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.355652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.372333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.405865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:32.406469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:32.432114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.433039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.433619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.434494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:32.435088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:32.435654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:32.500917 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:32.514296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:32.515831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:32.524760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ecbb73b-bf04-43ff-90cd-40b472eb2514 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.187069 Aug 21 01:37:32.525351 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2620/5889] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:32 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:32.764135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:32.773919 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3885518-4b5d-4dfc-bd8d-5dd6381af695 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.372113 Aug 21 01:37:32.775108 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3270/5890] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:32 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:33.556240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:33.563427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:33.578265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:33.578775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:33.579214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:33.579928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:33.585025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:33.586134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:33.718569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:33.734382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:33.739689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:33.741191 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66eb3c35-7f28-4e9b-a46c-e87770720e22 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.195394 Aug 21 01:37:33.743284 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2621/5891] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:33 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:33.795571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:33.796225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:33.806036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:33.806522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:33.813478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:33.814287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:33.814772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:33.815179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:34.454346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:34.465492 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10c3cc38-77b4-49dd-8060-4f6139832408 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.673496 Aug 21 01:37:34.467289 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3271/5892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:33 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:34.765596 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:34.766213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:34.779073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:34.779563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:34.780007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:34.780727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:34.781209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:34.781633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:34.901245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:34.911457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:34.914028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:34.915671 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45588867-daa3-453e-8f89-7797f6f7019e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.154003 Aug 21 01:37:34.916827 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2622/5893] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:34 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:35.488854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:35.490180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:35.492040 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:35.498410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:35.498849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:35.499258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:35.499955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:35.500394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:35.500827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:35.685945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:35.695742 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc514de4-fe3f-4b0d-b598-8996e199ce0e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.211632 Aug 21 01:37:35.697036 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3272/5894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:35 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:35.946447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:35.947595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:35.963338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:35.964399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:35.965326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:35.966285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:35.967675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:35.968251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:36.055339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:36.064279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:36.066096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:36.067351 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c139422-4bae-4e57-a177-2f33d28f1c18 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.125108 Aug 21 01:37:36.067914 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2623/5895] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:35 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:36.720572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:36.721464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:36.735762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:36.737243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:36.739112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:36.741493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:36.742238 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:36.742961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:36.932378 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:36.965385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2437ef23-9df7-4d80-a153-5da68d8eebce", "name": "network-vif-plugged", "status": "completed", "tag": "81dc824e-1d8e-4462-815d-adf38fecbae4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:36.983550 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:36.986544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:36.987434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:36.988198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:36.992567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:37.007052 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] Creating event network-vif-plugged:81dc824e-1d8e-4462-815d-adf38fecbae4 for instance 2437ef23-9df7-4d80-a153-5da68d8eebce on n-h2-master-1 Aug 21 01:37:37.013074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-78196853-0b10-4d6f-8e4a-3603de6635c7 req-9f526fda-6ca7-479f-bcb5-12d0c201c9fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333227 Aug 21 01:37:37.015014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3273/5896] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:37.017632 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba632358-3dec-4fdc-937a-a9d5fb7fcd5d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.303221 Aug 21 01:37:37.018240 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2624/5897] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:36 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:37.091360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:37.092227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:37.115961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:37.116580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:37.118497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:37.119879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:37.120574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:37.121210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:37.263923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:37.273150 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:37.274962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:37.276669 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-419c6cd9-bddd-4c2c-956e-aae81d7ea2c2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.189648 Aug 21 01:37:37.290035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3274/5898] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:37 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:38.040878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:38.042087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:38.062639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:38.075359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:38.076090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:38.077718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:38.078234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:38.078809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:38.236636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:38.245818 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53ae9a28-0613-4664-9e2c-80d06013ef58 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1367 microversion: 2.1 time: 0.209954 Aug 21 01:37:38.246863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2625/5899] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:38 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:38.303751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:38.304381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:38.310916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:38.311407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:38.311840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:38.312537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:38.313009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:38.313429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:38.380655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:38.383099 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:38.391512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:38.393306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:38.394606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de1a87fe-71f3-4e6b-820c-8335eabc3d4e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.096649 Aug 21 01:37:38.395166 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3275/5900] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:38 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:39.269035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:39.269767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:39.278334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.279010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.279666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.280908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.281489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.282034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.418351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:39.418995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:39.432121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.438234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.438696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.439443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.439936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.440381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.514511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:39.524983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:39.526533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:39.527720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e39a1755-b523-4d0f-8e70-1cc0ef3ac5d7 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.113611 Aug 21 01:37:39.528284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3276/5901] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:39 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:39.589575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:39.601902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63624287-8028-452b-8cf6-2ddba7acaec9 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1556 microversion: 2.1 time: 0.337970 Aug 21 01:37:39.603305 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2626/5902] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:37:39 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1556 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:37:39.626270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:39.626567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:39.633292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.633781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.634401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.635269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:39.636419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:39.639940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:39.804906 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-735d41cf-e58e-4398-a438-b26e39ab334d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183140 Aug 21 01:37:39.805712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3277/5903] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:37:39 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:40.551867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:40.552471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:40.560468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:40.560989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:40.573611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:40.574384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:40.574855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:40.575276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:40.775164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:40.797423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:40.799296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:40.801233 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c24c34e-82e4-4a32-8998-8eaa2318ffc2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.253594 Aug 21 01:37:40.801987 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2627/5904] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:40 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:41.344707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:41.349439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:41.358952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.359759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.360476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.361517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.362445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.364062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.413329 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f4b4411-62fc-4402-b161-2ac4ee5e8f67 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073366 Aug 21 01:37:41.413928 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3278/5905] 10.222.0.46 () {60 vars in 1343 bytes} [Sun Aug 21 01:37:41 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:37:41.506148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:41.506741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:41.518119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.520843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.521792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.523577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.525838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.526798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.612533 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:37:41.621464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2437ef23-9df7-4d80-a153-5da68d8eebce", "tag": "81dc824e-1d8e-4462-815d-adf38fecbae4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:41.637786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.638262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.638685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.679257 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] Creating event network-changed:81dc824e-1d8e-4462-815d-adf38fecbae4 for instance 2437ef23-9df7-4d80-a153-5da68d8eebce on n-h2-master-1 Aug 21 01:37:41.687545 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f8886e30-a2c8-404f-bd75-7c543457c130 req-f865d62f-b7cb-4944-b216-54865130200d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214159 Aug 21 01:37:41.688681 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2628/5906] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:41.833179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:41.834214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:41.846012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.847916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.848475 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab32242d-a728-4dce-ab31-e2057438c8b1 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 204 len: 0 microversion: 2.20 time: 0.346970 Aug 21 01:37:41.849147 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3279/5907] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:37:41 2022] DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 21 01:37:41.853039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.855135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.855770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.858737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.865118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:41.865830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:41.881123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.882024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.882588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.883621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:41.884068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:41.884607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:41.938439 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:42.024297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.038994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.040938 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.044112 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-589d3d0c-758c-4791-aff8-4406f5b56544 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.216345 Aug 21 01:37:42.059494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2629/5908] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:41 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:42.278790 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.309363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.311188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:42.312412 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-949319e3-534a-4049-a4ea-791e880b87e6 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.456087 Aug 21 01:37:42.328801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3280/5909] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:41 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:43.068019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:43.068649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:43.088469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:43.088990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:43.089591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:43.090485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:43.091148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:43.091715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:43.258310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.272796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.277706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.282461 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7c209bd-6711-4564-89a7-6219e911dd0e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.217662 Aug 21 01:37:43.283450 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2630/5910] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:43 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:43.340381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:43.340980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:43.358951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:43.359453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:43.359895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:43.360664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:43.369857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:43.370001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:43.612210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.625912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.627413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:43.628969 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9d4902c-9fd5-48b0-a1c9-9e4e4b159fb8 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1722 microversion: 2.20 time: 0.293312 Aug 21 01:37:43.641155 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3281/5911] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:43 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:44.307014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:44.307855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:44.315947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:44.317286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:44.317920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:44.319058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:44.319682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:44.320258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:44.530125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.542820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.545050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.547898 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2d564713-d80e-47f3-9561-98dc95dda8d4 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.245915 Aug 21 01:37:44.550269 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2631/5912] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:44 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:44.657862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:44.659131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:44.671724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:44.672511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:44.673240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:44.674246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:44.675020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:44.675545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:44.750761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.767065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.768623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:44.770036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e640a0ff-8e7e-478d-a99e-08a1d3930afc tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1654 microversion: 2.20 time: 0.118003 Aug 21 01:37:44.770604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3282/5913] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:44 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1654 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:45.583305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:45.584680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:45.591400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa235ebb-ea8f-4024-ad65-d60ec723b710", "name": "network-vif-deleted", "tag": "04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:37:45.593392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.594123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.594824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.595832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.596737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.597974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.616138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.620136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.649153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.690697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] Creating event network-vif-deleted:04fcaa92-3f19-4f47-82cb-ea7ce9d9b45d for instance aa235ebb-ea8f-4024-ad65-d60ec723b710 on n-h1-master-1 Aug 21 01:37:45.709526 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8ac6bdf9-2ea9-433b-a307-d91ca972cc71 req-ccb5a0a8-81c3-4406-88ce-4a2e326612b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121833 Aug 21 01:37:45.713115 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3283/5914] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:37:45.751410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.760519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.766349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.767589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-232b287a-47ab-4546-a33a-96361c48da85 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.189918 Aug 21 01:37:45.771169 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2632/5915] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:45 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:45.795976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:45.796667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:45.806428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.806928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.809792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.810838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.812689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.814368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.880170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:45.880657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:45.881142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:45.881648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lazy-loading 'fault' on Instance uuid aa235ebb-ea8f-4024-ad65-d60ec723b710 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:37:45.964686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.978715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.986512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61445b694d0c484c99648ec99f21a34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b84439bde64075ab7459b430b0e612', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:45.988218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a99b305-715d-4b3e-9a0c-31ab22028463 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 200 len: 1371 microversion: 2.20 time: 0.197446 Aug 21 01:37:45.990264 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3284/5916] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:45 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:46.791825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:46.793100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:46.806592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:46.809460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:46.811328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:46.812189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:46.813403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:46.815518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:46.901261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:46.905631 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:37:46.911196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:46.913140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:46.914521 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ce0541a3-b0f0-49d5-a3de-ffd3a27b7f05 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.127153 Aug 21 01:37:46.915089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2633/5917] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:46 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:47.013685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:47.014350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:47.021958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:47.022436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:47.022863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:47.023567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:47.024007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:47.024419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:47.038902 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 HTTP/1.1 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: exception: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'aa235ebb-ea8f-4024-ad65-d60ec723b710'} Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:47.040551 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5e220f1b-606a-4b3d-be8c-610deed0d2c4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 404 len: 111 microversion: 2.20 time: 0.033763 Aug 21 01:37:47.045509 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3285/5918] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:47 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:37:47.054985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-854547ae-d7b0-4b19-9f11-44e0c540ef4a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '.version_select at 0x7fc4030ef550>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:47.080114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-854547ae-d7b0-4b19-9f11-44e0c540ef4a tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587815751" status: 204 len: 0 microversion: 2.20 time: 0.028618 Aug 21 01:37:47.085254 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2634/5919] 10.222.0.46 () {60 vars in 1262 bytes} [Sun Aug 21 01:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587815751 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:37:47.940320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:47.941052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:47.958496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:47.965551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:47.966338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:47.967334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:47.968179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:47.968865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:48.099792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:48.117353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:48.119144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:48.121657 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-472ecfdb-636c-429f-9bc0-92543be5d791 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.187689 Aug 21 01:37:48.122769 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3286/5920] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:47 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:49.152074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:49.153584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:49.163836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:49.164716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:49.165433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:49.166592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:49.171265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:49.172052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:49.281690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:49.292699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:49.294696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:49.296110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd11ba02-0275-4729-8c69-0dce837565e2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.149497 Aug 21 01:37:49.306170 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2635/5921] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:49 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:50.321501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:50.322357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:50.338324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:50.339042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:50.339543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:50.342291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:50.357412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:50.358252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:50.559161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:50.574296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:50.575765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:50.577963 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f0d8290-46dd-4d81-a549-27183ed5a01e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.262105 Aug 21 01:37:50.579066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3287/5922] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:50 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:51.431281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:51.431793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:51.447405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.448164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.448915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.449833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.450287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.454301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.485619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 HTTP/1.1 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: exception: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'aa235ebb-ea8f-4024-ad65-d60ec723b710'} Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:51.488271 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.492400 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.494879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:51.495984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6aa7562c-fb5c-4310-9ae3-b2599212fd21 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 404 len: 111 microversion: 2.20 time: 0.071004 Aug 21 01:37:51.496909 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2636/5923] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:37:51 2022] DELETE /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:37:51.506468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:51.507086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: aa235ebb-ea8f-4024-ad65-d60ec723b710] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:51.524180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.529320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.529988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.531111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.531753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.532341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.567904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 HTTP/1.1 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: exception: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'aa235ebb-ea8f-4024-ad65-d60ec723b710'} Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.578282 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. Aug 21 01:37:51.583670 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:51.585189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance aa235ebb-ea8f-4024-ad65-d60ec723b710 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:51.586424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5413f12d-7221-401f-9517-1e44c4623748 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710" status: 404 len: 111 microversion: 2.20 time: 0.084789 Aug 21 01:37:51.591317 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3288/5924] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:51 2022] GET /compute/v2.1/servers/aa235ebb-ea8f-4024-ad65-d60ec723b710 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:37:51.603004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:51.604838 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:51.626825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.631803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.632405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.633300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:51.635179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:51.635720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:51.794907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:51.812327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:51.817365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:51.819135 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbee9625-0cc7-47f9-8d82-4abdc0d3065e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.221420 Aug 21 01:37:51.833526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2637/5925] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:51 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:52.859112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:52.859634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:52.880791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:52.886833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:52.887438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:52.888527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:52.889131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:52.893950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:53.381906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:53.393917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:53.399464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:53.404157 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-389e2824-218c-47bb-968e-ee0a2937cf2b tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.555873 Aug 21 01:37:53.406430 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3289/5926] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:52 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:54.431109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:54.432728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:54.443700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:54.444198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:54.444638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:54.445478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:54.446111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:54.446690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:54.574024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:54.589536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:54.594020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:54.597422 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7354e050-6f51-4f16-90f2-9b8235fbd4e0 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.169479 Aug 21 01:37:54.616663 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2638/5927] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:54 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 21 01:37:55.624928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:55.625731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:55.633627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:55.634471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:55.635144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:55.636902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:55.637578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:55.638234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:55.915449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:55.932032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:55.936861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:55.938629 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d92e9d65-99dc-4ff2-8cc5-fb747323ba69 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.318714 Aug 21 01:37:55.940110 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3290/5928] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:55 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:56.204297 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:56.205579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:56.213306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.214055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.214650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:56.215552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.216176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.216759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:56.233448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 HTTP/1.1 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd1d362bd-347a-4615-94d8-891d6017d171'} Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:56.235277 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.240001 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.241680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:56.242781 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-315f9898-67b3-43d9-bf5b-06d0e0e24442 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 404 len: 111 microversion: 2.20 time: 0.042841 Aug 21 01:37:56.252911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:56.253887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] [instance: d1d362bd-347a-4615-94d8-891d6017d171] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:56.257397 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2639/5929] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:37:56 2022] DELETE /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:37:56.261438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.262096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.262697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:56.263699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.264316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.264906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:56.281149 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] HTTP exception thrown: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Request method failure captured: Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 HTTP/1.1 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYpXtHDhjtpvKw-qzT8WxWs9C7oRGRM9DKjK_YQyO6PH9hxka2ejVeNU7FmrEUsctJ-CQsdzctJpWN8Tb3tiC2aiTi69DMWRcGM2qF2UWwZzsKhb4UTzs8czibRLUlAhwnSHdDGicWsmel0CoweSa-dlrois-kKCFF3pk11qXQ3bjk4 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Openstack-Nova-Api-Version: 2.20 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22b84439bde64075ab7459b430b0e612", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22b84439bde64075ab7459b430b0e612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22b84439bde64075ab7459b430b0e612"}]}] Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 22b84439bde64075ab7459b430b0e612 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1538789377 Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 61445b694d0c484c99648ec99f21a34a Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1538789377-project Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd1d362bd-347a-4615-94d8-891d6017d171'} Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.282900 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. Aug 21 01:37:56.288084 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:37:56.289779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] Returning 404 to user: Instance d1d362bd-347a-4615-94d8-891d6017d171 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:37:56.290807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10a49a7c-d0f5-4c9b-a3ee-8368781787b4 tempest-AttachVolumeShelveTestJSON-1538789377 tempest-AttachVolumeShelveTestJSON-1538789377-project] 10.222.0.46 "GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171" status: 404 len: 111 microversion: 2.20 time: 0.042238 Aug 21 01:37:56.295939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3291/5930] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:56 2022] GET /compute/v2.1/servers/d1d362bd-347a-4615-94d8-891d6017d171 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 21 01:37:56.977279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:56.978312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:56.987126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.989698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.991536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:56.995148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:56.995858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:56.996525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:57.155948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:57.186158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:57.195774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:57.199761 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53053f59-7452-46ba-a789-66bd450c339e tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.233654 Aug 21 01:37:57.201589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2640/5931] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:56 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:58.233534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:58.235156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:58.246114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:58.250794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:58.251430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:58.252457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:58.253126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:58.253722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:58.352242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:58.363042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:58.367248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:58.369248 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-591412af-a49c-4550-9e2d-fd87398cf287 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1407 microversion: 2.54 time: 0.149526 Aug 21 01:37:58.378858 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3292/5932] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:58 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:37:59.394919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:37:59.396167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:37:59.405131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:59.406129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:59.406857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:59.407836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:37:59.408919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:37:59.409747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:37:59.483946 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:59.497379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:59.499860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:37:59.501366 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-647c8ef6-4636-4104-9dfa-435b8c08f9e1 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1413 microversion: 2.54 time: 0.111844 Aug 21 01:37:59.502295 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2641/5933] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:37:59 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:00.527693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:00.528393 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:00.550621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:00.551144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:00.551552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:00.552259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:00.553084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:00.553730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:00.588842 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:00.696418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:00.713383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:00.723272 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:00.725495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e2cc64e-35ac-46aa-bd39-cecd84339959 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1413 microversion: 2.54 time: 0.201643 Aug 21 01:38:00.729673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3293/5934] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:00 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1413 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:01.748719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:01.749355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:01.763488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:01.767289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:01.768057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:01.771654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:01.772138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:01.772573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:02.053478 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:02.065194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:02.078012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:02.079306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f82e6388-73eb-4cba-87ec-b54667d79ae2 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1413 microversion: 2.54 time: 0.334530 Aug 21 01:38:02.083868 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2642/5935] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:01 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1413 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:03.109763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:03.110780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:03.123203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.124385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.125103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.126711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.128035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.129003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.251474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.266623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.268434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.269400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e83e57fe-ddb1-47fd-a102-30e4cf82e686 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1398 microversion: 2.54 time: 0.165568 Aug 21 01:38:03.269960 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3294/5936] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:03 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1398 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:03.296239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc0c889a-7f4b-4f66-aec3-72bce59ba825 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '.version_select at 0x7fc3fd18cee0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:03.315663 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:03.329430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc0c889a-7f4b-4f66-aec3-72bce59ba825 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-777464048" status: 204 len: 0 microversion: 2.54 time: 0.037752 Aug 21 01:38:03.331983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2643/5937] 10.222.0.46 () {60 vars in 1316 bytes} [Sun Aug 21 01:38:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-777464048 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:38:03.346355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:03.346795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:03.355563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.357865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.358612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.359507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.360983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.362184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.421897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:38:03.638560 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee453285-d4f7-4c72-a8f8-7691c2de459a tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 204 len: 0 microversion: 2.54 time: 0.295867 Aug 21 01:38:03.640252 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3295/5938] 10.222.0.46 () {60 vars in 1280 bytes} [Sun Aug 21 01:38:03 2022] DELETE /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 21 01:38:03.651635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:03.652313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:03.665503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.666011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.666450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.667213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:03.667671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:03.668099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:03.843548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.856117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.859513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:03.864902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bb4a64c6-81ef-4870-9691-86595890e8e9 tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1404 microversion: 2.54 time: 0.217833 Aug 21 01:38:03.868337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2644/5939] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:03 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:04.892544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:04.893697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:04.903427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:04.904432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:04.905159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:04.906203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:04.907111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:04.908607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:04.994283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:05.004503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:05.006627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b11b9adba9849b9ab5fd32b35c8ecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fccfb6e12034a7fb9cab13a9e9530d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:05.008792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65b62006-d917-4a4f-b718-abebccefe1dd tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 200 len: 1404 microversion: 2.54 time: 0.121575 Aug 21 01:38:05.010044 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3296/5940] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:04 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 1404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 21 01:38:06.032577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:06.035368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] [instance: 7eedec89-c236-42bd-9e00-56a7037dceec] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:06.055851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:06.057002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:06.058378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:06.062666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:06.063946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:06.067250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:06.094897 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] HTTP exception thrown: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Request method failure captured: Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec HTTP/1.1 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYxWmrd9ffWmt2xAzUfsqrjJgRiLAQGQ00aBDmjRxoh67cjfqHde2JVQbiZa42jUFoI0zyTX-xNHoDrqJEyLRdx1LhppdtogqiGaoWPLXb1rnaiOx6Q8hS6BkhbYRLcjvhuG3zlr8n4JKQq7G54Othc09Te4ZCxO6LdmEhahgnKzR1o Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Openstack-Nova-Api-Version: 2.54 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 5fccfb6e12034a7fb9cab13a9e9530d7 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerShowV254Test-1718152863 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fccfb6e12034a7fb9cab13a9e9530d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fccfb6e12034a7fb9cab13a9e9530d7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fccfb6e12034a7fb9cab13a9e9530d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fccfb6e12034a7fb9cab13a9e9530d7"}]}] Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerShowV254Test-1718152863 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 5fccfb6e12034a7fb9cab13a9e9530d7 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerShowV254Test-1718152863 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerShowV254Test-1718152863-project Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7b11b9adba9849b9ab5fd32b35c8ecf0 Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerShowV254Test-1718152863-project Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7eedec89-c236-42bd-9e00-56a7037dceec'} Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:38:06.097488 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. Aug 21 01:38:06.102188 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:38:06.104079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] Returning 404 to user: Instance 7eedec89-c236-42bd-9e00-56a7037dceec could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:38:06.105520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0e2074b8-858d-4112-8494-a7a8fa4a05dc tempest-ServerShowV254Test-1718152863 tempest-ServerShowV254Test-1718152863-project] 10.222.0.46 "GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec" status: 404 len: 111 microversion: 2.54 time: 0.077892 Aug 21 01:38:06.106705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2645/5941] 10.222.0.46 () {60 vars in 1277 bytes} [Sun Aug 21 01:38:06 2022] GET /compute/v2.1/servers/7eedec89-c236-42bd-9e00-56a7037dceec => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 21 01:38:10.006869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-336788412", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:38:10.036251 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:10.124570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] validate_networks() for None {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:38:10.793368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:38:10.793573 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:38:10.794052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:38:10.794461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:38:10.794874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:38:10.806735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:10.807453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:10.808062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:10.812603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:10.815930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:10.816208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:10.840925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Getting quotas for project b66b806e65424e56b49412c91d270e30. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:38:10.846876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Getting quotas for user 1972cecb38fe443bbf248e71e6f01c12 and project b66b806e65424e56b49412c91d270e30. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:38:10.874714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:38:10.882993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:38:10.987350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27b2ed00-2ce5-4569-bcca-000c9183893f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984064 Aug 21 01:38:10.988563 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3297/5942] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:38:10.999999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3a0dc11-16fc-4799-99dd-66e39d555647 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:11.000877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3a0dc11-16fc-4799-99dd-66e39d555647 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:11.104458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3a0dc11-16fc-4799-99dd-66e39d555647 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:11.117224 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3a0dc11-16fc-4799-99dd-66e39d555647 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1213 microversion: 2.1 time: 0.121865 Aug 21 01:38:11.118489 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2646/5943] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:10 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:12.145214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-724f2b77-8bab-42fa-8b69-cd3834b86082 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:12.147079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-724f2b77-8bab-42fa-8b69-cd3834b86082 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:12.387616 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-724f2b77-8bab-42fa-8b69-cd3834b86082 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:12.402853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-724f2b77-8bab-42fa-8b69-cd3834b86082 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1213 microversion: 2.1 time: 0.266375 Aug 21 01:38:12.406873 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3298/5944] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:12 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:13.429760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:13.430382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:13.449635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:13.451701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:13.453284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:13.454639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:13.456656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:13.458694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:13.637149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:13.650186 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1271 microversion: 2.1 time: 0.225755 Aug 21 01:38:13.652199 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2647/5945] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:13 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:14.676467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:14.678020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:14.692508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:14.693374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:14.693954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:14.694808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:14.698139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:14.699095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:15.049931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:15.064716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5ecf564-bb8d-4e56-9d21-ea54e158d59a tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.392780 Aug 21 01:38:15.078425 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3299/5946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:14 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:15.505589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:15.506581 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fdb5925c-4cc4-4e64-918e-ca4bdf75b3d0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001434 Aug 21 01:38:15.506923 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2648/5947] 10.222.0.46 () {56 vars in 886 bytes} [Sun Aug 21 01:38:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 21 01:38:16.086500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:16.091703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:16.104578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:16.105484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:16.106104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:16.107020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:16.107635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:16.108253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:16.598927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:16.610547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36b6c2a4-b02e-48b1-9f17-a0292d9389e6 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.527950 Aug 21 01:38:16.615008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3300/5948] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:16 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:16.706453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368534ca-ce9f-4ec9-96e5-0d0f68b5b237", "tag": "826c9016-c9ca-45f2-927b-3d7595fbed75"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:38:16.729982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:16.730734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:16.731316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:16.747143 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] Creating event network-changed:826c9016-c9ca-45f2-927b-3d7595fbed75 for instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 on n-h1-master-1 Aug 21 01:38:16.755746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6a6e55ba-d845-470a-9af5-e7fbd8687db7 req-46d095a5-5e72-4de2-b4f9-6e61f3d8b07f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054799 Aug 21 01:38:16.756727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2649/5949] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:38:17.635366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:17.636082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:17.649716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:17.650457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:17.651064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:17.651922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:17.652517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:17.657938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:18.001718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:18.015637 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e287f01-3751-4707-a301-27a2f8c6b3b4 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.382308 Aug 21 01:38:18.018033 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3301/5950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:17 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:19.041034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:19.042379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:19.050068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:19.050810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:19.051413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:19.052289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:19.052931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:19.053514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:19.081864 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=57 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:19.387814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:19.403701 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d88f9282-bc1d-4ac3-aee0-f5f8e79d3604 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.366619 Aug 21 01:38:19.404624 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2650/5951] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:19 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:20.429053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:20.429661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:20.443449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:20.444042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:20.444478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:20.449629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:20.450291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:20.450881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:20.745878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:20.785811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8525a18-5e36-4e34-9833-24ac377fdade tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.360008 Aug 21 01:38:20.787151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3302/5952] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:20 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:21.815229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:21.817540 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:21.829917 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:21.834283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:21.838704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:21.841127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:21.842205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:21.843249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:21.847994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:22.459384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:22.483597 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3d4185b-143a-4d7d-be5d-944890c41c4c tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.673596 Aug 21 01:38:22.498421 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2651/5953] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:21 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:22.907256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368534ca-ce9f-4ec9-96e5-0d0f68b5b237", "name": "network-vif-plugged", "status": "completed", "tag": "826c9016-c9ca-45f2-927b-3d7595fbed75"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:38:22.932047 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:22.935061 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:22.938719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:22.946784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:22.948124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:22.966564 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] Creating event network-vif-plugged:826c9016-c9ca-45f2-927b-3d7595fbed75 for instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 on n-h1-master-1 Aug 21 01:38:22.973785 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-07af701a-9f7a-46d8-9e11-fca2e1d380be req-b2de2458-ee16-4ce6-8e59-347b68887b5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072456 Aug 21 01:38:22.975070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3303/5954] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:38:23.505544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:23.506282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:23.517490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:23.518112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:23.518929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:23.520047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:23.520832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:23.521642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:23.770429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:23.780909 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c9b4e28-fdc2-4999-ad78-080e765afe1f tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1313 microversion: 2.1 time: 0.279547 Aug 21 01:38:23.782473 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2652/5955] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:23 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:24.805304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:24.805793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:24.812033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:24.812793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:24.813390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:24.814333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:24.814945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:24.815524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:25.003727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:38:25.015119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6af9e680-2421-40ae-b2e8-4d08380688f9 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1463 microversion: 2.1 time: 0.215496 Aug 21 01:38:25.017180 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3304/5956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:38:24 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:38:25.038770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac3d24ef-6d89-4a96-b62e-b5a8e676f596", "device": "/dev/sdb"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:38:25.041324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:25.052724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:25.054759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:25.057318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:25.058245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:25.058716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:25.059153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:25.479718 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50203b27-20d9-42b3-bed3-5cb69bceb0c0 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "POST /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.445203 Aug 21 01:38:25.496966 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2653/5957] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:38:25 2022] POST /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:38:47.058883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:38:47.059501 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:47.065053 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:47.069835 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:47.090990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:47.093119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:47.098479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:47.102048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:47.104215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:47.105461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:47.165133 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-813ca229-81cd-41b1-9db8-ae1ff6ae6a34 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/ips" status: 200 len: 149 microversion: 2.1 time: 0.110064 Aug 21 01:38:47.167926 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3305/5958] 10.222.0.46 () {58 vars in 1248 bytes} [Sun Aug 21 01:38:47 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:38:50.112391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "976ed10b-842c-4355-86ca-eb2b1066250a"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:38:50.115089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:38:50.123842 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:50.131250 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:38:50.151728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:50.152476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:50.153169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:50.159386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:38:50.159880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:38:50.160253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:38:50.791009 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-932a230f-24da-4dbf-8f66-907805b084d7 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "POST /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683930 Aug 21 01:38:50.805431 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2654/5959] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 01:38:50 2022] POST /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:06.836620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:06.837835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:06.847392 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:06.849236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:06.849936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:06.850809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:06.851776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:06.852547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:06.853210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:06.974624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lazy-loading 'services' on Instance uuid 2437ef23-9df7-4d80-a153-5da68d8eebce {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:39:07.075145 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f77480cf-dd1b-400e-816e-ae4f26ade3b3 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments/976ed10b-842c-4355-86ca-eb2b1066250a" status: 202 len: 0 microversion: 2.1 time: 0.245112 Aug 21 01:39:07.077035 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3306/5960] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:39:06 2022] DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments/976ed10b-842c-4355-86ca-eb2b1066250a => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:39:07.085712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:07.088008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:07.090979 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:07.091837 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:07.097565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:07.098268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:07.098874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:07.099736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:07.100352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:07.100898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:07.137502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-40d8acc0-21fa-4d9e-98f6-fb541a0b8d66 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056253 Aug 21 01:39:07.138728 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2655/5961] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:07 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:08.151653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:08.155789 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:08.178293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:08.179406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:08.181028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:08.184188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:08.186259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:08.186878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:08.245433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6084cc5-14a8-4629-93d2-7c026341f3e2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097694 Aug 21 01:39:08.247649 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3307/5962] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:08 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:09.258587 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:09.261101 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:09.283054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:09.284041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:09.284486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:09.285545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:09.285996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:09.286420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:09.360555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1080fed4-adc8-4d35-89e2-b11d8659fa4e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106552 Aug 21 01:39:09.361244 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2656/5963] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:09 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:10.409587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:10.413074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:10.421291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:10.422312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:10.423081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:10.424425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:10.425084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:10.425829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:10.463731 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ab6e7a4-aa63-4c67-b618-c471d0f1abee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083313 Aug 21 01:39:10.465394 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3308/5964] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:10 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:11.477258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:11.479435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:11.498091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:11.498868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:11.499483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:11.500344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:11.500982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:11.501400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:11.572133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-768a94d1-d933-46eb-bcc8-10013ae1640a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099133 Aug 21 01:39:11.573016 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2657/5965] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:11 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:12.585903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:12.588807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:12.598040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:12.598830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:12.599258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:12.600169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:12.600799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:12.601525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:12.640609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-066fe51f-70e7-4f6c-a71c-654ed6b7225d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060365 Aug 21 01:39:12.646172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3309/5966] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:12 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:13.653468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:13.658823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:13.693080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:13.693663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:13.694107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:13.694845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:13.695294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:13.695719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:13.752008 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-edb1d369-5734-4950-b6bc-417bddf727ee tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102127 Aug 21 01:39:13.773651 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2658/5967] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 01:39:13 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 01:39:13.869263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:13.869900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:13.885279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:13.887256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:13.889859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:13.891745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:13.896127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:13.897169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:13.941661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:39:14.062909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d928aab5-450c-417c-8d73-d2876f9dafd4 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 204 len: 0 microversion: 2.1 time: 0.197914 Aug 21 01:39:14.064373 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3310/5968] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:39:13 2022] DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:39:14.073126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:14.074140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:14.085138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:14.085893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:14.094155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:14.095785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:14.096508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:14.097313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:14.285870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:39:14.295742 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a46b0f24-f6b2-409b-a5ba-9f33893623f2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1681 microversion: 2.1 time: 0.227016 Aug 21 01:39:14.329391 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2659/5969] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:14 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:39:15.348405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:15.350207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:15.368162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:15.371076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:15.372753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:15.376025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:15.376677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:15.378235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:15.684588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:39:15.698231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6bc39f5-7dbb-4100-9f71-f8e0ad72ec79 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1681 microversion: 2.1 time: 0.354226 Aug 21 01:39:15.698813 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3311/5970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:15 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1681 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:39:16.721317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:16.721940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:16.730489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:16.737347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:16.737900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:16.738648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:16.739108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:16.741800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:17.095915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:39:17.105938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7b0207ba-1a75-4300-84dc-7c8d065dfd1d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1681 microversion: 2.1 time: 0.389361 Aug 21 01:39:17.106687 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2660/5971] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:16 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:39:18.131280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:18.132679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:18.141416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:18.142201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:18.142981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:18.143887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:18.144496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:18.145157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:18.330020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c1f10a225e4f14885bf583527e93a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522827f3647e4cdfa81257e8a048278b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:39:18.364444 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d62d52ad-93b2-4936-98eb-c9b640bbff4d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 200 len: 1613 microversion: 2.1 time: 0.236057 Aug 21 01:39:18.368040 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3312/5972] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:18 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 1613 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:39:18.628192 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2437ef23-9df7-4d80-a153-5da68d8eebce", "name": "network-vif-deleted", "tag": "81dc824e-1d8e-4462-815d-adf38fecbae4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:39:18.640348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:18.646266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:18.647133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:18.671585 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] Creating event network-vif-deleted:81dc824e-1d8e-4462-815d-adf38fecbae4 for instance 2437ef23-9df7-4d80-a153-5da68d8eebce on n-h2-master-1 Aug 21 01:39:18.679080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d0847950-881c-4d91-9ab8-77984269d74c req-23d00534-ef73-4806-8fa6-622c5a4a4fd2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362709 Aug 21 01:39:18.680066 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2661/5973] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:39:19.386039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:19.387988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:19.395792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:19.396590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:19.397218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:19.398084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:19.398691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:19.399264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:19.419599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce HTTP/1.1 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2437ef23-9df7-4d80-a153-5da68d8eebce'} Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:19.421648 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:19.431730 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:19.434310 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:19.435199 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-822ea291-d6b1-4250-ae72-7e233114617d tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 404 len: 111 microversion: 2.1 time: 0.053217 Aug 21 01:39:19.435777 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3313/5974] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:19 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:19.449890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a8f3a31-1154-42f1-9af6-f14bde8d0d92 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '.version_select at 0x7fc4030e2790>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:19.482830 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a8f3a31-1154-42f1-9af6-f14bde8d0d92 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663981610" status: 202 len: 0 microversion: 2.1 time: 0.041539 Aug 21 01:39:19.485139 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2662/5975] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 01:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663981610 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:39:26.838732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:26.839896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:26.869197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:26.869988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:26.873230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:26.874316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:26.875253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:26.876949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:26.913281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce HTTP/1.1 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2437ef23-9df7-4d80-a153-5da68d8eebce'} Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:26.914878 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:26.920224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:26.922800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1581a55-a686-4f47-8804-53349c54da8e tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 404 len: 111 microversion: 2.1 time: 0.091706 Aug 21 01:39:26.926295 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3314/5976] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:39:26 2022] DELETE /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:26.933322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:26.934108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 2437ef23-9df7-4d80-a153-5da68d8eebce] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:26.951828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:26.952806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:26.953573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:26.954522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:26.955143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:26.955713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:26.998811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce HTTP/1.1 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2437ef23-9df7-4d80-a153-5da68d8eebce'} Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:27.000578 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 2437ef23-9df7-4d80-a153-5da68d8eebce could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:27.005087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-285bb4ab-7441-44c7-a27e-40c17d993dc8 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce" status: 404 len: 111 microversion: 2.1 time: 0.074490 Aug 21 01:39:27.006953 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2663/5977] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:26 2022] GET /compute/v2.1/servers/2437ef23-9df7-4d80-a153-5da68d8eebce => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:33.945459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:33.945459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:33.962797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:33.965308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:33.966035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:33.969451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:33.970111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:33.970910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.003118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 HTTP/1.1 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7440db2c-dbb6-4b47-9b45-337589cdc1a0'} Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:34.005002 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.009722 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.016531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:34.017680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9df8402c-82e2-4283-8a20-2b79f443c3de tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 404 len: 111 microversion: 2.1 time: 0.078940 Aug 21 01:39:34.021981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3315/5978] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:39:33 2022] DELETE /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:34.028377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:34.029149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 7440db2c-dbb6-4b47-9b45-337589cdc1a0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:34.047123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.049398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.051158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.053163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.054569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.056981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.091164 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 HTTP/1.1 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '7440db2c-dbb6-4b47-9b45-337589cdc1a0'} Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.092909 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 7440db2c-dbb6-4b47-9b45-337589cdc1a0 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:34.100640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-27e9f84b-1171-4f33-af12-2e56d49876a2 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0" status: 404 len: 111 microversion: 2.1 time: 0.074714 Aug 21 01:39:34.108607 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2664/5979] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:34 2022] GET /compute/v2.1/servers/7440db2c-dbb6-4b47-9b45-337589cdc1a0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:34.116095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:34.116591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:34.125475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.125958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.126387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.127083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.127525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.127935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.160738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b HTTP/1.1 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87407c97-fde2-40e6-a122-e67a22a2617b'} Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:34.162315 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8940c7fe-d895-4fdb-8bdd-d6aecac9f358 tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 404 len: 111 microversion: 2.1 time: 0.053208 Aug 21 01:39:34.170209 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3316/5980] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:39:34 2022] DELETE /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:34.173410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:34.174058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: 87407c97-fde2-40e6-a122-e67a22a2617b] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:34.181572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.182061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.182482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.183179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:34.183621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:34.184031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:34.214355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b HTTP/1.1 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '87407c97-fde2-40e6-a122-e67a22a2617b'} Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:34.221958 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance 87407c97-fde2-40e6-a122-e67a22a2617b could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91e7f181-6f3e-444b-9127-b759cb11be4a tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b" status: 404 len: 111 microversion: 2.1 time: 0.054734 Aug 21 01:39:34.229948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2665/5981] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:34 2022] GET /compute/v2.1/servers/87407c97-fde2-40e6-a122-e67a22a2617b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:39:38.710603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:38.711819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:38.726631 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:38.730334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:38.731131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:38.732703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:38.734730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:38.747356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:38.750993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:38.803620 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:38.816010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf HTTP/1.1 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: exception: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e80c4bd7-a53e-411c-b9cb-d82036ff2fcf'} Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:38.817893 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.822720 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.826420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:38.832344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7bbcf264-b7a0-4611-b367-46953f059adc tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 404 len: 111 microversion: 2.1 time: 0.128452 Aug 21 01:39:38.833131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3317/5982] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:39:38 2022] DELETE /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:39:38.841686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:39:38.842710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] [instance: e80c4bd7-a53e-411c-b9cb-d82036ff2fcf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:39:38.846036 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:39:38.870480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:38.872226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:38.874096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:38.876651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:39:38.877561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:39:38.880681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:39:38.911825 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] HTTP exception thrown: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Request method failure captured: Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf HTTP/1.1 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAYsPaBeCpr_tbOs3ZkRd0H38Lao5-VqZ5MdQnh8bpOa4zBM8DeobzRnHDJFeVzQS_IZm1V93Sd0BfudrMXYzvtbXeBBXC84fX3RXIZLH2rgVLRKyfjOOlL7BDHnhMG7hALMT4PJd26p7NfXKS4hEqnL87iCTD6z6vaoBJvpFBJkZ4gc Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_522827f3647e4cdfa81257e8a048278b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/522827f3647e4cdfa81257e8a048278b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/522827f3647e4cdfa81257e8a048278b"}]}] Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 522827f3647e4cdfa81257e8a048278b Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1447072231 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 05c1f10a225e4f14885bf583527e93a0 Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-AttachVolumeNegativeTest-1447072231-project Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e80c4bd7-a53e-411c-b9cb-d82036ff2fcf'} Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:39:38.914487 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. Aug 21 01:39:38.918568 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:39:38.929209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] Returning 404 to user: Instance e80c4bd7-a53e-411c-b9cb-d82036ff2fcf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:39:38.930459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-759518c6-286f-4133-91cf-72db2b2722eb tempest-AttachVolumeNegativeTest-1447072231 tempest-AttachVolumeNegativeTest-1447072231-project] 10.222.0.46 "GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf" status: 404 len: 111 microversion: 2.1 time: 0.092854 Aug 21 01:39:38.933723 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2666/5983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:39:38 2022] GET /compute/v2.1/servers/e80c4bd7-a53e-411c-b9cb-d82036ff2fcf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:01.785726 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 01:40:01.786287 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 01:40:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 01:40:04.555364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:04.555926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:04.567576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:04.568352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:04.569354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:04.570620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:04.571266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:04.571873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:04.692266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lazy-loading 'services' on Instance uuid 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:40:04.811693 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a75ef4f6-2cb8-481f-9510-f88a8f5ac040 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "DELETE /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237/os-volume_attachments/ac3d24ef-6d89-4a96-b62e-b5a8e676f596" status: 202 len: 0 microversion: 2.1 time: 0.257955 Aug 21 01:40:04.813600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3318/5984] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 01:40:04 2022] DELETE /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237/os-volume_attachments/ac3d24ef-6d89-4a96-b62e-b5a8e676f596 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:40:11.728721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:11.729285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:11.731706 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.732431 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=46 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:11.740337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:11.740337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:11.740337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:11.740337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:11.740706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:11.741064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:11.771617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:40:11.917939 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22b3e706-604e-409b-9155-c7bb986bd169 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "DELETE /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 204 len: 0 microversion: 2.1 time: 0.192980 Aug 21 01:40:11.918925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2667/5985] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:40:11 2022] DELETE /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:40:11.933084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:11.934119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:11.950689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:11.951179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:11.951565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:11.952259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:11.954459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:11.956724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:12.179156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:12.188303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf538388-a0c9-4839-a836-ad2d75baa8f5 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1469 microversion: 2.1 time: 0.264477 Aug 21 01:40:12.202354 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3319/5986] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:11 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:13.212672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:13.213269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:13.222201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:13.222721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:13.223078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:13.223868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:13.224209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:13.224622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:13.424098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:13.434358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d7944ea0-b768-431c-bf6b-9e477a62d6df tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1469 microversion: 2.1 time: 0.226305 Aug 21 01:40:13.437537 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2668/5987] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:13 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:14.056700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368534ca-ce9f-4ec9-96e5-0d0f68b5b237", "name": "network-vif-deleted", "tag": "826c9016-c9ca-45f2-927b-3d7595fbed75"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:14.071528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:14.071992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:14.072631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:14.089407 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] Creating event network-vif-deleted:826c9016-c9ca-45f2-927b-3d7595fbed75 for instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 on n-h1-master-1 Aug 21 01:40:14.096030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e721690f-c925-450a-ba21-d6bac6829b69 req-b0183aba-a4bf-4e7e-b5ab-61c319291a9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045195 Aug 21 01:40:14.097144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3320/5988] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:40:14.457704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:14.458659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:14.469633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:14.471286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:14.471951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:14.472902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:14.473619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:14.474285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:14.516100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:14.516531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:14.517053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:14.517827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lazy-loading 'fault' on Instance uuid 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:40:14.587016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1972cecb38fe443bbf248e71e6f01c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66b806e65424e56b49412c91d270e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:14.606454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa86f3d9-6657-4619-a0f6-92a6a8c25d24 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 200 len: 1303 microversion: 2.1 time: 0.153358 Aug 21 01:40:14.608146 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3321/5989] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:14 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:14.899823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3da7cbb-7091-4a5d-b94e-d16bacf27895 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: .version_select at 0x7fc4030ef160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1902905960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD88R2QingLsrHOLYCLzU4LfmvnEgKGY9nNGNEcOafSFFSk24OMGN0fk7XN52Ee5C5MLu+YWSXRawSsXff8nDR0zIiIyiArYjClBxih+NJuzEvS1ySkgPiIoKYuwkfC6fg=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:14.919803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a3da7cbb-7091-4a5d-b94e-d16bacf27895 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:40:14.926601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a3da7cbb-7091-4a5d-b94e-d16bacf27895 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:40:14.955764 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3da7cbb-7091-4a5d-b94e-d16bacf27895 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.585972 Aug 21 01:40:14.958521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2669/5990] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:40:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:40:15.629811 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:15.631323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] [instance: 368534ca-ce9f-4ec9-96e5-0d0f68b5b237] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:15.649959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:15.650507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:15.651085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:15.651808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:15.652255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:15.652788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:16.147888 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] HTTP exception thrown: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Request method failure captured: Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 HTTP/1.1 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYx-t8Vm9FKMUmED6v-8scXxzCEcD7MZVVKgbTZpSxPY8Ws8IObC-ZfYRVCAyqLjgaBrzj_YZYQJjWb62XvXsU5OwD9lkgt7tG66ruzyZUYfq3pQQhK3xJ6pKaDDQQy0EjjACeShLMnjYc7mHcdGansgMA6BRBpeMi_C-LAVzTPSwcY Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b66b806e65424e56b49412c91d270e30 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesBackupsTest-98083942 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b66b806e65424e56b49412c91d270e30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b66b806e65424e56b49412c91d270e30", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b66b806e65424e56b49412c91d270e30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b66b806e65424e56b49412c91d270e30"}]}] Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesBackupsTest-98083942 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b66b806e65424e56b49412c91d270e30 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesBackupsTest-98083942 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesBackupsTest-98083942-project Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 1972cecb38fe443bbf248e71e6f01c12 Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesBackupsTest-98083942-project Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '368534ca-ce9f-4ec9-96e5-0d0f68b5b237'} Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:40:16.149700 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] Returning 404 to user: Instance 368534ca-ce9f-4ec9-96e5-0d0f68b5b237 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:40:16.154987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4ebfd13-c8ce-4bdf-84e1-5d5597a3cdf8 tempest-VolumesBackupsTest-98083942 tempest-VolumesBackupsTest-98083942-project] 10.222.0.46 "GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237" status: 404 len: 111 microversion: 2.1 time: 0.527432 Aug 21 01:40:16.162401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3322/5991] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:15 2022] GET /compute/v2.1/servers/368534ca-ce9f-4ec9-96e5-0d0f68b5b237 => generated 111 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:40:26.779171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-265837961", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "e135a885-ee36-48c9-aa0a-72b75c74bc6a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1902905960", "security_groups": [{"name": "tempest-secgroup-smoke-1114227687"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:26.841020 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:26.847365 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:26.856248 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:27.127570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] validate_networks() for [('e135a885-ee36-48c9-aa0a-72b75c74bc6a', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:40:28.811218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:40:28.811852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:40:28.812096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:40:28.812620 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:40:28.813436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:40:28.826509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:28.827307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:28.827933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:28.829155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:28.829819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:28.831346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:28.872525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:40:28.880220 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:40:28.896229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:40:28.900450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:40:29.020092 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5465eda2-edda-447e-ab4b-88a7e7cf6627 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.245207 Aug 21 01:40:29.033458 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2670/5992] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:40:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:40:29.041743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b14f2d3e-cab0-4417-95c4-4234a20d384c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:29.043504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b14f2d3e-cab0-4417-95c4-4234a20d384c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:29.052638 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=13 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:29.054285 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:29.196843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b14f2d3e-cab0-4417-95c4-4234a20d384c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:29.214721 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b14f2d3e-cab0-4417-95c4-4234a20d384c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1266 microversion: 2.1 time: 0.178755 Aug 21 01:40:29.216315 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3323/5993] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:29 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:30.236534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:30.237167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:30.247918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:30.250635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:30.252480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:30.257494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:30.258822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:30.259931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:30.457834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:30.472425 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c54bddbc-9d6f-41c0-bc03-8570d671ac75 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1270 microversion: 2.1 time: 0.240453 Aug 21 01:40:30.475521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2671/5994] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:30 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:31.496695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:31.500223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:31.516845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:31.517562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:31.518402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:31.521117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:31.522724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:31.523344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:31.622666 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:31.631348 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8265d34f-275e-431e-bb50-8e47aac5ef1e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1324 microversion: 2.1 time: 0.140189 Aug 21 01:40:31.637505 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3324/5995] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:31 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:32.662047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:32.662664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:32.676225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:32.683157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:32.684402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:32.691659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:32.692445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:32.693113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:33.201377 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:33.217042 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c626cac-1adb-4cbb-8b4e-c7bb2925d997 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.560637 Aug 21 01:40:33.218524 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2672/5996] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:32 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:34.242940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:34.246321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:34.282165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:34.282668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:34.283112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:34.283840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:34.284294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:34.284722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:34.324993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:34.345799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:34.346748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:34.347405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:34.374851 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] Creating event network-changed:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h2-master-1 Aug 21 01:40:34.382282 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d4bf9799-70ba-406d-9f33-2a4ca19d9874 req-0b6bb4af-e959-4789-a3a2-e94f09ae94bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061639 Aug 21 01:40:34.384716 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2673/5997] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:40:34.713058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:34.730597 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3da3332-f73a-47ea-a43e-770a60c75fe5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.491178 Aug 21 01:40:34.733519 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3325/5998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:34 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:35.759337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:35.759978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:35.767310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:35.768257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:35.768880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:35.769934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:35.770541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:35.771483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:36.102162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:36.114033 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4c728672-59e2-4f7f-a90d-d539267964e0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.359711 Aug 21 01:40:36.120809 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2674/5999] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:35 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:37.136452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:37.137336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:37.150550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:37.151913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:37.152349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:37.154531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:37.155006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:37.155459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:37.360932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:37.388442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c2d2e31b-7aeb-4b2d-8d56-fd9a529b7efa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.257199 Aug 21 01:40:37.396825 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3326/6000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:37 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:38.420707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:38.421341 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:38.437188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:38.437991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:38.438600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:38.439491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:38.440109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:38.440698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:38.859104 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:38.890821 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:38.904169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:38.922762 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ca72382-6972-4282-a69d-8513975ae553 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.503568 Aug 21 01:40:38.927372 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2675/6001] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:38 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:39.956217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:39.957722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:39.966695 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:39.970133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:39.970897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:39.971536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:39.972748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:39.973307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:39.973840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:40.266732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:40.283592 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa885104-a54c-4819-9455-f23540bbde69 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.341320 Aug 21 01:40:40.289900 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3327/6002] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:39 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:40:41.306053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:41.307436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:41.319175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:41.324955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:41.325753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:41.326957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:41.327581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:41.328166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:41.587597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "name": "network-vif-plugged", "status": "completed", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:41.607883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:41.610680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:41.613770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:41.641585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] Creating event network-vif-plugged:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h2-master-1 Aug 21 01:40:41.653811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3734db74-aa9b-4927-8a65-dc6db73f1147 req-1cad72db-e94f-4627-990f-a92f6617e3d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069835 Aug 21 01:40:41.658348 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3328/6003] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:40:41.729618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:41.739710 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f1ea01a-c7d5-4161-9648-edd94b6d5e66 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.437357 Aug 21 01:40:41.740633 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2676/6004] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:41 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:42.762137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:42.762862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:42.770830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:42.771485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:42.771923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:42.772977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:42.773614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:42.774189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:42.958856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:42.971285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b4f5c10-43a8-420e-b4ce-8e1b6ac09841 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1392 microversion: 2.1 time: 0.212173 Aug 21 01:40:42.972239 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3329/6005] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:42 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:43.998762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:44.002317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:44.011442 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:44.012286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:44.013168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:44.014337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:44.015324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:44.016049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:44.332107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:44.343210 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8125c732-cd64-4052-9277-9f00744a6e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1564 microversion: 2.1 time: 0.355019 Aug 21 01:40:44.363063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2677/6006] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:43 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1564 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:44.363899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:44.365126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:44.373233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:44.374006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:44.374618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:44.375503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:44.376117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:44.376802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:44.634034 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:44.645257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15e04b28-4d54-4866-8b72-731dfd7ed031 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1564 microversion: 2.1 time: 0.285372 Aug 21 01:40:44.664325 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3330/6007] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:44 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1564 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:44.713985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-329874847", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "e63efaf0-65fa-42f1-94c5-f45d33ac051e"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:44.866246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] validate_networks() for [('e63efaf0-65fa-42f1-94c5-f45d33ac051e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:40:45.428789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:40:45.429997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:40:45.430484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:40:45.430965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:40:45.431385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:40:45.452244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:45.453852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:45.454312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:45.457792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:45.459214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:45.460353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:45.502886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Getting quotas for project 80714967f868419fa75307662aca3a19. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:40:45.510233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Getting quotas for user 5a18d05ad96b490b80e80e3012d51126 and project 80714967f868419fa75307662aca3a19. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:40:45.533742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:40:45.536809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:40:45.609226 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffc5102d-01a5-4197-ab76-91de3a142393 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131801 Aug 21 01:40:45.609888 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2678/6008] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:40:45.621116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cfab9e21-ec39-405d-aa58-12fe764fb392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:45.622527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cfab9e21-ec39-405d-aa58-12fe764fb392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:45.775242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cfab9e21-ec39-405d-aa58-12fe764fb392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:45.789798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cfab9e21-ec39-405d-aa58-12fe764fb392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1213 microversion: 2.1 time: 0.172312 Aug 21 01:40:45.790747 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3331/6009] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:45 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:46.813150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:46.813738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:46.834987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:46.835817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:46.836445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:46.837421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:46.837861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:46.838302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:46.918441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:46.927374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53efca43-0aaf-4ebc-96dc-0da9e93ca502 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1265 microversion: 2.1 time: 0.119481 Aug 21 01:40:46.928183 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2679/6010] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:46 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:47.952960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:47.953567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:47.970858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:47.971459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:47.972097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:47.973257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:47.977333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:47.978769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:48.377884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:48.395166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ed7f9d2-9cde-4500-b6f5-99242269295d tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.447416 Aug 21 01:40:48.405905 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3332/6011] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:47 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:49.109505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705815f5-5545-46a1-a42d-241bab1d5c03", "tag": "572914bd-8fd3-4bc0-b05f-a813e6e7d1e2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:49.149310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:49.149841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:49.150303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:49.180744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] Creating event network-changed:572914bd-8fd3-4bc0-b05f-a813e6e7d1e2 for instance 705815f5-5545-46a1-a42d-241bab1d5c03 on n-h1-master-1 Aug 21 01:40:49.195613 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b96b22b0-eabb-4d85-97f2-25ea4779997b req-d758597b-c984-4204-b5e4-e6c9c29f50bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091889 Aug 21 01:40:49.197524 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2680/6012] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:40:49.420374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:49.422760 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:49.441204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:49.441717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:49.444128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:49.445781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:49.456139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:49.456709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:49.960746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:49.961529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:49.971993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:49.972481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:49.974051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:49.974773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:49.975229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:49.975652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:50.132264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:50.137636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40a16c9c-e642-4818-912a-cbf4c57d8cea tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.722915 Aug 21 01:40:50.143110 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3333/6013] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:49 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:50.152852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:50.174682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:50.179007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:50.179611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:50.202325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] Creating event network-changed:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h2-master-1 Aug 21 01:40:50.218618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-17ec1b67-19fa-4193-ab33-5933d24ddb5c req-d36569b0-b203-48d0-824f-0147ce44a9f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073897 Aug 21 01:40:50.219413 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3334/6014] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:40:50.231433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:50.242449 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2f9e1c4-b838-4ad1-9635-da18abfbbac9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1564 microversion: 2.1 time: 0.285913 Aug 21 01:40:50.243645 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2681/6015] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:49 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1564 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:40:51.163120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:51.163830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:51.191068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:51.191659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:51.195305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:51.198524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:51.199374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:51.200083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:51.455886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:51.475119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e438829-8175-440b-bef6-5c8dd16f2de5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.317448 Aug 21 01:40:51.476913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3335/6016] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:51 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:52.497168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:52.497945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:52.504343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:52.504868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:52.505291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:52.511842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:52.513313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:52.514434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:52.757699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:52.767388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f00dd1a-8d5b-4fe7-a98e-cfeafa954a58 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.275405 Aug 21 01:40:52.783413 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2682/6017] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:52 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:53.800082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:53.809786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:53.818675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:53.819435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:53.820233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:53.837661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:53.847258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:53.847848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:54.254897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:54.264057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb326843-aead-45e3-9743-d19582cd4413 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.471952 Aug 21 01:40:54.264654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3336/6018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:53 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:55.291175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:55.291845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:55.313027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:55.314966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:55.324183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:55.325497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:55.326152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:55.326753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:55.490400 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:55.527418 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:55.667332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:55.689314 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b98aefe-ea03-40b9-b88e-d24e461eb2b8 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.401902 Aug 21 01:40:55.690072 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2683/6019] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:55 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:55.795603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705815f5-5545-46a1-a42d-241bab1d5c03", "name": "network-vif-plugged", "status": "completed", "tag": "572914bd-8fd3-4bc0-b05f-a813e6e7d1e2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:40:55.818748 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:55.826048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:55.827752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:55.828372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:55.868176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] Creating event network-vif-plugged:572914bd-8fd3-4bc0-b05f-a813e6e7d1e2 for instance 705815f5-5545-46a1-a42d-241bab1d5c03 on n-h1-master-1 Aug 21 01:40:55.885055 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4b0653e3-3915-46ff-bfe2-005487eb5910 req-f70cedb6-108e-45ed-962f-fb68a8bdb1c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095781 Aug 21 01:40:55.886897 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3337/6020] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:40:56.715088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:56.715703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:56.724632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:56.726006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:56.726672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:56.728300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:56.729050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:56.729749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:57.118892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:57.123021 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=73 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:40:57.154810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-daefa41e-2d49-49e5-9939-7e6a3f51bf89 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1313 microversion: 2.1 time: 0.444217 Aug 21 01:40:57.172842 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2684/6021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:56 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:40:58.181288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:40:58.181995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:40:58.189777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:58.190260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:58.190887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:58.191594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:40:58.192037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:40:58.192665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:40:58.501901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:40:58.510542 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53e3958c-5e65-4a18-b49b-c4a30cba5392 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1497 microversion: 2.1 time: 0.335623 Aug 21 01:40:58.511378 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3338/6022] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:40:58 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:02.366541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Calling method '.version_select at 0x7fc3fde03c10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:02.367909 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:41:02.367909 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 01:41:02.370512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.372531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.374294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.393790 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:02.395861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.396530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.397250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.413623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.414395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.415291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.422964 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f5fc7228-6ead-44da-96d7-e7071e828e42 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561 tempest-PortsAdminExtendedAttrsIpV6TestJSON-416670561-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.340842 Aug 21 01:41:02.423798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2685/6023] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 01:41:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:41:02.679357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:02.681054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:02.688328 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=37 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:02.691185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.693071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.693696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.694635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.695248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.695987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.728486 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=73 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:02.757283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:41:02.872043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-42cfa9e9-1a3e-4ea0-867f-c52bd65af850 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "DELETE /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 204 len: 0 microversion: 2.1 time: 0.194083 Aug 21 01:41:02.872043 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3339/6024] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:41:02 2022] DELETE /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:41:02.880622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:02.881244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:02.889666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.890143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.890569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:02.891266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:02.891702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:02.892122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:03.171068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:03.190618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3e3668b-53e3-45ae-a178-cad0a0119144 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1503 microversion: 2.1 time: 0.315128 Aug 21 01:41:03.191729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2686/6025] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:02 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:04.214983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:04.216694 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:04.224846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:04.225687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:04.226371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:04.227305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:04.227859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:04.228365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:04.374801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:04.383905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ce77715-22ac-4e0e-98ad-d44ccda9fed5 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1503 microversion: 2.1 time: 0.173798 Aug 21 01:41:04.384480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3340/6026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:04 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:05.230770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705815f5-5545-46a1-a42d-241bab1d5c03", "name": "network-vif-deleted", "tag": "572914bd-8fd3-4bc0-b05f-a813e6e7d1e2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:41:05.248568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:05.249513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:05.250241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:05.265641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] Creating event network-vif-deleted:572914bd-8fd3-4bc0-b05f-a813e6e7d1e2 for instance 705815f5-5545-46a1-a42d-241bab1d5c03 on n-h1-master-1 Aug 21 01:41:05.286849 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-be03b176-e26a-4940-b4a2-9421c371c13b req-c9182366-09e9-4624-854c-d967c91ea4e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061012 Aug 21 01:41:05.290485 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2687/6027] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:41:05.407757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:05.409302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:05.416488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:05.417616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:05.418251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:05.419410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:05.420028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:05.420625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:05.458653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:05.459629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:05.460514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:05.461173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lazy-loading 'fault' on Instance uuid 705815f5-5545-46a1-a42d-241bab1d5c03 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:41:05.533128 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a18d05ad96b490b80e80e3012d51126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80714967f868419fa75307662aca3a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:05.541821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-50254151-b731-4ea4-be94-c4a9380a6412 tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 200 len: 1303 microversion: 2.1 time: 0.138835 Aug 21 01:41:05.543276 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3341/6028] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:05 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:06.564878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:06.566150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] [instance: 705815f5-5545-46a1-a42d-241bab1d5c03] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:06.572862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:06.573717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:06.574402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:06.575275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:06.575897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:06.576517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:06.591967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] HTTP exception thrown: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Request method failure captured: Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 HTTP/1.1 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY0Zsd5no2GWCDhjviMpqIvcsn0hsUe66Hehv5QJVdfgtGNbQjdUCMFf8f3sfzmmXTOXlMVtN0rQzS1TaRGQWuT1RgHFKjxdmMFT1YUZJN971Cnl4mgk9c_X7sgaadIbbtANJCKxziE1rfoNY-NEtDq4nZMpXKm0JxgoA4pRKSDGzno Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 80714967f868419fa75307662aca3a19 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-VolumesActionsTest-1916628006 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80714967f868419fa75307662aca3a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80714967f868419fa75307662aca3a19", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80714967f868419fa75307662aca3a19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80714967f868419fa75307662aca3a19"}]}] Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-VolumesActionsTest-1916628006 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 80714967f868419fa75307662aca3a19 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-VolumesActionsTest-1916628006 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-VolumesActionsTest-1916628006-project Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 5a18d05ad96b490b80e80e3012d51126 Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-VolumesActionsTest-1916628006-project Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '705815f5-5545-46a1-a42d-241bab1d5c03'} Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:41:06.593934 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. Aug 21 01:41:06.599499 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:41:06.600918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] Returning 404 to user: Instance 705815f5-5545-46a1-a42d-241bab1d5c03 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:41:06.602296 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d37ab2c-9a54-4c11-bed1-b6a3eaf562ae tempest-VolumesActionsTest-1916628006 tempest-VolumesActionsTest-1916628006-project] 10.222.0.46 "GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03" status: 404 len: 111 microversion: 2.1 time: 0.042625 Aug 21 01:41:06.606522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2688/6029] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:06 2022] GET /compute/v2.1/servers/705815f5-5545-46a1-a42d-241bab1d5c03 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:41:19.663280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:41:19.665853 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:19.671355 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:19.672039 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:19.678479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:19.679191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:19.679795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:19.680700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:19.681348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:19.681941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:19.776856 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10fbde95-7f42-452f-8791-9b6c5c757ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action" status: 200 len: 24580 microversion: 2.1 time: 0.116938 Aug 21 01:41:19.778319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3342/6030] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:41:19 2022] POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action => generated 24580 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:41:50.185306 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:50.186304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:50.189661 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=9 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:50.190222 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=17 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:50.212952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:50.215881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:50.216343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:50.217108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:50.217568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:50.218575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:51.097555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09ef9731-4617-4914-bc99-8fdcb92b3edd tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1834 microversion: 2.1 time: 0.916595 Aug 21 01:41:51.107315 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2689/6031] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:50 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1834 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:51.122697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:51.123758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:51.131197 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:51.132316 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:41:51.135725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:51.136347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:51.136932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:51.137804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:51.138344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:51.139028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:51.599485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:51.610443 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c63f3ee2-9a32-487c-b2d4-7038b9bfbae4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1683 microversion: 2.1 time: 0.492976 Aug 21 01:41:51.611415 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3343/6032] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:51 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1683 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:51.764515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:41:51.771308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:51.791438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:51.792196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:51.794970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:51.795953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:51.796626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:51.797444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:51.885439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c57cdf87-8224-4654-9bc1-e33a0f673d7f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action" status: 200 len: 32647 microversion: 2.1 time: 0.125924 Aug 21 01:41:51.888839 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2690/6033] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:41:51 2022] POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action => generated 32647 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:41:52.100635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:41:52.101243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:52.112066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:52.113018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:52.113777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:52.114748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:52.115433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:52.116301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:52.464056 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1bff082a56ab4740aa1b0eafd0cf0c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fd605c1535426d8c55a2aab5035335', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:52.464747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] flavor_id is None. Assuming migration. {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 21 01:41:52.465122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:41:52.956304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f83dff7b-f88c-4dc5-a4d4-42b415d149d9 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action" status: 202 len: 0 microversion: 2.1 time: 0.859412 Aug 21 01:41:52.958962 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3344/6034] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:41:52 2022] POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:41:52.967888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:52.970973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:52.990414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:52.990853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:52.991716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:52.991988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:52.992416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:52.992858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:53.560594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:53.582789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-446eb62d-ea81-4f67-9523-b1dbe6a50d70 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1692 microversion: 2.1 time: 0.619213 Aug 21 01:41:53.583753 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2691/6035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:52 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1692 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:41:54.607092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:54.607726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:54.623662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:54.632086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:54.634875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:54.636170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:54.639641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:54.641271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:55.915336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:55.927302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5826b46a-693a-40c0-8232-a9a0525f940d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1692 microversion: 2.1 time: 1.325513 Aug 21 01:41:55.941574 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3345/6036] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:54 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1692 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:56.966575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:56.967269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:56.979484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:56.991199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:56.992500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:56.995316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:56.999028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:56.999581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:57.418273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:57.436430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0c488431-69ca-4dd7-8157-fa8aabaa4052 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1692 microversion: 2.1 time: 0.473578 Aug 21 01:41:57.442500 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2692/6037] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:56 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1692 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:58.463091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:58.465284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:58.473221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:58.474147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:58.475258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:58.476296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:58.477140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:58.477847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:58.699449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:58.708596 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc62d5c1-bf92-4be0-8d55-afba914ec0dd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.250114 Aug 21 01:41:58.729651 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3346/6038] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:58 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:41:59.735811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:41:59.739777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:41:59.748744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:59.749593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:59.752637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:59.753578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:41:59.754273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:41:59.755195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:41:59.948064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:41:59.964313 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-545d3240-40be-40c3-abab-6ae201b651fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.232749 Aug 21 01:41:59.964943 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2693/6039] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:41:59 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:00.989106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:00.990618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:01.022073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:01.022795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:01.023596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:01.024443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:01.025090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:01.029945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:01.521621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:01.532378 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8846820-f337-479f-a730-6b60413d5060 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.548576 Aug 21 01:42:01.532979 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3347/6040] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:00 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:02.557209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:02.557878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:02.575738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:02.576490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:02.577147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:02.578063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:02.581052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:02.581843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:02.832975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:02.842675 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f059761-5305-4574-8faf-41c593b84f90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.289854 Aug 21 01:42:02.844211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2694/6041] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:02 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:03.864049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:03.865733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:03.874218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:03.875033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:03.876001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:03.877340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:03.877976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:03.878563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:04.164158 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:04.179158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77110f44-900f-44a9-88eb-6982af67249f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.319315 Aug 21 01:42:04.183717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3348/6042] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:03 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:05.205857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:05.222119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:05.233273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:05.234350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:05.235479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:05.236641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:05.238265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:05.240736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:05.618827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:05.630340 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60862a57-d025-409b-9088-f17f86e9b4fe tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.430678 Aug 21 01:42:05.632452 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2695/6043] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:05 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:06.660332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:06.661197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:06.673687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:06.674177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:06.674609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:06.680273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:06.681094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:06.684481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:07.572052 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:07.594311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebdb6b93-23dd-45d8-aef1-edd1317ce704 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.940272 Aug 21 01:42:07.595329 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3349/6044] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:06 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:08.619019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:08.620716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:08.632624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:08.633448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:08.634516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:08.635616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:08.637153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:08.637556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:09.067855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:09.079332 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a06e2b38-111d-4b36-8f58-96786134b1d5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1697 microversion: 2.1 time: 0.467580 Aug 21 01:42:09.101193 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2696/6045] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:08 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1697 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:10.112390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:10.113221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:10.122683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:10.123171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:10.123601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:10.124304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:10.124749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:10.125189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:10.407307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "name": "network-vif-unplugged", "status": "completed", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:10.432066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:10.433725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:10.434180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:10.467525 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Creating event network-vif-unplugged:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h1-master-1 Aug 21 01:42:10.482789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:42:10.512543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9965a957-8fc3-4d0d-8660-0032e1155aac req-02613c79-7297-4b0b-b006-da23c6ebc04e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110298 Aug 21 01:42:10.518351 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2697/6046] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:42:10.700505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:10.719239 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6bb6e12d-67a4-40a1-865f-c3340ed36a4c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1696 microversion: 2.1 time: 0.609675 Aug 21 01:42:10.737063 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3350/6047] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:10 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1696 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:11.747324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:11.748730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:11.765942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:11.766680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:11.767323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:11.768245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:11.768931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:11.769594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:12.500282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:12.514203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8b0915da-e577-4c5e-a63e-055714388fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1696 microversion: 2.1 time: 0.771310 Aug 21 01:42:12.528796 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2698/6048] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:11 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1696 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:12.575887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:12.601251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:12.604611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:12.605349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:12.654143 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Creating event network-changed:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h1-master-1 Aug 21 01:42:12.665719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:42:12.709501 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8f40973a-957c-4da9-8646-2825ecb92ec2 req-fb294101-489e-4cf1-9177-23927cb68e39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137329 Aug 21 01:42:12.710974 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3351/6049] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:42:13.538382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:13.539154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:13.552743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:13.553395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:13.553941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:13.557933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:13.558748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:13.559388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:13.838493 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:13.851823 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-050c9f68-f00d-404b-bfc0-e51019b79754 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1694 microversion: 2.1 time: 0.317378 Aug 21 01:42:13.853630 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2699/6050] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:13 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1694 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:14.875916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:14.877380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:14.886447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:14.887259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:14.887861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:14.889147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:14.892513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:14.893541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:15.174040 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:15.189177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f765c60a-c910-4760-98c9-69c76e4a9906 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1691 microversion: 2.1 time: 0.317713 Aug 21 01:42:15.202011 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3352/6051] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:14 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1691 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:15.211544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:15.212166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:15.227603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:15.228931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:15.229717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:15.243382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:15.245206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:15.246548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:15.443908 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2534923d-593c-477c-8f42-2689bc6dc168 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action" status: 204 len: 0 microversion: 2.1 time: 0.236982 Aug 21 01:42:15.444513 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2700/6052] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:42:15 2022] POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:42:15.458399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:15.458968 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:15.485622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:15.494668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:15.495160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:15.496009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:15.496469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:15.496926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:16.083018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:16.099444 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f331653f-0004-479e-abdb-4e70bb4ac9b9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1691 microversion: 2.1 time: 0.645295 Aug 21 01:42:16.102323 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3353/6053] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:15 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1691 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:17.126700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:17.130048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:17.144128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:17.145126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:17.146046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:17.147135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:17.149471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:17.150177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:17.495248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:17.524831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb1ce806-f0fd-4b96-8270-5a23d95652c5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1691 microversion: 2.1 time: 0.405129 Aug 21 01:42:17.526061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2701/6054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:17 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1691 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:18.347023 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "name": "network-vif-plugged", "status": "completed", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:18.379997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:18.382163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:18.383062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:18.410747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] Creating event network-vif-plugged:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h1-master-1 Aug 21 01:42:18.437710 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d545c4d5-e37c-493b-b4be-897f78d66478 req-05102863-8b7f-4bdb-b5a0-4e87fc5654a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095083 Aug 21 01:42:18.438635 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3354/6055] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:42:18.550498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:18.552357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:18.563355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:18.575359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:18.577597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:18.578796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:18.579898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:18.581326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:18.905797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:18.916324 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cea90ac8-f562-4a4d-b2f0-47902ec34474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1683 microversion: 2.1 time: 0.369602 Aug 21 01:42:18.930324 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2702/6056] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:18 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1683 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:39.141301 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=26 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:39.142160 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:39.146841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:39.149295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:39.174005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:39.174778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:39.175442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:39.176413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:39.177120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:39.177758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:39.241687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a997e512-c970-4b85-8ddd-6c06d48060a9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action" status: 200 len: 24575 microversion: 2.1 time: 0.102346 Aug 21 01:42:39.243335 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3355/6057] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:42:39 2022] POST /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6/action => generated 24575 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:42:45.741116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:45.741876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:45.744515 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=28 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:45.745192 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:45.765571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:45.772697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:45.777575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:45.778338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:45.779405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:45.780016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:46.143839 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65bd6a5a-96b7-488d-bcaa-db4f8cf8aa83 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1834 microversion: 2.1 time: 0.406810 Aug 21 01:42:46.150274 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2703/6058] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:45 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1834 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:49.966351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:49.967650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:49.971344 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:49.974240 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:42:50.007193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:50.012100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:50.013992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:50.016296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:50.019976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:50.020709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:50.085103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:42:50.272144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:50.278096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80f22b27-251d-4969-86c1-cb3ba04a2b65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 204 len: 0 microversion: 2.1 time: 0.317060 Aug 21 01:42:50.279312 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3356/6059] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:42:49 2022] DELETE /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:42:50.295648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:50.296377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:50.303156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:50.303815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:50.304780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:50.311938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:50.312431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:50.312901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:50.317540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:50.318119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:50.318564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:50.331548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] Creating event network-changed:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h1-master-1 Aug 21 01:42:50.370260 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6b08b9e0-af83-4abc-8114-ab2ae3a9d919 req-b8659686-0a66-498b-b204-e3f0db64883f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391647 Aug 21 01:42:50.371363 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2704/6060] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:42:51.229070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:51.253196 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8aaeef1d-1b89-433a-aaab-37b5ace7ab02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1689 microversion: 2.1 time: 0.968923 Aug 21 01:42:51.253799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3357/6061] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:50 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1689 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:52.281300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:52.282029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:52.301441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:52.311246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:52.311246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:52.311246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:52.311246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:52.311246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:52.672001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:52.681523 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d93c2d49-23d8-4f4d-9d72-feceb50bfec6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1689 microversion: 2.1 time: 0.408837 Aug 21 01:42:52.687209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2705/6062] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:52 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1689 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:53.708544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:53.709546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:53.729690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:53.730297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:53.730958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:53.731880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:53.732339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:53.732789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:53.929959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6", "name": "network-vif-deleted", "tag": "82bc3c5c-ddb3-4f0b-a701-4b56bda125d2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:42:53.934238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:42:53.958722 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66285a13-4527-45e9-92e1-10512cfc49a3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 200 len: 1621 microversion: 2.1 time: 0.254245 Aug 21 01:42:53.977926 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3358/6063] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:53 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 1621 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:42:54.006586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:54.009340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:54.011942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:54.039423 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] Creating event network-vif-deleted:82bc3c5c-ddb3-4f0b-a701-4b56bda125d2 for instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 on n-h1-master-1 Aug 21 01:42:54.050614 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1f655b71-1420-4c0f-b5b0-dbc62527b632 req-ecdf99cb-dbb1-429d-bdde-09fd184c8658 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124418 Aug 21 01:42:54.054964 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2706/6064] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:42:55.003783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:42:55.005027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:42:55.018942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:55.020955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:55.022780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:55.038771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:42:55.039504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:42:55.040097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:42:55.079099 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] HTTP exception thrown: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Request method failure captured: Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 HTTP/1.1 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYz8QhgFytmd4_Ps4SloBSvhjtcuMqsJGdF5F5aGUhRVp62zfjKYfvaboNciTc-PyRqZLGdU6xJAViU39YXdEmapMcWXISYBKohwGqnQoVSW8YWZRt7Apmpyh05O2KRy08IrusUMF-g0ry05qgfDoZzl3jVVve4sx7jkCr5vfqyxNxg Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d17d705402549dc94e6fdd36e917823", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}] Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 6a5f1b1c768b43be80f4e2a89694a811 Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: exception: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6'} Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:42:55.088506 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Returning 404 to user: Instance a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-079ca403-e382-4950-aa89-256c8dd26e0d tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6" status: 404 len: 111 microversion: 2.1 time: 0.091544 Aug 21 01:42:55.091980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3359/6065] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:42:54 2022] GET /compute/v2.1/servers/a596c7b8-d86d-4d1c-bf2d-3b7e962e07b6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:43:06.587348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c65494e4-b4a0-46df-8978-66016d6bc4f0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '.version_select at 0x7fc3fd18cf70>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:06.593382 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c65494e4-b4a0-46df-8978-66016d6bc4f0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 01:43:06.595217 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:06.597649 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=16 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:07.606807 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-c65494e4-b4a0-46df-8978-66016d6bc4f0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 35774. Aug 21 01:43:07.653549 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c65494e4-b4a0-46df-8978-66016d6bc4f0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1902905960" status: 202 len: 0 microversion: 2.1 time: 1.071029 Aug 21 01:43:07.658050 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2707/6066] 10.222.0.46 () {58 vars in 1284 bytes} [Sun Aug 21 01:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1902905960 => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:43:07.692383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: .version_select at 0x7fc3f87125e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-440167664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARU9/jZhL8UkmSqbxegHJtqvMr0KzeVyp9nlfPHf+bJjKDY6BNsmYObjIakM8Scl2Jv1GPwAeK29tftkjZ1PnJuTSc8d3XuvP0hBjpdpW+Wj3RdKxMLfzDxNIdmdXXntA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:43:07.701756 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:07.703121 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:07.722447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:43:07.731796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:43:07.750671 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 01:43:08.760150 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 35788. Aug 21 01:43:08.779904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8161223-89fc-4fee-bffc-d7a4f7e11a67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.092330 Aug 21 01:43:08.780528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3360/6067] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:43:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:43:24.446633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1617569268", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "53080247-2d28-4c37-8583-728736489205"}], "key_name": "tempest-TestNetworkAdvancedServerOps-440167664", "security_groups": [{"name": "tempest-secgroup-smoke-1343962336"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:43:24.473745 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:25.190901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] validate_networks() for [('53080247-2d28-4c37-8583-728736489205', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:43:26.081856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:43:26.083046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:43:26.083539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:43:26.084009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:43:26.084420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:43:26.145623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:26.149182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:26.149856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:26.153022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:26.153895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:26.154471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:26.217550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:43:26.241152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:43:26.281745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:43:26.284233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:43:26.361211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9fff317-7cae-4650-b72c-e8722b5a5040 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.922527 Aug 21 01:43:26.362471 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2708/6068] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:43:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:43:26.371705 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:26.373369 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:26.381327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-241c16a0-d551-42d8-b131-fe13bc725ab9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:26.388559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-241c16a0-d551-42d8-b131-fe13bc725ab9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:26.717588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-241c16a0-d551-42d8-b131-fe13bc725ab9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:26.730775 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-241c16a0-d551-42d8-b131-fe13bc725ab9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1266 microversion: 2.1 time: 0.361286 Aug 21 01:43:26.731695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3361/6069] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:26 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:27.760798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e60894f-3575-4a15-8532-03790b20bfa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:27.761444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8e60894f-3575-4a15-8532-03790b20bfa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:27.910140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8e60894f-3575-4a15-8532-03790b20bfa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:27.919532 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8e60894f-3575-4a15-8532-03790b20bfa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1266 microversion: 2.1 time: 0.166040 Aug 21 01:43:27.936223 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2709/6070] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:27 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:28.950715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-20fdfb16-6b95-44da-bcb0-525f5f287645 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:28.951886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20fdfb16-6b95-44da-bcb0-525f5f287645 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:29.055436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-20fdfb16-6b95-44da-bcb0-525f5f287645 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:29.063530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-20fdfb16-6b95-44da-bcb0-525f5f287645 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1266 microversion: 2.1 time: 0.116817 Aug 21 01:43:29.064816 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3362/6071] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:28 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:30.086504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:30.087223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:30.095768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:30.096430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:30.097344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:30.099615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:30.100227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:30.100821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:30.191753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:30.213550 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-136dfa77-e15f-498b-91ff-84d42c83e18e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1318 microversion: 2.1 time: 0.132037 Aug 21 01:43:30.214491 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2710/6072] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:30 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:31.241055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:31.242427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:31.251707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:31.252558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:31.253264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:31.256535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:31.257330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:31.258152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:31.451749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:31.460995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-355a8ad6-d94e-4a27-b27b-14290c877ee5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1324 microversion: 2.1 time: 0.226781 Aug 21 01:43:31.461605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3363/6073] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:31 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:32.484059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:32.492706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:32.502197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:32.502896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:32.504288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:32.505350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:32.506208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:32.506788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:32.962978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:32.977786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-18a69a13-5ae4-4a21-8c17-df8f21571843 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.498637 Aug 21 01:43:32.978564 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2711/6074] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:32 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:33.811254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:43:33.831398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:33.851756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:33.852326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:33.883425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] Creating event network-changed:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:43:33.889468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-212a5258-69ee-4645-91e2-0d2aa0aacc2d req-70221bc1-41bb-49e5-8bee-005f887b181a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081943 Aug 21 01:43:33.890645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3364/6075] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:43:34.000061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:34.000687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:34.011725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:34.012396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:34.018186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:34.019608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:34.029732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:34.036009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:34.471807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:34.480567 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea133172-c602-4c8d-9661-1705b41bd12f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.485285 Aug 21 01:43:34.481775 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2712/6076] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:33 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:35.506782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:35.508610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:35.521462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:35.522471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:35.522921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:35.523667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:35.524124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:35.524549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:35.811457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:35.822520 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d06faf0d-31e9-4ae0-b49d-612e0ffe70fd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.324098 Aug 21 01:43:35.823446 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3365/6077] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:35 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:36.850472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:36.851070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:36.854254 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:36.864670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:36.866669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:36.880334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:36.885477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:36.887294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:36.887734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:37.622666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:37.631748 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3295224b-9984-434f-9370-e52b5bb3a86e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.785279 Aug 21 01:43:37.645337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2713/6078] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:36 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:38.654785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:38.656156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:38.673423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:38.675662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:38.676288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:38.680453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:38.681246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:38.681931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:38.965335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:38.973556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23611d18-660d-4763-8517-fec947bb0cc8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.323149 Aug 21 01:43:38.974220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3366/6079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:38 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:39.995823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:39.997348 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:40.000317 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:40.014861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:40.015765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:40.017223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:40.020014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:40.020619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:40.021254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:40.355084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:40.364186 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2cef268c-c3ba-4957-b5b1-438e26c881d9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.372405 Aug 21 01:43:40.365603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2714/6080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:39 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:41.391112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:41.391735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:41.399382 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:43:41.403249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:41.404463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:41.405232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:41.406597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:41.407287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:41.408203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:41.697494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:41.712073 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b0c1a81-2167-4fe3-a24d-da0ab641eb08 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.325023 Aug 21 01:43:41.726360 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3367/6081] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:41 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:42.393544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-plugged", "status": "completed", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:43:42.405639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:42.406116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:42.406738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:42.426526 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] Creating event network-vif-plugged:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:43:42.439973 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-17041966-6f31-43d7-a40c-f0844d77e885 req-eee0427d-6cbe-44d1-b2ed-8ed85682107b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264019 Aug 21 01:43:42.440836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2715/6082] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:43:42.734679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:42.735355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:42.755067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:42.757582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:42.758082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:42.759839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:42.760359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:42.760977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:42.944696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:42.953747 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cee97b60-6d29-4866-b25c-57babf0a4a46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 0.223566 Aug 21 01:43:42.968695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3368/6083] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:42 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:43.978511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:43.979992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:43.989117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:43.990306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:43.991481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:43.992635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:43.993402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:43.994047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:45.040625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:45.052216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21cdb138-4f5a-449b-82fc-3c4789088ed4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1392 microversion: 2.1 time: 1.079078 Aug 21 01:43:45.070140 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2716/6084] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:43 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1392 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:46.078380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:46.079964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:46.093600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:46.094516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:46.094959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:46.095909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:46.096397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:46.096846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:46.370719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:46.383966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b59b42a8-c361-48da-a353-566286a08182 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1563 microversion: 2.1 time: 0.309359 Aug 21 01:43:46.397623 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3369/6085] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:46 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1563 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:43:46.406248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:46.406870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:46.421889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:46.422105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:46.424723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:46.425593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:46.426062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:46.426577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:47.159445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:47.170740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4097b847-94d8-4b8b-8e4f-0585584f869c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1563 microversion: 2.1 time: 0.768349 Aug 21 01:43:47.186869 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2717/6086] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:46 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1563 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:43:52.320058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:43:52.320874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:43:52.327259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:43:52.342594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:52.346023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:52.346772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:52.347687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:52.351021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:43:52.352005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:52.352652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:52.354173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:43:52.359515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:43:52.393310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] Creating event network-changed:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:43:52.403179 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b9ccb9ae-7416-4400-bbde-3bee9738afb7 req-9d1d90af-1329-4c75-9d1f-714db490692c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090578 Aug 21 01:43:52.404214 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2718/6087] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:43:52.963743 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:43:52.981367 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2dd6fccc-bc44-45ff-87da-4266744efe26 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1563 microversion: 2.1 time: 0.674720 Aug 21 01:43:52.986514 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3370/6088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:43:52 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1563 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:20.804606 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:44:20.807609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:20.815638 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:20.816911 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=48 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:20.820124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:20.822058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:20.822633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:20.824032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:20.826147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:20.826790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:20.918901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a88aa8ec-6b6e-4a6a-ba8e-bc9e7f09d483 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action" status: 200 len: 24569 microversion: 2.1 time: 0.119494 Aug 21 01:44:20.927986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2719/6089] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:44:20 2022] POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action => generated 24569 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:44:51.343765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:51.345279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:51.363560 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:51.365230 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=44 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:51.367060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:51.367836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:51.368378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:51.369319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:51.370018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:51.370659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:51.725199 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e60afc1-7747-44bf-9a7d-18c1ed24e6a2 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1833 microversion: 2.1 time: 0.385731 Aug 21 01:44:51.726128 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3371/6090] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:51 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1833 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:51.747193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:51.748702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:51.757901 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:51.759693 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:44:51.761952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:51.762644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:51.765261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:51.765261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:51.765261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:51.766621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:52.141657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:52.152682 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9be7859b-e3e2-4945-a957-138482e6701b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1682 microversion: 2.1 time: 0.410195 Aug 21 01:44:52.170904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2720/6091] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:51 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1682 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:52.348162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:44:52.352786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:52.362351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:52.364275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:52.365253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:52.366434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:52.367073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:52.367702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:52.494777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68bc4ec1-97a7-45d1-9576-086f00e18a85 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action" status: 200 len: 32636 microversion: 2.1 time: 0.150877 Aug 21 01:44:52.502135 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3372/6092] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:44:52 2022] POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action => generated 32636 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:44:52.704934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:44:52.705678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:52.722457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:52.722964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:52.723401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:52.724181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:52.724630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:52.725083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:52.771480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1bff082a56ab4740aa1b0eafd0cf0c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fd605c1535426d8c55a2aab5035335', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:52.772301 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] flavor_id is None. Assuming migration. {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 21 01:44:52.773109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 01:44:53.261654 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cce721a5-3ec5-4aef-8946-6d3aa041df96 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action" status: 202 len: 0 microversion: 2.1 time: 0.560603 Aug 21 01:44:53.265869 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2721/6093] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:44:52 2022] POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:44:53.281607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:53.285006 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:53.307702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:53.308147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:53.308596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:53.312147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:53.315873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:53.316715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:53.606525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:53.625848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d73a1bf3-a874-4915-b6cc-47b87432d1f8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1691 microversion: 2.1 time: 0.357838 Aug 21 01:44:53.638616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3373/6094] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:53 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1691 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:54.656223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:54.657004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:54.667912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:54.669885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:54.670973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:54.671910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:54.672530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:54.673192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:54.911911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:54.921772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d97e785d-1163-42d2-b466-20b062edb3be tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1691 microversion: 2.1 time: 0.271238 Aug 21 01:44:54.923013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2722/6095] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:54 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:55.947001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:55.948203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:55.964746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:55.965305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:55.966022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:55.966792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:55.967408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:55.967841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:56.322091 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:56.335084 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f61595f-bfc7-425e-850d-292fbe66a7e6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1691 microversion: 2.1 time: 0.392869 Aug 21 01:44:56.335856 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3374/6096] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:55 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1691 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:57.359416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:57.360026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:57.385337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:57.386264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:57.387022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:57.389876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:57.391354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:57.392783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:57.691080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:57.705927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93797bb8-3956-4cee-a469-ea68ee467af7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1691 microversion: 2.1 time: 0.350976 Aug 21 01:44:57.709117 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2723/6097] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:57 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1691 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:44:58.729062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:44:58.730262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:44:58.740537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:58.741184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:58.741645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:58.742489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:44:58.743142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:44:58.743646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:44:58.986478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:44:58.997945 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9b352a0-c89c-430a-ae78-4c9d800905b1 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.272574 Aug 21 01:44:58.999172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3375/6098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:44:58 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:45:00.022930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:00.023524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:00.035790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:00.036269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:00.036699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:00.040848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:00.041404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:00.041837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:00.623763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:00.643933 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2e0d5c6-60a2-45d0-ae03-084d59c79d65 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.623496 Aug 21 01:45:00.644711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2724/6099] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:00 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:01.666826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:01.667572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:01.683291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:01.683997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:01.684653 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:01.685849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:01.686637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:01.693536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:01.868565 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 01:45:01.869027 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 01:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d (ip 10.222.0.46) !!! Aug 21 01:45:01.897681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:01.908554 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6fd79dcf-473b-4668-b922-e8d1b2f14ad2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.246268 Aug 21 01:45:01.909875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3376/6100] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:01 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:45:02.930077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:02.930689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:02.944371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:02.945612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:02.947770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:02.948797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:02.951335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:02.953103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:03.285124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:03.307059 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffe9ccf6-84a8-4730-ae10-8397e3d7bfda tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.380950 Aug 21 01:45:03.308313 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2725/6101] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:02 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:04.334644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:04.335976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:04.377764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:04.378287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:04.378738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:04.379483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:04.379942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:04.380370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:04.915786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:04.931412 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61fafb94-d859-403d-9784-bb308f05ed49 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.602162 Aug 21 01:45:04.983766 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3377/6102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:04 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:05.963489 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:05.963950 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:05.997700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:05.998190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:05.998627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:05.999343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:05.999805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:06.000208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:06.492438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:06.507311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84a8610b-933e-411a-8f7e-f7ab8f48eb14 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.551912 Aug 21 01:45:06.512561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2726/6103] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:05 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:07.536575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:07.537889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:07.551382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:07.556058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:07.557210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:07.558238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:07.559212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:07.560434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:07.870779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:07.880511 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-346a0b96-642f-4e3b-b411-a9a59baf26aa tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.349699 Aug 21 01:45:07.883313 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3378/6104] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:07 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:08.915453 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:08.916124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:08.928653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:08.929185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:08.929623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:08.933716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:08.934194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:08.934636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:09.243767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:09.264649 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-efeff8f8-5d9a-4062-ac89-f274457801bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.357247 Aug 21 01:45:09.267403 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2727/6105] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:08 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:10.286448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:10.287820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:10.299044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:10.299868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:10.300521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:10.301788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:10.302434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:10.303755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:10.648540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:10.663738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-627a4875-af3a-41f4-a61d-44f9a398519c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1696 microversion: 2.1 time: 0.376776 Aug 21 01:45:10.669376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3379/6106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:10 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1696 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:11.687027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:11.687886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:11.701428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:11.702262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:11.703793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:11.705043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:11.705934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:11.706635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:11.738401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-unplugged", "status": "completed", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:11.761101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:11.762799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:11.765919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:11.809304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Creating event network-vif-unplugged:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h1-master-1 Aug 21 01:45:11.824664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] Instance c56ba7dd-6006-4493-9659-31fde21c5c5d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:45:11.864163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b51764d3-631d-48aa-9c94-e9c2261e92e7 req-2daa2416-6bfa-4b40-814f-3a5be23730ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130031 Aug 21 01:45:11.865420 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3380/6107] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:12.283015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:12.291692 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acdb35a0-c0d4-4a68-9bcf-5162e4c95f30 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1695 microversion: 2.1 time: 0.609202 Aug 21 01:45:12.295107 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2728/6108] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:11 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1695 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:13.318346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:13.319051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:13.331977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:13.332743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:13.333388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:13.337095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:13.337737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:13.338322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:13.977704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:14.010259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:14.010973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:14.011417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:14.049552 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Creating event network-changed:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h1-master-1 Aug 21 01:45:14.059588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] Instance c56ba7dd-6006-4493-9659-31fde21c5c5d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:45:14.094333 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-eb057dfb-ecab-416f-88d8-43fb628deca3 req-322ae025-ca54-421c-a41f-d2a6c922eb9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122173 Aug 21 01:45:14.095535 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2729/6109] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 21 01:45:14.375487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:14.385524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee8ace02-ef51-473d-84dd-dbfd069e54da tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1695 microversion: 2.1 time: 1.072946 Aug 21 01:45:14.390364 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3381/6110] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:13 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1695 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:15.879334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:15.880681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:15.889275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:15.890201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:15.890861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:15.901666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:15.902175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:15.902632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:16.450406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:16.463984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2047be4-ae82-46f5-ac2b-36588bc5a639 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1693 microversion: 2.1 time: 1.050937 Aug 21 01:45:16.466238 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2730/6111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:15 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1693 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:17.490155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:17.491022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:17.499557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:17.500432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:17.501165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:17.502761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:17.503606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:17.504171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:17.803645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:17.830082 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-220b7e71-22b2-45ea-bb2d-f4c7e1702ea3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1690 microversion: 2.1 time: 0.346063 Aug 21 01:45:17.831579 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3382/6112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:17 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:17.853158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:17.854302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:17.862571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:17.863289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:17.863875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:17.864809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:17.865861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:17.866296 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:18.103633 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-10b5568e-37b9-41c9-8aba-925227f26135 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action" status: 202 len: 0 microversion: 2.1 time: 0.253694 Aug 21 01:45:18.112163 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2731/6113] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:45:17 2022] POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:45:18.122004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:18.122567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:18.150732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:18.150936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:18.151843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:18.153468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:18.154221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:18.155189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:18.434277 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:18.444056 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24519dc6-78e6-4b8a-9562-c6e232c2f474 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.326125 Aug 21 01:45:18.448847 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3383/6114] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:18 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:19.469503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:19.470224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:19.488122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:19.490985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:19.491623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:19.495485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:19.496295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:19.496908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:19.869832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:19.886142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dbe5518d-41cf-4928-990b-cf3f79cc35e5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.422915 Aug 21 01:45:19.887267 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2732/6115] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:19 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:20.913232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:20.914679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:20.927750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:20.929192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:20.929963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:20.930964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:20.969304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:20.972955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:21.212063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:21.224122 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea8dbecf-8ce4-4bc8-b04d-0da419bae948 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.317077 Aug 21 01:45:21.225220 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3384/6116] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:20 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:22.256445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:22.257170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:22.277341 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=29 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:22.289020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:22.289627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:22.290310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:22.291136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:22.291724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:22.292256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:22.299351 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=81 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:22.578553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:22.601588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d5f1935-1046-4230-abc4-b3044bb025e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.355056 Aug 21 01:45:22.602694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3385/6117] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:22 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:22.816070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e583fd5-78d3-4087-aa4e-27de36910e73 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Action: 'create', calling method: .version_select at 0x7fc3fcfbb940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1062857870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxqTRzAzUSh7wnh8e1eKsMvZ5/ND45HdwTnePCjnNDIJFmiRBFEUNVN+RJxAGknYHi1cyYaEWYB+KIR06+Cz+gFK0U3XIE2oAHAzles0aGWCAqZqgXoYRjtlFEJIQssjQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:22.834865 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=33 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:22.859167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5e583fd5-78d3-4087-aa4e-27de36910e73 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:45:22.873848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5e583fd5-78d3-4087-aa4e-27de36910e73 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for user c89ec4d04ba54e54a1d844a3566f3821 and project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:45:22.936036 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e583fd5-78d3-4087-aa4e-27de36910e73 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.692701 Aug 21 01:45:22.937109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2733/6118] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:45:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:23.009262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-plugged", "status": "completed", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:23.031949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:23.032575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:23.033155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:23.065696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Creating event network-vif-plugged:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:45:23.082797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] Instance c56ba7dd-6006-4493-9659-31fde21c5c5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:45:23.135785 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-233811c8-df02-4f8c-8ffd-52a5fb3b44fa req-cc892aa8-177b-4061-9877-16180ecd5d0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130799 Aug 21 01:45:23.137108 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3386/6119] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:23.625515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:23.626244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:23.648466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:23.649202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:23.649656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:23.650412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:23.650868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:23.651290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:23.665615 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:24.071837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:24.093321 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea229d52-4b75-4fec-8522-52e45adce7b2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.472723 Aug 21 01:45:24.105608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2734/6120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:23 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:25.142189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:25.144911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:25.177445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:25.178353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:25.179012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:25.182133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:25.182876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:25.208565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:25.581041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-unplugged", "status": "completed", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:25.596967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:25.597582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:25.628913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:25.653198 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Creating event network-vif-unplugged:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:45:25.693015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] Instance c56ba7dd-6006-4493-9659-31fde21c5c5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:45:25.718495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-89fcc43f-f893-404d-8b63-8fd3eb1aa872 req-d8876483-65dd-420e-847f-fb935231a828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.757515 Aug 21 01:45:25.720273 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3387/6121] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:25.844908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:25.858246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-638c46a9-e11b-4b99-bae6-7d9f0bb2425e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.739108 Aug 21 01:45:25.858949 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2735/6122] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:25 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:45:26.725477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-646894879", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1062857870", "security_groups": [{"name": "tempest-secgroup-smoke-1978473281"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a4c903de-95ca-457a-b29b-d61bd61fe9c5"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:26.880016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:26.880637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:26.900043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:26.900555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:26.901026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:26.901743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:26.907589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:26.908324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:27.157716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] validate_networks() for [('a4c903de-95ca-457a-b29b-d61bd61fe9c5', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:45:27.271758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:27.306506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f192620-a29d-429e-8229-2c292c702e18 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.418081 Aug 21 01:45:27.323207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2736/6123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:26 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:27.760360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:27.780405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:27.783892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:27.784489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:27.824473 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Creating event network-changed:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:45:27.864053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] Instance c56ba7dd-6006-4493-9659-31fde21c5c5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 01:45:27.919024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-2e988671-4ca7-4223-9cd9-e7ec58d8cb0b req-7209e589-dbaf-47b1-ab9e-d9d6d84c572c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164422 Aug 21 01:45:27.922038 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2737/6124] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:28.197402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:45:28.213302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for user c89ec4d04ba54e54a1d844a3566f3821 and project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: dict_keys(['metadata_items']) {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:45:28.230057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:45:28.231581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:45:28.232258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:45:28.236335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:45:28.236924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:45:28.249223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:28.249781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:28.250342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:28.251195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:28.251745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:28.252398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:28.281555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:45:28.289304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Getting quotas for user c89ec4d04ba54e54a1d844a3566f3821 and project a8b7791cd2474b4a8bbfc8f9a069024e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:45:28.316468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:45:28.319614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:45:28.329811 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:28.330535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:28.344925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:28.345421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:28.345959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:28.346680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:28.347131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:28.347665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:28.458128 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7f585ec-37d7-40f9-a813-2e24ed6a5c50 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.738225 Aug 21 01:45:28.458791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3388/6125] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:45:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:45:28.470786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8867758-b649-43a8-b785-0957f1daef89 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:28.471769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8867758-b649-43a8-b785-0957f1daef89 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:28.629831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a8867758-b649-43a8-b785-0957f1daef89 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:28.639303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8867758-b649-43a8-b785-0957f1daef89 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1302 microversion: 2.1 time: 0.172904 Aug 21 01:45:28.639898 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3389/6126] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:28 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:28.849897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:28.864442 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ecfa495b-1934-46c6-8b0b-ddb2e5ca82e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.540373 Aug 21 01:45:28.868946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2738/6127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:28 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:45:29.663347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:29.665051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:29.679506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:29.681101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:29.683067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:29.686252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:29.689545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:29.690340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:29.812495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:29.832336 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-21705eff-87a0-4afa-a318-0feb583d6c46 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1354 microversion: 2.1 time: 0.173974 Aug 21 01:45:29.833432 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3390/6128] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:29 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:29.892082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:29.893031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:29.903898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:29.904577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:29.905207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:29.906273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:29.906897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:29.907694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:30.162601 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:30.176956 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-74ecdbb3-d848-494b-a27f-22e6c7cc6c12 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1689 microversion: 2.1 time: 0.288955 Aug 21 01:45:30.181443 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2739/6129] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:29 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1689 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:30.857835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:30.862495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:30.885433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:30.886075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:30.888453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:30.891210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:30.892198 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:30.893268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:31.059598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:31.073853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-127fc418-436d-4754-98d6-184fe7e0f74e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1360 microversion: 2.1 time: 0.223608 Aug 21 01:45:31.089848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3391/6130] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:30 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1360 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:31.203298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:31.205712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:31.233033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:31.233033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:31.233033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:31.233033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:31.233033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:31.233454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:31.631603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:31.645589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d04862d2-b186-4445-aaaa-386bca97d1cb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1682 microversion: 2.1 time: 0.447392 Aug 21 01:45:31.648089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2740/6131] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:31 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1682 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:32.103880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:32.104990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:32.117422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:32.118100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:32.119306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:32.120590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:32.121518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:32.122224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:32.444047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:32.479275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ded4b06-a3de-4314-a631-bc10e8740676 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.381904 Aug 21 01:45:32.479794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3392/6132] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:32 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:32.792571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85893e01-a4d1-4c26-9964-6f2306713b5a", "tag": "3d261361-facb-4838-9c77-08fe6316f95c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:32.822012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:32.823708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:32.824338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:32.842305 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] Creating event network-changed:3d261361-facb-4838-9c77-08fe6316f95c for instance 85893e01-a4d1-4c26-9964-6f2306713b5a on n-h1-master-1 Aug 21 01:45:32.851829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-915c0f1c-9f62-42cd-b908-7417e0cab1d2 req-80bebcc9-3be8-43e6-a105-d35a1e81c082 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065379 Aug 21 01:45:32.853154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2741/6133] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:33.503936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:33.504709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:33.517130 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:33.518486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:33.520535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:33.525232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:33.527364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:33.528137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:33.739470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:33.753892 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a148403-8e6e-445b-ae98-a031435d5608 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.254269 Aug 21 01:45:33.769183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3393/6134] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:33 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:34.702035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-plugged", "status": "completed", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:34.707315 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:34.722409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:34.722840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:34.723255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:34.759065 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] Creating event network-vif-plugged:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:45:34.767684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-47323327-a7d4-477b-831f-b681ed97ffef req-7a01bfa6-9945-459f-8009-7e0a6055af6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070094 Aug 21 01:45:34.768558 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2742/6135] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:45:34.775744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:34.776352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:34.786612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:34.788639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:34.789940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:34.791470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:34.792955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:34.801098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:35.003773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:35.017417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d28ff801-a1f4-4559-9e38-b06eff892597 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.244021 Aug 21 01:45:35.039610 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3394/6136] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:34 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:45:36.043624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:36.044477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:36.055260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:36.057999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:36.063482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:36.065968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:36.066616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:36.068724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:36.435279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:36.447061 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c3b5d05-2567-4eea-aa3d-ee67674ea393 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.408807 Aug 21 01:45:36.457590 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2743/6137] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:36 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:37.482606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:37.483223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:37.491472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:37.494685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:37.497222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:37.500006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:37.501727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:37.502325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:37.849633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:37.861127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9151f51-9d29-4045-b6e2-e602dae50f4b tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.383020 Aug 21 01:45:37.864562 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3395/6138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:37 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:38.891889 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:38.892930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:38.902900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:38.903624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:38.904734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:38.906199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:38.906800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:38.908028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:39.114099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:39.127411 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbc2af2f-85cf-43b6-81b5-65560d6f7cca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.244969 Aug 21 01:45:39.131462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2744/6139] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:38 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:39.742731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85893e01-a4d1-4c26-9964-6f2306713b5a", "name": "network-vif-plugged", "status": "completed", "tag": "3d261361-facb-4838-9c77-08fe6316f95c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:39.759429 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:39.767992 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:45:39.798338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:39.798338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:39.798338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:39.862469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] Creating event network-vif-plugged:3d261361-facb-4838-9c77-08fe6316f95c for instance 85893e01-a4d1-4c26-9964-6f2306713b5a on n-h1-master-1 Aug 21 01:45:39.891698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3e251635-8b53-43ed-9040-0b8756938a42 req-432b9075-d654-4fd1-8c08-011d5820b056 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148345 Aug 21 01:45:39.904915 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3396/6140] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:45:40.148413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:40.149067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:40.180318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:40.193161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:40.193599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:40.194401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:40.194888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:40.195322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:40.523116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:40.533513 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c6b1c1af-9c23-4fa9-baa5-7e3462d553ce tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1428 microversion: 2.1 time: 0.389645 Aug 21 01:45:40.550721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2745/6141] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:40 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1428 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:41.558191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:41.559564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:41.566720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:41.567579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:41.568447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:41.569397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:41.569848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:41.570444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:41.776917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:41.786903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-487a71d9-8d96-452d-b974-2275b1f829ff tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1608 microversion: 2.1 time: 0.236076 Aug 21 01:45:41.796821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3397/6142] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:41 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1608 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:41.809012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:41.810329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:41.819333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:41.820369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:41.821090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:41.822328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:41.823486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:41.824135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:42.043111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:42.055691 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8db8313a-cf67-402b-89cf-68742ad2cbb8 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1608 microversion: 2.1 time: 0.250582 Aug 21 01:45:42.056865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2746/6143] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:41 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1608 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:42.076938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:45:42.077593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:45:42.087516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:42.088089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:42.088532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:42.089281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:42.090598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:42.091031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:42.379381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:45:42.387609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7935ab14-c38c-49f7-a339-0e5460f2993e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1608 microversion: 2.1 time: 0.314626 Aug 21 01:45:42.388856 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3398/6144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:45:42 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1608 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:45:45.792758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85893e01-a4d1-4c26-9964-6f2306713b5a", "tag": "3d261361-facb-4838-9c77-08fe6316f95c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:45:45.806576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:45:45.807386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:45:45.807982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:45:45.824229 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] Creating event network-changed:3d261361-facb-4838-9c77-08fe6316f95c for instance 85893e01-a4d1-4c26-9964-6f2306713b5a on n-h1-master-1 Aug 21 01:45:45.830454 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-73fde72b-f02f-4784-94a9-5dfaa11d0c47 req-bbd9e34e-936a-4bd4-91ae-4b3e42737723 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041824 Aug 21 01:45:45.831304 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2747/6145] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:03.948459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:03.950766 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:03.953778 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:03.954448 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=65 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:03.961355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:03.961841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:03.962297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:03.962997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:03.963446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:03.963866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:04.035034 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f198df9-97f9-438a-82d4-2db1e8af3d17 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action" status: 200 len: 63215 microversion: 2.1 time: 0.090513 Aug 21 01:46:04.035684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3399/6146] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:46:03 2022] POST /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d/action => generated 63215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:46:16.971529 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:16.973073 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=69 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:16.978476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:16.979095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:16.995417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:16.997131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:16.997599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:17.000987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:17.001469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:17.001916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:17.073221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e382d109-69ba-4e0e-8338-7e1d01fcf889 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.100503 Aug 21 01:46:17.073925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2748/6147] 10.222.0.46 () {58 vars in 1293 bytes} [Sun Aug 21 01:46:16 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a/os-server-password => generated 116 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:19.984676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f85d184-422a-4c0e-8465-e1aad7571092 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: .version_select at 0x7fc3fa265b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1018256055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGF3+mSCFpwjJIfbciuruDfelQ0t4hctJG2OR96cK2v6O/73AXtS8dQmZoSa9mAAGBJpwETUCCGYb3OWxCB/xP1eIqdS21N+JDgvJVWp6kBNRfGDK79MtjPlhbnGvcuKg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:19.997121 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:19.998134 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:20.011004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4f85d184-422a-4c0e-8465-e1aad7571092 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:46:20.018535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-4f85d184-422a-4c0e-8465-e1aad7571092 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:46:20.052191 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f85d184-422a-4c0e-8465-e1aad7571092 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.072018 Aug 21 01:46:20.052806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3400/6148] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:46:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:21.249275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-38283917", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "be5e9ed4-3851-4b23-a5dc-4379cc9df651"}], "key_name": "tempest-TestNetworkBasicOps-1018256055", "security_groups": [{"name": "tempest-secgroup-smoke-591787789"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:21.376721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] validate_networks() for [('be5e9ed4-3851-4b23-a5dc-4379cc9df651', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:46:21.956436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:46:21.956884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:46:21.959732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:46:21.960111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:46:21.960519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:46:21.972730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:21.973399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:21.973834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:21.974687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:21.975321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:21.975738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:22.001978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:46:22.008163 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:46:22.026170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:46:22.028550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:46:22.089689 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a11f33d8-fd14-4d5f-afa1-d308d2e4df4d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.844837 Aug 21 01:46:22.091004 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2749/6149] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:46:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:46:22.101938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77f5db8b-bbdb-4078-a68c-57aebf5aea65 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:22.105691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77f5db8b-bbdb-4078-a68c-57aebf5aea65 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:22.224570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77f5db8b-bbdb-4078-a68c-57aebf5aea65 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:22.232663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77f5db8b-bbdb-4078-a68c-57aebf5aea65 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1247 microversion: 2.1 time: 0.134634 Aug 21 01:46:22.234456 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3401/6150] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:22 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1247 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:23.255885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:23.257096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:23.264200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:23.264724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:23.265677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:23.266567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:23.267050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:23.267464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:23.338134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:23.347571 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f3187633-7360-4349-bfab-bc4fe461a46a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1299 microversion: 2.1 time: 0.096497 Aug 21 01:46:23.348505 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2750/6151] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:23 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:24.369970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:24.371226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:24.379606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:24.380356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:24.380973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:24.381859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:24.382467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:24.383079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:24.618146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:24.628382 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c504263-db0f-491f-a577-e11b684eae10 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.262333 Aug 21 01:46:24.629848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3402/6152] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:24 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:24.879384 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fe7f41-48b5-4617-a755-6e3a01d41e9d", "tag": "7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:24.895813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:24.896336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:24.896755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:24.925431 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] Creating event network-changed:7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4 for instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d on n-h2-master-1 Aug 21 01:46:24.939743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b3c9f9c9-0309-4b77-9024-908dcf2f70e0 req-1d24bdae-8281-4040-840b-43f52fdd3de3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063225 Aug 21 01:46:24.941053 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2751/6153] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:25.651719 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:25.652321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:25.661353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:25.661810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:25.662662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:25.663820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:25.664754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:25.665413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:25.804375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:25.812547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61e5739f-b4d0-4146-aee8-ece5818b7992 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.165755 Aug 21 01:46:25.813160 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3403/6154] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:25 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:26.836204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:26.837522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:26.845271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:26.845710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:26.846203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:26.847011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:26.847553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:26.848085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:26.995284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:27.003317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86ce0455-4b7b-4e1c-a538-cb7c44da31d3 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.173331 Aug 21 01:46:27.003923 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2752/6155] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:26 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:27.279330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:27.280120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:27.286320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:27.286865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:27.287361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:27.288112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:27.288644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:27.289167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:27.435210 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9119fe81-db82-40ea-9534-4baafb11dcc7 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1833 microversion: 2.1 time: 0.360195 Aug 21 01:46:27.435787 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3404/6156] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:27 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1833 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:28.028232 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:28.028881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:28.036367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:28.036884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:28.037810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:28.038782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:28.040130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:28.040658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:28.322039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:28.331523 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-77009498-b858-4d75-9c95-05b0d2763a40 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.309702 Aug 21 01:46:28.332127 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2753/6157] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:28 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:28.840583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:28.841114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:28.849998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:28.861733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:28.862226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:28.862658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:28.863355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:28.867315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:28.867782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:28.868201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:28.872583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:28.873250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:28.895642 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] Creating event network-changed:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:46:28.901543 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c99d6d79-b82c-452b-befc-3d52b6f3e039 req-abedcb61-4ab1-4f3f-87ae-b7dec8afad89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055312 Aug 21 01:46:28.902398 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2754/6158] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:28.917632 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:46:29.014339 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e374adb8-46b1-4754-8f7a-9c638b6c3d15 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 204 len: 0 microversion: 2.1 time: 0.177380 Aug 21 01:46:29.016626 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3405/6159] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:46:28 2022] DELETE /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:46:29.026516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:29.027509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:29.038770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:29.039949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:29.040556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:29.041517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:29.042111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:29.042681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:29.195282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:29.209816 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f6cd9063-460d-4249-a1a8-a4c0d8b0c3f6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1688 microversion: 2.1 time: 0.187943 Aug 21 01:46:29.226482 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2755/6160] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:29 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:29.353780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:29.354741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:29.361269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:29.362006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:29.362594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:29.363472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:29.364071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:29.364641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:29.522335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:29.532271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-848bb233-4e44-4401-8530-c3e29e492776 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.183019 Aug 21 01:46:29.533516 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3406/6161] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:29 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:30.233492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:30.234962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:30.242404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:30.242896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:30.243293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:30.243999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:30.244479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:30.244937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:30.387825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:30.398173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-24b6edd9-46f2-4e93-b6bb-1a4c7c8d467c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1688 microversion: 2.1 time: 0.167420 Aug 21 01:46:30.398173 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2756/6162] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:30 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:30.555195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:30.555786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:30.564282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:30.564803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:30.565263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:30.565983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:30.566439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:30.566849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:30.773042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:30.782457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab57c554-7104-402c-97b4-e66a5d37a45f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.231283 Aug 21 01:46:30.783440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3407/6163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:30 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:30.850992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fe7f41-48b5-4617-a755-6e3a01d41e9d", "name": "network-vif-plugged", "status": "completed", "tag": "7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:30.882533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:30.883907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:30.884467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:30.898815 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] Creating event network-vif-plugged:7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4 for instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d on n-h2-master-1 Aug 21 01:46:30.905386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-87712283-b4ca-4706-878c-d7287fa78e58 req-570fc982-c84f-4fa8-86a5-c915804536c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064331 Aug 21 01:46:30.906013 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2757/6164] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:31.228670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56ba7dd-6006-4493-9659-31fde21c5c5d", "name": "network-vif-deleted", "tag": "4df01b20-81fb-46a3-a8d3-8d10a83c2526"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:31.238704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:31.239209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:31.239827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:31.251285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] Creating event network-vif-deleted:4df01b20-81fb-46a3-a8d3-8d10a83c2526 for instance c56ba7dd-6006-4493-9659-31fde21c5c5d on n-h2-master-1 Aug 21 01:46:31.256310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c310d205-39d7-4946-b6d8-75682125acc2 req-80b0cb0c-e953-4778-ac5b-ebadbf611b8a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Aug 21 01:46:31.256946 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3408/6165] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:46:31.421107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:31.421836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:31.428029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:31.428523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:31.428956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:31.429673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:31.430152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:31.430563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:31.503852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:31.513378 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-514cb808-58bb-4867-ac78-58ff5197afdf tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1501 microversion: 2.1 time: 0.098562 Aug 21 01:46:31.517027 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2758/6166] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:31 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1501 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:31.805481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:31.806149 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:31.813580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:31.814095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:31.814539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:31.815245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:31.815695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:31.816122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:31.960197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:31.968518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4df0f983-946c-4860-befc-8633cc85634f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1372 microversion: 2.1 time: 0.168426 Aug 21 01:46:31.969172 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3409/6167] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:31 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:32.536304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:32.536959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:32.539278 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:32.540039 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:32.547901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:32.548501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:32.548972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:32.549689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:32.550180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:32.550615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:32.585765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:32.586261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:32.587077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:32.587077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lazy-loading 'fault' on Instance uuid c56ba7dd-6006-4493-9659-31fde21c5c5d {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:46:32.635362 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:32.651603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e20bd3cd-6d9a-43f3-bbf4-bfb1f36f32ad tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 200 len: 1356 microversion: 2.1 time: 0.119340 Aug 21 01:46:32.652472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2759/6168] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:32 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:32.990618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:32.992448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:32.999026 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:33.003188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.003696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.004498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.005230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.005696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.006142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.151906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:33.161019 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37a38994-53c8-4386-8a02-3efe4ee1f71b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1544 microversion: 2.1 time: 0.175128 Aug 21 01:46:33.161626 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3410/6169] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:32 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1544 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:33.181738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:33.182353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:33.188815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.189321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.189755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.190467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.190958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.191376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.331345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:33.339398 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2af3e478-a11d-48c6-a592-9b463cc4ddcd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1544 microversion: 2.1 time: 0.161639 Aug 21 01:46:33.340051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2760/6170] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:33 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1544 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:33.672793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:33.673434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: c56ba7dd-6006-4493-9659-31fde21c5c5d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:33.679930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.680425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.680932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.681931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:33.682645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:33.683277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:33.706271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] HTTP exception thrown: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Request method failure captured: Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d HTTP/1.1 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYz8QhgFytmd4_Ps4SloBSvhjtcuMqsJGdF5F5aGUhRVp62zfjKYfvaboNciTc-PyRqZLGdU6xJAViU39YXdEmapMcWXISYBKohwGqnQoVSW8YWZRt7Apmpyh05O2KRy08IrusUMF-g0ry05qgfDoZzl3jVVve4sx7jkCr5vfqyxNxg Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d17d705402549dc94e6fdd36e917823", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}] Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 6a5f1b1c768b43be80f4e2a89694a811 Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: exception: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c56ba7dd-6006-4493-9659-31fde21c5c5d'} Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:46:33.709317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. Aug 21 01:46:33.714117 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:46:33.716519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Returning 404 to user: Instance c56ba7dd-6006-4493-9659-31fde21c5c5d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:46:33.718179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5cc56981-c90d-4cbf-aae4-ad811b7112f5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d" status: 404 len: 111 microversion: 2.1 time: 0.049266 Aug 21 01:46:33.722628 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3411/6171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:33 2022] GET /compute/v2.1/servers/c56ba7dd-6006-4493-9659-31fde21c5c5d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:46:35.584052 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fe7f41-48b5-4617-a755-6e3a01d41e9d", "tag": "7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:35.601007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:35.604790 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:35.606321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:35.634169 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] Creating event network-changed:7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4 for instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d on n-h2-master-1 Aug 21 01:46:35.648641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8cf7d1a9-096d-40c4-b505-c742060be202 req-374cf012-db5d-4b1f-994a-1558476b3221 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068206 Aug 21 01:46:35.649910 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2761/6172] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:37.962477 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b82e5b60-25a7-44d2-bfa6-fa7bffdd99d8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '.version_select at 0x7fc403240280>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:37.988918 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b82e5b60-25a7-44d2-bfa6-fa7bffdd99d8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-440167664" status: 202 len: 0 microversion: 2.1 time: 0.030719 Aug 21 01:46:37.989642 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3412/6173] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 01:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-440167664 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:46:38.048708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dc09558-4bf7-4177-ae42-41336ddff7f4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: .version_select at 0x7fc3fce9bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-535634669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE46IcNdovD1Ae7CbcsdKwSrmmr/2ISisauDEjetcTb7C98NkmjMCWgT7FOh+yKEVjnGqp7tmpNYuyGZ/zmPlZwarKQtv+h1yUaT4RtdI8V1a5r2Hjfcm1QsGOEwozbG7g=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:38.087973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2dc09558-4bf7-4177-ae42-41336ddff7f4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:46:38.095868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-2dc09558-4bf7-4177-ae42-41336ddff7f4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:46:38.136509 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2dc09558-4bf7-4177-ae42-41336ddff7f4 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.108666 Aug 21 01:46:38.144808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2762/6174] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:46:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:44.393027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1055524533", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "e1561c2d-6118-4427-a9d5-dfc0a2536661"}], "key_name": "tempest-TestNetworkAdvancedServerOps-535634669", "security_groups": [{"name": "tempest-secgroup-smoke-671777939"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:44.409496 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:44.531350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] validate_networks() for [('e1561c2d-6118-4427-a9d5-dfc0a2536661', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:46:45.034167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:46:45.034884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:46:45.035665 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:46:45.036075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:46:45.036476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:46:45.048648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:45.049327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:45.049903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:45.050763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:45.051375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:45.051956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:45.084258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:46:45.091697 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:46:45.109390 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:46:45.112740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:46:45.185958 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37beab22-736a-4fac-9298-789a9af35ed6 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.795952 Aug 21 01:46:45.195061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3413/6175] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:46:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:46:45.202878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08b94d64-960a-4047-ad9a-c96304e0511e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:45.204327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-08b94d64-960a-4047-ad9a-c96304e0511e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:45.366922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-08b94d64-960a-4047-ad9a-c96304e0511e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:45.377138 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08b94d64-960a-4047-ad9a-c96304e0511e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1266 microversion: 2.1 time: 0.178601 Aug 21 01:46:45.379287 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2763/6176] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:45 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:46.405364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:46.406636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:46.415022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:46.415537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:46.416182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:46.416918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:46.417374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:46.417832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:46.503567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:46.520106 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2dbb217d-bdf3-47fe-82d6-700f318be07b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1318 microversion: 2.1 time: 0.120861 Aug 21 01:46:46.520940 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3414/6177] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:46 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1318 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:46.780567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1792171371", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:46.788743 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=64 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:46.881067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:46:47.375572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:46:47.376391 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:46:47.376957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:46:47.377758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:46:47.379050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:46:47.390936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:47.391424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:47.391856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:47.392609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:47.393545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:47.393986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:47.415625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Getting quotas for project 406733cfbadb4633a74f1680bcddb5da. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:46:47.421790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Getting quotas for user 781e46904b7243f29208992393cf4945 and project 406733cfbadb4633a74f1680bcddb5da. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:46:47.437167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:46:47.440223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:46:47.503044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09be4058-d9e1-42dd-ae0e-3c63545d1b8c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727121 Aug 21 01:46:47.504095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2764/6178] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:46:47.517316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2e0a61d-4a3e-4932-8e46-e36d061864fd tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:47.518886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2e0a61d-4a3e-4932-8e46-e36d061864fd tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:47.543728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:47.544349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:47.555914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:47.557278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:47.557911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:47.558792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:47.559401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:47.560051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:47.602700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b2e0a61d-4a3e-4932-8e46-e36d061864fd tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:47.615350 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2e0a61d-4a3e-4932-8e46-e36d061864fd tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1215 microversion: 2.1 time: 0.103781 Aug 21 01:46:47.616419 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3415/6179] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:47 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:47.650073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:47.660013 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0a0162b-105a-4b50-aa35-71a52be46f00 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1324 microversion: 2.1 time: 0.121549 Aug 21 01:46:47.661173 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2765/6180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:47 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1324 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:46:48.637255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:48.637876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:48.657459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:48.658022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:48.658516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:48.659490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:48.659924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:48.660572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:48.684329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:48.685411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:48.694652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:48.695382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:48.696099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:48.697382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:48.698031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:48.699192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:48.742959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:48.751705 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-023d0148-a302-45af-b200-d3073566ad49 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1267 microversion: 2.1 time: 0.118346 Aug 21 01:46:48.752412 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3416/6181] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:48 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:49.019757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:49.032911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:49.033780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:49.034560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:49.043622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:49.056051 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f324a46f-719a-4c36-a85f-3d63db5272e3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.374009 Aug 21 01:46:49.060932 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2766/6182] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:48 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:49.067370 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] Creating event network-changed:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h2-master-1 Aug 21 01:46:49.083875 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9ebe434a-015e-4f96-a7b5-768ed2ca5ab6 req-2725b66f-28ff-4783-b366-577808d61cdd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068482 Aug 21 01:46:49.084888 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3417/6183] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:49.773423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:49.784256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:49.791963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:49.792440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:49.792904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:49.793601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:49.794178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:49.794649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:49.865545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:49.874374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-07fe3930-5658-4354-ac67-d71600e20afa tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1273 microversion: 2.1 time: 0.104806 Aug 21 01:46:49.874970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2767/6184] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:49 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:50.081295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:50.082008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:50.084172 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:50.091535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:50.092199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:50.092728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:50.093623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:50.094081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:50.094494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:50.242706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:50.252338 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-393bd3df-e28d-49ea-bf80-6a1be8887e0f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.176358 Aug 21 01:46:50.262840 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3418/6185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:50 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:50.895844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:50.896522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:50.903653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:50.904179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:50.904690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:50.905471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:50.905925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:50.906343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:51.102923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d7f211-d8bf-45da-ab0a-d45b0d6b4206", "tag": "26b56894-62c5-420f-9828-c28150e40c74"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:51.115126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:51.115665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:51.116185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:51.128063 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] Creating event network-changed:26b56894-62c5-420f-9828-c28150e40c74 for instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 on n-h1-master-1 Aug 21 01:46:51.136988 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8ba8f824-defe-480b-a3fe-4a6f7249b8f5 req-0196f255-b187-40cf-97b3-2d52247a3cd4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037995 Aug 21 01:46:51.137777 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3419/6186] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:51.275859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:51.276629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:51.277664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:51.284942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:51.285133 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9dbc2a19-c38f-4f6a-8802-e2a0e30dec17 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.393344 Aug 21 01:46:51.285417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:51.285597 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2768/6187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:50 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:51.285879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:51.286587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:51.287029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:51.287445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:51.497520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:51.506048 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5919829-9369-4dbf-915d-bd63df9b6162 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.233931 Aug 21 01:46:51.506621 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3420/6188] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:51 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:52.307275 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:52.308009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:52.311290 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:52.316559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:52.317069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:52.317492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:52.318190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:52.318631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:52.319044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:52.527073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:52.527723 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:52.535900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:52.536392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:52.536882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:52.537600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:52.538047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:52.538484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:52.681774 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:52.687164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:52.691779 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4dbd1d34-d5f5-4530-8aeb-bd5c6b99aa62 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.388809 Aug 21 01:46:52.692346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2769/6189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:52 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:52.723062 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4896508c-ed1d-43c4-a3c5-c4a74dd96802 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.199890 Aug 21 01:46:52.724109 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3421/6190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:52 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:53.728682 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:53.729607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:53.741550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:53.742323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:53.748245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:53.749120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:53.749235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:53.750027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:53.750487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:53.751067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:53.756392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:53.756892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:53.757308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:53.757999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:53.758438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:53.758853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:53.888145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:53.897775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:53.898051 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b37cbcb8-1870-407f-85d0-e9d5640c0678 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.175952 Aug 21 01:46:53.898800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2770/6191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:53 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:53.906038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a57b1f5c-2e29-42a4-8755-7e5d22341e67 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.164790 Aug 21 01:46:53.906613 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3422/6192] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:53 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:54.861965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "name": "network-vif-plugged", "status": "completed", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:54.874581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:54.875066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:54.875496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:54.886739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] Creating event network-vif-plugged:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h2-master-1 Aug 21 01:46:54.892185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-fe6a0ac1-6233-4aa1-9a6d-21989fea329f req-619f590c-2c1c-4025-af36-bee0a90ec754 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Aug 21 01:46:54.893728 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2771/6193] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:54.919960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:54.921281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:54.927757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:54.928316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:54.928439 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:54.928835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:54.929271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:54.930184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:54.930607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:54.931232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:54.943102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:54.943583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:54.944019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:54.944723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:54.945204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:54.945618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:55.070937 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:55.081588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:55.090169 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63002bed-0bf2-483f-952f-c0117c31ea6c tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.174538 Aug 21 01:46:55.091212 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3423/6194] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:54 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:55.154114 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:55.163090 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b46fcaa9-cd72-474b-afce-cebeea08fb3e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.239890 Aug 21 01:46:55.164022 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2772/6195] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:54 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:56.113504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:56.114059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:56.124019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:56.124505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:56.125173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:56.125897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:56.126359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:56.126792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:56.183647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:56.184261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:56.193775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:56.194575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:56.195203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:56.196171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:56.197081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:56.197728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:56.269020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:56.276804 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adba8594-5556-4de4-ae48-f2fe5edd6723 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.169396 Aug 21 01:46:56.277381 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3424/6196] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:56 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:56.336790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:56.344786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c78bb3d0-5466-4409-a760-60f23dfe7e46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1391 microversion: 2.1 time: 0.165085 Aug 21 01:46:56.345411 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2773/6197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:56 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:56.908804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d7f211-d8bf-45da-ab0a-d45b0d6b4206", "name": "network-vif-plugged", "status": "completed", "tag": "26b56894-62c5-420f-9828-c28150e40c74"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:56.918820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:56.919287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:56.919680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:56.931231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] Creating event network-vif-plugged:26b56894-62c5-420f-9828-c28150e40c74 for instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 on n-h1-master-1 Aug 21 01:46:56.936611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-fa1f6767-e47f-4d95-b831-b0c227c263ea req-ad6904af-358b-4870-9708-770ec71ed820 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Aug 21 01:46:56.937233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3425/6198] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:46:57.300068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:57.300616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:57.307908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.308391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.308870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.309563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.310041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.310657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.368343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:57.369300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:57.376726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.377324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.377822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.378608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.379257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.379756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.403430 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:57.431353 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:57.523071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:57.532033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d83d0d2-39aa-4dfb-a0f9-441bfe0f2cdd tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1564 microversion: 2.1 time: 0.170024 Aug 21 01:46:57.532627 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3426/6199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:57 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:57.552559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:57.553136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:57.559748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.560295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.560935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.561717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:57.562235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:57.562722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:57.608498 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:46:57.705806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:57.714764 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad5e20b2-f089-4590-bb1a-9096afd9ad2f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1564 microversion: 2.1 time: 0.166012 Aug 21 01:46:57.715456 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3427/6200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:57 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:57.755267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:57.763064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3a3c0702-4b60-4372-a61b-2c656558b2e7 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1315 microversion: 2.1 time: 0.467082 Aug 21 01:46:57.763900 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2774/6201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:57 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:58.784562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:58.785247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:58.792548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:58.793067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:58.793475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:58.794210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:58.795337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:58.795773 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:58.999265 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:59.007302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49147b2d-a14f-4a7d-a1bf-9cc19dd08b01 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1465 microversion: 2.1 time: 0.226701 Aug 21 01:46:59.007894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3428/6202] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:58 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1465 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:59.054430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:59.054973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:59.062235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.062709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.063135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.063828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.064270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.064681 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.092871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:46:59.172530 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1950bb3b-71d8-4d34-b685-fa4da0257de2 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "DELETE /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 204 len: 0 microversion: 2.1 time: 0.121526 Aug 21 01:46:59.173501 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2775/6203] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:46:59 2022] DELETE /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:46:59.182103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:59.182720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:59.189645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.190119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.190560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.191316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.191935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.192516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.456411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:46:59.464890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7fd5eefe-1667-480b-89e2-15580eaf0db1 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1471 microversion: 2.1 time: 0.286807 Aug 21 01:46:59.465462 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3429/6204] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:59 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:46:59.838733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:46:59.839517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:46:59.841507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:46:59.846036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.846605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.847112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.848098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.848651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.849189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.852924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:46:59.853404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:46:59.854015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:46:59.866297 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] Creating event network-changed:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h2-master-1 Aug 21 01:46:59.871521 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-00b26771-edef-4ff7-b3c6-b56958a05a92 req-6e9feee7-a0fe-46db-bb43-d3a35b1e6e35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034141 Aug 21 01:46:59.872526 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3430/6205] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:47:00.065080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:00.074217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-832ae06e-8fb6-42e8-8c56-22ce04c066df tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1564 microversion: 2.1 time: 0.239969 Aug 21 01:47:00.074926 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2776/6206] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:46:59 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:47:00.488675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:00.489413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:00.498004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:00.498646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:00.499086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:00.499801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:00.500253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:00.500661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:00.653932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e46904b7243f29208992393cf4945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406733cfbadb4633a74f1680bcddb5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:00.670495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-767377fc-b4c3-4914-bbdb-ca5c0ed34830 tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 200 len: 1471 microversion: 2.1 time: 0.184999 Aug 21 01:47:00.672405 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3431/6207] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:00 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:47:01.071331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d7f211-d8bf-45da-ab0a-d45b0d6b4206", "name": "network-vif-deleted", "tag": "26b56894-62c5-420f-9828-c28150e40c74"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:01.082414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:01.083165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:01.083760 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:01.097104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] Creating event network-vif-deleted:26b56894-62c5-420f-9828-c28150e40c74 for instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 on n-h1-master-1 Aug 21 01:47:01.102558 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-53d206aa-9a75-4ba9-a9e7-0c3e62ef154b req-9e6925a5-1431-41e5-be8c-dd3574b48fac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Aug 21 01:47:01.103825 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2777/6208] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:47:01.692337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:01.692989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] [instance: 02d7f211-d8bf-45da-ab0a-d45b0d6b4206] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:01.702297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:01.702891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:01.703338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:01.704050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:01.704507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:01.704964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:01.719987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] HTTP exception thrown: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Request method failure captured: Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 HTTP/1.1 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY6DkQg3jCCDLM3WckdwwjxtYgrWDzfPa5kGFuhB_EgYANwqHEE5aJCuLAXGVEYfT_GcIaBJKXXSGJFM_bygvBBRofiE5pTJI5GKGNtI8IJfLFCpinywvmJ75faUT6CMwGC1q8jtxsJbEcGSq0oUMnM_zObrKYabl5fC4YR7XL_VhHQ Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 406733cfbadb4633a74f1680bcddb5da Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-VolumesNegativeTest-120669723 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/406733cfbadb4633a74f1680bcddb5da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_406733cfbadb4633a74f1680bcddb5da", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/406733cfbadb4633a74f1680bcddb5da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/406733cfbadb4633a74f1680bcddb5da"}]}] Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-VolumesNegativeTest-120669723 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 406733cfbadb4633a74f1680bcddb5da Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-VolumesNegativeTest-120669723 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-VolumesNegativeTest-120669723-project Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 781e46904b7243f29208992393cf4945 Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-VolumesNegativeTest-120669723-project Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '02d7f211-d8bf-45da-ab0a-d45b0d6b4206'} Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:47:01.721708 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] Returning 404 to user: Instance 02d7f211-d8bf-45da-ab0a-d45b0d6b4206 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d90a4b9-6192-4d13-8d98-e49a0658ce9b tempest-VolumesNegativeTest-120669723 tempest-VolumesNegativeTest-120669723-project] 10.222.0.46 "GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206" status: 404 len: 111 microversion: 2.1 time: 0.035052 Aug 21 01:47:01.726521 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3432/6209] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:01 2022] GET /compute/v2.1/servers/02d7f211-d8bf-45da-ab0a-d45b0d6b4206 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:47:10.277461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:10.279787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:10.286935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:10.287429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:10.287857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:10.288540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:10.289022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:10.289449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:10.361860 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff235d97-3ee8-4b4b-acbe-95810cf01a44 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d/action" status: 200 len: 24573 microversion: 2.1 time: 0.089900 Aug 21 01:47:10.362705 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2778/6210] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:47:10 2022] POST /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:47:34.497981 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:34.500404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:34.502743 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=29 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:34.503403 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=90 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:34.510529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:34.511045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:34.511468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:34.512171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:34.512641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:34.513102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:34.584627 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bad2d70e-a2b5-43a9-b90d-1f461d3d7cf3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action" status: 200 len: 24564 microversion: 2.1 time: 0.090838 Aug 21 01:47:34.585355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3433/6211] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:47:34 2022] POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action => generated 24564 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:47:52.611083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc28bac5-5d2b-4544-bf75-f393b7513c94 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: .version_select at 0x7fc3fda4eca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1017941702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyb57EEyYn0v/3iO8JJOI4hmeBkuLnPXFlINzHK9N1xMmHol2HN6zV7yuVCePTiDruua+oFDCtC7AaChLii8IYJgX4SV6gwcwAvgDUjbsl9iaNeJFLD3yfxYRdyl12oLg=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:52.617084 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:52.617732 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:52.635140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fc28bac5-5d2b-4544-bf75-f393b7513c94 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:47:52.642130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fc28bac5-5d2b-4544-bf75-f393b7513c94 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:47:52.669335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc28bac5-5d2b-4544-bf75-f393b7513c94 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.062701 Aug 21 01:47:52.669954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2779/6212] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:47:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:47:53.793302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-19380934", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "9d87cf42-771c-42d7-a013-9a1b68042e15"}], "key_name": "tempest-TestNetworkBasicOps-1017941702", "security_groups": [{"name": "tempest-secgroup-smoke-1221287952"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:53.802059 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:53.802723 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:47:53.909105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] validate_networks() for [('9d87cf42-771c-42d7-a013-9a1b68042e15', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:47:54.408076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:47:54.408818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:47:54.409123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:47:54.409529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:47:54.409936 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:47:54.420305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:54.420807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:54.421233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:54.421973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:54.422417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:54.422834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:54.442004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:47:54.447652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:47:54.461595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:47:54.464104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:47:54.514454 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fa5bad1-cecb-467b-a940-5a444d228ffa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725658 Aug 21 01:47:54.515104 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3434/6213] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:47:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:47:54.527875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6228cf0-9e3d-4cf7-a7eb-ad002521fa69 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:54.528789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6228cf0-9e3d-4cf7-a7eb-ad002521fa69 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:54.598772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6228cf0-9e3d-4cf7-a7eb-ad002521fa69 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:54.606237 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6228cf0-9e3d-4cf7-a7eb-ad002521fa69 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1247 microversion: 2.1 time: 0.083540 Aug 21 01:47:54.606818 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2780/6214] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:54 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:47:55.628031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:55.629902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:55.637112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:55.638032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:55.638476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:55.639486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:55.640182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:55.641178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:55.712189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:55.720277 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12b4d051-697b-46a2-8efa-717794bbacdd tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1305 microversion: 2.1 time: 0.097334 Aug 21 01:47:55.720875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3435/6215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:55 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:47:56.742663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:56.743254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:56.752824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:56.753346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:56.753811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:56.754553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:56.755006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:56.755431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:57.156953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:57.165196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3f2eb23-9f94-4ef9-aada-000869d24b92 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1373 microversion: 2.1 time: 0.426804 Aug 21 01:47:57.165775 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2781/6216] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:56 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1373 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:47:57.450662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd3155a-c198-4904-b308-1ff31e63ad2f", "tag": "c3672165-c43c-4e61-ba18-3a509c46f7ed"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:47:57.460327 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:57.460816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:57.461255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:57.474794 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] Creating event network-changed:c3672165-c43c-4e61-ba18-3a509c46f7ed for instance 8bd3155a-c198-4904-b308-1ff31e63ad2f on n-h1-master-1 Aug 21 01:47:57.479887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-593f82b7-e88d-4376-b14d-1d6fd78aa09e req-47b14cc9-c281-4d57-95e2-6b1d05b879bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167651 Aug 21 01:47:57.480546 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3436/6217] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:47:58.188473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:58.189120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:58.199161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:58.199631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:58.200060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:58.200738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:58.201222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:58.201633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:58.348334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:58.360852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af4f3019-7064-484f-bfd2-05ebebacc364 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1373 microversion: 2.1 time: 0.177748 Aug 21 01:47:58.361723 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2782/6218] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:58 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:47:59.387386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:47:59.388426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:47:59.395101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:59.395720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:59.396190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:59.396930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:47:59.397592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:47:59.398021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:47:59.534162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:47:59.544395 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-982c4a72-6aec-4690-a27a-761bbe19ca6d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1373 microversion: 2.1 time: 0.162506 Aug 21 01:47:59.545004 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3437/6219] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:47:59 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:00.566058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:00.566718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:00.574307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:00.574797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:00.575728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:00.576400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:00.576921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:00.577347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:00.739065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:00.749862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7f190fc-a51c-4735-875b-db17c161bbd0 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1373 microversion: 2.1 time: 0.187894 Aug 21 01:48:00.750479 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2783/6220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:00 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:01.461582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd3155a-c198-4904-b308-1ff31e63ad2f", "name": "network-vif-plugged", "status": "completed", "tag": "c3672165-c43c-4e61-ba18-3a509c46f7ed"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:01.473574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:01.474053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:01.474553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:01.486791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] Creating event network-vif-plugged:c3672165-c43c-4e61-ba18-3a509c46f7ed for instance 8bd3155a-c198-4904-b308-1ff31e63ad2f on n-h1-master-1 Aug 21 01:48:01.492064 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-727c6cfb-13ea-4063-82af-baa9645ae738 req-38830b1c-ffe4-4028-9040-b5d2e98b1507 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Aug 21 01:48:01.492790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3438/6221] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:01.771681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:01.772334 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:01.780689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:01.781224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:01.781656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:01.782355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:01.782804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:01.783223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:02.195274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:02.208744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-926afa15-af97-4bef-95f1-b39a8bf397fa tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1373 microversion: 2.1 time: 0.440990 Aug 21 01:48:02.209627 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2784/6222] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:01 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1373 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:03.235610 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:03.236352 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:03.243295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:03.243774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:03.244207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:03.244937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:03.245390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:03.245808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:03.399084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:03.410978 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d03bd044-77b2-4902-a0e5-64330c685f73 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1544 microversion: 2.1 time: 0.180812 Aug 21 01:48:03.411749 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3439/6223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:03 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1544 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:03.434948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:03.435762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:03.445633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:03.446324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:03.446995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:03.448070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:03.448726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:03.449303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:03.597935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:03.605997 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4903898f-eaac-4d7d-87d5-e474f0979f27 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1544 microversion: 2.1 time: 0.177558 Aug 21 01:48:03.607030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2785/6224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:03 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1544 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:13.295884 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:13.296502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:13.299062 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:13.299760 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:13.300589 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:13.306425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.306909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.307342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.308025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.308469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.308927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.447011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:13.460043 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a77e78a8-3ba8-45f8-a52a-138cb39dad0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1683 microversion: 2.1 time: 0.168147 Aug 21 01:48:13.460948 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3440/6225] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:13 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:13.575179 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:13.577632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:13.580231 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:13.581052 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:13.586880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.587360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.587799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.588486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.588973 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.589393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.659081 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f6b7f0a-d874-4f39-904c-72a0da898666 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action" status: 200 len: 32627 microversion: 2.1 time: 0.088627 Aug 21 01:48:13.659727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2786/6226] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:48:13 2022] POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action => generated 32627 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:48:13.826412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:13.826962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:13.833213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.833685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.834115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.834801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:13.835244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:13.835661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:13.966863 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66e20517-cf58-4b86-a1eb-1ce8506515a1 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1834 microversion: 2.1 time: 0.146344 Aug 21 01:48:13.967440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3441/6227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:13 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1834 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:13.994789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:13.997431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:14.004966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:14.005452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:14.005888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:14.006584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:14.007035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:14.007462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:14.033746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lazy-loading 'flavor' on Instance uuid 564b4309-e959-4670-851d-a1518e9d445e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:48:14.051810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Going to try to live migrate instance to another host {{(pid=122483) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 21 01:48:15.580291 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9a7f41c6-568f-44fb-84ed-a026a003655e tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action" status: 202 len: 0 microversion: 2.1 time: 1.589527 Aug 21 01:48:15.581578 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2787/6228] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:48:13 2022] POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action => generated 0 bytes in 1591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:48:15.594276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:15.595080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:15.602599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:15.603050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:15.603521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:15.604334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:15.605598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:15.606037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:16.075909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:16.084457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea9be14b-cbaf-47bc-9403-800a2311b91e tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.496033 Aug 21 01:48:16.085091 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3442/6229] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:15 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:16.697095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "name": "network-vif-unplugged", "status": "completed", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:16.709736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:16.710224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:16.710658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:16.722203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] Creating event network-vif-unplugged:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h2-master-1 Aug 21 01:48:16.727589 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4bbadee5-e771-48fe-8bb4-cf751fa37d58 req-37afe73f-876c-4c69-a003-377454be730d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035123 Aug 21 01:48:16.728955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2788/6230] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:17.107019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:17.107619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:17.115146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:17.115788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:17.117082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:17.118163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:17.118632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:17.119057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:17.262916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:17.272308 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edce5473-9de0-4448-8d9f-c4d637d7205a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.169338 Aug 21 01:48:17.272939 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3443/6231] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:17 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:18.298072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:18.298779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:18.306280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:18.306759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:18.307188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:18.307878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:18.308322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:18.308749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:18.455909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:18.464315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6689eb6-4fef-4c3f-b09a-469842279985 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.172310 Aug 21 01:48:18.464908 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2789/6232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:18 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:18.773833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:18.787222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:18.787700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:18.788164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:18.802322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] Creating event network-changed:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h2-master-1 Aug 21 01:48:18.807424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ad5922a9-a679-49be-99a8-0be95ac837c4 req-0646371b-4fa4-4a31-bed5-ea39b2032d57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 Aug 21 01:48:18.808052 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3444/6233] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:19.486255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:19.486939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:19.494062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:19.494540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:19.494979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:19.495730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:19.496109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:19.496576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:19.638678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:19.647387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e36cb2e-59a1-4fad-a83b-399ddcdbae6f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.165468 Aug 21 01:48:19.647951 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2790/6234] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:19 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:20.674716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:20.675740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:20.686350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:20.686840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:20.687289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:20.687988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:20.688446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:20.688897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:20.840198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:20.849396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74fd9590-39ea-4281-8574-e6210073d89b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.183375 Aug 21 01:48:20.850277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3445/6235] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:20 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:21.874027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:21.874995 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:21.886942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:21.887763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:21.888536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:21.889578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:21.890350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:21.890763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:22.045206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:22.053230 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-512f10e0-8790-49ff-af1e-f0964687008a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.185983 Aug 21 01:48:22.053836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2791/6236] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:21 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:23.075151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:23.075827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:23.083505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:23.083992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:23.084463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:23.085224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:23.085684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:23.086449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:23.230540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:23.238717 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b54c64c4-08b5-4120-9215-d10a82fa758c tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.167641 Aug 21 01:48:23.239291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3446/6237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:23 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:24.259971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:24.260669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:24.269291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:24.269901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:24.270561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:24.271281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:24.271739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:24.272171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:24.275045 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:24.415464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:24.424197 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-49766849-9af5-4586-bdf1-ae9b89979c8a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1693 microversion: 2.1 time: 0.168152 Aug 21 01:48:24.424790 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2792/6238] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:24 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:25.445767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:25.446451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:25.453899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.454451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.454947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.455690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.456209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.456686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.459574 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=63 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:25.600437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:25.609289 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2097208-4b4f-4b88-967c-0219726fb9bb tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1683 microversion: 2.1 time: 0.167369 Aug 21 01:48:25.609856 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3447/6239] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:25 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:25.629627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:25.630245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:25.637399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.637829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.638274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.639181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.639949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.640387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.777086 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0e58720-0d2f-41fc-af37-212aa3b98053 tempest-TestNetworkAdvancedServerOps-1905565498 tempest-TestNetworkAdvancedServerOps-1905565498-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1834 microversion: 2.1 time: 0.151047 Aug 21 01:48:25.777669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2793/6240] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:25 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1834 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:25.799497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:25.800114 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:25.806408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.806889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.807301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.807995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:25.808448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:25.808911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:25.955880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:25.967402 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a5b849b-1d0d-4ffe-8bda-8f428b7e38bc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1683 microversion: 2.1 time: 0.172180 Aug 21 01:48:25.968072 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3448/6241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:25 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:26.067464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:26.069664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:26.075833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:26.076481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:26.076976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:26.077709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:26.078148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:26.078568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:26.131394 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17cfb4ff-db3d-4b64-8e02-e146b2cab236 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action" status: 200 len: 38358 microversion: 2.1 time: 0.067295 Aug 21 01:48:26.132333 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2794/6242] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:48:26 2022] POST /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e/action => generated 38358 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:48:27.202917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:27.203577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:27.205784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:27.210917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:27.211406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:27.211837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:27.212544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:27.213029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:27.213448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:27.217348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:27.218154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:27.218648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:27.231868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] Creating event network-changed:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h1-master-1 Aug 21 01:48:27.237323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6ae2d16d-2509-4197-bf64-bbbaa3b2f201 req-445b3e42-b560-49c5-b0ac-8f0aa8c6f4ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036144 Aug 21 01:48:27.238259 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2795/6243] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:27.241444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:48:27.341818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2bc11b58-8e63-4494-909f-d7a87bf12d68 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 204 len: 0 microversion: 2.1 time: 0.142786 Aug 21 01:48:27.342838 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3449/6244] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:48:27 2022] DELETE /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:48:27.352209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:27.353197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:27.360187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:27.360677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:27.361250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:27.362068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:27.362788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:27.363419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:27.543460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:27.552678 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80e53066-4f3d-452c-8553-d655797eaf3f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1689 microversion: 2.1 time: 0.205094 Aug 21 01:48:27.553500 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2796/6245] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:27 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:28.390712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564b4309-e959-4670-851d-a1518e9d445e", "name": "network-vif-deleted", "tag": "e2cdef1a-7aed-4d1d-a7e7-4f65e225829c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:28.402493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:28.402975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:28.403493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:28.414611 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] Creating event network-vif-deleted:e2cdef1a-7aed-4d1d-a7e7-4f65e225829c for instance 564b4309-e959-4670-851d-a1518e9d445e on n-h1-master-1 Aug 21 01:48:28.419967 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2cadd2c6-353d-4e4c-a1b9-ef32916f9911 req-839a7c0c-5f12-4c28-a677-4628e65f9f63 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Aug 21 01:48:28.420793 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3450/6246] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:28.576604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:28.578186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:28.585814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:28.586289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:28.586742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:28.587450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:28.587933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:28.588335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:28.621210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:28.621615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:28.622055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:28.622504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lazy-loading 'fault' on Instance uuid 564b4309-e959-4670-851d-a1518e9d445e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:48:28.670319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:28.678080 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-098d0b58-0aea-4c33-ad1e-70149aafbdf0 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 200 len: 1356 microversion: 2.1 time: 0.106509 Aug 21 01:48:28.678877 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2797/6247] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:28 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:29.701090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:29.701990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 564b4309-e959-4670-851d-a1518e9d445e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:29.708815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:29.709437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:29.709872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:29.710570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:29.711007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:29.711427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:29.728717 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] HTTP exception thrown: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Request method failure captured: Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e HTTP/1.1 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYz8QhgFytmd4_Ps4SloBSvhjtcuMqsJGdF5F5aGUhRVp62zfjKYfvaboNciTc-PyRqZLGdU6xJAViU39YXdEmapMcWXISYBKohwGqnQoVSW8YWZRt7Apmpyh05O2KRy08IrusUMF-g0ry05qgfDoZzl3jVVve4sx7jkCr5vfqyxNxg Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d17d705402549dc94e6fdd36e917823", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}] Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 6a5f1b1c768b43be80f4e2a89694a811 Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '564b4309-e959-4670-851d-a1518e9d445e'} Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:29.730423 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Returning 404 to user: Instance 564b4309-e959-4670-851d-a1518e9d445e could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d771b269-7946-45e3-8c06-e1831a479bde tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e" status: 404 len: 111 microversion: 2.1 time: 0.036200 Aug 21 01:48:29.735327 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3451/6248] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:29 2022] GET /compute/v2.1/servers/564b4309-e959-4670-851d-a1518e9d445e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:48:31.252302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:31.253336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:31.261965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:31.262632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:31.263270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:31.265267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:31.265913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:31.266497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:31.296538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:48:31.428324 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d48fc2a-c4fc-4e19-92e4-055b19ce63b6 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 204 len: 0 microversion: 2.1 time: 0.179415 Aug 21 01:48:31.429612 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2798/6249] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:48:31 2022] DELETE /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:48:31.439920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:31.440550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:31.450985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:31.452853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:31.453316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:31.454054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:31.455426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:31.456622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:31.661198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:31.669720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3407269-6cd5-4d38-aba8-5fb631ee398c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1550 microversion: 2.1 time: 0.235469 Aug 21 01:48:31.672024 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3452/6250] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:31 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1550 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:32.693613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:32.694470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:32.701312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:32.702166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:32.702600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:32.703302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:32.703748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:32.704163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:33.176342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:33.186809 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6683a208-843d-4cdc-9c37-4bb357358eae tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 200 len: 1550 microversion: 2.1 time: 0.497521 Aug 21 01:48:33.187400 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2799/6251] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:32 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 1550 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:33.649404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14c502ee-4a86-4c5f-aa8f-b79816386fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '.version_select at 0x7fc3fa166430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:33.699735 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14c502ee-4a86-4c5f-aa8f-b79816386fb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-535634669" status: 202 len: 0 microversion: 2.1 time: 0.054125 Aug 21 01:48:33.700342 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3453/6252] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 01:48:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-535634669 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:48:33.724415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd3155a-c198-4904-b308-1ff31e63ad2f", "name": "network-vif-deleted", "tag": "c3672165-c43c-4e61-ba18-3a509c46f7ed"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:33.736205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ffd6a51a-da64-450b-b7ba-a9bb5e686766 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: .version_select at 0x7fc3fa03aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1239986217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiONpMpvB2ZUQmRYni6yGOb0VvLTbDNpzEE+mE5c8V9iT5nXmdSGcPg/HgISY2+3AjQuwJB9GPaev9Ea02tCn9G+Q9KRIOjYcBnRHC2k3YCbvPlIcJqMwwnJoR621uA8Q=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:33.742480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:33.742963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:33.743585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:33.754008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ffd6a51a-da64-450b-b7ba-a9bb5e686766 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:48:33.757433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] Creating event network-vif-deleted:c3672165-c43c-4e61-ba18-3a509c46f7ed for instance 8bd3155a-c198-4904-b308-1ff31e63ad2f on n-h1-master-1 Aug 21 01:48:33.759783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-ffd6a51a-da64-450b-b7ba-a9bb5e686766 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:48:33.762686 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a3ac2d7d-b938-48aa-8979-545eca5c1908 req-ed0260cc-b63d-4e4c-b553-6cb9484248c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042135 Aug 21 01:48:33.763363 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2800/6253] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:33.791245 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ffd6a51a-da64-450b-b7ba-a9bb5e686766 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059133 Aug 21 01:48:33.792211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3454/6254] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:48:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:48:34.208964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:34.210018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 8bd3155a-c198-4904-b308-1ff31e63ad2f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:34.216902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:34.217396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:34.218131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:34.218927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:34.219438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:34.220264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:34.235650 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] HTTP exception thrown: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Request method failure captured: Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f HTTP/1.1 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY5kXcgYgw63H2enjIW9zYT_jSBqixqXvGbEC4JaICKoJ1xBwGHAx5FqfuRyO24U-QcpNoricpcV4d42o5iqg3SjLCu12mjDYomMYuyaKnMaDTa6Hr_TNp_-YvHBTCPiIxIFUwygKkQTQ_iAirkKEfsOpDIM_Q56Jh_SGDDyC50AVe4 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d4ba3cc14844d08a6f85bbd32823067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}] Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f90ad477160c43d6afbdb868b89738fd Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '8bd3155a-c198-4904-b308-1ff31e63ad2f'} Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:34.237475 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Returning 404 to user: Instance 8bd3155a-c198-4904-b308-1ff31e63ad2f could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3682ee7-0a71-485c-b4c7-17219415468f tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f" status: 404 len: 111 microversion: 2.1 time: 0.034451 Aug 21 01:48:34.241436 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2801/6255] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:34 2022] GET /compute/v2.1/servers/8bd3155a-c198-4904-b308-1ff31e63ad2f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:48:34.432704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9678d34c-7697-41a1-ae03-cc698dc0b1f1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '.version_select at 0x7fc403240430>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:34.455411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9678d34c-7697-41a1-ae03-cc698dc0b1f1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1017941702" status: 202 len: 0 microversion: 2.1 time: 0.026656 Aug 21 01:48:34.459616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3455/6256] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1017941702 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:48:37.488134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:37.493323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fe7f41-48b5-4617-a755-6e3a01d41e9d", "tag": "7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:37.498758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:37.508504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:37.509027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:37.509502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:37.510178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:37.510634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:37.511064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:37.519038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:37.519523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:37.519955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:37.544485 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] Creating event network-changed:7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4 for instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d on n-h2-master-1 Aug 21 01:48:37.550340 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b4ce11b0-d699-4ac1-8a7a-341c16b67e11 req-2eb4932a-bc45-4b03-8ae9-07a51f380e9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060534 Aug 21 01:48:37.551465 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3456/6257] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:37.561669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:48:37.667511 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fb7e2dc8-b282-4bda-b322-9b95b56d3fd9 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 204 len: 0 microversion: 2.1 time: 0.183002 Aug 21 01:48:37.668416 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2802/6258] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:48:37 2022] DELETE /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:48:37.678207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:37.679075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:37.686391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:37.687239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:37.687914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:37.689112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:37.689806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:37.690444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:37.850726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:37.860539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b3684c7-1877-49f1-a142-07939f118455 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1669 microversion: 2.1 time: 0.186920 Aug 21 01:48:37.875453 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3457/6259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:37 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:38.883560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:38.884300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:38.892742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:38.893641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:38.894291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:38.895454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:38.896221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:38.896898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:39.136833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:39.146843 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf195d03-85f2-49db-874b-b757e564f805 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1669 microversion: 2.1 time: 0.267482 Aug 21 01:48:39.147682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2803/6260] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:38 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1669 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:40.167828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:40.173793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:40.182280 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fe7f41-48b5-4617-a755-6e3a01d41e9d", "name": "network-vif-deleted", "tag": "7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:40.194094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:40.194586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:40.195017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:40.195725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:40.196173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:40.196588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:40.200632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:40.201144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:40.201724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:40.222116 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] Creating event network-vif-deleted:7bf6b3e8-b501-4bcb-9ffd-2b55cc3a0aa4 for instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d on n-h2-master-1 Aug 21 01:48:40.228535 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5dd2bfa3-dea1-4483-a36a-81a7ab1c34e5 req-438e6498-4b4f-48fe-b59a-4eae1fae49f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049876 Aug 21 01:48:40.229513 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2804/6261] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:48:40.331169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:40.344324 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a54b440-f903-4cbc-b303-4d4d9185568a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 200 len: 1332 microversion: 2.1 time: 0.180404 Aug 21 01:48:40.345703 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3458/6262] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:40 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:41.276532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1094740280", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "99b26ce4-c2e1-4b01-8d84-f6894b89a87a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1239986217", "security_groups": [{"name": "tempest-secgroup-smoke-131231379"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:41.365765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:41.366443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: 99fe7f41-48b5-4617-a755-6e3a01d41e9d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:41.385267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:41.385894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:41.386477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:41.388296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:41.389619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:41.390966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:41.409582 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] HTTP exception thrown: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Request method failure captured: Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d HTTP/1.1 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY5kXcgYgw63H2enjIW9zYT_jSBqixqXvGbEC4JaICKoJ1xBwGHAx5FqfuRyO24U-QcpNoricpcV4d42o5iqg3SjLCu12mjDYomMYuyaKnMaDTa6Hr_TNp_-YvHBTCPiIxIFUwygKkQTQ_iAirkKEfsOpDIM_Q56Jh_SGDDyC50AVe4 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d4ba3cc14844d08a6f85bbd32823067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}] Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: f90ad477160c43d6afbdb868b89738fd Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '99fe7f41-48b5-4617-a755-6e3a01d41e9d'} Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:48:41.411809 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. Aug 21 01:48:41.417214 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:48:41.419841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Returning 404 to user: Instance 99fe7f41-48b5-4617-a755-6e3a01d41e9d could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:48:41.421437 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad165dc9-5051-4fc4-a9f6-165a3e2d553d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d" status: 404 len: 111 microversion: 2.1 time: 0.059613 Aug 21 01:48:41.426779 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3459/6263] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:41 2022] GET /compute/v2.1/servers/99fe7f41-48b5-4617-a755-6e3a01d41e9d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:48:41.442435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] validate_networks() for [('99b26ce4-c2e1-4b01-8d84-f6894b89a87a', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:48:41.662345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-031d9016-02ae-426f-ba02-2c8d49c5cfbe tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '.version_select at 0x7fc3f9d90e50>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:41.700259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-031d9016-02ae-426f-ba02-2c8d49c5cfbe tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1018256055" status: 202 len: 0 microversion: 2.1 time: 0.043604 Aug 21 01:48:41.701940 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3460/6264] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 01:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1018256055 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:48:41.937694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:48:41.938137 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:48:41.938908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:48:41.939331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:48:41.939747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:48:41.949610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:41.950102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:41.950625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:41.952928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:41.953786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:41.954728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:41.975214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:48:41.981807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Getting quotas for user 6a5f1b1c768b43be80f4e2a89694a811 and project 4d17d705402549dc94e6fdd36e917823. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:48:41.997608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:48:42.000695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:48:42.063923 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d97ef9d-76a0-4b8e-baa4-c34824616730 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793143 Aug 21 01:48:42.065773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2805/6265] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:48:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:48:42.081710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0789147f-8c75-4760-aec9-8fd415ef6ea2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:42.082582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0789147f-8c75-4760-aec9-8fd415ef6ea2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:42.207681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0789147f-8c75-4760-aec9-8fd415ef6ea2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:42.221268 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0789147f-8c75-4760-aec9-8fd415ef6ea2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1267 microversion: 2.1 time: 0.148176 Aug 21 01:48:42.222573 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3461/6266] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:42 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:43.242308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:43.243008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:43.261577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:43.261577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:43.261577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:43.266147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:43.266723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:43.267092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:43.392003 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:43.401355 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-712a0a35-a42f-449e-99c9-7c9029551af2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1319 microversion: 2.1 time: 0.162907 Aug 21 01:48:43.402666 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2806/6267] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:43 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:44.426822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:44.428465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:44.437588 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:44.440641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:44.441421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:44.442273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:44.443335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:44.444013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:44.444922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:44.852716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:44.864000 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60ffba37-f3c6-4134-94ae-e8a085d09a5f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.442124 Aug 21 01:48:44.869706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3462/6268] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:44 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:45.526543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:45.554708 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:45.555618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:45.556690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:45.557424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:45.573791 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] Creating event network-changed:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:48:45.582643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3f86329d-f18b-42c4-bd3e-135d20f61bd1 req-0968a079-92e5-4c64-b0d0-08d2a0a33c9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059657 Aug 21 01:48:45.584194 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2807/6269] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:45.885029 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:45.885871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:45.896810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:45.897598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:45.898025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:45.898725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:45.899332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:45.899744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:46.161137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:46.170257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d3cd1c4d-a87c-42d5-ab2a-c80a1e6840f2 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.289105 Aug 21 01:48:46.171122 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3463/6270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:45 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:47.193579 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:47.195021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:47.203065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:47.203811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:47.204581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:47.205474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:47.206348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:47.206932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:47.432539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:47.440631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b94825fb-ead2-44a9-9e07-e2755ba63531 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.252724 Aug 21 01:48:47.441299 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2808/6271] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:47 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:48.461919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:48.463525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:48.473056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:48.473934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:48.474606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:48.475516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:48.476159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:48.476793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:48.730266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:48.738532 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2326975c-d8b2-49ff-b22d-1b26b4057b74 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.280494 Aug 21 01:48:48.752644 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3464/6272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:48 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:49.759994 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:49.760613 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:49.768698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:49.769060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:49.769493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:49.770201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:49.770656 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:49.771078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:49.786828 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:49.999857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:50.016968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1c180a35-2f5d-4f6a-b6cf-b09efbf57b82 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.260953 Aug 21 01:48:50.018006 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2809/6273] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:49 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:51.038914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:51.039693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:51.055403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:51.056204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:51.056645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:51.057407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:51.057889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:51.058483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:51.249268 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:51.259547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-351de74b-f834-49b1-a304-8841f5cec0f9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.225743 Aug 21 01:48:51.260249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3465/6274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:51 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:51.739900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e998087d-52bb-4d52-b086-9edf1d0cea4e tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: .version_select at 0x7fc3fd155f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-881678122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEqLekuyC+6LwC4SIyfJ4Ao9B59yGr6qtNjJRWh64cQEQio6u60jkIL5Oxe+jaA82AKQ2tRWqDWpCm3lbszNn3e8xrPQ0O4OaBQKGRBEKUcNwBLQLuR4d9wfi890IjWdQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:51.758758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e998087d-52bb-4d52-b086-9edf1d0cea4e tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:48:51.766038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e998087d-52bb-4d52-b086-9edf1d0cea4e tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:48:51.800925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e998087d-52bb-4d52-b086-9edf1d0cea4e tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.064838 Aug 21 01:48:51.802041 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2810/6275] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:48:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:52.033463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "name": "network-vif-plugged", "status": "completed", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:52.054269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:52.056080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:52.056547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:52.089211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] Creating event network-vif-plugged:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:48:52.102663 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7d5b33fc-7e05-4c97-87dc-f6d4bbc6f9b6 req-94e85081-a0f3-4410-a72e-564b5ee0daa7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213767 Aug 21 01:48:52.103301 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3466/6276] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:52.283432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:52.284492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:52.295162 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:52.301612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:52.302217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:52.305326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:52.307228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:52.308555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:52.309091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:52.562677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:52.572439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cce83812-883f-48d3-a740-34cca60c2ece tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.295408 Aug 21 01:48:52.573494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2811/6277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:52 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:53.172198 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-514460626", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "31071720-7249-48c1-a86b-f6573e699d99"}], "key_name": "tempest-TestNetworkBasicOps-881678122", "security_groups": [{"name": "tempest-secgroup-smoke-1756178742"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:53.181301 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:53.295442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] validate_networks() for [('31071720-7249-48c1-a86b-f6573e699d99', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:48:53.593285 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:53.594529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:53.602329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:53.602822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:53.603259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:53.603962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:53.604571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:53.605186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:53.750448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:48:53.750873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:48:53.751348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:48:53.751756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:48:53.753313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:48:53.764930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:53.765437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:53.766098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:53.767037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:53.767643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:53.768238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:53.777849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:53.788343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30c1d778-4677-4cb1-a198-e244e7e60e90 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1392 microversion: 2.1 time: 0.199042 Aug 21 01:48:53.788578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:48:53.788970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2812/6278] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:53 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:53.795273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Getting quotas for user f90ad477160c43d6afbdb868b89738fd and project 9d4ba3cc14844d08a6f85bbd32823067. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:48:53.808476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:48:53.811162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:48:53.859850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a03fdfaa-1f2e-4267-a4de-d6b20560ed8a tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694009 Aug 21 01:48:53.860540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3467/6279] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:48:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:48:53.873663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67aaf9df-0f07-42f2-b319-2c8be36ddc22 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:53.874642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67aaf9df-0f07-42f2-b319-2c8be36ddc22 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:53.932952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67aaf9df-0f07-42f2-b319-2c8be36ddc22 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:53.941964 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67aaf9df-0f07-42f2-b319-2c8be36ddc22 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1247 microversion: 2.1 time: 0.072948 Aug 21 01:48:53.943253 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2813/6280] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:53 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:48:54.815931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:54.816959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:54.828689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:54.829207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:54.829643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:54.830366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:54.830809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:54.831218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:54.962678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:54.963403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:54.970957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:54.971732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:54.972427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:54.973408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:54.974046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:54.974689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:55.003787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:55.015930 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9c10e67-d1cc-4dab-8b86-b79ec544a631 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1564 microversion: 2.1 time: 0.208447 Aug 21 01:48:55.016441 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3468/6281] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:54 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1564 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:55.037005 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:55.037837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:55.044157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:55.044999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:55.046853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:55.047742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:55.048357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:55.048989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:55.049254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:55.060144 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b5962f9-ff1a-4036-aed5-3880a86acd2b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1317 microversion: 2.1 time: 0.101336 Aug 21 01:48:55.060821 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2814/6282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:54 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:55.206086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:55.215779 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-192603e6-2dbe-4f87-bf28-7d3072055449 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1564 microversion: 2.1 time: 0.182660 Aug 21 01:48:55.216920 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3469/6283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:55 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:56.084528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:56.085197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:56.095492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:56.096281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:56.096410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:56.101046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:56.101546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:56.101981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:56.328203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:56.336966 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-034cf14d-bb31-4557-842e-6219dc6f3388 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.256455 Aug 21 01:48:56.337877 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2815/6284] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:56 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:56.810902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599", "tag": "6c609790-bd0a-415c-83ed-c9d5580a944b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:56.826621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:56.827601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:56.828211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:56.841503 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:48:56.853088 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] Creating event network-changed:6c609790-bd0a-415c-83ed-c9d5580a944b for instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 on n-h1-master-1 Aug 21 01:48:56.858614 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e30e6e42-612f-4fe3-b26a-2ce8c1c9b188 req-085f2e61-ab2c-40a9-864e-b4f7cebc0a40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051630 Aug 21 01:48:56.859867 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3470/6285] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:57.321434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:57.322093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:57.327399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:48:57.329534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:57.330022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:57.330457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:57.331384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:57.331999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:57.332424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:57.341504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:57.342109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:57.342758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:57.356196 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] Creating event network-changed:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:48:57.361887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3c745c18-4a52-4275-b40b-c1b79e819109 req-e60dac61-1a95-4267-b30d-a330c09f8122 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041238 Aug 21 01:48:57.362984 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3471/6286] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:48:57.369336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:57.370108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:57.377127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:57.377867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:57.378306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:57.379010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:57.379458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:57.379879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:57.499797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:57.511771 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3f857dc5-e3f4-485f-b8bd-c3a6a67b3f46 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1564 microversion: 2.1 time: 0.194659 Aug 21 01:48:57.512368 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2816/6287] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:57 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1564 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:57.611602 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:57.622881 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68b4a186-1a13-4e47-afbe-fbd9e9df9274 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.258353 Aug 21 01:48:57.624552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3472/6288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:57 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:58.647944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:58.648523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:58.658498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:58.659074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:58.659507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:58.660461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:58.661157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:58.661774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:58.810639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:48:58.819134 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7352164-fa5f-4ea7-bdd3-83d62467969c tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.177129 Aug 21 01:48:58.819743 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2817/6289] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:58 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:48:59.840048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:48:59.840664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:48:59.847842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:59.848326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:59.848759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:59.849493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:48:59.849937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:48:59.850357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:48:59.995991 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:00.004384 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6873fd1d-d37a-4940-a8bd-6e4ff0211ecc tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.168555 Aug 21 01:49:00.005024 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3473/6290] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:48:59 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:01.030451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:01.032376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:01.043686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:01.044594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:01.045387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:01.046857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:01.047282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:01.047711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:01.185355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:01.193674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d3ba80e-4a87-45f8-9980-ad2045340ec5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.170053 Aug 21 01:49:01.194246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2818/6291] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:01 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:01.825439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599", "name": "network-vif-plugged", "status": "completed", "tag": "6c609790-bd0a-415c-83ed-c9d5580a944b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:01.837652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:01.838120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:01.838548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:01.850687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] Creating event network-vif-plugged:6c609790-bd0a-415c-83ed-c9d5580a944b for instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 on n-h1-master-1 Aug 21 01:49:01.855638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-68db54d2-c0dd-4050-a053-6bdc39f07b08 req-d29ff101-6d71-4951-b2d7-bcd84588bb1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Aug 21 01:49:01.856402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3474/6292] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:02.214638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:02.215272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:02.222962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:02.223369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:02.223804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:02.224500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:02.224991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:02.225432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:02.367690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:02.379246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-710dcee4-c892-415f-a135-f8ce1dc741d7 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1373 microversion: 2.1 time: 0.168348 Aug 21 01:49:02.380030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2819/6293] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:02 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:03.408154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:03.408729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:03.415662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:03.416127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:03.416590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:03.417318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:03.417776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:03.418197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:03.554940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:03.564198 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bef013e8-0044-441a-b498-4de1a37a426d tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1544 microversion: 2.1 time: 0.164022 Aug 21 01:49:03.564805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3475/6294] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:03 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:03.584928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:03.585550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:03.592797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:03.593950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:03.594349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:03.595053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:03.595510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:03.595938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:03.741064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:03.749717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d377c0a6-3c0a-4d04-b860-86e53f1fb22b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1544 microversion: 2.1 time: 0.168536 Aug 21 01:49:03.750669 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2820/6295] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:03 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1544 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:05.391223 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:05.393021 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:05.399184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599", "tag": "6c609790-bd0a-415c-83ed-c9d5580a944b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:05.409869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:05.410338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:05.410746 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:05.422803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] Creating event network-changed:6c609790-bd0a-415c-83ed-c9d5580a944b for instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 on n-h1-master-1 Aug 21 01:49:05.428176 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-42e7b71d-d736-4abf-a349-750815f49e12 req-67ccd76c-7b21-447d-bb77-c03f529a2766 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038110 Aug 21 01:49:05.429623 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3476/6296] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:27.728805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:27.732076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:27.734723 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:27.735501 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:27.736376 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=57 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:27.745031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:27.745605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:27.746230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:27.747290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:27.747934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:27.748385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:27.806261 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-53b62779-3549-4cd9-9d19-cdb1379bffab tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599/action" status: 200 len: 24567 microversion: 2.1 time: 0.083799 Aug 21 01:49:27.807067 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2821/6297] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:49:27 2022] POST /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599/action => generated 24567 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:49:28.852956 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:28.853874 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=25 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:28.858181 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:28.860493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:28.868610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:28.869125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:28.869560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:28.870243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:28.870707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:28.871126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:28.944601 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1bb489e-028c-45fc-85f4-aea295aa1700 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action" status: 200 len: 24577 microversion: 2.1 time: 0.093257 Aug 21 01:49:28.945423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3477/6298] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:49:28 2022] POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action => generated 24577 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:49:34.354342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:34.356677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:34.364406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:34.364918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:34.365352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:34.366006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:34.366485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:34.366901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:34.427365 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9427768b-2499-401c-870a-b93e520cc4da tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "POST /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599/action" status: 200 len: 32638 microversion: 2.1 time: 0.077073 Aug 21 01:49:34.428018 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2822/6299] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:49:34 2022] POST /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599/action => generated 32638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:49:35.810625 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:35.811209 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:35.819826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:35.820393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:35.821020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:35.821929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:35.822449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:35.822936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:35.823444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599", "tag": "6c609790-bd0a-415c-83ed-c9d5580a944b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:35.839490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:35.840578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:35.841152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:35.853701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:49:35.855217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] Creating event network-changed:6c609790-bd0a-415c-83ed-c9d5580a944b for instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 on n-h1-master-1 Aug 21 01:49:35.862408 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9bd2d392-c7a7-41c8-8d67-1dfb323195ad req-2910518e-e1c2-4d40-a2e7-14caee0c13d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044149 Aug 21 01:49:35.863392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2823/6300] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:35.958979 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b65679e-2199-4fd3-a7f7-7e78f8b0fbd1 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 204 len: 0 microversion: 2.1 time: 0.152391 Aug 21 01:49:35.960122 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3478/6301] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:49:35 2022] DELETE /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:49:35.970692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:35.971537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:35.978846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:35.978846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:35.979241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:35.980006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:35.980453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:35.980895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:36.175672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:36.183640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-84980143-68ca-4218-acad-281a207a2c17 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1668 microversion: 2.1 time: 0.217551 Aug 21 01:49:36.184228 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2824/6302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:35 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:37.206909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:37.207614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:37.215734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:37.216221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:37.216664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:37.217397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:37.217852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:37.218290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:37.361786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:37.370348 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-001f391a-baea-4ba5-bc3b-bf7ed9556c8b tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1668 microversion: 2.1 time: 0.167720 Aug 21 01:49:37.370854 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3479/6303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:37 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:38.205677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599", "name": "network-vif-deleted", "tag": "6c609790-bd0a-415c-83ed-c9d5580a944b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:38.218548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:38.219321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:38.219745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:38.232420 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] Creating event network-vif-deleted:6c609790-bd0a-415c-83ed-c9d5580a944b for instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 on n-h1-master-1 Aug 21 01:49:38.238765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bf03e4db-00a3-4a08-98d9-1b4890a917eb req-4aac1879-dec9-4afa-aeb6-5e72dbc48975 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Aug 21 01:49:38.239386 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2825/6304] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:38.392233 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:38.393707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:38.403440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:38.403923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:38.404365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:38.405125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:38.405583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:38.406075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:38.438333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:38.438725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:38.439155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:38.439636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lazy-loading 'fault' on Instance uuid ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:49:38.483463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90ad477160c43d6afbdb868b89738fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4ba3cc14844d08a6f85bbd32823067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:38.492183 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa274762-6b65-4adf-b4da-425ae4a409c8 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 200 len: 1337 microversion: 2.1 time: 0.104030 Aug 21 01:49:38.493245 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3480/6305] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:38 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:39.518885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:39.519829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] [instance: ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:39.530849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:39.531583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:39.532515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:39.533608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:39.534060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:39.534482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:39.548190 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] HTTP exception thrown: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Request method failure captured: Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 HTTP/1.1 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY5kXcgYgw63H2enjIW9zYT_jSBqixqXvGbEC4JaICKoJ1xBwGHAx5FqfuRyO24U-QcpNoricpcV4d42o5iqg3SjLCu12mjDYomMYuyaKnMaDTa6Hr_TNp_-YvHBTCPiIxIFUwygKkQTQ_iAirkKEfsOpDIM_Q56Jh_SGDDyC50AVe4 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9d4ba3cc14844d08a6f85bbd32823067", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9d4ba3cc14844d08a6f85bbd32823067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9d4ba3cc14844d08a6f85bbd32823067"}]}] Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestNetworkBasicOps-71652139 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 9d4ba3cc14844d08a6f85bbd32823067 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestNetworkBasicOps-71652139 Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: f90ad477160c43d6afbdb868b89738fd Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestNetworkBasicOps-71652139-project Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599'} Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:49:39.549897 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Returning 404 to user: Instance ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f95e2af-a303-48ba-b2a6-3ee7ad202cf5 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599" status: 404 len: 111 microversion: 2.1 time: 0.039768 Aug 21 01:49:39.554420 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2826/6306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:39 2022] GET /compute/v2.1/servers/ea7eb669-04d1-4c8a-a2d2-fe88b4a9e599 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:49:39.718313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4b05e23-61a4-4df0-9198-693dc90e1105 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] Calling method '.version_select at 0x7fc4032479d0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:39.738585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4b05e23-61a4-4df0-9198-693dc90e1105 tempest-TestNetworkBasicOps-71652139 tempest-TestNetworkBasicOps-71652139-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-881678122" status: 202 len: 0 microversion: 2.1 time: 0.024378 Aug 21 01:49:39.739180 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3481/6307] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-881678122 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:49:47.214047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-5636238", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5f8acde3-04d0-4a91-9899-3be1537e3b48"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:47.270703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] validate_networks() for [('5f8acde3-04d0-4a91-9899-3be1537e3b48', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:49:47.653531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:49:47.653959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:49:47.654435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:49:47.654844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:49:47.655264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:49:47.666122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:47.666602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:47.667056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:47.667766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:47.668267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:47.668629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:47.686559 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Getting quotas for project 05989576d0d24f10836a22a6586c9f6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:49:47.692126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Getting quotas for user 4d6d757cd16a4ba494c903a3d17df919 and project 05989576d0d24f10836a22a6586c9f6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:49:47.705219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:49:47.707806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:49:47.757838 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de0dc784-4a6d-4a4e-a34d-acd4daea486c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680197 Aug 21 01:49:47.758476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2827/6308] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:49:47.770788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-481750a8-980b-4393-81d2-8cfdc0db934c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:47.771403 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-481750a8-980b-4393-81d2-8cfdc0db934c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:47.827245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-481750a8-980b-4393-81d2-8cfdc0db934c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:47.834546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-481750a8-980b-4393-81d2-8cfdc0db934c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1212 microversion: 2.1 time: 0.068896 Aug 21 01:49:47.834951 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3482/6309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:47 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:48.856190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:48.857063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:48.865839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:48.866441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:48.866978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:48.867775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:48.868649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:48.869595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:48.944992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:48.953000 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be8f79d7-88bd-40bb-8722-c9722902beeb tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1272 microversion: 2.1 time: 0.101678 Aug 21 01:49:48.953571 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2828/6310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:48 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:49.975132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:49.975750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:49.977914 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:49.984424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:49.984933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:49.985412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:49.986133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:49.986579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:49.987001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:50.185516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:50.194605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7d201f9-d6a6-439b-80e5-79a46dc0e8c2 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.223475 Aug 21 01:49:50.195424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3483/6311] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:49 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:50.261311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089f37a6-7806-443a-9021-222a75960918", "tag": "4f82337b-f392-4f96-97f4-d701d85b33fc"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:50.273326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:50.274139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:50.274576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:50.287442 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] Creating event network-changed:4f82337b-f392-4f96-97f4-d701d85b33fc for instance 089f37a6-7806-443a-9021-222a75960918 on n-h2-master-1 Aug 21 01:49:50.292722 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-65efaecf-f064-442b-b593-80f6fdf9d159 req-c26509a7-257e-425a-9d0c-b783c23d0bb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035513 Aug 21 01:49:50.293398 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2829/6312] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:51.216235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:51.216871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:51.224289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:51.224797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:51.225390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:51.226080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:51.226550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:51.226965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:51.373866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:51.382525 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-01c11700-8fe9-4b53-bee1-6b60b8d55bd1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.170643 Aug 21 01:49:51.383138 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3484/6313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:51 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:52.410564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:52.411149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:52.418323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:52.418806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:52.419239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:52.419946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:52.420400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:52.420823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:52.563669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:52.571564 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd287799-f613-4864-abfd-89a422ea8796 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.169345 Aug 21 01:49:52.572138 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2830/6314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:52 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:53.597227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:53.597227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:53.608283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:53.609193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:53.609998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:53.611183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:53.611936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:53.613241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:53.747784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:53.756695 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4310409-6574-42f3-8e4f-4e500bbc470c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.167315 Aug 21 01:49:53.757306 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3485/6315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:53 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:54.777631 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:54.778253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:54.786783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:54.787406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:54.787981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:54.789008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:54.789549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:54.790158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:54.947809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:54.959334 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a57aad1f-e029-4ab1-bbec-4d4372f4cb3c tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.185615 Aug 21 01:49:54.959919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2831/6316] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:54 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:55.776383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089f37a6-7806-443a-9021-222a75960918", "name": "network-vif-plugged", "status": "completed", "tag": "4f82337b-f392-4f96-97f4-d701d85b33fc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:55.788383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:55.788999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:55.789452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:55.801227 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] Creating event network-vif-plugged:4f82337b-f392-4f96-97f4-d701d85b33fc for instance 089f37a6-7806-443a-9021-222a75960918 on n-h2-master-1 Aug 21 01:49:55.806414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6009d2dc-507c-4cfa-b225-2f6bb7376d91 req-89fc05af-2c7e-45ae-b88a-39579b721790 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Aug 21 01:49:55.807083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3486/6317] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:49:55.979918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:55.980511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:55.987708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:55.988194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:55.988657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:55.989533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:55.990309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:55.990743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:56.137185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:56.147717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-411e7b27-4c6e-4d1d-b799-90b1cabf3ab3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.171592 Aug 21 01:49:56.148364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2832/6318] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:55 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:57.170656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:57.171423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:57.178194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:57.178700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:57.179134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:57.179833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:57.180264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:57.180683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:57.327347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:57.335508 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6fddc220-3ca1-4467-b192-c69515fbd217 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1312 microversion: 2.1 time: 0.170330 Aug 21 01:49:57.336087 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3487/6319] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:57 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:58.362515 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:58.363904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:58.367975 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.369145 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.370733 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.381209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.381718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.382152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.382845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.383293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.383714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.387031 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=49 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.525196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:58.537027 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22a19fe4-2652-46b4-b37a-87ba73d9d71e tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1500 microversion: 2.1 time: 0.180737 Aug 21 01:49:58.537867 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2833/6320] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:58 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:58.562196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:58.562755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:58.564815 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.571903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.572380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.572795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.573504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.573955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.574371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.716672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:58.725274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c9b6051b-b57c-48a5-869f-16c12c72213a tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1500 microversion: 2.1 time: 0.166869 Aug 21 01:49:58.725773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3488/6321] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:58 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:58.750235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:58.750775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:58.757544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.758032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.758495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.759194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.759647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.760074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.784081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lazy-loading 'flavor' on Instance uuid 089f37a6-7806-443a-9021-222a75960918 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:49:58.863042 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-013b562e-88d4-495a-84b7-05446cf4413f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action" status: 202 len: 0 microversion: 2.1 time: 0.116333 Aug 21 01:49:58.864337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2834/6322] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:49:58 2022] POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:49:58.873044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:58.873659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:58.875516 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:49:58.881730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.882320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.882779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:58.883483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:58.883930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:58.884419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.033215 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:59.042135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f3a9abfb-23fd-4b7e-bfd2-5b2bde89d536 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1508 microversion: 2.1 time: 0.173243 Aug 21 01:49:59.042719 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3489/6323] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:58 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:49:59.480508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:49:59.485188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:59.494333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.494796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.495234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.495927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.496382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.496796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.578624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:49:59.579049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:49:59.579525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:49:59.579933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:49:59.580342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:49:59.648722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:59.655975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.656462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.656968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.657746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.658230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.658649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.686512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67a051aa-3269-42d0-a594-5dc862c15e02 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action" status: 202 len: 1138 microversion: 2.1 time: 0.213352 Aug 21 01:49:59.687411 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2835/6324] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:49:59 2022] POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action => generated 1138 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 21 01:49:59.707378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:49:59.708412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:49:59.716125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.716835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.717301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.718078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:49:59.718627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:49:59.719181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:49:59.870067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:49:59.878606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fbfe92da-a977-4d79-8eae-17a8e89fa2b8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.175651 Aug 21 01:49:59.879200 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3490/6325] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:49:59 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:50:00.071504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:00.072129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:00.078814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.079303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.079742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.080444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.080938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.081365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.232460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:00.241154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fea868b0-4bde-443d-b2a5-2c19b24983e8 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1491 microversion: 2.1 time: 0.173652 Aug 21 01:50:00.241729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2836/6326] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:00 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1491 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:00.261838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:00.262380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:00.268718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.269624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.270135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.270840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.271298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.271726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.356068 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06d22a22-627e-481b-8dea-f70438f1d32d tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action" status: 202 len: 0 microversion: 2.1 time: 0.097739 Aug 21 01:50:00.356986 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3491/6327] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:50:00 2022] POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:50:00.367758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:00.368379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:00.375479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.375956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.376479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.377280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.378627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.379129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.528709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:00.537469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0588cc4c-7c86-4a57-ab7f-5b2da7071de1 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1497 microversion: 2.1 time: 0.174041 Aug 21 01:50:00.538136 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2837/6328] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:00 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:00.904622 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:00.905423 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:00.916757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.917283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.917744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:00.918457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:00.918910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:00.919321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:01.063826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:01.072393 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7524fda0-c11e-40fe-94a5-4b19f79f024b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.175495 Aug 21 01:50:01.073023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3492/6329] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:00 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:01.561193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:01.562181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:01.572850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:01.573582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:01.574194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:01.575198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:01.575868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:01.576499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:01.744786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:01.752845 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-01198833-0f6d-481e-972f-93d5d620b900 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1497 microversion: 2.1 time: 0.197768 Aug 21 01:50:01.753418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2838/6330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:01 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:02.094032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:02.094634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:02.102821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.103339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.103743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.104741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.105282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.105744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.254686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:02.263223 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-236c1fd3-b879-4b23-aa4a-2661e1a60008 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.173928 Aug 21 01:50:02.263778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3493/6331] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:02 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:02.774249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:02.774817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:02.782095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.782575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.783009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.783713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.784164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.784589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.934411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:02.945428 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-246d4236-037b-4002-b1cc-0080b43ace12 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1500 microversion: 2.1 time: 0.175363 Aug 21 01:50:02.946004 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2839/6332] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:02 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:02.966073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:02.966600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:02.973154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.973630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.974159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.974907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:02.975346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:02.975765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:02.999905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lazy-loading 'flavor' on Instance uuid 089f37a6-7806-443a-9021-222a75960918 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:50:03.076708 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15cc60b7-1600-4b63-a2a4-622fa95aa54f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action" status: 202 len: 0 microversion: 2.1 time: 0.114165 Aug 21 01:50:03.077552 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3494/6333] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:50:02 2022] POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:50:03.091913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:03.093238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:03.102161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:03.102981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:03.104134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:03.105289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:03.105881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:03.106353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:03.242159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:03.257902 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f39bb4ad-1ac8-4d82-a575-1fff87e3c8cc tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1508 microversion: 2.1 time: 0.173374 Aug 21 01:50:03.258486 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2840/6334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:03 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:03.288065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:03.288759 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:03.295217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:03.295698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:03.296132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:03.296846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:03.297297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:03.297716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:03.438724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:03.447185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-540d9a2c-b8b5-4ddb-b5dc-b92dbd85b075 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.164391 Aug 21 01:50:03.447773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3495/6335] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:03 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:04.288229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:04.288831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:04.296377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.296925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.301096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.301096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.301096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.301096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.450845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:04.458930 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9120efc2-f40a-4f0a-9223-de8bedfec7d9 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1491 microversion: 2.1 time: 0.176721 Aug 21 01:50:04.459496 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2841/6336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:04 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1491 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:04.467557 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:04.468172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:04.475648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.476139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.476573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.477295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.477762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.478188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.480966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:04.481513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:04.487965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.488420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.488892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.489650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.490240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.490953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.567001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-654a53b2-4119-4740-be6c-3f00ee41a19f tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action" status: 202 len: 0 microversion: 2.1 time: 0.090795 Aug 21 01:50:04.567778 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2842/6337] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:50:04 2022] POST /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:50:04.577517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:04.578240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:04.585283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.585903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.586346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.587051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:04.587497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:04.587956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:04.618561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:04.627081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-489fa760-3e35-4d7a-b353-1d0a33c673e8 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.163366 Aug 21 01:50:04.627955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3496/6338] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:04 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:04.722475 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:04.733283 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7108329-0611-4ded-9430-992953105f09 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1497 microversion: 2.1 time: 0.160943 Aug 21 01:50:04.734055 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2843/6339] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:04 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:05.651844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:05.652701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:05.662935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:05.663418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:05.663861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:05.664553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:05.665039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:05.665470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:05.687463 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:05.754666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:05.755299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:05.762823 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:05.763325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:05.763729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:05.764429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:05.764904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:05.765321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:05.802827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:05.811585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7123c8e4-f7ea-4fdf-b09e-81b7cce64e2b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.165317 Aug 21 01:50:05.812372 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3497/6340] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:05 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:05.904071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:05.911979 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b726a5e-d6c3-44df-b2ad-8899424d96e7 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1497 microversion: 2.1 time: 0.161204 Aug 21 01:50:05.912561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2844/6341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:05 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:06.837130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:06.837817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:06.845802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:06.846343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:06.846830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:06.847605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:06.848120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:06.848597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:06.942008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:06.942627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:06.950010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:06.950500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:06.950947 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:06.951677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:06.952214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:06.952641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:06.955535 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:06.988962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:06.997009 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e22fc40f-8e14-40a9-9d27-a7eaa7cdedb7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.166147 Aug 21 01:50:06.997593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3498/6342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:06 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:07.093016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:07.101094 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-21d71d79-6460-4baa-9444-9bdee3cfe4f3 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1500 microversion: 2.1 time: 0.164274 Aug 21 01:50:07.101882 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2845/6343] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:06 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:07.123953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:07.124692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:07.132049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:07.132571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:07.133051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:07.133763 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:07.134255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:07.134704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:07.161126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:50:07.253280 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e77b649f-5faa-4671-bd1d-d43a45ecfd57 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "DELETE /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 204 len: 0 microversion: 2.1 time: 0.135010 Aug 21 01:50:07.253924 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3499/6344] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:50:07 2022] DELETE /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:50:07.262597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:07.263226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:07.269821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:07.270309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:07.270815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:07.271598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:07.272055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:07.272507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:07.425144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:07.436628 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ecce859-9004-4944-a770-fa542b52a359 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1506 microversion: 2.1 time: 0.177706 Aug 21 01:50:07.437498 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2846/6345] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:07 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:08.024716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:08.025902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:08.036063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:08.036543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:08.037020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:08.037795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:08.038251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:08.038662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:08.235328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:08.245908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-396ffab1-ef0b-41db-a837-afe7bf361e28 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.230687 Aug 21 01:50:08.246773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3500/6346] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:08 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:08.467977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:08.468691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:08.477352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:08.477982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:08.478575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:08.479402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:08.479961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:08.480558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:08.641678 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:08.650315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c498a857-246c-46c0-9098-3c5f8850579b tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1506 microversion: 2.1 time: 0.187066 Aug 21 01:50:08.650887 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2847/6347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:08 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:09.268548 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:09.269192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:09.277467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:09.277957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:09.278395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:09.279103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:09.279552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:09.280011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:09.518076 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:09.526483 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33d37a14-44ca-43d5-8b82-6cecdcaf3b47 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.262342 Aug 21 01:50:09.527088 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3501/6348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:09 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:09.671802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:09.672505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:09.680292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:09.680870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:09.681386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:09.682197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:09.682686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:09.683530 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:09.820405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6d757cd16a4ba494c903a3d17df919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05989576d0d24f10836a22a6586c9f6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:09.830777 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f482a47-298c-446e-9966-1ed0ff8c1e13 tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 200 len: 1506 microversion: 2.1 time: 0.162896 Aug 21 01:50:09.832303 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2848/6349] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:09 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:09.885488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089f37a6-7806-443a-9021-222a75960918", "name": "network-vif-deleted", "tag": "4f82337b-f392-4f96-97f4-d701d85b33fc"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:09.896162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:09.896679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:09.897079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:09.908696 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] Creating event network-vif-deleted:4f82337b-f392-4f96-97f4-d701d85b33fc for instance 089f37a6-7806-443a-9021-222a75960918 on n-h2-master-1 Aug 21 01:50:09.914358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9752a902-d844-4996-a1c9-e4f159bdd594 req-9b8f8c9c-c36a-4075-9498-807ed6b2ef82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Aug 21 01:50:09.915188 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3502/6350] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:10.547909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:10.548544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:10.555584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:10.556066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:10.556497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:10.557225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:10.557676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:10.558094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:10.709293 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:10.720964 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd23a209-dc7a-439a-9f41-17af7e7e4c0a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.176579 Aug 21 01:50:10.721898 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2849/6351] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:10 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:10.854928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:10.855644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] [instance: 089f37a6-7806-443a-9021-222a75960918] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:10.862296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:10.862774 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:10.863200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:10.863915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:10.864358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:10.864792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:10.878213 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] HTTP exception thrown: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Request method failure captured: Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 HTTP/1.1 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY85AC1oP99td9UlE0pCB8hLy1fPLNXxBeT_QfBx6-7v6-DpvF1ijYHlksB6FQ1c4Sp51Ov4N_xmO-byTWOtmj87FCWcBC4N0Bwypt0NES2IBh4gj-59bK5C1uwTdVUW4kZvIV5z_K_KhpBMR84wjgwpcn4FWIPfhD78-S0e8G6RXJ0 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 05989576d0d24f10836a22a6586c9f6f Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestServerAdvancedOps-7111949 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05989576d0d24f10836a22a6586c9f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_05989576d0d24f10836a22a6586c9f6f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/05989576d0d24f10836a22a6586c9f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/05989576d0d24f10836a22a6586c9f6f"}]}] Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestServerAdvancedOps-7111949 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 05989576d0d24f10836a22a6586c9f6f Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestServerAdvancedOps-7111949 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestServerAdvancedOps-7111949-project Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 4d6d757cd16a4ba494c903a3d17df919 Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestServerAdvancedOps-7111949-project Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '089f37a6-7806-443a-9021-222a75960918'} Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:10.879859 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] Returning 404 to user: Instance 089f37a6-7806-443a-9021-222a75960918 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f5e328f-94fd-4bbe-b188-a014f78c2cdd tempest-TestServerAdvancedOps-7111949 tempest-TestServerAdvancedOps-7111949-project] 10.222.0.46 "GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918" status: 404 len: 111 microversion: 2.1 time: 0.032056 Aug 21 01:50:10.885260 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3503/6352] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:10 2022] GET /compute/v2.1/servers/089f37a6-7806-443a-9021-222a75960918 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:50:11.750542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:11.751150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:11.758273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:11.758757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:11.759388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:11.760377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:11.760877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:11.761847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:11.902481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:11.910948 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7b93443-a36e-4026-8f4a-2ed42a4639fc tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.164321 Aug 21 01:50:11.911534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2850/6353] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:11 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:12.932633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:12.933449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:12.940345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:12.940930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:12.941367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:12.942067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:12.942515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:12.942940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:13.093203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:13.101150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5520db38-f56e-41b9-9231-e21708757bb5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.172578 Aug 21 01:50:13.101752 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3504/6354] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:12 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:14.123837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:14.124461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:14.137974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:14.138468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:14.138916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:14.139669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:14.140322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:14.140733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:14.286492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:14.294826 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-460e3116-dbc2-4484-9e35-c6d1dfc1a492 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.175889 Aug 21 01:50:14.295661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2851/6355] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:14 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:15.318032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:15.323725 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:15.333258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:15.335442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:15.335891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:15.336630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:15.341602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:15.342348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:15.503938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:15.514949 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3fd333b8-1c0d-41f2-8646-5c57857824f3 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1692 microversion: 2.1 time: 0.202184 Aug 21 01:50:15.515816 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3505/6356] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:15 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1692 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:16.791096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:16.791771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:16.810150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:16.810641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:16.811082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:16.811806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:16.812456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:16.812991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:17.062261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:17.070566 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63739808-fa62-44ed-bda3-5ac1c22ba72a tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1710 microversion: 2.1 time: 0.537050 Aug 21 01:50:17.071548 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2852/6357] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:16 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1710 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:18.096017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:18.096630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:18.104350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:18.104912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:18.105345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:18.106052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:18.106496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:18.106914 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:18.245057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:18.253763 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1318b11-3e33-441f-8d3e-dca2450f0f48 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1698 microversion: 2.1 time: 0.161921 Aug 21 01:50:18.269107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3506/6358] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:18 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:19.280013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:19.281441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:19.294248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:19.295220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:19.295767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:19.296722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:19.297396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:19.298069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:19.584389 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:19.593122 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-016c7c46-800a-4804-b4cb-2201314f5fa9 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1698 microversion: 2.1 time: 0.319230 Aug 21 01:50:19.593987 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2853/6359] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:19 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1698 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:20.615882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:20.616651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:20.628823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:20.629369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:20.629864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:20.630802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:20.631355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:20.631942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:20.794985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:20.813033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ae5683ea-c4e6-41ba-a625-76edf0386bf5 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1698 microversion: 2.1 time: 0.197156 Aug 21 01:50:20.824795 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3507/6360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:20 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1698 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:20.936304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:20.937401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:20.951048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:20.951869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:20.954579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:20.955497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:20.957646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:20.958284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:21.013142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:50:21.180595 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1b9a70e8-af49-4621-8917-19c1349b791c tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "DELETE /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 204 len: 0 microversion: 2.1 time: 0.249259 Aug 21 01:50:21.181635 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2854/6361] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:50:20 2022] DELETE /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:50:21.191271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:21.192157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:21.217961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:21.228216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:21.229696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:21.230916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:21.233980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:21.237249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:21.545841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:21.554983 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-346c97e3-c40d-4c1d-99fe-4a73641508ba tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1733 microversion: 2.1 time: 0.368451 Aug 21 01:50:21.565486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3508/6362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:21 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1733 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:21.840550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:21.841284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:21.859212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:21.859903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:21.860825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:21.861755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:21.862381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:21.862954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:22.159262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:22.169706 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3a9a8fa-c32d-4f05-9149-598905fef53f tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1683 microversion: 2.1 time: 0.332915 Aug 21 01:50:22.175154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2855/6363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:21 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1683 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:22.958462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:22.959226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:22.969405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:22.974678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:22.975255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:22.976136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:22.977397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:22.979143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:23.206761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:23.216114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e845ba4-1719-4e9b-bd0a-fea79bf84d2e tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1733 microversion: 2.1 time: 0.641837 Aug 21 01:50:23.232036 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3509/6364] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:22 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1733 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:24.239547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:24.240161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:24.265114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.266116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.266842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.267829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.268503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.269156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.341278 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:24.344094 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:50:24.344094 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 01:50:24.345672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.346974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.347891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.349135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.349806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.350224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.369400 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:24.380115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-102f9fee-6534-4567-b808-942759795880 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.127473 Aug 21 01:50:24.381344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3510/6365] 10.222.0.46 () {58 vars in 1185 bytes} [Sun Aug 21 01:50:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:50:24.389738 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12563215-a5e8-446c-b550-8be43fa3deca tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1665 microversion: 2.1 time: 0.146693 Aug 21 01:50:24.390631 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2856/6366] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:24 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:24.485376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "name": "network-vif-plugged", "status": "completed", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:24.517045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.517548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.519355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.549423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-298108561", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "4d64f9aa-226b-4937-9632-ebac82d59c8e"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:24.549679 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] Creating event network-vif-plugged:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:50:24.556165 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-939e8595-fce4-4127-b717-4f60d89a2553 req-0c9c4432-eeec-4cab-bad1-ffd5fecdf5c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078381 Aug 21 01:50:24.557767 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3511/6367] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:24.671771 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] validate_networks() for [('4d64f9aa-226b-4937-9632-ebac82d59c8e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:50:24.858882 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85893e01-a4d1-4c26-9964-6f2306713b5a", "name": "network-vif-deleted", "tag": "3d261361-facb-4838-9c77-08fe6316f95c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:24.899190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:24.900003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:24.904354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:24.932529 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] Creating event network-vif-deleted:3d261361-facb-4838-9c77-08fe6316f95c for instance 85893e01-a4d1-4c26-9964-6f2306713b5a on n-h1-master-1 Aug 21 01:50:24.949585 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-80fc16ea-39f3-4edc-b9f5-eb3e3fe6d560 req-2618f2ed-140a-459e-ab06-0276d823d12f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099767 Aug 21 01:50:24.950331 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3512/6368] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:50:25.231741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:50:25.232142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:50:25.232611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:50:25.233110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:50:25.233491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:50:25.249847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:25.250416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:25.250761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:25.251491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:25.251940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:25.252377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:25.302907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Getting quotas for project 8dac24bfe0f9493a885a80bfa0bf0cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:50:25.314562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Getting quotas for user c0d2fa0c02f946f4b91109857abd7e22 and project 8dac24bfe0f9493a885a80bfa0bf0cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:50:25.334374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:50:25.337435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:50:25.390066 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f7cf3ba-5243-445d-b6f4-7daaa67938bc tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844397 Aug 21 01:50:25.390727 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2857/6369] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:50:25.402663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c3588de-ca7f-4c47-95ce-d2846ef057cd tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:25.403380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c3588de-ca7f-4c47-95ce-d2846ef057cd tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:25.418041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:25.419171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:25.427439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:25.428025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:25.429228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:25.431438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:25.431984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:25.432598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:25.476241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:25.477795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:25.478482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:25.478621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c3588de-ca7f-4c47-95ce-d2846ef057cd tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1328 microversion: 2.1 time: 0.078861 Aug 21 01:50:25.479345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lazy-loading 'fault' on Instance uuid 85893e01-a4d1-4c26-9964-6f2306713b5a {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:50:25.495093 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3513/6370] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:25 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:25.554454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89ec4d04ba54e54a1d844a3566f3821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8b7791cd2474b4a8bbfc8f9a069024e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:50:25.563957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fcb8a7e6-873f-4e60-a0e4-2854496807fd tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 200 len: 1388 microversion: 2.1 time: 0.150999 Aug 21 01:50:25.577927 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2858/6371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:25 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:50:26.507571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:26.508192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:26.516361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:26.516834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:26.517521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:26.518218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:26.518672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:26.519093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:26.588527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:26.589135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:26.596824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7c39aed-cebc-44af-a238-6df647b14fa8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1415 microversion: 2.1 time: 0.093063 Aug 21 01:50:26.597645 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3514/6372] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:26 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1415 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:26.601817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:26.602304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:26.602732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:26.603434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:26.603883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:26.604299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:26.624511 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] HTTP exception thrown: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Request method failure captured: Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a HTTP/1.1 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY4mtExFAPcpJk7_SQyDgCOGvZZo5-S2YwOzTza3q9hyRKZykwvMtFcNmzFL3VxruKQbZHUui0roPTmyCAEL6eXygq0rTiqHUekt5WrrPSL_kfQjnMKNDMdPXZCkoIrE9xTAp2AEeDfde2zmyxYT3qgjxZrDn_Kz7E3utTuzCdMOUnk Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8b7791cd2474b4a8bbfc8f9a069024e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}] Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestServerBasicOps-596136794 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c89ec4d04ba54e54a1d844a3566f3821 Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '85893e01-a4d1-4c26-9964-6f2306713b5a'} Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:26.626193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:26.630784 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:26.631918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Returning 404 to user: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:26.633271 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0462c563-3640-4b7d-996b-cbbd2e11d9c2 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 404 len: 111 microversion: 2.1 time: 0.049451 Aug 21 01:50:26.634370 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2859/6373] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:26 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:50:27.161627 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:27.162143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:27.169530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.170021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.170459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.171167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.171608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.172025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.187465 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] HTTP exception thrown: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Request method failure captured: Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a HTTP/1.1 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY4mtExFAPcpJk7_SQyDgCOGvZZo5-S2YwOzTza3q9hyRKZykwvMtFcNmzFL3VxruKQbZHUui0roPTmyCAEL6eXygq0rTiqHUekt5WrrPSL_kfQjnMKNDMdPXZCkoIrE9xTAp2AEeDfde2zmyxYT3qgjxZrDn_Kz7E3utTuzCdMOUnk Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8b7791cd2474b4a8bbfc8f9a069024e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}] Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c89ec4d04ba54e54a1d844a3566f3821 Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '85893e01-a4d1-4c26-9964-6f2306713b5a'} Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:27.189881 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Returning 404 to user: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d6b5374-3a38-4694-93bd-ffd64a9861fe tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "DELETE /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 404 len: 111 microversion: 2.1 time: 0.035603 Aug 21 01:50:27.194827 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3515/6374] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:50:27 2022] DELETE /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 21 01:50:27.201658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:27.202373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] [instance: 85893e01-a4d1-4c26-9964-6f2306713b5a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:27.212589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.212949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.213385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.214084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.214525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.215198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.237177 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] HTTP exception thrown: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Request method failure captured: Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a HTTP/1.1 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY4mtExFAPcpJk7_SQyDgCOGvZZo5-S2YwOzTza3q9hyRKZykwvMtFcNmzFL3VxruKQbZHUui0roPTmyCAEL6eXygq0rTiqHUekt5WrrPSL_kfQjnMKNDMdPXZCkoIrE9xTAp2AEeDfde2zmyxYT3qgjxZrDn_Kz7E3utTuzCdMOUnk Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a8b7791cd2474b4a8bbfc8f9a069024e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a8b7791cd2474b4a8bbfc8f9a069024e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a8b7791cd2474b4a8bbfc8f9a069024e"}]}] Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a8b7791cd2474b4a8bbfc8f9a069024e Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestServerBasicOps-596136794 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c89ec4d04ba54e54a1d844a3566f3821 Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestServerBasicOps-596136794-project Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '85893e01-a4d1-4c26-9964-6f2306713b5a'} Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:27.238769 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Returning 404 to user: Instance 85893e01-a4d1-4c26-9964-6f2306713b5a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea0cb07d-6071-4bf1-809e-1de277bd16c0 tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a" status: 404 len: 111 microversion: 2.1 time: 0.042980 Aug 21 01:50:27.246088 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2860/6375] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:27 2022] GET /compute/v2.1/servers/85893e01-a4d1-4c26-9964-6f2306713b5a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:50:27.623692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:27.625134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:27.633278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.633864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.634378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.635234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:27.635769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:27.636511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:27.656721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ee06c70-ba2d-4189-a916-7329be3e874a tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] Calling method '.version_select at 0x7fc3fd9c60d0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:27.692315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ee06c70-ba2d-4189-a916-7329be3e874a tempest-TestServerBasicOps-596136794 tempest-TestServerBasicOps-596136794-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1062857870" status: 202 len: 0 microversion: 2.1 time: 0.039469 Aug 21 01:50:27.694364 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2861/6376] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 01:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1062857870 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 01:50:27.918337 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-faa288ea-5796-47c8-a2f5-b09042bea212 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.298069 Aug 21 01:50:27.933114 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3516/6377] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:27 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:28.338494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171f40ba-d001-4e0b-a3b6-c1d17770be72", "tag": "f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:28.355463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:28.355940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:28.356312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:28.367974 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] Creating event network-changed:f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364 for instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 on n-h2-master-1 Aug 21 01:50:28.373469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c42f1c94-17c5-45d6-bab5-2afd93366b4e req-90300618-2563-45dc-a1f0-0aad800061a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138072 Aug 21 01:50:28.374299 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2862/6378] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:28.941173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:28.945264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:28.947427 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:28.953367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:28.953945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:28.954504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:28.955295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:28.955757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:28.956173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:28.979534 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:29.102276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c084cef9-ea0e-495c-874e-d38f65ab966a tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.166136 Aug 21 01:50:29.102855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3517/6379] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:28 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:30.124647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:30.131076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:30.133421 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:30.139662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:30.140423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:30.141072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:30.141960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:30.143231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:30.143859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:30.164947 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:30.298901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36cf6f51-1e30-4282-ae12-ff5d5f123e27 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.179324 Aug 21 01:50:30.299506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2863/6380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:30 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:31.323840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:31.326506 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:31.335166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:31.335934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:31.336602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:31.337600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:31.339157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:31.339646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:31.594605 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-27272ee4-eab7-4b57-8a97-e506ac6377f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.278039 Aug 21 01:50:31.596235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3518/6381] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:31 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:32.615922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:32.616458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:32.623761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:32.624232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:32.624664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:32.625399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:32.625847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:32.626268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:32.764021 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afc8189c-7c1a-49db-880d-48a3a619522f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.152077 Aug 21 01:50:32.764969 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2864/6382] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:32 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:33.786007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:33.786795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:33.794316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:33.794861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:33.795497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:33.796313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:33.796980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:33.797710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:34.024786 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a0a22ae-a78b-438e-b3e8-9b207f58f660 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.242776 Aug 21 01:50:34.025878 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3519/6383] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:33 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:34.051208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171f40ba-d001-4e0b-a3b6-c1d17770be72", "name": "network-vif-plugged", "status": "completed", "tag": "f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:34.065037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:34.065590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:34.066456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:34.079616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] Creating event network-vif-plugged:f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364 for instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 on n-h2-master-1 Aug 21 01:50:34.086176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-392f4b97-03a0-4458-a108-3243602030ea req-3955e52f-73ad-44a3-b632-e1794699f142 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039279 Aug 21 01:50:34.086888 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2865/6384] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:35.045642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:35.046340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:35.048283 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:35.054595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:35.055146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:35.055646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:35.056427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:35.056920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:35.057325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:35.194823 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2113e347-82ff-42e6-bf15-c0ca469f5799 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1463 microversion: 2.1 time: 0.152822 Aug 21 01:50:35.209083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3520/6385] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:35 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1463 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:36.215522 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:36.217713 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:36.222735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:36.223574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:36.232501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.233156 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.233673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.234503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.235054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.235574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.393870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ba6fbdd-d6fc-4efa-a696-363cd73d52e4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1648 microversion: 2.1 time: 0.180535 Aug 21 01:50:36.396417 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2866/6386] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:36 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1648 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:36.415555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:36.416902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:36.419283 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:36.426467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.427134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.427666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.428484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.429092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.429611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.709590 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2038e5b-99a9-403f-8e33-1faa67a9d4ee tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1648 microversion: 2.1 time: 0.297818 Aug 21 01:50:36.710486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3521/6387] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:36 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1648 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:36.730927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:36.731741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:36.738255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.738996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.739430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.740133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:36.740580 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:36.741033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:36.883306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-439c79e9-cbf8-4f23-9484-e5f13bdd15f2 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1648 microversion: 2.1 time: 0.156146 Aug 21 01:50:36.884260 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2867/6388] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:36 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1648 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:36.999845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1867263840", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "4d64f9aa-226b-4937-9632-ebac82d59c8e"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:37.064402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] validate_networks() for [('4d64f9aa-226b-4937-9632-ebac82d59c8e', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:50:37.477420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:50:37.478053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:50:37.478309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:50:37.478712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:50:37.479117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:50:37.488854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:37.489329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:37.489754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:37.490472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:37.490913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:37.491326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:37.510264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Getting quotas for project 8dac24bfe0f9493a885a80bfa0bf0cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:50:37.516408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Getting quotas for user c0d2fa0c02f946f4b91109857abd7e22 and project 8dac24bfe0f9493a885a80bfa0bf0cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:50:37.530836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:50:37.533235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:50:37.582494 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8dee0020-30d6-4fdd-9a1a-513c2e622bbe tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587155 Aug 21 01:50:37.583527 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3522/6389] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:50:37.595353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd432196-d1c2-4f2b-94ad-27a556dc01c8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:37.596628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd432196-d1c2-4f2b-94ad-27a556dc01c8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:37.658619 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd432196-d1c2-4f2b-94ad-27a556dc01c8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1329 microversion: 2.1 time: 0.068121 Aug 21 01:50:37.659200 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2868/6390] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:37 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:50:38.680611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:38.681907 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:38.689473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:38.690202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:38.690840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:38.691739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:38.692351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:38.692977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:38.774697 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b184f4e7-bde7-4f7a-a8f4-64a881340851 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1434 microversion: 2.1 time: 0.098736 Aug 21 01:50:38.775623 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3523/6391] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:38 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1434 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:39.748849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a67995-718d-48eb-a751-a5cfe39f47b5", "tag": "c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:39.763632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:39.764393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:39.765025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:39.776173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] Creating event network-changed:c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb for instance b2a67995-718d-48eb-a751-a5cfe39f47b5 on n-h1-master-1 Aug 21 01:50:39.781925 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a98f940f-6baa-49fa-86cf-49a200356b52 req-f2360432-4f50-49ed-81de-e900fb00230b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Aug 21 01:50:39.782552 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2869/6392] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:39.798383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:39.799123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:39.805983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:39.806541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:39.807048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:39.808046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:39.808567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:39.809076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:39.943094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b0c0ddc-e355-4763-9b12-b963d23d3d49 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1464 microversion: 2.1 time: 0.148744 Aug 21 01:50:39.943735 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3524/6393] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:39 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:40.966649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:40.967473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:40.974000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:40.974467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:40.974896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:40.975601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:40.976043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:40.976457 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:41.211319 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-266ced47-270d-4275-8a68-1c5c036f478c tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1464 microversion: 2.1 time: 0.251182 Aug 21 01:50:41.211922 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2870/6394] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:40 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1464 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:42.235144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:42.235929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:42.246096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:42.246801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:42.247430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:42.248456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:42.249270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:42.250099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:42.398719 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b18d1a5-8be8-404d-b614-a1b441926540 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1464 microversion: 2.1 time: 0.168799 Aug 21 01:50:42.399583 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3525/6395] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:42 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:43.420296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:43.421172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:43.428326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:43.428798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:43.429271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:43.429974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:43.430429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:43.430853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:43.565182 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-748a00d4-2f21-4247-b553-c683783ddc1b tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1464 microversion: 2.1 time: 0.148681 Aug 21 01:50:43.565758 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2871/6396] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:43 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:44.493446 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a67995-718d-48eb-a751-a5cfe39f47b5", "name": "network-vif-plugged", "status": "completed", "tag": "c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:44.504088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:44.504525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:44.504969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:44.516458 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] Creating event network-vif-plugged:c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb for instance b2a67995-718d-48eb-a751-a5cfe39f47b5 on n-h1-master-1 Aug 21 01:50:44.521856 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c930775b-32be-4a55-81a1-b87cefe09094 req-f8804f20-05b0-4dd2-85aa-99c5cab8e376 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Aug 21 01:50:44.522458 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3526/6397] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:44.586119 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:44.586736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:44.593490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:44.593977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:44.594405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:44.595124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:44.595763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:44.596176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:44.755024 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1b0ff5f-1005-42b4-9381-ac59ccc7f071 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1464 microversion: 2.1 time: 0.172887 Aug 21 01:50:44.755605 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2872/6398] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:44 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:45.781284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:45.781974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:45.789028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:45.789533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:45.789977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:45.790675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:45.791122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:45.791544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:45.927292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a2a36f3-1151-4d92-a2e5-8c11d7a1629f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1649 microversion: 2.1 time: 0.151038 Aug 21 01:50:45.927886 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3527/6399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:45 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1649 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:45.951198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:45.952197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:45.964205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:45.965171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:45.965902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:45.967063 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:45.967810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:45.968524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.108263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b5e4648-d2ea-4a1a-aca2-9aac9eb08be3 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1649 microversion: 2.1 time: 0.163434 Aug 21 01:50:46.108860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2873/6400] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:45 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1649 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:46.128636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:46.129300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:46.135404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.135878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.136316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.137022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.137463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.137876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.267767 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73f17e24-761d-4ae4-8d34-6843ef502489 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1649 microversion: 2.1 time: 0.142944 Aug 21 01:50:46.268356 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3528/6401] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:46 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1649 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:46.291546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:46.292256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:46.301925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.302340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.302766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.303450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.303893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.304345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.332048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:50:46.427775 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4fd0d4d-cfca-4827-8ac2-da10333a7065 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 204 len: 0 microversion: 2.1 time: 0.142535 Aug 21 01:50:46.428816 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2874/6402] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:50:46 2022] DELETE /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:50:46.437494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:46.438108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:46.444199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.444671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.445134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.445815 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:46.446256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:46.446671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:46.587999 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b137270-5a32-45cd-b707-f7b8396762de tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1655 microversion: 2.1 time: 0.154430 Aug 21 01:50:46.588609 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3529/6403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:46 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:47.612697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:47.613810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:47.624269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:47.625111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:47.625789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:47.626839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:47.627531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:47.628177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:47.661797 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:47.841479 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1283bd0e-0675-4458-81f3-f5f4eb23d95f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 200 len: 1655 microversion: 2.1 time: 0.234779 Aug 21 01:50:47.842072 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2875/6404] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:47 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 1655 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:48.168380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a67995-718d-48eb-a751-a5cfe39f47b5", "name": "network-vif-deleted", "tag": "c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:48.176822 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:48.177511 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:48.186244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:48.186978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:48.187556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:48.201524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] Creating event network-vif-deleted:c643b6e4-ac7b-4b47-8a11-91ed4c4e44eb for instance b2a67995-718d-48eb-a751-a5cfe39f47b5 on n-h1-master-1 Aug 21 01:50:48.206974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-75290689-432a-48ac-b193-591b90338e14 req-ee8705ad-8c26-47d7-a79c-a8616fd66979 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044280 Aug 21 01:50:48.207643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3530/6405] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:48.865886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:48.866465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: b2a67995-718d-48eb-a751-a5cfe39f47b5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:48.873970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:48.874452 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:48.874887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:48.875566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:48.876035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:48.876428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:48.890670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] HTTP exception thrown: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Request method failure captured: Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 HTTP/1.1 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY9gmgZJ8mGQS-h6Eut3k-3f3r8kC9dcEJl2LmRhGkGYIIqXyj7qJFyCfJRQrQ9ixdiOGW4xJ628DHmg0k1huoGQPfU9juC-3Z2BnmDX4jd4J8WLxz_AQ5sliLjCIyUon3IgdEGEOgNKTX18Bl-k2TUOUDVKLrkJEDNfbNDRGee9lUE Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8dac24bfe0f9493a885a80bfa0bf0cf1 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestServerMultinode-1880813045 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8dac24bfe0f9493a885a80bfa0bf0cf1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}] Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestServerMultinode-1880813045 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8dac24bfe0f9493a885a80bfa0bf0cf1 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestServerMultinode-1880813045 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestServerMultinode-1880813045-project-admin Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c0d2fa0c02f946f4b91109857abd7e22 Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestServerMultinode-1880813045-project-admin Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b2a67995-718d-48eb-a751-a5cfe39f47b5'} Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:48.892338 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Returning 404 to user: Instance b2a67995-718d-48eb-a751-a5cfe39f47b5 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d1eb6be-0744-423b-8d32-216a05001c35 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5" status: 404 len: 111 microversion: 2.1 time: 0.033712 Aug 21 01:50:48.897885 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2876/6406] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:48 2022] GET /compute/v2.1/servers/b2a67995-718d-48eb-a751-a5cfe39f47b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:50:48.903645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:48.904230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:48.910988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:48.911686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:48.912123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:48.912856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:48.913326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:48.913751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:48.938927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:50:49.028813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0740296-955e-4b0f-acfe-9f1d6bf84b7f tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 204 len: 0 microversion: 2.1 time: 0.129061 Aug 21 01:50:49.029423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3531/6407] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:50:48 2022] DELETE /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:50:49.038497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:49.039147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:49.045595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:49.046121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:49.046559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:49.047261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:49.047715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:49.048143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:49.186392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6f050b60-fa00-4499-a6de-77f9cabc3cce tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1654 microversion: 2.1 time: 0.152113 Aug 21 01:50:49.187153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2877/6408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:49 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:50.211332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:50.212039 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:50.219448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:50.219943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:50.220404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:50.221212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:50.221719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:50.222192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:50.360740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d65fe3d-2a8e-4254-b167-0911cc6d21f8 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1654 microversion: 2.1 time: 0.154064 Aug 21 01:50:50.361704 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3532/6409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:50 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:51.082854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171f40ba-d001-4e0b-a3b6-c1d17770be72", "name": "network-vif-deleted", "tag": "f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:51.097010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:51.097469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:51.097898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:51.110420 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] Creating event network-vif-deleted:f04cdde7-2c88-4aaf-8a3c-e3ab9d63a364 for instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 on n-h2-master-1 Aug 21 01:50:51.117004 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0a81d4a2-7bdc-44f7-b237-25d30b40f385 req-ede086a2-8120-4b36-ac1d-b4430592fcb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037446 Aug 21 01:50:51.117802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2878/6410] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:50:51.383103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:51.383744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:51.390911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:51.391381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:51.391813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:51.392500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:51.392988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:51.393402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:51.428031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:51.428495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:51.428980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:51.429427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lazy-loading 'fault' on Instance uuid 171f40ba-d001-4e0b-a3b6-c1d17770be72 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:50:51.482553 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b2610e5-2d74-4c8e-b10b-a0fd36052431 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 200 len: 1453 microversion: 2.1 time: 0.103383 Aug 21 01:50:51.483201 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3533/6411] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:51 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:50:52.506780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:50:52.507585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] [instance: 171f40ba-d001-4e0b-a3b6-c1d17770be72] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:52.517508 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:52.518145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:52.518727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:52.519641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:52.520255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:52.520955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:52.534819 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] HTTP exception thrown: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Request method failure captured: Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 HTTP/1.1 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY9gmgZJ8mGQS-h6Eut3k-3f3r8kC9dcEJl2LmRhGkGYIIqXyj7qJFyCfJRQrQ9ixdiOGW4xJ628DHmg0k1huoGQPfU9juC-3Z2BnmDX4jd4J8WLxz_AQ5sliLjCIyUon3IgdEGEOgNKTX18Bl-k2TUOUDVKLrkJEDNfbNDRGee9lUE Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 8dac24bfe0f9493a885a80bfa0bf0cf1 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestServerMultinode-1880813045 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8dac24bfe0f9493a885a80bfa0bf0cf1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8dac24bfe0f9493a885a80bfa0bf0cf1"}]}] Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestServerMultinode-1880813045 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 8dac24bfe0f9493a885a80bfa0bf0cf1 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestServerMultinode-1880813045 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestServerMultinode-1880813045-project-admin Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c0d2fa0c02f946f4b91109857abd7e22 Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestServerMultinode-1880813045-project-admin Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '171f40ba-d001-4e0b-a3b6-c1d17770be72'} Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:50:52.536562 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] Returning 404 to user: Instance 171f40ba-d001-4e0b-a3b6-c1d17770be72 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13ca1417-b304-4841-9cd1-402c86b3e6d4 tempest-TestServerMultinode-1880813045 tempest-TestServerMultinode-1880813045-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72" status: 404 len: 111 microversion: 2.1 time: 0.037150 Aug 21 01:50:52.540647 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2879/6412] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:50:52 2022] GET /compute/v2.1/servers/171f40ba-d001-4e0b-a3b6-c1d17770be72 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:50:56.481115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:50:56.483257 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:50:56.491160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:56.491674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:56.492110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:56.492858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:50:56.493321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:50:56.493731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:50:56.498399 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:50:56.568944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-753fb9d6-b26d-4a2b-8ac8-d6adb4536542 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action" status: 200 len: 24570 microversion: 2.1 time: 0.091758 Aug 21 01:50:56.569615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3534/6413] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:50:56 2022] POST /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 01:51:27.896121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:27.897141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:27.898704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:27.901848 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:27.903291 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:27.907765 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:27.908489 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:27.913547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:27.914698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:27.915485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:27.917097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:27.917675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:27.918066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:27.918365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:27.919178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:27.919848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:27.933857 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] Creating event network-changed:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:51:27.939133 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6db24593-5256-456c-875a-cd378c020226 req-167681ba-084c-4a41-a4d4-d49a22f99091 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046880 Aug 21 01:51:27.940192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3535/6414] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:51:27.955078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:51:28.071204 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9312f8b6-e600-424f-b35f-fac52181d803 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 204 len: 0 microversion: 2.1 time: 0.182918 Aug 21 01:51:28.072271 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2880/6415] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:51:27 2022] DELETE /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:51:28.081636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:28.082342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:28.089990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:28.090458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:28.090994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:28.091738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:28.092295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:28.092603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:28.270203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:28.281984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da925010-1536-4ec3-9439-2e5f260c67c7 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1689 microversion: 2.1 time: 0.205120 Aug 21 01:51:28.282744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3536/6416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:28 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:29.306646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:29.307303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:29.315179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:29.315665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:29.316086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:29.316829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:29.317511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:29.318330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:29.471752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:29.480331 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf05a6be-028d-4066-8fad-383e4ca1358b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1689 microversion: 2.1 time: 0.178087 Aug 21 01:51:29.480945 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2881/6417] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:29 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:30.147651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d8095a-2224-4679-b3ad-bc444035c1d6", "name": "network-vif-deleted", "tag": "9deb8f69-f2fd-42a7-9ea5-91e66f3434ae"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:30.159457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:30.160091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:30.160632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:30.174387 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] Creating event network-vif-deleted:9deb8f69-f2fd-42a7-9ea5-91e66f3434ae for instance 46d8095a-2224-4679-b3ad-bc444035c1d6 on n-h2-master-1 Aug 21 01:51:30.180285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-791e2a5a-5ff0-48ef-ad96-9e39a8938fb8 req-1c9a9872-83f4-47cc-922f-8e0c3fcc0ef4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Aug 21 01:51:30.181344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3537/6418] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:51:30.502121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:30.502882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:30.511302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:30.511655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:30.512350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:30.513233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:30.513942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:30.514466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:30.559994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:30.560515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:30.561036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:30.561652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lazy-loading 'fault' on Instance uuid 46d8095a-2224-4679-b3ad-bc444035c1d6 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:51:30.615092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5f1b1c768b43be80f4e2a89694a811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d17d705402549dc94e6fdd36e917823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:30.625001 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ed0f7a43-75e6-4943-8fbe-0bf5226ec523 tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 200 len: 1357 microversion: 2.1 time: 0.126462 Aug 21 01:51:30.626278 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2882/6419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:30 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 1357 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:31.649042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:31.649772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] [instance: 46d8095a-2224-4679-b3ad-bc444035c1d6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:31.657714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:31.658201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:31.658647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:31.659349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:31.659810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:31.660233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:31.674426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] HTTP exception thrown: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Request method failure captured: Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 HTTP/1.1 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAYz8QhgFytmd4_Ps4SloBSvhjtcuMqsJGdF5F5aGUhRVp62zfjKYfvaboNciTc-PyRqZLGdU6xJAViU39YXdEmapMcWXISYBKohwGqnQoVSW8YWZRt7Apmpyh05O2KRy08IrusUMF-g0ry05qgfDoZzl3jVVve4sx7jkCr5vfqyxNxg Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4d17d705402549dc94e6fdd36e917823", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4d17d705402549dc94e6fdd36e917823"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4d17d705402549dc94e6fdd36e917823"}]}] Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4d17d705402549dc94e6fdd36e917823 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-62838617 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 6a5f1b1c768b43be80f4e2a89694a811 Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-62838617-project Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '46d8095a-2224-4679-b3ad-bc444035c1d6'} Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:51:31.676103 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Returning 404 to user: Instance 46d8095a-2224-4679-b3ad-bc444035c1d6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df6f2205-902a-4590-8a1c-a278de0ecb7b tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6" status: 404 len: 111 microversion: 2.1 time: 0.033338 Aug 21 01:51:31.681566 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3538/6420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:31 2022] GET /compute/v2.1/servers/46d8095a-2224-4679-b3ad-bc444035c1d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:51:35.217243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-25492a17-2a3c-4119-be92-404fcced00ff tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] Calling method '.version_select at 0x7fc3fd1bbaf0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:35.247532 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-25492a17-2a3c-4119-be92-404fcced00ff tempest-TestNetworkAdvancedServerOps-62838617 tempest-TestNetworkAdvancedServerOps-62838617-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1239986217" status: 202 len: 0 microversion: 2.1 time: 0.037105 Aug 21 01:51:35.248526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2883/6421] 10.222.0.46 () {58 vars in 1284 bytes} [Sun Aug 21 01:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1239986217 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:51:41.496210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abeeae6d-8bf9-4248-859d-680ab87538e1 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Action: 'create', calling method: .version_select at 0x7fc4031d3a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-331892444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHCWfHu/4FAkdbykKPHfPUu7miKCYhWlxR7f8p6Cma5LcbLP07ZAZV+mOTUOe4kjPS2GO7eM0sJed9yimlKM25nqP1SrQbKZzfsaJYXVfK1EA1NHKPZ+VxzSX/vp9c1g=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:41.512948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-abeeae6d-8bf9-4248-859d-680ab87538e1 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for project 288daeed1607434ba873f29bfc0d6eee. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:51:41.519176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-abeeae6d-8bf9-4248-859d-680ab87538e1 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for user 137f0efed4004fab97a97c79a7ca01b0 and project 288daeed1607434ba873f29bfc0d6eee. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:51:41.545369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abeeae6d-8bf9-4248-859d-680ab87538e1 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.238935 Aug 21 01:51:41.545967 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3539/6422] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:51:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:51:47.526236 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:47.527222 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:47.533414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-771316578-access_point-69588354", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "5da5eb08-17b3-4cc9-8527-34ee3671d355"}], "key_name": "tempest-TestSecurityGroupsBasicOps-331892444", "security_groups": [{"name": "tempest-secgroup_access--958299303"}, {"name": "tempest-secgroup_general--934690446"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:47.757948 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] validate_networks() for [('5da5eb08-17b3-4cc9-8527-34ee3671d355', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:51:48.331499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:51:48.331900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:51:48.332552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:51:48.334237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:51:48.334911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:51:48.344688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:48.345197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:48.345621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:48.346353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:48.346797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:48.347244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:48.370035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for project 288daeed1607434ba873f29bfc0d6eee. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:51:48.375875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for user 137f0efed4004fab97a97c79a7ca01b0 and project 288daeed1607434ba873f29bfc0d6eee. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:51:48.390363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:51:48.392413 n-d-master-1 devstack@n-api.service[122483]: WARNING nova.utils [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-771316578-access_point-69588354 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-771316578-acc Aug 21 01:51:48.393837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:51:48.455256 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1917b1e1-61b8-4f72-8cfe-9baaa73bc8a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.931868 Aug 21 01:51:48.460962 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2884/6423] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:51:47 2022] POST /compute/v2.1/servers => generated 456 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:51:48.464562 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:48.470213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41baee57-940e-4241-a688-5f6e59b5fdde tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:48.470745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-41baee57-940e-4241-a688-5f6e59b5fdde tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:48.553503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-41baee57-940e-4241-a688-5f6e59b5fdde tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:48.562790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41baee57-940e-4241-a688-5f6e59b5fdde tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1291 microversion: 2.1 time: 0.099119 Aug 21 01:51:48.564816 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3540/6424] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:48 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1291 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:51:49.591380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:49.596736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:49.611925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:49.612534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:49.613121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:49.613946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:49.614859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:49.618222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:49.725249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:49.738871 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-23140799-0ac9-4110-9445-fc721e9e25a8 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1343 microversion: 2.1 time: 0.153389 Aug 21 01:51:49.741484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2885/6425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:49 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:50.766338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:50.766932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:50.779245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:50.781360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:50.783176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:50.784010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:50.786125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:50.787767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:51.025672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:51.034204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-70d8d859-59e0-4275-9fa2-2c880a2643cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.272555 Aug 21 01:51:51.034771 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3541/6426] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:50 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:51:51.275905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65b3c72-f5ce-4d79-9c1d-ef391070d0f4", "tag": "0970509b-e6fd-4de3-b73e-30782554030e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:51.287503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:51.288236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:51.288858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:51.301634 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] Creating event network-changed:0970509b-e6fd-4de3-b73e-30782554030e for instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 on n-h2-master-1 Aug 21 01:51:51.308891 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cdff3d0d-c0f0-41e9-a816-5ceb3c8ad143 req-d5f95907-6534-4500-a9c0-59ebff56fd10 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036411 Aug 21 01:51:51.310099 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2886/6427] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:51:52.056253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:52.056851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:52.064376 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:52.064892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:52.065335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:52.066029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:52.066484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:52.066901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:52.285620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:52.294132 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca11e1cf-433c-4298-9cff-8d33d32e4dcc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.241853 Aug 21 01:51:52.294755 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3542/6428] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:52 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:53.317358 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:53.318747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:53.328816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:53.329470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:53.329901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:53.330631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:53.331079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:53.331495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:53.543632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:53.551645 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bc4e186-c88c-44ec-b9df-93ca63c0fa16 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.239910 Aug 21 01:51:53.552230 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2887/6429] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:53 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:54.573137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:54.573779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:54.583578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:54.584039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:54.584477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:54.585217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:54.585650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:54.586075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:55.066043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:55.073845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f63580a9-c212-4bf2-a661-4cd93c79770a tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.504778 Aug 21 01:51:55.074507 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3543/6430] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:54 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:56.095608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:56.096205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:56.103430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:56.103918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:56.104351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:56.105094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:56.105599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:56.106126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:56.259536 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:56.267921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8b31be8-724b-4aae-992f-3ffbcbb45e6c tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.177000 Aug 21 01:51:56.268508 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2888/6431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:56 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:56.420119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65b3c72-f5ce-4d79-9c1d-ef391070d0f4", "name": "network-vif-plugged", "status": "completed", "tag": "0970509b-e6fd-4de3-b73e-30782554030e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:51:56.433152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:56.434055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:56.434722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:56.446550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] Creating event network-vif-plugged:0970509b-e6fd-4de3-b73e-30782554030e for instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 on n-h2-master-1 Aug 21 01:51:56.452452 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ebb9ebfb-b083-49e1-85db-c241b9c8e1fe req-30b1f5c2-0dc8-444e-9d19-759dcb90fe44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Aug 21 01:51:56.453486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3544/6432] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:51:57.289602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:57.290226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:57.297982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:57.298469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:57.298905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:57.299605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:57.300055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:57.300477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:57.448155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:57.456883 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-533de453-ce16-4fa2-b6ec-e62525657a08 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1467 microversion: 2.1 time: 0.171309 Aug 21 01:51:57.457449 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2889/6433] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:57 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1467 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:58.479118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:58.479679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:58.483434 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:58.489388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.489876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.490315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:58.491013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.491467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.491891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:58.561804 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:58.639925 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:58.648414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64c47445-b917-4406-933d-fff073a845a5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1638 microversion: 2.1 time: 0.173911 Aug 21 01:51:58.648976 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3545/6434] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:58 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1638 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:58.671043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:58.671630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:58.674533 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:58.675205 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:51:58.680734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.681275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.681719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:58.682407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.682857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.683285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:58.837170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:51:58.845218 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4cbdb53-c5b9-45d8-bf38-24c2b8e81389 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1638 microversion: 2.1 time: 0.178665 Aug 21 01:51:58.845758 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2890/6435] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:58 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1638 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:51:58.865054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:51:58.865669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:51:58.871957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.872432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.872887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:58.873576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:51:58.874022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:51:58.874442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:51:59.119292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4e91f504-0835-4cb4-882a-7123f873fc9a tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1789 microversion: 2.1 time: 0.257913 Aug 21 01:51:59.119837 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3546/6436] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:51:58 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1789 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:52:01.056528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65b3c72-f5ce-4d79-9c1d-ef391070d0f4", "tag": "0970509b-e6fd-4de3-b73e-30782554030e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:52:01.070855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:52:01.071625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:52:01.072259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:52:01.087741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] Creating event network-changed:0970509b-e6fd-4de3-b73e-30782554030e for instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 on n-h2-master-1 Aug 21 01:52:01.099282 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-6aa7a11d-5f92-4cae-b1a5-a6d8045f63d2 req-8601324d-f91f-4914-8d43-f9d2b01e7b16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Aug 21 01:52:01.099946 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2891/6437] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:05.259630 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:05.260385 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=32 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:05.265025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f3b6ba2-c2d2-4aad-8162-44c57e3fb8cb tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Action: 'create', calling method: .version_select at 0x7fc40330d3a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1932180386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw8KZMaDvIAY8KsPFU9JET4XGUmcBcoP4V1//BKFwCWwp43O/QUSoEbO6VEGYz+GzXIk8Yr03AJQq+vnR0KsXgU/bQIRh188Kp+jum7XLU270pRdXfWH1WKqSke785XvA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:05.282315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7f3b6ba2-c2d2-4aad-8162-44c57e3fb8cb tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Getting quotas for project 1e3493d1d7ad47b2981af000f2168ed8. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:53:05.287808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7f3b6ba2-c2d2-4aad-8162-44c57e3fb8cb tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Getting quotas for user 83c0183473044981a355938f51265763 and project 1e3493d1d7ad47b2981af000f2168ed8. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:53:05.315325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f3b6ba2-c2d2-4aad-8162-44c57e3fb8cb tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057545 Aug 21 01:53:05.315942 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3547/6438] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:53:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:06.527554 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:06.528391 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:06.533092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-921639132", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b0bf80df-a316-4da3-bca2-fa273178de9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1932180386", "security_groups": [{"name": "tempest-secgroup-smoke-1684796696"}], "networks": [{"uuid": "23d7157f-a9e9-4cb3-adb2-ca5360f913b2"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:06.652962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] validate_networks() for [('23d7157f-a9e9-4cb3-adb2-ca5360f913b2', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:53:07.045454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:53:07.045877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:53:07.046488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:53:07.046987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:53:07.047379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:53:07.056467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:07.056983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:07.057414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:07.058134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:07.058731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:07.059153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:07.076673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Getting quotas for project 1e3493d1d7ad47b2981af000f2168ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:53:07.082549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Getting quotas for user 83c0183473044981a355938f51265763 and project 1e3493d1d7ad47b2981af000f2168ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:53:07.145514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:53:07.147772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0bf80df-a316-4da3-bca2-fa273178de9a',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:53:07.299927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bfb0247a-f237-4173-98af-0acf1900866b tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775290 Aug 21 01:53:07.300691 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2892/6439] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:53:07.312540 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c958298-21a1-4d1b-9b91-062f63ccf467 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:07.313387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c958298-21a1-4d1b-9b91-062f63ccf467 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:07.410410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7c958298-21a1-4d1b-9b91-062f63ccf467 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:07.420179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c958298-21a1-4d1b-9b91-062f63ccf467 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1098 microversion: 2.1 time: 0.112230 Aug 21 01:53:07.420701 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3548/6440] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:07 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1098 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:08.443421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:08.444153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:08.453280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:08.454043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:08.454694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:08.455644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:08.456300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:08.456969 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:08.546298 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:08.555010 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ce049f0-6ce8-48ac-967e-4d3873d5b07e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1214 microversion: 2.1 time: 0.117487 Aug 21 01:53:08.556172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2893/6441] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:08 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:53:09.592736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:09.594110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:09.602071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:09.602830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:09.603450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:09.604337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:09.604984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:09.605566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:09.884065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:09.893703 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c71d354-de34-40a4-b96f-3498f0cda2d8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1282 microversion: 2.1 time: 0.305665 Aug 21 01:53:09.896614 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3549/6442] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:09 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:10.333413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:10.358524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:10.359009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:10.359578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:10.372717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] Creating event network-changed:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:53:10.388370 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-46b9f1ef-312d-4cfc-893a-636c5fb6b3a6 req-2359b32f-233e-46ab-8e60-669fdfb6ee9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219834 Aug 21 01:53:10.389395 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2894/6443] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:10.916276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:10.917008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:10.962205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:10.965433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:10.965889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:10.966699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:10.967167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:10.967767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:11.305993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:11.317981 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-488ba1f9-98f2-4f46-a6a7-8077f6d87fd0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1282 microversion: 2.1 time: 0.405826 Aug 21 01:53:11.319871 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3550/6444] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:10 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1282 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:12.341263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:12.342120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:12.350154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:12.350896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:12.351542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:12.352588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:12.353536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:12.354544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:12.530458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:12.539500 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f57fca0-d97c-4969-ae99-422aa839f896 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1282 microversion: 2.1 time: 0.202946 Aug 21 01:53:12.540559 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2895/6445] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:12 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:13.237774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2002199287", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "879c3469-06ef-4336-8f23-547307dfc532"}], "key_name": "tempest-TestSecurityGroupsBasicOps-331892444", "security_groups": []}, "os:scheduler_hints": {"different_host": ["e65b3c72-f5ce-4d79-9c1d-ef391070d0f4"]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:13.304874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] validate_networks() for [('879c3469-06ef-4336-8f23-547307dfc532', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:53:13.561566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:13.562257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:13.571616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:13.572208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:13.572749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:13.573609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:13.574349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:13.574976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:13.915792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:13.926015 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a1b19225-7979-4056-8dba-a06794d3cf71 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1282 microversion: 2.1 time: 0.368264 Aug 21 01:53:13.927348 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2896/6446] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:13 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1282 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:14.089577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:53:14.090060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:53:14.090805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:53:14.091321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:53:14.091985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:53:14.106450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:14.107257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:14.107940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:14.109011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:14.110330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:14.110948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:14.140843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for project 288daeed1607434ba873f29bfc0d6eee. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:53:14.147567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Getting quotas for user 137f0efed4004fab97a97c79a7ca01b0 and project 288daeed1607434ba873f29bfc0d6eee. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:53:14.168399 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:53:14.171747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:53:14.241580 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [8a1242cb-258c-42a3-b294-f24031baab34] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 01:53:14.947884 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:14.948693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:14.957159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:14.958047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:14.958461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:14.959216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:14.959679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:14.961700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:15.107953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:15.116693 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a50f55a0-be15-473e-ae47-1b03ba9b889d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1282 microversion: 2.1 time: 0.172729 Aug 21 01:53:15.117339 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2897/6447] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:14 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:53:15.252020 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [8a1242cb-258c-42a3-b294-f24031baab34] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 45476. Aug 21 01:53:15.256954 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-97118d81-385a-4d28-9564-4c7f8d21b6c5 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.025471 Aug 21 01:53:15.258106 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3551/6448] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:53:13 2022] POST /compute/v2.1/servers => generated 361 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:53:15.271112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77cfb424-7029-40db-ba95-58b9f4e8a42b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:15.271840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-77cfb424-7029-40db-ba95-58b9f4e8a42b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:15.346370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-77cfb424-7029-40db-ba95-58b9f4e8a42b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:15.355263 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-77cfb424-7029-40db-ba95-58b9f4e8a42b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1241 microversion: 2.1 time: 0.088432 Aug 21 01:53:15.366349 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2898/6449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:15 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:16.140582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:16.141463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:16.148288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:16.148790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:16.149239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:16.149940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:16.150389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:16.150807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:16.302467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:16.318689 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fc22447-5554-4843-b51e-88e8620825f9 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.181733 Aug 21 01:53:16.319358 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3552/6450] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:16 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:16.377737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:16.378337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:16.386581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:16.387308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:16.387903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:16.388813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:16.389257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:16.389851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:16.494059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:16.502971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-efe83dc0-6368-47de-8454-f64fa1902511 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1311 microversion: 2.1 time: 0.129868 Aug 21 01:53:16.503571 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2899/6451] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:16 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:17.340277 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:17.340909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:17.348050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:17.348748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:17.349230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:17.349944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:17.350419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:17.350832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:17.491523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:17.499540 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e1c750e-c5cd-41aa-8d44-394b1bcff918 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.163270 Aug 21 01:53:17.500130 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3553/6452] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:17 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:17.523666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:17.524365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:17.526468 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:17.533695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:17.534254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:17.534694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:17.535386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:17.535832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:17.536245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:17.574382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd75e19-f628-46d4-9875-834d5d94f6c5", "tag": "84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:17.588526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:17.589207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:17.589909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:17.602255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] Creating event network-changed:84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7 for instance abd75e19-f628-46d4-9875-834d5d94f6c5 on n-h1-master-1 Aug 21 01:53:17.607661 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6d68c1e0-77bc-44f9-a669-d2af9de01930 req-b4863ddb-333e-4386-ad03-3e7147298b24 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037146 Aug 21 01:53:17.608293 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3554/6453] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:17.689458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:17.697771 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6efcdaa6-a86a-4aa7-93e1-c14271699815 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.178069 Aug 21 01:53:17.698355 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2900/6454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:17 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:18.526970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:18.528325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:18.539259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:18.540014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:18.540711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:18.541861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:18.542606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:18.543266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:18.697521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:18.707711 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11541c49-5a14-4701-b097-a2b7f907ddb0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.189395 Aug 21 01:53:18.708298 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3555/6455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:18 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:18.719024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:18.719899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:18.727071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:18.727539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:18.727965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:18.728657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:18.729134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:18.729551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:18.811615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:18.820168 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-13c11557-6c2f-4d2d-8867-20f0feccb7f4 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.105054 Aug 21 01:53:18.820746 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2901/6456] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:18 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:19.733539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:19.734111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:19.741714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:19.742200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:19.742635 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:19.743344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:19.743806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:19.744249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:19.841033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:19.841664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:19.849192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:19.849677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:19.850112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:19.850794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:19.851443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:19.851870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:19.890011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:19.898904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f507da1-fe55-40b1-a7c5-c636f017bd3e tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.171833 Aug 21 01:53:19.899508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3556/6457] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:19 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:19.939407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:19.947339 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a111df34-0b63-447c-bda8-dc85e35965cc tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.110235 Aug 21 01:53:19.947907 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2902/6458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:19 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:53:20.920733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:20.921436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:20.929109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:20.929582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:20.930013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:20.930704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:20.931146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:20.931560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:20.968226 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:20.968863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:20.976388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:20.977119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:20.977578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:20.978277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:20.978724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:20.979139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:21.070081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:21.079574 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91342c96-ce3c-4533-990c-e4894e9534da tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.115168 Aug 21 01:53:21.080265 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2903/6459] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:20 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:53:21.100821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:21.110275 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1c4710f8-e51a-4820-beaf-deab23d31f67 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.192612 Aug 21 01:53:21.110275 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3557/6460] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:20 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:22.102270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:22.102964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:22.111138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:22.111677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:22.112147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:22.113012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:22.113517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:22.113990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:22.131592 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:22.132189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:22.140741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:22.141572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:22.142055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:22.143132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:22.143241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:22.143625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:22.205504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:22.213485 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0ae34957-f37e-42cd-a730-461ad5a9c54b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.115703 Aug 21 01:53:22.214108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2904/6461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:22 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:22.286134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:22.298328 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b109a93a-25a6-4de3-b311-7fcd89246c1c tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.170756 Aug 21 01:53:22.298937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3558/6462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:22 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:23.234650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:23.235539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:23.243283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:23.243768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:23.244212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:23.245116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:23.245575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:23.246008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:23.290100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd75e19-f628-46d4-9875-834d5d94f6c5", "name": "network-vif-plugged", "status": "completed", "tag": "84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:23.310330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:23.310801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:23.311220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:23.323609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] Creating event network-vif-plugged:84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7 for instance abd75e19-f628-46d4-9875-834d5d94f6c5 on n-h1-master-1 Aug 21 01:53:23.329508 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ecfeffb0-c4fa-4dd2-96a1-954f87d78bfd req-6cda658f-1fc5-4cb2-a975-58e68ef1f147 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043064 Aug 21 01:53:23.330492 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3559/6463] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:53:23.335654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:23.336695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:23.343314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:23.344028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:23.344846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:23.345609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:23.346778 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:23.347351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:23.350508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:23.358894 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ab1b1360-ffd5-4234-8a76-e0b13173e5f6 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.128574 Aug 21 01:53:23.359484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2905/6464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:23 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:23.513011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:23.521716 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e77ff2e5-6086-4287-9920-bd520c8a03f8 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.189935 Aug 21 01:53:23.522523 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3560/6465] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:23 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:24.380558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:24.381252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:24.388563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:24.389072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:24.389504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:24.390224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:24.390671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:24.391087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:24.478418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:24.489780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28f9bdb9-2aab-41b2-aee5-dc7475bf6229 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1299 microversion: 2.1 time: 0.113652 Aug 21 01:53:24.490900 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2906/6466] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:24 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:24.544988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:24.545623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:24.547695 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:24.549050 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:24.556246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:24.556741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:24.557194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:24.557906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:24.558351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:24.558766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:24.710883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:24.722709 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06f24840-6e48-44a7-b46b-821812bea349 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.182739 Aug 21 01:53:24.723457 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3561/6467] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:24 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:25.348959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "name": "network-vif-plugged", "status": "completed", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:25.353966 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:25.359968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.360734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.361197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.372681 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] Creating event network-vif-plugged:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:53:25.378232 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-b73bd278-a6a2-4d61-bfc5-205171857751 req-30db933d-5cbb-4d1e-98d1-27ff0c3c0434 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 Aug 21 01:53:25.378901 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2907/6468] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:25.512563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:25.513214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:25.520294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.520804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.521267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.521974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.522432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.522857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.608467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:25.617364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5b0eb3b-0939-4322-8f28-1bec642b92db tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1470 microversion: 2.1 time: 0.109051 Aug 21 01:53:25.618233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3562/6469] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:25 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:25.639471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:25.640168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:25.646572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.647032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.647479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.648247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.648598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.649055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.737281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:25.743768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:25.744381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:25.745478 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1766b42f-d3c3-414a-833a-1edeb6a12630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1470 microversion: 2.1 time: 0.111121 Aug 21 01:53:25.746061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2908/6470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:25 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:25.750495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.751060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.751667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.752394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.752872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.753303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.766072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:25.767395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:25.773718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.774209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.774650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.775382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.775895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.776369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.863601 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f75ed1e-b907-4af3-8c5a-f0760265c7ff tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1621 microversion: 2.1 time: 0.100873 Aug 21 01:53:25.864204 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2909/6471] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:25 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:25.883238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:25.883863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:25.890247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.890756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.891286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.891549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:25.892250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:25.892707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:25.893163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:25.900217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92a9b468-69f3-491a-b139-40dd692986f0 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.160317 Aug 21 01:53:25.900794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3563/6472] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:25 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:53:26.047058 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4e8270fa-f551-42d3-a4c7-2dd24d1638d4 tempest-TestSecurityGroupsBasicOps-1815821971 tempest-TestSecurityGroupsBasicOps-1815821971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1908 microversion: 2.1 time: 0.167192 Aug 21 01:53:26.047945 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2910/6473] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:25 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1908 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:26.114773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:26.115190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:26.121729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.122221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.122656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:26.123353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.123835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.124227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:26.153609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:53:26.236751 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df6f4508-660b-4472-88d4-4a58e8de1630 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "DELETE /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 204 len: 0 microversion: 2.1 time: 0.126083 Aug 21 01:53:26.237353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3564/6474] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:53:26 2022] DELETE /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:53:26.245985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:26.246598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:26.253085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.253532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.253987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:26.254663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.255103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.255510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:26.275089 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=100 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:26.348258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:26.360055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7610c21-2851-4b94-b876-74d34edb142b tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1476 microversion: 2.1 time: 0.117766 Aug 21 01:53:26.360826 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2911/6475] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:26 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1476 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:26.922964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:26.923668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:26.931087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.931548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.932007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:26.932701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:26.933195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:26.933600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:27.083547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:27.087134 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:27.092267 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9cae047-fb14-4adc-bcda-d27e6a9440e7 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1270 microversion: 2.1 time: 0.174010 Aug 21 01:53:27.092838 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3565/6476] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:26 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:27.382522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:27.383486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:27.391220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:27.393640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:27.394107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:27.394983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:27.395369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:27.395796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:27.487545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:27.497544 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9a67ec3a-fba2-44f0-89ef-d926d722b6a7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1476 microversion: 2.1 time: 0.119506 Aug 21 01:53:27.498126 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2912/6477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:27 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1476 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:28.058316 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd75e19-f628-46d4-9875-834d5d94f6c5", "name": "network-vif-deleted", "tag": "84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:28.074246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.075120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.075533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.091065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] Creating event network-vif-deleted:84032e8a-cae6-4cf4-b8a2-c36cc0f93ed7 for instance abd75e19-f628-46d4-9875-834d5d94f6c5 on n-h1-master-1 Aug 21 01:53:28.097730 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b4c51072-4527-41d6-827a-24ad30b3c625 req-fc159a4c-7651-4843-9b72-a6e07714ebfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042988 Aug 21 01:53:28.098467 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3566/6478] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:28.113020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:28.113962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:28.121090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.121835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.122493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.123222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.123673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.124095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.277172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:28.288356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8fca5989-e902-4bde-8684-cf81d0bce8b4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1460 microversion: 2.1 time: 0.179276 Aug 21 01:53:28.288979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2913/6479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:28 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1460 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:28.312671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:28.313648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:28.320319 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.320809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.321258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.321949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.322646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.323072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.476865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:28.486521 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40afbff7-cf6b-42e0-8513-7c5db06ee86d tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1460 microversion: 2.1 time: 0.177577 Aug 21 01:53:28.487431 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3567/6480] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:28 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1460 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:28.518688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:28.520123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:28.527385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.528179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.528819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.529770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.530204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.530637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.568396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:28.568909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:28.569347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:28.569887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lazy-loading 'fault' on Instance uuid abd75e19-f628-46d4-9875-834d5d94f6c5 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:53:28.617350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:28.624525 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef49be95-59fb-4e62-a080-70476dc8e30d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 200 len: 1331 microversion: 2.1 time: 0.110696 Aug 21 01:53:28.625176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2914/6481] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:28 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:29.646447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:29.647175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: abd75e19-f628-46d4-9875-834d5d94f6c5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:29.654416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:29.654986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:29.655416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:29.656111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:29.656553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:29.657000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:29.671359 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] HTTP exception thrown: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Request method failure captured: Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 HTTP/1.1 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY-sejx94HmD37ZPf7NguhHXYVH3Iqow0AHOeHN1nXy6XxXe6KR3_Ye6C2RiP9cWBmZWPs0HbRvI-cqss8cCDRtvwh4akev1xLZCWTrGdkX9I_AN-zKmJRt_M-6myabsTjoX0d0wEzaC1xGEg-FfGrTBlhRvxgaDbLV2Vsdc8tdZPUE Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 288daeed1607434ba873f29bfc0d6eee Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/288daeed1607434ba873f29bfc0d6eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_288daeed1607434ba873f29bfc0d6eee", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/288daeed1607434ba873f29bfc0d6eee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/288daeed1607434ba873f29bfc0d6eee"}]}] Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 288daeed1607434ba873f29bfc0d6eee Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestSecurityGroupsBasicOps-771316578-project Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 137f0efed4004fab97a97c79a7ca01b0 Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestSecurityGroupsBasicOps-771316578-project Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: exception: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'abd75e19-f628-46d4-9875-834d5d94f6c5'} Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:53:29.673634 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Returning 404 to user: Instance abd75e19-f628-46d4-9875-834d5d94f6c5 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d92ece13-7a53-4a56-a28b-b8b4d2955476 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5" status: 404 len: 111 microversion: 2.1 time: 0.032889 Aug 21 01:53:29.679230 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3568/6482] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:29 2022] GET /compute/v2.1/servers/abd75e19-f628-46d4-9875-834d5d94f6c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:53:30.265376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:30.276846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:30.277332 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:30.277764 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:30.290342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] Creating event network-changed:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:53:30.295542 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ae575351-ebde-4d04-bdb8-98dc2cede9d2 req-f461e18c-7f1c-46f0-930d-0ab5af0a0828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033880 Aug 21 01:53:30.296413 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2915/6483] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:32.209099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:32.220641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:32.221132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:32.221550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:32.233660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] Creating event network-changed:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:53:32.239485 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-98a7e321-db38-47a1-974d-b2d085f79e29 req-12fd3b67-5f8a-484e-a886-5629e7118a66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035104 Aug 21 01:53:32.240553 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3569/6484] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:34.257313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:34.269548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:34.269913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:34.270326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:34.282773 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] Creating event network-changed:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:53:34.288054 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-16223979-e5df-41fd-923c-d70f358b01ae req-1c15fca3-678c-4dbe-a59a-5f4c80e75764 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035922 Aug 21 01:53:34.288693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2916/6485] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:35.789564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:35.790166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:35.791949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65b3c72-f5ce-4d79-9c1d-ef391070d0f4", "tag": "0970509b-e6fd-4de3-b73e-30782554030e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:35.792413 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:35.800194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:35.801008 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:35.801659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:35.802371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:35.802823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:35.803225 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:35.803353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:35.803891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:35.804406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:35.816433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] Creating event network-changed:0970509b-e6fd-4de3-b73e-30782554030e for instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 on n-h2-master-1 Aug 21 01:53:35.821723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-dae46980-9c8d-4f9e-ba99-d92f2bcd535f req-96e1d380-6ed6-4839-9cb6-8a7c8b8f5836 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034962 Aug 21 01:53:35.822623 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2917/6486] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:35.833472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:53:35.920245 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f8d0fe5-2851-4419-a70e-db914dcca024 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 204 len: 0 microversion: 2.1 time: 0.136015 Aug 21 01:53:35.921140 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3570/6487] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:53:35 2022] DELETE /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:53:35.930846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:35.931963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:35.938709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:35.940187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:35.940928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:35.942540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:35.943226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:35.943998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:36.094345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:36.103242 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fc32234-e62c-43c2-b358-fdb5855dc365 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1763 microversion: 2.1 time: 0.176704 Aug 21 01:53:36.103840 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2918/6488] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:35 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1763 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:37.127791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:37.128799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:37.136350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:37.136873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:37.137300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:37.138173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:37.138833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:37.139259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:37.329802 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:37.338738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13579fe1-ac10-4b0a-ac02-a43c525eb9ea tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1763 microversion: 2.1 time: 0.216314 Aug 21 01:53:37.339326 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3571/6489] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:37 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1763 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:38.104074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65b3c72-f5ce-4d79-9c1d-ef391070d0f4", "name": "network-vif-deleted", "tag": "0970509b-e6fd-4de3-b73e-30782554030e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:53:38.110409 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:53:38.117565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:38.118113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:38.118670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:38.131702 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] Creating event network-vif-deleted:0970509b-e6fd-4de3-b73e-30782554030e for instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 on n-h2-master-1 Aug 21 01:53:38.138095 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-dc4e6a87-ef85-4779-86a2-91beda31ad21 req-2ae7b01b-07fd-43b6-a3bf-3a6cbc113c95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038001 Aug 21 01:53:38.139095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2919/6490] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:53:38.360913 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:38.362119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:38.370428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:38.371033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:38.371475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:38.372259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:38.372753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:38.373218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:38.408984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:38.409481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:38.409987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:38.410479 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lazy-loading 'fault' on Instance uuid e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:53:38.459370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '137f0efed4004fab97a97c79a7ca01b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288daeed1607434ba873f29bfc0d6eee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:53:38.468330 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3a14dd04-96fa-43d1-ba50-6c45a9fac03d tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 200 len: 1381 microversion: 2.1 time: 0.112361 Aug 21 01:53:38.469144 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3572/6491] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:38 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 1381 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:53:39.496706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:39.498124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] [instance: e65b3c72-f5ce-4d79-9c1d-ef391070d0f4] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:53:39.506720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:39.507195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:39.507626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:39.508311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:53:39.508752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:53:39.509200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:53:39.523129 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] HTTP exception thrown: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Request method failure captured: Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 HTTP/1.1 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAY-sejx94HmD37ZPf7NguhHXYVH3Iqow0AHOeHN1nXy6XxXe6KR3_Ye6C2RiP9cWBmZWPs0HbRvI-cqss8cCDRtvwh4akev1xLZCWTrGdkX9I_AN-zKmJRt_M-6myabsTjoX0d0wEzaC1xGEg-FfGrTBlhRvxgaDbLV2Vsdc8tdZPUE Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 288daeed1607434ba873f29bfc0d6eee Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/288daeed1607434ba873f29bfc0d6eee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_288daeed1607434ba873f29bfc0d6eee", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/288daeed1607434ba873f29bfc0d6eee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/288daeed1607434ba873f29bfc0d6eee"}]}] Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 288daeed1607434ba873f29bfc0d6eee Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-771316578 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestSecurityGroupsBasicOps-771316578-project Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 137f0efed4004fab97a97c79a7ca01b0 Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestSecurityGroupsBasicOps-771316578-project Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e65b3c72-f5ce-4d79-9c1d-ef391070d0f4'} Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:53:39.524797 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Returning 404 to user: Instance e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ae9a456-78cd-4574-8b6a-1afdac06fba7 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4" status: 404 len: 111 microversion: 2.1 time: 0.038227 Aug 21 01:53:39.529608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2920/6492] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:53:39 2022] GET /compute/v2.1/servers/e65b3c72-f5ce-4d79-9c1d-ef391070d0f4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:53:42.993637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24c85075-7dfb-4369-9083-c89888022b64 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] Calling method '.version_select at 0x7fc3f8712d30>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:53:43.023792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24c85075-7dfb-4369-9083-c89888022b64 tempest-TestSecurityGroupsBasicOps-771316578 tempest-TestSecurityGroupsBasicOps-771316578-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-331892444" status: 202 len: 0 microversion: 2.1 time: 0.035079 Aug 21 01:53:43.024957 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3573/6493] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 01:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-331892444 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:54:03.996536 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:03.997548 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:03.999382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:04.000427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:04.001401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:54:04.005300 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:04.005933 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=38 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:04.010783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:04.011364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:04.011772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:04.012758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:04.013540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:04.014260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:04.015238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:04.015731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:04.016163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:04.029967 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] Creating event network-changed:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:54:04.035302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-204af00f-aa7f-4627-9617-cdacca746f84 req-f4d0efd2-8026-4708-be51-dfbfcbfd35eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040496 Aug 21 01:54:04.038981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3574/6494] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:54:04.049136 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:54:04.152353 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93cb40b1-26f3-45a1-9073-32b94f648232 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "DELETE /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 204 len: 0 microversion: 2.1 time: 0.159078 Aug 21 01:54:04.157246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2921/6495] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:54:03 2022] DELETE /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:54:04.163546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:04.164252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:04.170692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:04.171173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:04.171605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:04.172302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:04.172750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:04.173209 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:04.317117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:04.325538 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-298b12f7-e3ff-4189-b345-f92b431a9cb4 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1585 microversion: 2.1 time: 0.166683 Aug 21 01:54:04.326124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3575/6496] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:04 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1585 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:05.350167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:05.350897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:05.358677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:05.359196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:05.359634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:05.360345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:05.360860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:05.361281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:05.568499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:05.576665 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fe200552-2fdb-46e9-a35c-4bb8b1ca5669 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1585 microversion: 2.1 time: 0.231033 Aug 21 01:54:05.577284 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2922/6497] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:05 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1585 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:06.551808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d36da4-290b-4549-83d2-35e57f978c52", "name": "network-vif-deleted", "tag": "33114171-1337-4883-bda4-ee7f51ed5083"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:54:06.562410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:06.562886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:06.563299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:06.575772 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] Creating event network-vif-deleted:33114171-1337-4883-bda4-ee7f51ed5083 for instance 40d36da4-290b-4549-83d2-35e57f978c52 on n-h1-master-1 Aug 21 01:54:06.580908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-71329dfd-8be6-4d11-b6db-2ef501feda9e req-f3b65f38-4fd4-4983-8d49-9590a8fdc3ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Aug 21 01:54:06.581967 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3576/6498] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:54:06.598476 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:06.599238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:06.606341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:06.606818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:06.607256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:06.607948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:06.608395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:06.608825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:06.674753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:06.685531 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b91125b2-cc63-4120-ae3a-5ab8ba3db8a3 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1229 microversion: 2.1 time: 0.090748 Aug 21 01:54:06.686213 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2923/6499] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:06 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:07.709837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:07.710443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:07.717419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:07.717896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:07.718335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:07.719031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:07.719475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:07.719891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:07.784866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:07.793330 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-60cd1c5b-1acf-4c8e-83c8-2d30a8bd9c74 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1229 microversion: 2.1 time: 0.089525 Aug 21 01:54:07.793920 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3577/6500] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:07 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:08.814818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:08.815454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:08.823808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:08.824285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:08.824716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:08.825447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:08.825891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:08.826307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:08.893614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:08.902292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3d7d20a-2225-41e7-a002-50c2e9a08093 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1229 microversion: 2.1 time: 0.091491 Aug 21 01:54:08.902876 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2924/6501] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:08 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:09.923902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:09.924486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:09.931444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:09.931916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:09.932342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:09.933056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:09.933515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:09.933906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:09.995453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:10.003392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c357cff7-c266-4ff2-94bc-ef7f64990435 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1229 microversion: 2.1 time: 0.083735 Aug 21 01:54:10.003957 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3578/6502] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:09 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1229 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:11.024411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:11.025008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:11.032595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:11.033127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:11.033564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:11.034282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:11.034737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:11.035160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:11.075093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:11.075500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:11.075917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:11.076392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lazy-loading 'fault' on Instance uuid 40d36da4-290b-4549-83d2-35e57f978c52 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:54:11.135022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83c0183473044981a355938f51265763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3493d1d7ad47b2981af000f2168ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:11.146577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ef532d5b-6d1a-4673-97e7-50ae1afc2974 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 200 len: 1234 microversion: 2.1 time: 0.126350 Aug 21 01:54:11.147166 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2925/6503] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:11 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 1234 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:12.171939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:12.172526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] [instance: 40d36da4-290b-4549-83d2-35e57f978c52] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:12.181060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:12.181541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:12.181981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:12.182742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:12.183199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:12.183622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:12.198019 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] HTTP exception thrown: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Request method failure captured: Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 HTTP/1.1 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAY-JSr7Oc8UXjugg1qiUeS1SiHBnyDr85q3mVRF5vpu94lPhSa8YKNVzJboj4_uoRnSoA4mzIwnY6GRveqVSJ7nENBbLxVpJj-VZ2JYshafy6Axl37T3h8FZyynKIKQc238nqSUd9A80GQ3vaLopQOvScBT6jU9H7NJYCSUbfphZoBw Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 1e3493d1d7ad47b2981af000f2168ed8 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBackupRestore-1888503623 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1e3493d1d7ad47b2981af000f2168ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1e3493d1d7ad47b2981af000f2168ed8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1e3493d1d7ad47b2981af000f2168ed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1e3493d1d7ad47b2981af000f2168ed8"}]}] Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBackupRestore-1888503623 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 1e3493d1d7ad47b2981af000f2168ed8 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1888503623 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBackupRestore-1888503623-project Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 83c0183473044981a355938f51265763 Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBackupRestore-1888503623-project Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '40d36da4-290b-4549-83d2-35e57f978c52'} Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:54:12.199692 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Returning 404 to user: Instance 40d36da4-290b-4549-83d2-35e57f978c52 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-720b9c87-2823-443f-a5c3-bec4db4d8214 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52" status: 404 len: 111 microversion: 2.1 time: 0.033168 Aug 21 01:54:12.204801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3579/6504] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:12 2022] GET /compute/v2.1/servers/40d36da4-290b-4549-83d2-35e57f978c52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:54:12.377237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-321419f7-4b72-45d1-a4ad-d5c18249d203 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] Calling method '.version_select at 0x7fc3fe009160>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:12.402059 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-321419f7-4b72-45d1-a4ad-d5c18249d203 tempest-TestVolumeBackupRestore-1888503623 tempest-TestVolumeBackupRestore-1888503623-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1932180386" status: 202 len: 0 microversion: 2.1 time: 0.029126 Aug 21 01:54:12.402983 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2926/6505] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 01:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1932180386 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 01:54:36.516515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-146938611", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "186d099b-e35a-46d6-92bc-2238d78e0fc9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:54:36.526800 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:36.527450 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:36.584659 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:54:36.971328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:54:36.971826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:54:36.972421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:54:36.973086 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:54:36.973521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:54:36.984046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:36.984519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:36.985114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:36.985931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:36.986413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:36.986819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:37.005871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:54:37.011254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:54:37.074350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:54:37.076604 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='186d099b-e35a-46d6-92bc-2238d78e0fc9',volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:54:37.228621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-edad2fc5-93e3-4fb3-9805-c66ad1859966 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715932 Aug 21 01:54:37.229319 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3580/6506] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:54:37.240645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eefce9e1-00ed-4b24-9b97-c18c57727621 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:37.241542 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eefce9e1-00ed-4b24-9b97-c18c57727621 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:37.244568 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:37.245652 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:37.312109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eefce9e1-00ed-4b24-9b97-c18c57727621 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:37.319434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eefce9e1-00ed-4b24-9b97-c18c57727621 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1056 microversion: 2.1 time: 0.083101 Aug 21 01:54:37.320010 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2927/6507] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:37 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1056 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:38.340217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:38.340816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:38.350049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:38.350536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:38.350993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:38.351695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:38.352143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:38.352594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:38.416498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:38.424988 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b86bbfec-9b05-4bc2-8ce3-8bf2c350ac17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1154 microversion: 2.1 time: 0.088668 Aug 21 01:54:38.425467 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3581/6508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:38 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1154 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:39.447658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:39.449129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:39.456384 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:39.457223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:39.457847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:39.458991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:39.459637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:39.460241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:39.738711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:39.748025 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5ba78fe5-1ecb-4326-a574-25d6ba4eb37f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1214 microversion: 2.1 time: 0.304938 Aug 21 01:54:39.748806 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2928/6509] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:39 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:40.033508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96389ad3-2356-402f-8afd-0c8a84970545", "tag": "1bcfa430-4b54-41c6-a7c9-87af95f5a968"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:54:40.046721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:40.047535 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:40.048207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:40.062595 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] Creating event network-changed:1bcfa430-4b54-41c6-a7c9-87af95f5a968 for instance 96389ad3-2356-402f-8afd-0c8a84970545 on n-h2-master-1 Aug 21 01:54:40.069369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-88435460-fb4d-4076-9a82-b866d287aa3c req-e6e54e01-56eb-4901-b62d-d42a8c7a3951 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042757 Aug 21 01:54:40.070684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3582/6510] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:54:40.768465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:40.769827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:40.777344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:40.778708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:40.779236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:40.780367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:40.781208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:40.781680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:41.012075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:41.020606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-173793e5-ba3b-429d-8824-32b081c4b0cd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1214 microversion: 2.1 time: 0.256097 Aug 21 01:54:41.022192 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2929/6511] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:40 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:42.043095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:42.043893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:42.051835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:42.052322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:42.053111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:42.053486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:42.053929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:42.054345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:42.197473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:42.205486 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c131a685-c98e-4451-a8a5-94c6376a68d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1214 microversion: 2.1 time: 0.166956 Aug 21 01:54:42.206072 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3583/6512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:42 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:43.227255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:43.227848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:43.235407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:43.235893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:43.236331 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:43.237072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:43.237588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:43.238018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:43.383010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:43.391466 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30416e05-53ee-491d-b4ad-94b37537f26f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1214 microversion: 2.1 time: 0.168478 Aug 21 01:54:43.392065 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2930/6513] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:43 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:44.416093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:44.416679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:44.424270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:44.424752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:44.425235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:44.425935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:44.426393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:44.426814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:44.586270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:44.594695 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-54f959f5-f046-4e2e-9962-ca8969c252ac tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.184486 Aug 21 01:54:44.595281 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3584/6514] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:44 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:45.616533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:45.617586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:45.628089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:45.628883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:45.629622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:45.630742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:45.631894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:45.632495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:45.770637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:45.778929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e9ae2c6-0c4b-40ab-823a-c991889811d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.167272 Aug 21 01:54:45.779512 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2931/6515] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:45 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:46.800626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:46.801385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:46.809752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:46.810286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:46.810769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:46.811536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:46.812036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:46.812644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:46.951012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:46.959515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-376bb717-cf17-49b0-8d81-5e47d4c2f45f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.163313 Aug 21 01:54:46.960148 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3585/6516] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:46 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:47.984371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:47.985077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:47.989246 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:47.996942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:47.997598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:47.998203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:47.999197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:47.999861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:48.000438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:48.138600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:48.147181 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00c4b31b-c7cb-4e34-9404-35b3765761ba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.168936 Aug 21 01:54:48.147805 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2932/6517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:47 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:49.168326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:49.168978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:49.172117 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:49.173112 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:54:49.181646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:49.182126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:49.182559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:49.183255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:49.183700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:49.184119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:49.351442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:49.359630 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-781e2d7f-f519-4976-99b5-de676aab2421 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.195524 Aug 21 01:54:49.360127 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3586/6518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:49 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:50.383360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:50.384024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:50.391503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:50.391962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:50.392398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:50.393802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:50.394253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:50.394673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:50.542106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:50.550453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b2042d2d-394f-4c03-90b7-9f842f3e703f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.172891 Aug 21 01:54:50.551029 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2933/6519] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:50 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:51.571447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:51.572161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:51.579330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:51.579907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:51.580398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:51.581119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:51.581566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:51.582081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:51.730242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:51.738115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9793f1c0-2647-4aa1-82c6-d5b6d8ac7547 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.170597 Aug 21 01:54:51.738691 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3587/6520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:51 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:52.762258 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:52.762919 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:52.770287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:52.771042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:52.771467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:52.772161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:52.772611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:52.773058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:52.922810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:52.930734 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7383bd48-ced8-4417-8dd7-b11648eecafd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.174351 Aug 21 01:54:52.932231 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2934/6521] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:52 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:53.956734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:53.957647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:53.969939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:53.970733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:53.971461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:53.972619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:53.973425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:53.974164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:54.119042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:54.129312 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-90dccbab-ab0d-4b37-9b3b-07773a44c899 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.179135 Aug 21 01:54:54.129874 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3588/6522] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:53 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:55.151412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:55.152094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:55.159922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:55.160986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:55.161743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:55.162960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:55.163419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:55.163901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:55.261632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96389ad3-2356-402f-8afd-0c8a84970545", "name": "network-vif-plugged", "status": "completed", "tag": "1bcfa430-4b54-41c6-a7c9-87af95f5a968"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:54:55.272199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:55.272199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:55.272618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:55.284176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] Creating event network-vif-plugged:1bcfa430-4b54-41c6-a7c9-87af95f5a968 for instance 96389ad3-2356-402f-8afd-0c8a84970545 on n-h2-master-1 Aug 21 01:54:55.289783 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ef132122-f4bb-4202-92b6-cf5871011654 req-f51c2bc4-937f-441c-ae7b-2b195727d0ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194296 Aug 21 01:54:55.290937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2935/6523] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:54:55.297207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:55.304974 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64c3e72d-6c3d-48c7-9dec-9f7aaef55568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.157555 Aug 21 01:54:55.305540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3589/6524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:55 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:56.330530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:56.331593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:56.342667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:56.343381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:56.343981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:56.345068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:56.345730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:56.346386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:56.512139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:56.524814 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88f8938d-78b0-4800-9417-fdeda536ce0c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1202 microversion: 2.1 time: 0.201123 Aug 21 01:54:56.525585 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2936/6525] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:56 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:57.551151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:57.552126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:57.561782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.562270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.562706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:57.563411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.563867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.564292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:57.708512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:57.721648 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f2af044-665e-4971-bfc3-b8a1095c8de2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1388 microversion: 2.1 time: 0.176790 Aug 21 01:54:57.722518 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3590/6526] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:57 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1388 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:57.744412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:57.745254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:57.752330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.752813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.753283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:57.753978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.754426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.754846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:57.892627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:57.905477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aea961c7-0dc3-4f59-906e-cf8339749ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1388 microversion: 2.1 time: 0.164369 Aug 21 01:54:57.906345 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2937/6527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:57 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:57.932239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:57.933015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:57.939745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.940227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.940655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:57.941379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:57.941830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:57.942252 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:58.089363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:58.097369 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63314e8d-dab6-4fb8-a07b-0c5bbb328587 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1388 microversion: 2.1 time: 0.170278 Aug 21 01:54:58.097972 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3591/6528] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:57 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:58.117638 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:58.118131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:58.124894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:58.125454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:58.125930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:58.126637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:58.127073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:58.127485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:58.154788 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:54:58.235738 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bccc653-74a7-465f-a52f-c64c47ae14bf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 204 len: 0 microversion: 2.1 time: 0.121599 Aug 21 01:54:58.236797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2938/6529] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:54:58 2022] DELETE /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:54:58.245420 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:58.246036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:58.252193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:58.252676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:58.253127 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:58.253817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:58.254264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:58.254681 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:58.399015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:58.409544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5550b8ed-59e1-4670-8ee3-669e2dae2975 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1394 microversion: 2.1 time: 0.167779 Aug 21 01:54:58.410558 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3592/6530] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:58 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1394 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:54:59.435855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:54:59.436433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:54:59.444383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:59.444910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:59.445345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:59.446045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:54:59.446491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:54:59.446879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:54:59.598499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:54:59.607013 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-418272b9-12a2-4a1c-bfe5-22ec9c26407d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1394 microversion: 2.1 time: 0.176816 Aug 21 01:54:59.607600 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2939/6531] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:54:59 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1394 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:00.450081 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96389ad3-2356-402f-8afd-0c8a84970545", "name": "network-vif-deleted", "tag": "1bcfa430-4b54-41c6-a7c9-87af95f5a968"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:55:00.460686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:00.461642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:00.462243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:00.475323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] Creating event network-vif-deleted:1bcfa430-4b54-41c6-a7c9-87af95f5a968 for instance 96389ad3-2356-402f-8afd-0c8a84970545 on n-h2-master-1 Aug 21 01:55:00.480993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f413b0c2-1e06-4d95-a4cb-5b767c366b54 req-01068f7b-9bcb-46d1-83a5-fdd05e356700 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035714 Aug 21 01:55:00.485093 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3593/6532] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:55:00.633485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:00.634080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:00.642041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:00.642533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:00.643031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:00.643682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:00.644462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:00.644949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:00.712057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:00.721170 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b013ceb7-7ac9-47a6-a1ea-d9a7d3e44647 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1187 microversion: 2.1 time: 0.091678 Aug 21 01:55:00.721789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2940/6533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:00 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:01.743934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:01.746222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:01.752976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:01.753468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:01.753920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:01.754623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:01.755207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:01.755634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:01.822660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:01.831524 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a77608d-4523-4ce8-ab8f-956f53a002cf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1187 microversion: 2.1 time: 0.092974 Aug 21 01:55:01.832105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3594/6534] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:01 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:02.855131 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:02.856034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:02.866699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:02.867323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:02.867757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:02.868797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:02.869462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:02.870055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:02.939865 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:02.948380 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16c9c2fe-d907-42e5-90f1-5c50fd2063f0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1187 microversion: 2.1 time: 0.099860 Aug 21 01:55:02.949207 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2941/6535] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:02 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:03.971929 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:03.972536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:03.979497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:03.980375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:03.981011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:03.981731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:03.982184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:03.982605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:04.049513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:04.057670 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7ec06c55-178d-4840-944a-1e521bf82718 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1187 microversion: 2.1 time: 0.089731 Aug 21 01:55:04.071318 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3595/6536] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:03 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:05.081697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:05.082776 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:05.092167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:05.092811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:05.093370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:05.094503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:05.095030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:05.095501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:05.129549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:05.130312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:05.130912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:05.131529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lazy-loading 'fault' on Instance uuid 96389ad3-2356-402f-8afd-0c8a84970545 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:55:05.178548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:05.186410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35ce4211-1220-4388-b35a-25c1ed4e68f1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 200 len: 1146 microversion: 2.1 time: 0.110484 Aug 21 01:55:05.186995 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2942/6537] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:05 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 1146 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:06.210921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:06.211828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 96389ad3-2356-402f-8afd-0c8a84970545] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:06.223062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:06.223805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:06.224467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:06.225583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:06.226274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:06.226925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:06.242990 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 HTTP/1.1 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '96389ad3-2356-402f-8afd-0c8a84970545'} Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:55:06.244637 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 96389ad3-2356-402f-8afd-0c8a84970545 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e9604bb-1de0-4e18-a342-ecfa40567659 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545" status: 404 len: 111 microversion: 2.1 time: 0.041338 Aug 21 01:55:06.250004 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3596/6538] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:06 2022] GET /compute/v2.1/servers/96389ad3-2356-402f-8afd-0c8a84970545 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:55:11.230711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1497282624", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "52bd99b6-8ada-4869-a771-43bf1e94e1c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:55:11.238809 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:11.294824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:55:11.997231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:55:11.997658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:55:11.998150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:55:11.998561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:55:11.998971 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:55:12.008803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:12.009320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:12.009753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:12.010472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:12.010922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:12.011365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:12.017663 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:12.033261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:55:12.038916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:55:12.101893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:55:12.103963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52bd99b6-8ada-4869-a771-43bf1e94e1c9',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:55:12.247922 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eea568ef-c530-4c53-8882-ac9aeb901b04 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025679 Aug 21 01:55:12.248675 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2943/6539] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 01:55:12.259914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11ccb6b6-b0e3-4df1-996f-2683a68608d7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:12.260538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11ccb6b6-b0e3-4df1-996f-2683a68608d7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:12.263749 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:12.317643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-11ccb6b6-b0e3-4df1-996f-2683a68608d7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:12.325334 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11ccb6b6-b0e3-4df1-996f-2683a68608d7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1057 microversion: 2.1 time: 0.069032 Aug 21 01:55:12.326210 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3597/6540] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:12 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1057 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:13.347279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:13.347856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:13.354631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:13.355545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:13.355667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:13.356884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:13.356884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:13.357305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:13.449028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:13.457588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-684c46f4-5218-4aaa-b565-d5e6ccbcfe52 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1173 microversion: 2.1 time: 0.115671 Aug 21 01:55:13.458426 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2944/6541] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:13 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1173 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:14.480402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:14.482068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:14.490555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:14.491045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:14.491492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:14.492217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:14.492658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:14.493220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:14.495940 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=87 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:14.648815 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:14.658417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-728a84fc-2e7c-4fb2-bf6d-3b7d8524d77c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1215 microversion: 2.1 time: 0.182755 Aug 21 01:55:14.659600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3598/6542] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:14 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:14.677132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5936ac6a-4ed0-417c-b52d-31f171c3cdb1", "tag": "4d480b5f-7ea7-4dff-b5ec-347c49139d75"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:55:14.691278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:14.692184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:14.692799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:14.705097 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] Creating event network-changed:4d480b5f-7ea7-4dff-b5ec-347c49139d75 for instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 on n-h2-master-1 Aug 21 01:55:14.710780 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7a658b1e-ca26-4e57-9233-bcc2d92fda7d req-7bdb8520-3dad-4721-a800-3750e6ff3bb8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039168 Aug 21 01:55:14.711589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2945/6543] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:55:15.679820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:15.681418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:15.689369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:15.689851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:15.690282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:15.690987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:15.691437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:15.691857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:15.827516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:15.835813 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9530ae63-abd7-4bbb-ae78-802addc77798 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1215 microversion: 2.1 time: 0.160095 Aug 21 01:55:15.836389 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3599/6544] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:15 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:16.858993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:16.859575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:16.866506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:16.867002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:16.867441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:16.868149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:16.868604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:16.869076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:17.016668 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:17.024577 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-68563978-6235-45e6-85e8-6392831745c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1215 microversion: 2.1 time: 0.171605 Aug 21 01:55:17.025178 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2946/6545] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:16 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:18.050866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:18.051478 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:18.059132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:18.059693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:18.060340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:18.061116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:18.061550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:18.061969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:18.208175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:18.216941 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1fb66af4-79cf-4436-a875-0b8b2d3c5164 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1215 microversion: 2.1 time: 0.170500 Aug 21 01:55:18.217528 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3600/6546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:18 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:19.238566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:19.239168 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:19.246749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:19.247415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:19.247775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:19.248443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:19.248935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:19.249361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:19.396617 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:19.404671 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-32ff8913-2d3e-4ad5-8f06-b31337342a9c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.170133 Aug 21 01:55:19.405350 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2947/6547] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:19 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:20.426967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:20.427583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:20.434996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:20.435481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:20.435921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:20.436629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:20.437118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:20.437987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:20.580589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:20.588604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a43b3b0-103d-42df-866b-5010379f2cdb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.166096 Aug 21 01:55:20.589217 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3601/6548] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:20 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:21.611022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:21.611625 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:21.619309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:21.619806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:21.620235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:21.620971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:21.621412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:21.621829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:21.757787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:21.769074 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6721670f-3a4b-43b2-b16d-da19d35e7613 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.162675 Aug 21 01:55:21.769658 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2948/6549] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:21 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:22.800836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:22.801894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:22.805262 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:22.813207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:22.813868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:22.814435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:22.815247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:22.815675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:22.816102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:22.957970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:22.966319 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b2da73d6-bc75-4f4b-93f3-1d1e150826c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.171783 Aug 21 01:55:22.966863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3602/6550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:22 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:23.993584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:23.994538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:23.997686 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:23.998763 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:55:24.015250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:24.015250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:24.015250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:24.015250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:24.015250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:24.016130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:24.166772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:24.174822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3ef735a0-6471-431a-8210-b67bfc4bb922 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.188067 Aug 21 01:55:24.175397 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2949/6551] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:23 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:25.199761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:25.200663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:25.211747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:25.212484 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:25.213241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:25.214305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:25.214997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:25.215644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:25.373735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:25.382198 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-483fd44e-67f9-45c4-9e12-ba0ba5a2104c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.188494 Aug 21 01:55:25.382775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3603/6552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:25 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:26.408614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:26.409252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:26.417107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:26.417594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:26.418058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:26.418765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:26.419220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:26.419640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:26.556580 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:26.567976 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-90c2c6ee-4b1e-4584-bcdc-38adb497ba27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.166970 Aug 21 01:55:26.568581 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2950/6553] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:26 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:27.596083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:27.596888 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:27.603954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:27.604438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:27.604910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:27.605594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:27.606068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:27.606487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:27.741511 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:27.750002 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ebde1912-ed98-4d30-a46d-a74b98b4a1a7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.158039 Aug 21 01:55:27.750576 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3604/6554] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:27 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:28.771333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:28.771951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:28.779389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:28.779869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:28.780306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:28.781378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:28.781834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:28.782254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:28.928673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:28.936606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-196fa562-5514-45b0-b494-05a70cf4d10c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.169671 Aug 21 01:55:28.937217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2951/6555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:28 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:29.182911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5936ac6a-4ed0-417c-b52d-31f171c3cdb1", "name": "network-vif-plugged", "status": "completed", "tag": "4d480b5f-7ea7-4dff-b5ec-347c49139d75"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:55:29.194212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:29.195580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:29.196030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:29.207854 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] Creating event network-vif-plugged:4d480b5f-7ea7-4dff-b5ec-347c49139d75 for instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 on n-h2-master-1 Aug 21 01:55:29.213364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-d28cc534-395b-4c83-ae19-da36cb88825e req-bd2623e5-e0cf-4369-acdf-c5b9dfc4ec59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Aug 21 01:55:29.213971 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3605/6556] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:55:29.963866 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:29.964952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:29.975164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:29.975964 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:29.976680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:29.977854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:29.978601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:29.979305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:30.121840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:30.131208 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-98c904a6-09b0-4f8d-9f39-1e4049a58b9d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1203 microversion: 2.1 time: 0.175488 Aug 21 01:55:30.131793 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2952/6557] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:29 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:31.152836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:31.153569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:31.161694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.162173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.162608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.163308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.163764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.164239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.307412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:31.320177 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8dbf6b69-443d-4c86-a1bd-52d123df1bae tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1389 microversion: 2.1 time: 0.171641 Aug 21 01:55:31.320801 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3606/6558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:31 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:31.340805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:31.342204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:31.352661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.353184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.353618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.354321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.354770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.355194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.496569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:31.505600 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87c39fc2-7342-448d-963c-73fa5b79531d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1389 microversion: 2.1 time: 0.168815 Aug 21 01:55:31.506139 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2953/6559] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:31 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:31.525400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:31.526022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:31.532593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.533103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.533536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.534225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.534694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.535244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.681615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:31.689810 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-300cdea6-14d9-49ed-815b-8dae25cd4e3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1389 microversion: 2.1 time: 0.168352 Aug 21 01:55:31.690426 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3607/6560] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:31 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:31.714330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:31.715117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:31.724615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.725373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.726010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.727060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.727695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.728323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.756848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:55:31.843504 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-57a0f943-44e2-4452-b37b-198192cf02fc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 204 len: 0 microversion: 2.1 time: 0.135070 Aug 21 01:55:31.844090 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2954/6561] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:55:31 2022] DELETE /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 01:55:31.853609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:31.854294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:31.860597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.861114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.861543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:31.862231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:31.862678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:31.863148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:32.010250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:32.018736 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a64f9d76-b372-4442-a52c-b2bdece2e752 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1395 microversion: 2.1 time: 0.169094 Aug 21 01:55:32.019522 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3608/6562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:31 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1395 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:55:33.041777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:33.042482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:33.048747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:33.049235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:33.049670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:33.050412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:33.050868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:33.051307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:33.185494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:33.197413 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b087300-1add-4d57-ae58-09347eb063ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1395 microversion: 2.1 time: 0.160992 Aug 21 01:55:33.198275 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2955/6563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:33 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:34.048943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5936ac6a-4ed0-417c-b52d-31f171c3cdb1", "name": "network-vif-deleted", "tag": "4d480b5f-7ea7-4dff-b5ec-347c49139d75"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:55:34.065569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:34.066049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:34.066478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:34.079123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] Creating event network-vif-deleted:4d480b5f-7ea7-4dff-b5ec-347c49139d75 for instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 on n-h2-master-1 Aug 21 01:55:34.085158 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-62d53de4-76f6-4b49-868d-ba9271138ab9 req-b6b709b7-0b7b-47ef-afd4-5bf6fdb7a685 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040307 Aug 21 01:55:34.085775 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3609/6564] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:55:34.223706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:34.224516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:34.231720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:34.232208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:34.232645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:34.233372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:34.233822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:34.234242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:34.300657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:34.310033 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-591eec31-12af-489c-b410-4e03b70bf238 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1188 microversion: 2.1 time: 0.091120 Aug 21 01:55:34.310597 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2956/6565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:34 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:35.333547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:35.335041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:35.342872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:35.343375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:35.343810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:35.344553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:35.345108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:35.345545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:35.418405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:35.426475 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a8ffbd59-1d5b-4a85-ab17-7eb69460b021 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1188 microversion: 2.1 time: 0.098827 Aug 21 01:55:35.427508 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3610/6566] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:35 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:36.447982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:36.448540 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:36.455858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:36.456367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:36.456811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:36.457565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:36.458004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:36.458551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:36.528141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:36.537760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-61527da5-8093-45be-b48f-7b193ab94321 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1188 microversion: 2.1 time: 0.093737 Aug 21 01:55:36.538340 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2957/6567] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:36 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:37.559510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:37.560786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:37.571837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:37.573615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:37.574950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:37.575811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:37.576478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:37.577039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:37.644823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:37.653143 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a014ea8-1a86-47fb-bd29-817b1bdafbf9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1188 microversion: 2.1 time: 0.097520 Aug 21 01:55:37.653730 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3611/6568] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:37 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:38.674839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:38.675548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:38.682770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:38.683248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:38.683675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:38.684363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:38.684805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:38.685253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:38.718487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:38.718979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:38.719399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:38.719987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lazy-loading 'fault' on Instance uuid 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:55:38.766096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:55:38.775327 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4c8ba4c-80a6-46a3-b036-810d9a2aad88 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 200 len: 1147 microversion: 2.1 time: 0.105016 Aug 21 01:55:38.775892 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2958/6569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:38 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 1147 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:55:39.797463 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:55:39.798120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 5936ac6a-4ed0-417c-b52d-31f171c3cdb1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:55:39.805779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:39.806251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:39.806678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:39.807361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:55:39.807802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:55:39.808215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:55:39.822382 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 HTTP/1.1 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5936ac6a-4ed0-417c-b52d-31f171c3cdb1'} Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:55:39.824030 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 5936ac6a-4ed0-417c-b52d-31f171c3cdb1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7333c12-efd5-4d01-945b-6cabeb781a53 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1" status: 404 len: 111 microversion: 2.1 time: 0.032064 Aug 21 01:55:39.829672 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3612/6570] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:55:39 2022] GET /compute/v2.1/servers/5936ac6a-4ed0-417c-b52d-31f171c3cdb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:56:01.936720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-212879719", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c3d740a5-43f5-4ff6-9489-0c79fb5d34c7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:56:01.946926 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:01.947605 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:02.036534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:56:02.426022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:56:02.426537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:56:02.427214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:56:02.427796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:56:02.428424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:56:02.439001 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:02.439510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:02.439954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:02.440665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:02.441140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:02.441560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:02.460594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:56:02.466937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:56:02.480862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:56:02.483010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c3d740a5-43f5-4ff6-9489-0c79fb5d34c7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:56:02.570703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d2c01fab-36bb-4492-859d-3c19763a6f29 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638055 Aug 21 01:56:02.571389 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2959/6571] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:56:02.582910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-91799ea3-b558-4ee0-b866-ac99462ab424 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:02.583559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-91799ea3-b558-4ee0-b866-ac99462ab424 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:02.586289 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=33 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:02.587196 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=77 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:02.644633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-91799ea3-b558-4ee0-b866-ac99462ab424 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:02.652639 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-91799ea3-b558-4ee0-b866-ac99462ab424 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1056 microversion: 2.1 time: 0.073914 Aug 21 01:56:02.653250 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3613/6572] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:02 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1056 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:03.675345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:03.676014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:03.686379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:03.686932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:03.687314 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:03.688062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:03.688479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:03.688907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:03.762486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:03.771588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3adf3df-6f88-47d1-9eb1-284dcb0048d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1108 microversion: 2.1 time: 0.101458 Aug 21 01:56:03.772371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2960/6573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:03 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1108 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:56:04.793516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:04.794296 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:04.802808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:04.803582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:04.804113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:04.804939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:04.805616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:04.806095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:04.949784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:04.958659 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d211a235-c410-48fb-a2dc-7111882a5e66 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.169362 Aug 21 01:56:04.959261 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3614/6574] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:04 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:05.125511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad5d8cf-78fe-49ee-b932-1a7725c603e5", "tag": "2cd5d001-2a63-492c-9639-f19a5b44e69d"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:56:05.138652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:05.139133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:05.139561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:05.151890 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] Creating event network-changed:2cd5d001-2a63-492c-9639-f19a5b44e69d for instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 on n-h2-master-1 Aug 21 01:56:05.157698 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3bd10ab3-25d9-4ce1-b0aa-46a7bfcb07ec req-ae6b9a36-5c1c-4bb0-b6b2-57ca63054363 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Aug 21 01:56:05.158298 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2961/6575] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:56:05.980591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:05.981207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:05.989167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:05.989652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:05.990058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:05.990794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:05.991454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:05.991847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:06.131749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:06.141030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6ef00339-46ad-4255-8bd2-9a719c0c89fe tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.164681 Aug 21 01:56:06.146778 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3615/6576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:05 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:07.164376 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:07.165214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:07.172105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:07.172589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:07.173091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:07.173769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:07.174218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:07.174642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:07.324158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:07.332122 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-172829f1-27c6-443f-a20f-d5fadbfcfacf tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.173064 Aug 21 01:56:07.345247 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2962/6577] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:07 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:08.358740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:08.359773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:08.370970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:08.372517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:08.373001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:08.373726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:08.374381 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:08.375053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:08.569144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:08.580911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a672c0ba-10be-4cd1-b81c-913bd49915c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.228624 Aug 21 01:56:08.592982 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3616/6578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:08 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:09.611365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:09.612882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:09.623513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:09.624218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:09.624660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:09.625400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:09.625855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:09.626312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:09.783120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:09.791343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08745ff0-c905-4e21-ad05-ca924599fbab tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.190558 Aug 21 01:56:09.792385 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2963/6579] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:09 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:10.814092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:10.815404 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:10.828589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:10.829221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:10.829754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:10.830536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:10.831035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:10.831560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:10.997353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:11.006677 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c688ede-f89d-4224-b5bd-0eb80af134e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.196994 Aug 21 01:56:11.007598 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3617/6580] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:10 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:12.030447 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:12.031050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:12.044860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:12.045348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:12.045771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:12.046476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:12.046917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:12.047325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:12.190981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:12.202518 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3e1be54-70f4-4002-8b79-713614b4bf21 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.175766 Aug 21 01:56:12.203904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2964/6581] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:12 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:13.227959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:13.228612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:13.231831 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:13.237688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:13.238150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:13.238580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:13.239267 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:13.239707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:13.240125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:13.373054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:13.381020 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92602404-97d3-4b1a-87fb-4aca98786fbd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.159844 Aug 21 01:56:13.381598 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3618/6582] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:13 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:14.402338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:14.402908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:14.405092 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:14.405743 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:14.412376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:14.412998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:14.413438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:14.414131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:14.414608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:14.415075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:14.555084 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:14.563429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9089b58-3eb4-46f7-8ebf-146d5ac7b283 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.165280 Aug 21 01:56:14.564288 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2965/6583] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:14 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:15.586192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:15.586920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:15.598982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:15.600575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:15.601200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:15.602321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:15.602817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:15.603342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:15.743578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:15.752010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2f324d13-cbb1-4f14-9016-43c585be5c48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.170492 Aug 21 01:56:15.752556 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3619/6584] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:15 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:16.774423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:16.775019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:16.783170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:16.783659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:16.784088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:16.784829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:16.785299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:16.785721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:16.924339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:16.932515 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76266562-7d11-4a3b-a59c-d3c6c8b067c0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.162105 Aug 21 01:56:16.933161 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2966/6585] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:16 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:17.953970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:17.954569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:17.961874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:17.962363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:17.962800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:17.963534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:17.964120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:17.964549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:18.103716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:18.115695 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f0827357-0672-400e-9572-3320dfff743e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1168 microversion: 2.1 time: 0.165623 Aug 21 01:56:18.116735 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3620/6586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:17 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:56:19.139966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:19.140583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:19.148189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:19.148674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:19.149144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:19.149853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:19.150312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:19.150736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:19.301472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:19.314720 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dfa0954a-96bb-418c-8f37-de9201fc9fb2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.179543 Aug 21 01:56:19.315594 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2967/6587] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:19 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:20.343334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:20.343995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:20.352826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:20.353419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:20.353923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:20.354770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:20.355290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:20.355779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:20.497652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:20.506470 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9a3098c0-8c7b-4d9b-9449-5a11e56326e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.169405 Aug 21 01:56:20.507044 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3621/6588] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:20 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:21.528014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:21.528728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:21.536882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:21.537350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:21.537789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:21.538523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:21.539106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:21.539540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:21.692314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:21.700300 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a09cd6a-e2c6-44b5-aa60-74ae7fe44138 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.176229 Aug 21 01:56:21.700904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2968/6589] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:21 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:22.724562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:22.725551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:22.737534 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:22.738329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:22.739042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:22.740184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:22.740980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:22.741682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:22.886279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:22.894621 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-145e744a-11df-47c8-9cd2-f60e676840f8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.176623 Aug 21 01:56:22.895221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3622/6590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:22 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:23.917127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:23.917801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:23.927527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:23.928844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:23.930008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:23.932077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:23.932731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:23.933175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:24.082514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:24.093955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92e8fcaf-c699-4849-9732-0964fc8d528f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.181049 Aug 21 01:56:24.094519 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2969/6591] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:23 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:25.120453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:25.121896 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:25.135800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:25.136602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:25.137392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:25.138664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:25.139119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:25.139575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:25.277751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:25.289480 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7f6b7e9f-2e0c-48a3-8458-b8d9d4add501 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.176627 Aug 21 01:56:25.290251 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3623/6592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:25 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:26.312506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:26.313185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:26.320589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:26.321107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:26.321540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:26.322230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:26.322678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:26.323103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:26.472159 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:26.480760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0fc120ab-127d-428b-a34b-8aa1f8bf62ff tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.172360 Aug 21 01:56:26.481362 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2970/6593] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:26 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:27.509483 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:27.510122 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:27.517270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:27.517780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:27.518233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:27.518921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:27.519401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:27.519824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:27.659239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:27.667372 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-642c8d75-bf58-4cc5-8323-f5abe71f5286 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.162074 Aug 21 01:56:27.667983 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3624/6594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:27 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:28.690496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:28.691111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:28.699943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:28.700614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:28.702110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:28.703174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:28.703806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:28.704373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:28.845211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:28.853442 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc7ce911-9adf-4784-bbe8-c927de4d563b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.168413 Aug 21 01:56:28.854016 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2971/6595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:28 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:29.456497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad5d8cf-78fe-49ee-b932-1a7725c603e5", "name": "network-vif-plugged", "status": "completed", "tag": "2cd5d001-2a63-492c-9639-f19a5b44e69d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:56:29.467674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:29.468510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:29.468999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:29.480436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] Creating event network-vif-plugged:2cd5d001-2a63-492c-9639-f19a5b44e69d for instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 on n-h2-master-1 Aug 21 01:56:29.486091 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-60dcc2f2-13cd-4f6a-bd23-04e40281977f req-ebd43dc8-7f27-439e-9e21-a2dfa28d0cd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Aug 21 01:56:29.487254 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3625/6596] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:56:29.878768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:29.879492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:29.890473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:29.890976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:29.891403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:29.892094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:29.892589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:29.893097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:30.037148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:30.045408 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bd17234-a291-4c8b-98ad-b6125f759927 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1202 microversion: 2.1 time: 0.173166 Aug 21 01:56:30.046023 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2972/6597] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:29 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:31.068567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:31.069291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:31.075952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.076451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.076922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.077595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.078250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.078662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.215612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:31.224293 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b283df9-15d2-4124-a80a-a6739f641905 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1388 microversion: 2.1 time: 0.161288 Aug 21 01:56:31.224903 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3626/6598] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:31 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:31.247477 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:31.248067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:31.256204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.256682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.257146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.257836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.258284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.258703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.404328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:31.413055 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd42b668-47ea-4622-a1a0-dd4bed98071a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1388 microversion: 2.1 time: 0.171695 Aug 21 01:56:31.413642 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2973/6599] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:31 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:31.433134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:31.433756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:31.441239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.441724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.442160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.442859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.443315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.443743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.597212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:31.609305 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bb5b3388-8e53-4a16-9525-02509205c171 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1388 microversion: 2.1 time: 0.179859 Aug 21 01:56:31.610127 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3627/6600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:31 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1388 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:56:31.691751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:31.692260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:31.698814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.699287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.699722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.700397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.700992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.701407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.726299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:56:31.811108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bebf572a-ded7-4d79-aa2a-369aae84d1cc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 204 len: 0 microversion: 2.1 time: 0.123087 Aug 21 01:56:31.811971 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2974/6601] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:56:31 2022] DELETE /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:56:31.821236 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:31.822883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:31.828066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.828549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.829121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.829840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:31.830286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:31.830702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:31.978983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:31.992280 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca430527-3ada-419b-9b4c-034b75b652d2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1394 microversion: 2.1 time: 0.174757 Aug 21 01:56:31.993177 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3628/6602] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:31 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1394 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:56:33.020223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:33.020855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:33.023639 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:33.029543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:33.030036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:33.030521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:33.031252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:33.031704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:33.032477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:33.037421 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:33.175608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:33.183723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f7465df-cf07-43a9-8548-3e119d566343 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1394 microversion: 2.1 time: 0.168752 Aug 21 01:56:33.184304 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2975/6603] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:33 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1394 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:34.059657 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad5d8cf-78fe-49ee-b932-1a7725c603e5", "name": "network-vif-deleted", "tag": "2cd5d001-2a63-492c-9639-f19a5b44e69d"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:56:34.066031 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=35 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:34.072332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:34.072849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:34.073286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:34.077718 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=87 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:56:34.089189 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] Creating event network-vif-deleted:2cd5d001-2a63-492c-9639-f19a5b44e69d for instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 on n-h2-master-1 Aug 21 01:56:34.095738 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a08aef89-87cb-4a98-8a96-fbf5609fad89 req-b987f87e-9178-4446-8c3f-ad4eccdcbee5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040631 Aug 21 01:56:34.096822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3629/6604] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:56:34.205630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:34.206162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:34.213876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:34.214401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:34.214807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:34.215498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:34.215943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:34.216358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:34.281144 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:34.289851 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b5ed8aa2-bbef-4a70-9d53-188701f1caa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1187 microversion: 2.1 time: 0.088538 Aug 21 01:56:34.290433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2976/6605] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:34 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:35.311957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:35.312640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:35.321023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:35.321513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:35.321942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:35.322634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:35.323075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:35.323502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:35.388312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:35.396626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5194a8ed-a2a0-47ae-85a6-1d00318d33ce tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1187 microversion: 2.1 time: 0.089057 Aug 21 01:56:35.408792 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3630/6606] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:35 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:36.418669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:36.419241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:36.427033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:36.427518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:36.427949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:36.428661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:36.429141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:36.429558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:36.496208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:36.505684 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b64023b-6854-4717-9a39-59cd9c0be0ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1187 microversion: 2.1 time: 0.091020 Aug 21 01:56:36.506296 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2977/6607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:36 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:37.527825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:37.528485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:37.537237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:37.537724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:37.538156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:37.538858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:37.539302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:37.539725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:37.603549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:37.611894 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68ddfc4d-07d9-4e3f-89e1-25f62f9851c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1187 microversion: 2.1 time: 0.088093 Aug 21 01:56:37.612491 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3631/6608] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:37 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:38.633219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:38.633961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:38.641391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:38.641877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:38.642357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:38.643158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:38.643608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:38.644020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:38.681153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:38.681645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:38.682096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:38.682528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lazy-loading 'fault' on Instance uuid 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:56:38.724544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:56:38.733437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3de13f58-359f-4fe6-9e09-1edefaa7b869 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 200 len: 1192 microversion: 2.1 time: 0.104214 Aug 21 01:56:38.734217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2978/6609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:38 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:56:39.755742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:39.756462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:39.764083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:39.764574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:39.765032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:39.765728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:39.766167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:39.766579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:39.784098 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 HTTP/1.1 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2ad5d8cf-78fe-49ee-b932-1a7725c603e5'} Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:39.785830 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3b031e0-5c21-4f20-a8ef-b988344a52eb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 404 len: 111 microversion: 2.1 time: 0.035694 Aug 21 01:56:39.790980 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3632/6610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:39 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:56:41.810927 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 01:56:41.811658 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 01:56:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 01:56:41.931335 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:41.931885 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:41.938643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:41.939267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:41.939569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:41.940241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:41.940683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:41.941169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:41.955570 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 HTTP/1.1 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '2ad5d8cf-78fe-49ee-b932-1a7725c603e5'} Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:56:41.957430 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8db9e317-6a72-4c5a-8ab1-9f60654be538 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 404 len: 111 microversion: 2.1 time: 0.031931 Aug 21 01:56:41.962149 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2979/6611] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:56:41 2022] DELETE /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:56:41.968699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:56:41.969397 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 2ad5d8cf-78fe-49ee-b932-1a7725c603e5] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:56:41.977529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:41.978014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:41.978447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:41.979601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:56:41.980057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:56:41.980481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:56:41.995287 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 HTTP/1.1 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '2ad5d8cf-78fe-49ee-b932-1a7725c603e5'} Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:56:41.996904 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 2ad5d8cf-78fe-49ee-b932-1a7725c603e5 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-702d740c-3c65-4b9d-9362-f66dfc76eb4b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5" status: 404 len: 111 microversion: 2.1 time: 0.033933 Aug 21 01:56:42.001534 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3633/6612] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:56:41 2022] GET /compute/v2.1/servers/2ad5d8cf-78fe-49ee-b932-1a7725c603e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:57:02.741665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-403881442", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8faee71d-0b16-4194-b413-4733f7415759", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:02.751642 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=11 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:02.752476 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=27 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:02.900356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:57:03.428085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:57:03.428825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:57:03.429654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:57:03.430343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:57:03.431024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:57:03.445150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:03.445639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:03.446076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:03.446803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:03.447256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:03.447674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:03.466038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:57:03.471599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:57:03.537839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:57:03.541327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8faee71d-0b16-4194-b413-4733f7415759',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:57:03.685647 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-106a1346-28b6-4d5b-a61a-5e3d41460c87 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947842 Aug 21 01:57:03.686224 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2980/6613] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:57:03.697614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bc52e581-dba7-4145-a53b-f43f1e4d7b16 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:03.698320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bc52e581-dba7-4145-a53b-f43f1e4d7b16 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:03.701250 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:03.702003 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=17 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:04.227441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc52e581-dba7-4145-a53b-f43f1e4d7b16 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:04.234811 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bc52e581-dba7-4145-a53b-f43f1e4d7b16 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1070 microversion: 2.1 time: 0.541187 Aug 21 01:57:04.235478 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3634/6614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:03 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1070 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:05.257386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:05.258288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:05.265531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:05.266025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:05.266497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:05.267210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:05.267830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:05.268632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:05.373370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:05.382340 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-42108ff5-1e84-4cd8-adfa-147f0e65e20e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1186 microversion: 2.1 time: 0.130625 Aug 21 01:57:05.382931 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2981/6615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:05 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1186 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:06.194587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e2c63f-a066-4423-92a2-3a3261a20cd1", "tag": "697a9ae2-fb77-4f0d-b788-4990a46eef2b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:06.208326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:06.209062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:06.209559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:06.220620 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] Creating event network-changed:697a9ae2-fb77-4f0d-b788-4990a46eef2b for instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 on n-h2-master-1 Aug 21 01:57:06.226230 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f8a3a505-8b72-4227-aa0f-56ee03c87a94 req-39251ec3-89dc-4b1b-9c92-2470b5d031d7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035724 Aug 21 01:57:06.227102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3635/6616] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:57:06.405085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:06.406342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:06.414764 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:06.415259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:06.415675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:06.416636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:06.417141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:06.417562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:06.639007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:06.647444 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d9c17b61-515b-4d95-9fbf-76710742f553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1228 microversion: 2.1 time: 0.247675 Aug 21 01:57:06.648118 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2982/6617] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:06 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1228 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:07.669324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:07.670007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:07.676991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:07.677503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:07.677924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:07.678629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:07.679117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:07.679538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:07.815112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:07.823853 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef70d328-52a1-4b7d-9438-de8f38ef17b9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1228 microversion: 2.1 time: 0.159789 Aug 21 01:57:07.824455 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3636/6618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:07 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:08.845517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:08.846123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:08.854228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:08.854689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:08.855121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:08.855833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:08.856282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:08.856702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:08.993578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:09.001568 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf66122a-c5e6-4592-8084-9c030109f425 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1228 microversion: 2.1 time: 0.160110 Aug 21 01:57:09.002135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2983/6619] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:08 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:10.023532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:10.024119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:10.031680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:10.032191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:10.033049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:10.033782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:10.034259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:10.034740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:10.193517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:10.201929 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-96ca9963-cf3a-4444-b746-acfb1987e2cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.183235 Aug 21 01:57:10.202504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3637/6620] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:10 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:11.226104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:11.227055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:11.236972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:11.237678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:11.238303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:11.239294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:11.239939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:11.240545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:11.381354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:11.389329 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2dd8b02c-7399-48ee-a8c8-42ab27fd5b48 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.169149 Aug 21 01:57:11.389868 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2984/6621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:11 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:12.416191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:12.416822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:12.424743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:12.425262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:12.425693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:12.426396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:12.426841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:12.427264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:12.600527 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:12.611516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5306ec89-6fb3-4e6c-ae64-9241f737fe3c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.203586 Aug 21 01:57:12.612309 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3638/6622] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:12 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:13.640322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:13.640976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:13.643656 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:13.644319 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:13.651216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:13.651701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:13.652137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:13.652870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:13.653319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:13.653737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:13.802187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:13.810114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b019d9e-2d33-41c5-9f8f-a64a218510d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.173765 Aug 21 01:57:13.810753 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2985/6623] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:13 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:14.836061 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:14.836806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:14.839738 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:14.845748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:14.846447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:14.846960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:14.847738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:14.848316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:14.848814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:14.985551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:14.994050 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9a1263e-8b2e-4fb3-aa0d-c2b2a8bbc331 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.164592 Aug 21 01:57:14.994624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3639/6624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:14 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:16.019125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:16.020269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:16.031263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:16.032056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:16.033219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:16.034405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:16.035148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:16.035862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:16.174768 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:16.182917 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d9e3263-1002-4797-984a-3f5d80a9a50d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.170739 Aug 21 01:57:16.183501 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2986/6625] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:16 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:17.208753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:17.209788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:17.218465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:17.218951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:17.219384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:17.220080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:17.220546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:17.220997 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:17.368724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:17.377144 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-110026ef-6153-448f-a77e-7d5eb5d430f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.175682 Aug 21 01:57:17.377950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3640/6626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:17 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:18.403910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:18.404856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:18.416158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:18.416636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:18.417094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:18.417782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:18.418230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:18.418646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:18.566155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:18.578586 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-12fb9c3d-5fa4-4b4a-8be5-324d25d686c3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.181183 Aug 21 01:57:18.579502 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2987/6627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:18 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:19.604064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:19.604683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:19.613229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:19.614185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:19.614185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:19.614835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:19.615291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:19.615703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:19.754129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:19.762987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f30dc181-0897-4359-bd64-f6824eb73ce8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.163873 Aug 21 01:57:19.763593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3641/6628] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:19 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:20.784846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:20.785738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:20.796522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:20.797324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:20.798122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:20.799281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:20.800009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:20.800691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:20.943481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:20.956712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd167ad6-62b7-4597-98bd-3e9a0abfc19c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.176159 Aug 21 01:57:20.957608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2988/6629] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:20 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:57:21.823805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e2c63f-a066-4423-92a2-3a3261a20cd1", "name": "network-vif-plugged", "status": "completed", "tag": "697a9ae2-fb77-4f0d-b788-4990a46eef2b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:21.837092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:21.837641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:21.838092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:21.849489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] Creating event network-vif-plugged:697a9ae2-fb77-4f0d-b788-4990a46eef2b for instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 on n-h2-master-1 Aug 21 01:57:21.854715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2f066512-5bac-47e6-82d3-6ce8f154b523 req-c1750499-89bb-4d2c-b503-c34e85505138 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Aug 21 01:57:21.855331 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3642/6630] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:57:21.979454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:21.980046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:21.987612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:21.988399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:21.988855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:21.989569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:21.990018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:21.990476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:22.138859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:22.146967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d248876-f7c2-4832-8e3e-ddeb6e7fcbf6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.171710 Aug 21 01:57:22.147555 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2989/6631] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:21 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:23.179392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:23.180436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:23.188616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:23.189160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:23.189623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:23.190344 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:23.190798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:23.191364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:23.339692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:23.348458 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e5bea721-3d68-4218-a50a-48df0b9a4089 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1216 microversion: 2.1 time: 0.175916 Aug 21 01:57:23.349070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3643/6632] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:23 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:24.374655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:24.375507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:24.386271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.386750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.387179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.387871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.388298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.388714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.539957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:24.549901 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f0e28a8d-73f0-4ff0-9ea4-4254700ca8a9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1402 microversion: 2.1 time: 0.182603 Aug 21 01:57:24.550484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2990/6633] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:24 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:24.573482 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:24.574480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:24.586760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.587870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.588318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.589055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.589506 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.589926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.728053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:24.740957 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3356aede-a734-4521-9161-9a074f56bbd8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1402 microversion: 2.1 time: 0.173676 Aug 21 01:57:24.741788 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3644/6634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:24 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1402 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:24.763296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-856248979"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:24.765832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:24.772474 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.772996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.773435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.774131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:24.774588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:24.775259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:24.887656 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.api [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Attempting to quiesce instance before volume snapshot. Aug 21 01:57:24.954501 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.api [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 21 01:57:25.036190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Creating snapshot from volume 8faee71d-0b16-4194-b413-4733f7415759. {{(pid=122483) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 21 01:57:25.927378 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50ea34b9-f911-48e6-a04f-47cef9e07731 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1/action" status: 202 len: 0 microversion: 2.1 time: 1.168232 Aug 21 01:57:25.928133 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2991/6635] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 01:57:24 2022] POST /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1/action => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 01:57:27.095291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-270872699", "imageRef": "206ef943-f6aa-4a29-bbb1-38ce4298f7ac", "flavorRef": "452", "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:27.158266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:57:27.547386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:57:27.547806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:57:27.548279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:57:27.548679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:57:27.549141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:57:27.558963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:27.559443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:27.559878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:27.560600 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:27.561108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:27.561529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:27.579709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:57:27.585062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:57:27.599159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:57:27.601799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e8572e1f-2d47-4e79-8414-35499f2911ae',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:57:27.683411 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30ab766d-8f81-4b27-bef1-6f53202f72ed tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595356 Aug 21 01:57:27.684055 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3645/6636] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:57:27.696742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6eabc2e6-c8c3-4959-a623-5e4c52970a11 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:27.697550 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6eabc2e6-c8c3-4959-a623-5e4c52970a11 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:27.753981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6eabc2e6-c8c3-4959-a623-5e4c52970a11 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:27.761922 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6eabc2e6-c8c3-4959-a623-5e4c52970a11 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1229 microversion: 2.1 time: 0.070538 Aug 21 01:57:27.762492 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2992/6637] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:27 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1229 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:28.787359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:28.788453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:28.800722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:28.801697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:28.802543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:28.803796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:28.804611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:28.805594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:28.876103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:28.884850 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6e1b53b5-ae36-4593-8c68-c5172767bbc3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1299 microversion: 2.1 time: 0.105651 Aug 21 01:57:28.885616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3646/6638] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:28 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:29.907322 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:29.908433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:29.924377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:29.925898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:29.927340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:29.928164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:29.928684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:29.929258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:30.398763 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:30.408502 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-67fa35a4-6aab-4974-bfd0-550ebe445a3b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.504992 Aug 21 01:57:30.415555 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2993/6639] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:29 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:30.493147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2e52a5-9be1-4888-8257-4ba1146d4cdf", "tag": "5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:30.505647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:30.506417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:30.507007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:30.521956 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] Creating event network-changed:5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a for instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf on n-h1-master-1 Aug 21 01:57:30.527223 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-43cdce1d-0b6b-418e-92db-b748ae4acd0a req-005b6344-2021-4a0d-a013-c1230fb4dbd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037778 Aug 21 01:57:30.528142 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3647/6640] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:57:31.441766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:31.442487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:31.454230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:31.454737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:31.455181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:31.455889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:31.456386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:31.456843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:31.596794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:31.605381 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f69f2875-274a-47c3-9912-948507efc507 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.177787 Aug 21 01:57:31.606121 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2994/6641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:31 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:32.629474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:32.632363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:32.636701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:32.637461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:32.637896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:32.638602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:32.639056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:32.639472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:32.802914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:32.811867 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05d9de92-daff-40c9-a242-550b2c0166da tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.188585 Aug 21 01:57:32.812732 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3648/6642] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:32 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:33.836808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:33.837965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:33.841652 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:33.848173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:33.848858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:33.849304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:33.850163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:33.850752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:33.851195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:33.855627 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:34.068367 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:34.089826 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f8b31a24-51d3-4a5b-b25d-0e929505e022 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.256826 Aug 21 01:57:34.091122 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2995/6643] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:33 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:35.115062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:35.115825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:35.119462 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:35.126544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:35.127172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:35.127792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:35.128855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:35.129517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:35.130158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:35.138688 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=69 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:35.296497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:35.304469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6a76949c-a896-4070-a457-9758a72c8017 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.194085 Aug 21 01:57:35.305327 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3649/6644] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:35 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:36.326183 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:36.326841 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:36.335679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:36.336170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:36.336609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:36.337352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:36.338010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:36.338523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:36.472700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:36.481107 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3aa5db9b-411d-479a-b32c-750ef0493857 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.159241 Aug 21 01:57:36.492788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2996/6645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:36 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:37.506475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:37.507266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:37.515423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:37.516014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:37.516462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:37.517207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:37.517660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:37.518101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:37.568484 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:37.593442 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:37.659755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:37.668588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3301e3fe-7f9c-4d3b-898e-fd441c0d0b6f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.168615 Aug 21 01:57:37.669174 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3650/6646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:37 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:38.690827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:38.691449 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:38.694193 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:57:38.699939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:38.700428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:38.700883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:38.701595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:38.702046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:38.702471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:38.846512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:38.855123 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-47d2b675-f862-4248-8545-9e441ba294c6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.168367 Aug 21 01:57:38.855726 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2997/6647] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:38 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:39.876624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:39.877264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:39.884163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:39.884761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:39.885792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:39.886505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:39.886963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:39.887392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:40.024756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:40.033421 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56bbafed-fa41-4dab-8274-dbcce6f9af05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.160541 Aug 21 01:57:40.034241 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3651/6648] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:39 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:41.055051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:41.055699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:41.062755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:41.063245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:41.063696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:41.064403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:41.064884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:41.065316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:41.203221 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:41.211176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-55b17edd-65c9-4be6-8319-a6d36e1da694 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.160295 Aug 21 01:57:41.211730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2998/6649] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:41 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:42.232677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:42.233355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:42.240802 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:42.241426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:42.241976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:42.242686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:42.243138 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:42.243561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:42.381167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:42.391281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57741452-6ede-42e5-8b7e-c50b29db17d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1341 microversion: 2.1 time: 0.163247 Aug 21 01:57:42.392061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3652/6650] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:42 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:43.415032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:43.415634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:43.423567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:43.424345 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:43.424624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:43.425227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:43.425769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:43.426168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:43.571937 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:43.580871 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c2421613-746f-4406-a149-16fc1e14b6d0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1387 microversion: 2.1 time: 0.170172 Aug 21 01:57:43.581462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 2999/6651] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:43 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1387 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:44.605656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:44.606254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:44.618479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:44.619142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:44.619727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:44.620517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:44.621374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:44.621838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:44.766464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:44.774976 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72d8772f-7f7c-40f5-89b2-7eea2d5370e3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.175677 Aug 21 01:57:44.775626 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3653/6652] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:44 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:45.797835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:45.798460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:45.807114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:45.807581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:45.808163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:45.809265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:45.809974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:45.810407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:45.954091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:45.962927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4bd1b421-9c5e-4e79-bf35-ac5db9db251e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.169368 Aug 21 01:57:45.963630 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3000/6653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:45 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:46.983855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:46.984471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:46.991614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:46.992099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:46.992567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:46.993289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:46.993744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:46.994196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:47.143883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:47.151965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-51334968-eb36-471d-a1b4-5b1069f78e7f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.172215 Aug 21 01:57:47.152543 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3654/6654] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:46 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:48.173660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:48.174320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:48.182409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:48.183142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:48.183749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:48.184643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:48.185411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:48.185769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:48.336347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:48.346022 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35126deb-d3e6-4669-8366-1ffd5ce5c2b4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.176945 Aug 21 01:57:48.346757 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3001/6655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:48 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:49.371221 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:49.372103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:49.384109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:49.384947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:49.385645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:49.386939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:49.387543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:49.388513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:49.546211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:49.554591 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-acba3b20-591e-4a96-8016-2c889c021d32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.189988 Aug 21 01:57:49.555343 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3655/6656] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:49 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:50.580562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:50.581218 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:50.590897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:50.592137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:50.592589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:50.593333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:50.593807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:50.594270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:50.733244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:50.741817 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9cb27a5f-8ec0-4c8b-a78b-f2ea71d1d542 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.167333 Aug 21 01:57:50.742404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3002/6657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:50 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:51.764269 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:51.764851 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:51.772697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:51.773320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:51.773845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:51.774625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:51.775097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:51.775519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:51.924247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:51.932643 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3c3e2a4d-92cb-4ebc-a6ec-2faa72e67618 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.173132 Aug 21 01:57:51.933273 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3656/6658] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:51 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:52.954598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:52.955347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:52.963316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:52.963810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:52.964251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:52.964983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:52.965442 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:52.965869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:53.101281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:53.109685 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-723d5ae5-1543-4d24-b1f0-64e81cc325f4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.159678 Aug 21 01:57:53.110313 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3003/6659] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:52 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:54.131412 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:54.132638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:54.140437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:54.141257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:54.141705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:54.142465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:54.143686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:54.143686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:54.287274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:54.295956 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-720cada9-5e21-4c4f-88ad-9333f385b6a6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.168624 Aug 21 01:57:54.296849 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3657/6660] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:54 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:57:54.313456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2e52a5-9be1-4888-8257-4ba1146d4cdf", "name": "network-vif-plugged", "status": "completed", "tag": "5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:54.324404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:54.325263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:54.325752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:54.338739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] Creating event network-vif-plugged:5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a for instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf on n-h1-master-1 Aug 21 01:57:54.346883 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-37d0c9dc-3c20-4934-ba90-da13f8a0b822 req-81163bda-1d11-4fbd-9588-2fb814306834 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038444 Aug 21 01:57:54.347535 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3004/6661] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:57:55.319067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:55.319676 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:55.327084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:55.328013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:55.328467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:55.329421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:55.330026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:55.330412 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:55.477502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:55.485948 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-947d918c-3662-478a-a879-e4d16c1a690b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1375 microversion: 2.1 time: 0.171361 Aug 21 01:57:55.486523 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3658/6662] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:55 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 01:57:56.511639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:56.512533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:56.520231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.520723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.521209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:56.521916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.522376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.522815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:56.664511 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:56.674595 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c7d17f4c-5485-4275-aa73-9040841d94a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1561 microversion: 2.1 time: 0.170192 Aug 21 01:57:56.675330 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3005/6663] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:56 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:56.695429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:56.696054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:56.703416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.704152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.704695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:56.705457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.705913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.706334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:56.866304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:56.875510 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-46eaa70e-e5ae-4df8-8ef2-1d1545092ad6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1561 microversion: 2.1 time: 0.183825 Aug 21 01:57:56.876192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3659/6664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:56 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:56.975824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:56.976466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:56.983741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.984228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.984998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:56.985813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:56.986305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:56.986734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:57.016996 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:57:57.108976 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bff10d26-c4cc-40c3-8c4c-d76c50a32a0e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 204 len: 0 microversion: 2.1 time: 0.137844 Aug 21 01:57:57.109486 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3006/6665] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:57:56 2022] DELETE /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:57:57.121541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:57.122381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:57.132197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:57.132715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:57.133372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:57.134588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:57.135082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:57.135499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:57.290289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:57.301565 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7859551b-0e94-430f-afc5-8fe290e4b111 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1567 microversion: 2.1 time: 0.185842 Aug 21 01:57:57.302121 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3660/6666] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:57 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:58.328123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:58.329170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:58.337711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:58.338208 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:58.338650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:58.339359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:58.339817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:58.340248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:58.518337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:58.526750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-37d9247c-e7c8-46f0-9917-bb016c2528d5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1567 microversion: 2.1 time: 0.206002 Aug 21 01:57:58.527340 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3007/6667] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:58 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:57:59.015679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2e52a5-9be1-4888-8257-4ba1146d4cdf", "name": "network-vif-deleted", "tag": "5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:57:59.027940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:59.028567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:59.029133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:59.043803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] Creating event network-vif-deleted:5ea3fbba-eeb6-4c21-8a07-e5d957ffc21a for instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf on n-h1-master-1 Aug 21 01:57:59.051537 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-4b124c97-be01-4e5f-8394-fb8b7da28395 req-b30fc1e0-d55d-4443-a589-9963068fb6bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038778 Aug 21 01:57:59.053571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3661/6668] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:57:59.549808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:57:59.551558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:57:59.558929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:59.559387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:59.559855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:59.560556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:57:59.561047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:57:59.561478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:57:59.625294 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:57:59.633993 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6962b876-5e1c-495f-a6f9-d6c6e4840e27 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1360 microversion: 2.1 time: 0.088129 Aug 21 01:57:59.634641 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3008/6669] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:57:59 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:00.656684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:00.657357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:00.665036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:00.665602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:00.666072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:00.666814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:00.667428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:00.667782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:00.737822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:00.746389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f019e96a-2c2b-4de6-ad9c-d5fe3bef7b30 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1360 microversion: 2.1 time: 0.094973 Aug 21 01:58:00.747401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3662/6670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:00 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1360 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:01.769707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:01.770499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:01.778855 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:01.779500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:01.780157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:01.781184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:01.781744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:01.782253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:01.862132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:01.872310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7426c50f-57cd-43bd-8633-7f4346024944 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1360 microversion: 2.1 time: 0.107660 Aug 21 01:58:01.875777 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3009/6671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:01 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1360 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:02.894613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:02.895375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:02.902816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:02.903299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:02.903740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:02.904442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:02.904938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:02.905364 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:02.974658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:02.983318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cbd54a21-6ce1-4376-b05a-c944c1c45ae5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 200 len: 1360 microversion: 2.1 time: 0.092993 Aug 21 01:58:02.983894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3663/6672] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:02 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:04.006864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:04.007649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:04.011147 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:04.017859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:04.018411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:04.018861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:04.019639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:04.020785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:04.021285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:04.027531 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:04.041680 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf HTTP/1.1 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ba2e52a5-9be1-4888-8257-4ba1146d4cdf'} Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:04.043573 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bef20f4-f695-4f25-99cc-c0e69be5740d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 404 len: 111 microversion: 2.1 time: 0.043905 Aug 21 01:58:04.053567 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3010/6673] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:03 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:09.423165 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:09.423747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:09.427272 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=30 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:09.433613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:09.434106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:09.434543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:09.435251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:09.435701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:09.436128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:09.439112 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=86 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:09.479973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 01:58:09.568528 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6c595a0-a98e-4606-8ee3-510e274c0df9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 204 len: 0 microversion: 2.1 time: 0.151761 Aug 21 01:58:09.569268 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3664/6674] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:58:09 2022] DELETE /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 01:58:09.577796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:09.578433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:09.588046 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:09.588546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:09.589023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:09.589789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:09.590250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:09.590685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:09.729725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:09.737893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2352ef5-9e27-40ea-bdb5-8f91c0597a76 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1408 microversion: 2.1 time: 0.164008 Aug 21 01:58:09.738441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3011/6675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:09 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:10.770873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:10.771504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:10.779240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:10.779836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:10.780564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:10.781307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:10.781848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:10.782459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:10.923830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:10.933164 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6cfe5648-0f5d-4669-9b62-8fe1aac258c7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1408 microversion: 2.1 time: 0.169717 Aug 21 01:58:10.933770 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3665/6676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:10 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:11.882692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e2c63f-a066-4423-92a2-3a3261a20cd1", "name": "network-vif-deleted", "tag": "697a9ae2-fb77-4f0d-b788-4990a46eef2b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:58:11.892453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:11.893014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:11.893453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:11.904921 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] Creating event network-vif-deleted:697a9ae2-fb77-4f0d-b788-4990a46eef2b for instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 on n-h2-master-1 Aug 21 01:58:11.910269 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c2ec4b9f-d82d-4572-931d-33284c222433 req-f6cd9b33-fa6f-470f-87a1-973ca7abfeea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102677 Aug 21 01:58:11.910918 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3012/6677] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:58:11.954744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:11.955349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:11.962674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:11.963089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:11.963515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:11.964243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:11.964684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:11.965120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:12.034058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:12.043109 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f81fdc0-053f-404f-8838-a313d6226335 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1201 microversion: 2.1 time: 0.092350 Aug 21 01:58:12.043670 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3666/6678] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:11 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:13.070189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:13.071506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:13.079518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:13.080027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:13.080477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:13.081223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:13.081674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:13.082340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:13.151169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:13.159885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db612d43-ca8a-4887-aaa8-4ba6062b23bc tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1201 microversion: 2.1 time: 0.099357 Aug 21 01:58:13.160453 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3013/6679] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:13 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:14.179843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:14.180455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:14.187630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:14.188105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:14.188536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:14.189487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:14.189934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:14.190321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:14.256322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:14.269343 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-413dc1d7-b9ce-4684-92fd-32be95fd567f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1201 microversion: 2.1 time: 0.093300 Aug 21 01:58:14.270111 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3667/6680] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:14 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:15.296857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:15.297508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:15.306418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:15.306418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:15.306841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:15.307566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:15.308032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:15.308466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:15.380189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:15.388468 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-51ec5484-3218-4eca-9f7a-3b1cad3773fa tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1201 microversion: 2.1 time: 0.095885 Aug 21 01:58:15.389110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3014/6681] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:15 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:16.410223 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:16.410807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:16.418553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:16.419119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:16.419650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:16.420431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:16.420996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:16.421490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:16.454664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:16.455140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:16.455576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:16.456024 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lazy-loading 'fault' on Instance uuid 14e2c63f-a066-4423-92a2-3a3261a20cd1 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 01:58:16.502776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:16.511880 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-15fde4f2-cfe8-433c-a23b-bfb03e084e17 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 200 len: 1206 microversion: 2.1 time: 0.106096 Aug 21 01:58:16.512469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3668/6682] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:16 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 1206 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:17.532592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:17.533544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:17.541678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:17.542168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:17.542610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:17.543313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:17.543771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:17.544200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:17.559593 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 HTTP/1.1 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '14e2c63f-a066-4423-92a2-3a3261a20cd1'} Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:17.561309 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-421709e4-b99e-4753-962b-457d08185e7e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 404 len: 111 microversion: 2.1 time: 0.034232 Aug 21 01:58:17.565790 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3015/6683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:17 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:19.720234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:19.720713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:19.728329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:19.728844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:19.729281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:19.729994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:19.730442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:19.730820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:19.745499 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf HTTP/1.1 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ba2e52a5-9be1-4888-8257-4ba1146d4cdf'} Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:19.747200 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b69ba52-e6e3-4fa8-bdd2-e3e15f8bfe4a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 404 len: 111 microversion: 2.1 time: 0.032468 Aug 21 01:58:19.753314 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3669/6684] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:58:19 2022] DELETE /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:19.757666 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:19.758562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: ba2e52a5-9be1-4888-8257-4ba1146d4cdf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:19.766151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:19.766644 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:19.767088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:19.767798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:19.768432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:19.768927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:19.783078 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf HTTP/1.1 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ba2e52a5-9be1-4888-8257-4ba1146d4cdf'} Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:19.785078 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance ba2e52a5-9be1-4888-8257-4ba1146d4cdf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad0711d1-f8d1-4ce6-a2c9-07ace60e823b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf" status: 404 len: 111 microversion: 2.1 time: 0.032821 Aug 21 01:58:19.793773 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3016/6685] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:19 2022] GET /compute/v2.1/servers/ba2e52a5-9be1-4888-8257-4ba1146d4cdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:20.170547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:20.171044 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:20.177590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:20.178067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:20.178497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:20.179187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:20.179633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:20.180051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:20.193762 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 HTTP/1.1 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '14e2c63f-a066-4423-92a2-3a3261a20cd1'} Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:20.195308 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-665769e0-e659-47d6-bcb9-6780d6addfc8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 404 len: 111 microversion: 2.1 time: 0.030310 Aug 21 01:58:20.200271 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3670/6686] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 01:58:20 2022] DELETE /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:20.205936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:20.206576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 14e2c63f-a066-4423-92a2-3a3261a20cd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:20.212938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:20.213400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:20.214092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:20.214818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:20.215283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:20.215724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:20.232211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 HTTP/1.1 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '14e2c63f-a066-4423-92a2-3a3261a20cd1'} Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 01:58:20.233708 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 14e2c63f-a066-4423-92a2-3a3261a20cd1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b1c4a7c-46e6-4cc3-849c-2fe853d6440e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1" status: 404 len: 111 microversion: 2.1 time: 0.033173 Aug 21 01:58:20.239340 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3017/6687] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:20 2022] GET /compute/v2.1/servers/14e2c63f-a066-4423-92a2-3a3261a20cd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 01:58:20.315619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd4f9594-b1a4-46b2-8faf-f11564c9d785 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: .version_select at 0x7fc3f9d00820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-491001172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhLKDPbcpYaOcOJOMwgp4yPRwv6U8agaK15yg80mxo8/Wj7JE3xJ91P/Hc+dMG2tgHzdTABOqC1KUADWKrHbEV6QhKdBafqWohEB6Ix9E1VEQWk+sy4EYVLeH3EAhQYlg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:58:20.333332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd4f9594-b1a4-46b2-8faf-f11564c9d785 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:58:20.340374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dd4f9594-b1a4-46b2-8faf-f11564c9d785 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:58:20.372344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd4f9594-b1a4-46b2-8faf-f11564c9d785 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.060843 Aug 21 01:58:20.372975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3671/6688] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 01:58:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:58:37.795270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-511863367", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491001172", "security_groups": [{"name": "tempest-secgroup-smoke-237196080"}], "block_device_mapping_v2": [{"uuid": "5484bea9-8766-4ffc-9c34-08086652512a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:58:37.806151 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=15 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:37.806810 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=27 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:37.926465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 01:58:38.326956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 01:58:38.327380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 01:58:38.327858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 01:58:38.328268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 01:58:38.328707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 01:58:38.338338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:38.338822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:38.339260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:38.339981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:38.340459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:38.340890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:38.358435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 01:58:38.363961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 01:58:38.431162 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 01:58:38.433461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5484bea9-8766-4ffc-9c34-08086652512a',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 01:58:38.580497 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-61b966a5-a61e-4524-aea6-ed317d7a174b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789100 Aug 21 01:58:38.581108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3018/6689] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 01:58:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 01:58:38.591818 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:38.592588 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:38.593680 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:38.601862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b902a62a-ac9e-4ea2-94e2-a7af7b553936 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:38.601862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b902a62a-ac9e-4ea2-94e2-a7af7b553936 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:38.666520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b902a62a-ac9e-4ea2-94e2-a7af7b553936 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:38.674039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b902a62a-ac9e-4ea2-94e2-a7af7b553936 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1093 microversion: 2.1 time: 0.084537 Aug 21 01:58:38.674624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3672/6690] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:38 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:39.695186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:39.695857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:39.705710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:39.706218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:39.706659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:39.707401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:39.708082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:39.708522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:39.803988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:39.812336 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8645835b-af26-4df1-b2e6-851fca85395c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1209 microversion: 2.1 time: 0.121053 Aug 21 01:58:39.812971 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3019/6691] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:39 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:40.834068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:40.834906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:40.842957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:40.843807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:40.844435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:40.845537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:40.846386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:40.847906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:41.002313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:41.012076 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e306bd7-49d5-4c89-bff1-5594082f7447 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1276 microversion: 2.1 time: 0.182080 Aug 21 01:58:41.012678 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3673/6692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:40 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:41.074075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f051cd-1536-43ff-9303-f3ef1b6e2cb6", "tag": "a1c6c783-244c-4f8f-adab-fdd3f5f35e25"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:58:41.089946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:41.090786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:41.091222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:41.103990 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] Creating event network-changed:a1c6c783-244c-4f8f-adab-fdd3f5f35e25 for instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 on n-h2-master-1 Aug 21 01:58:41.116864 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a0da966d-7390-4222-ab76-1951513348f7 req-68e2cdbf-cb9b-4b65-ac19-8b743d33deb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053205 Aug 21 01:58:41.117997 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3020/6693] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 01:58:42.034036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:42.035123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:42.043132 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:42.043623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:42.044052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:42.044992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:42.045456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:42.045857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:42.198735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:42.207331 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e0de3a26-cb10-42e8-815a-c9f592ece578 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1276 microversion: 2.1 time: 0.177559 Aug 21 01:58:42.207933 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3674/6694] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:42 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:43.230600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:43.231382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:43.238168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:43.238665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:43.239107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:43.239820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:43.240274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:43.240702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:43.384951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:43.393039 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3be822e-cac6-46af-b705-c30d3f1ead25 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1276 microversion: 2.1 time: 0.167931 Aug 21 01:58:43.393745 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3021/6695] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:43 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:44.415690 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:44.416251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:44.423636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:44.424116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:44.424545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:44.425248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:44.425727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:44.426114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:44.565860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:44.574135 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e42c417c-05c3-4ac4-9525-9a4cb6c467a4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1276 microversion: 2.1 time: 0.163214 Aug 21 01:58:44.574685 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3675/6696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:44 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:45.595404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:45.596010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:45.603305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:45.603803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:45.604250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:45.605004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:45.605463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:45.605895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:45.754095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:45.762422 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e9bd6bd-0700-4b20-b81b-db4565a688d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.171072 Aug 21 01:58:45.763011 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3022/6697] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:45 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:46.788075 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:46.789112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:46.797111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:46.797602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:46.798035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:46.798738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:46.799196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:46.799624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:46.946337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:46.954533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a10d5f6c-ee41-4e24-a28d-a593a83597be tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.173510 Aug 21 01:58:46.955073 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3676/6698] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:46 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:47.977593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:47.978548 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:47.988303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:47.989067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:47.989735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:47.990812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:47.991555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:47.992230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:48.146292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:48.154768 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5947a99-415f-40f5-937e-dc685c2205cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.182948 Aug 21 01:58:48.155350 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3023/6699] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:47 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:49.176543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:49.177177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:49.179992 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:49.185757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:49.186239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:49.186677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:49.187374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:49.187827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:49.188251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:49.329454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:49.338750 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b025831-3023-4c10-8fbc-5c9421fe0629 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.166247 Aug 21 01:58:49.339312 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3677/6700] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:49 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:50.362814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:50.363656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:50.366412 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:50.367368 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:58:50.374538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:50.375032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:50.375478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:50.376172 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:50.376626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:50.377086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:50.517517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:50.529851 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa9c6e97-0e07-481b-aab3-71fb051fad2b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.172477 Aug 21 01:58:50.530643 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3024/6701] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:50 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:51.553115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:51.553888 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:51.563512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:51.564155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:51.564735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:51.565693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:51.566310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:51.566859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:51.721796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:51.730234 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fe88078f-a641-4c1e-a6b1-a2fcb6692877 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.182496 Aug 21 01:58:51.730811 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3678/6702] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:51 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:52.754320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:52.755134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:52.763627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:52.764160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:52.764611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:52.765373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:52.765840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:52.766274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:52.913558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:52.922603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95b97bff-e830-4711-832d-aaaf6f7ed34c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.174124 Aug 21 01:58:52.923171 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3025/6703] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:52 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:53.954821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:53.955950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:53.966086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:53.966564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:53.966995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:53.967699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:53.968137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:53.968560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:54.101445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:54.109838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e7208b61-79ca-4cb0-bff1-f7644e46bafb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.161903 Aug 21 01:58:54.110418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3679/6704] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:53 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:55.137209 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:55.138949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:55.147984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:55.148477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:55.148930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:55.149703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:55.150647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:55.150818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:55.306321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:55.318404 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c4f311cb-d43b-4e61-aa47-5a601d2c6c0f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.189287 Aug 21 01:58:55.319176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3026/6705] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:55 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:56.340546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:56.341415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:56.348438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:56.348972 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:56.349410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:56.350105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:56.350550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:56.350966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:56.421890 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f051cd-1536-43ff-9303-f3ef1b6e2cb6", "name": "network-vif-plugged", "status": "completed", "tag": "a1c6c783-244c-4f8f-adab-fdd3f5f35e25"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:58:56.434405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:56.434999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:56.436068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:56.448417 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] Creating event network-vif-plugged:a1c6c783-244c-4f8f-adab-fdd3f5f35e25 for instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 on n-h2-master-1 Aug 21 01:58:56.453610 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5b0171b4-bff8-4236-ab8f-6487802dc25e req-84105e50-fd0c-4b4d-8677-c5e733721755 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Aug 21 01:58:56.454215 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3027/6706] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 01:58:56.501500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:56.510812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f0aa9ad-b8df-4fc8-be32-b82ca4af2e01 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.173811 Aug 21 01:58:56.511622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3680/6707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:56 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:57.538398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:57.539555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:57.546767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:57.547273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:57.547718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:57.548419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:57.548923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:57.549355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:57.696034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:57.704832 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-578629c2-f92b-4ed2-84bf-472fef2bf0bd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1264 microversion: 2.1 time: 0.175189 Aug 21 01:58:57.705435 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3028/6708] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:57 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:58.731267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:58.731900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:58.739255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:58.739739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:58.740179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:58.740913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:58.741346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:58.741793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:58.879058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:58.887086 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1881586-47b8-4185-9abf-3702aeb2e266 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1451 microversion: 2.1 time: 0.159936 Aug 21 01:58:58.887720 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3681/6709] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:58 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:58:58.916146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 01:58:58.916796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 01:58:58.924394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:58.924935 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:58.925411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:58.926073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:58:58.926565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:58:58.926997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:58:59.067556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 01:58:59.075955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a1e979b-28d6-42ba-a5c8-c35b1a0abc32 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1451 microversion: 2.1 time: 0.163751 Aug 21 01:58:59.076497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3029/6710] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 01:58:58 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 01:59:00.746674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f051cd-1536-43ff-9303-f3ef1b6e2cb6", "tag": "a1c6c783-244c-4f8f-adab-fdd3f5f35e25"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 01:59:00.757877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 01:59:00.758433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 01:59:00.758908 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 01:59:00.770672 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] Creating event network-changed:a1c6c783-244c-4f8f-adab-fdd3f5f35e25 for instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 on n-h2-master-1 Aug 21 01:59:00.776675 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e2d7d5b7-01f5-4bc8-8790-7ed0f5deea13 req-09af123b-f696-401c-8517-7ad47560d272 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Aug 21 01:59:00.777674 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3682/6711] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 01:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:00:02.233880 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:00:02.234590 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:00:56.012240 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:00:56.013582 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:00:56.014392 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=60 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:00:56.090933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:00:56.091454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:00:56.097780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:56.098278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:56.098725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:56.099435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:56.099902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:56.100334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:56.127072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:00:56.213088 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6b089ec-c55f-4839-9125-1fabe069ce07 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 204 len: 0 microversion: 2.1 time: 0.203971 Aug 21 02:00:56.213692 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3030/6712] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:00:56 2022] DELETE /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:00:56.220639 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:00:56.221566 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:00:56.222300 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=56 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:00:56.226769 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:00:56.227493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:00:56.235162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:56.235682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:56.236116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:56.236876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:56.237288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:56.237709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:56.384475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:00:56.393912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eec2c5fd-2af4-496b-8679-ddd35c0a7d67 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1575 microversion: 2.1 time: 0.175504 Aug 21 02:00:56.394812 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3683/6713] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:00:56 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:00:57.420043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:00:57.420623 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:00:57.429793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:57.430293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:57.430737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:57.431448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:57.431894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:57.432328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:57.436450 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47494. Aug 21 02:00:57.577238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:00:57.589266 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aa519e93-dd5a-43dd-8daa-858a8d1566f9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1575 microversion: 2.1 time: 0.175268 Aug 21 02:00:57.590104 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3031/6714] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:00:57 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:00:58.613305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:00:58.614038 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:00:58.625528 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47498. Aug 21 02:00:58.629868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:58.630355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:58.630782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:58.631513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:58.631965 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:58.632388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:58.777512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:00:58.787777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1bd2845-cf9d-49f0-8ca4-39b128567c68 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1575 microversion: 2.1 time: 0.180273 Aug 21 02:00:58.788376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3684/6715] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:00:58 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:00:59.087876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f051cd-1536-43ff-9303-f3ef1b6e2cb6", "name": "network-vif-deleted", "tag": "a1c6c783-244c-4f8f-adab-fdd3f5f35e25"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:00:59.099639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:59.100107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:59.100780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:59.117016 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] Creating event network-vif-deleted:a1c6c783-244c-4f8f-adab-fdd3f5f35e25 for instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 on n-h2-master-1 Aug 21 02:00:59.123790 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-cf4b0542-c286-4c0d-8288-d595305b9989 req-a4ade420-3236-4dbc-bc78-cfa54dee1250 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039609 Aug 21 02:00:59.124511 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3032/6716] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:00:59.811678 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:00:59.812342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:00:59.819284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:59.819768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:59.820208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:59.820936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:00:59.821389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:00:59.821812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:00:59.890026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:00:59.898574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a91c7bb5-1554-4fb6-9baf-7195ab2756e7 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1224 microversion: 2.1 time: 0.091867 Aug 21 02:00:59.899161 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3685/6717] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:00:59 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:00.921670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:00.922387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:00.928906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:00.929404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:00.929896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:00.930606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:00.931075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:00.931517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:01.003092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:01.011774 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0ce8fdf1-97ad-4b86-854e-c4b7950d8ca8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1224 microversion: 2.1 time: 0.095656 Aug 21 02:01:01.012585 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3033/6718] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:00 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:02.032954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:02.033593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:02.041953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:02.042494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:02.043178 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:02.044107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:02.044847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:02.045284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:02.109590 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:02.118491 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b9b3c01-5042-4315-95a6-54133405f550 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1224 microversion: 2.1 time: 0.089791 Aug 21 02:01:02.119082 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3686/6719] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:02 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:03.140059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:03.140644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:03.148918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:03.149606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:03.150184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:03.151117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:03.151714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:03.152286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:03.222936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:03.231915 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afc43834-cb9d-48fb-8b42-db729dd96d82 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 200 len: 1224 microversion: 2.1 time: 0.095871 Aug 21 02:01:03.232586 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3034/6720] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:03 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:04.253893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:04.254528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:04.261904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:04.262377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:04.262807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:04.263494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:04.263938 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:04.264355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:04.280800 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 HTTP/1.1 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87f051cd-1536-43ff-9303-f3ef1b6e2cb6'} Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:01:04.282567 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c5f9b05f-013c-4890-b497-a95783989ebd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 404 len: 111 microversion: 2.1 time: 0.034470 Aug 21 02:01:04.288544 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3687/6721] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:04 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:01:04.345857 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1233194763", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491001172", "security_groups": [{"name": "tempest-secgroup-smoke-237196080"}], "block_device_mapping_v2": [{"uuid": "5484bea9-8766-4ffc-9c34-08086652512a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:01:04.479057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:01:05.154363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:01:05.154793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:01:05.155273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:01:05.155688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:01:05.156360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:01:05.165923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:05.166415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:05.166888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:05.167619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:05.168080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:05.168514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:05.185499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:01:05.190883 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:01:05.254997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:01:05.257186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5484bea9-8766-4ffc-9c34-08086652512a',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:01:05.404160 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:01:06.416836 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 47528. Aug 21 02:01:06.423894 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fac2ecfa-0909-4267-98b2-93f83b5ce560 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.083674 Aug 21 02:01:06.424553 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3035/6722] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:01:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:01:06.435653 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb811091-60f7-4ba2-8465-c4f1f9741ea4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:06.436228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb811091-60f7-4ba2-8465-c4f1f9741ea4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:06.496271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb811091-60f7-4ba2-8465-c4f1f9741ea4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:06.503962 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb811091-60f7-4ba2-8465-c4f1f9741ea4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1094 microversion: 2.1 time: 0.072147 Aug 21 02:01:06.504594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3688/6723] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:06 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:01:07.526316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:07.526966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:07.534756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:07.535266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:07.535699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:07.536406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:07.536893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:07.537328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:07.618438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:07.627382 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c02ed468-5b49-4d31-9d23-39680f49d8d9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1200 microversion: 2.1 time: 0.105973 Aug 21 02:01:07.628282 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3036/6724] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:07 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:08.648730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:08.649493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:08.659761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:08.660886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:08.661742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:08.662487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:08.662948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:08.663461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:08.808062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:08.816607 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f6f2537-1390-42eb-b87d-422b1a1cc2c5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1277 microversion: 2.1 time: 0.171685 Aug 21 02:01:08.824266 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3689/6725] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:08 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:08.987016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83147848-63cc-45d7-b1a1-2688c4437762", "tag": "7e3aad8e-759a-4459-88bb-62624667e12b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:01:09.001191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:09.002053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:09.002832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:09.018467 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] Creating event network-changed:7e3aad8e-759a-4459-88bb-62624667e12b for instance 83147848-63cc-45d7-b1a1-2688c4437762 on n-h2-master-1 Aug 21 02:01:09.024483 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-aae40e29-76a7-450a-9445-2f6d6fc4c062 req-55322a00-c6b9-47aa-9d98-bc8af3e9f302 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041415 Aug 21 02:01:09.025572 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3037/6726] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:01:09.838332 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:09.839358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:09.846701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:09.847334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:09.847885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:09.848683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:09.849421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:09.849991 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:09.993313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:10.002881 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2715d40-912d-4788-a0b9-6c2974383b05 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1277 microversion: 2.1 time: 0.168645 Aug 21 02:01:10.003894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3690/6727] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:09 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:11.025773 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:11.027279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:11.035060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:11.035554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:11.036146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:11.037356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:11.037858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:11.038294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:11.184716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:11.193516 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c5f5218f-0014-4067-b121-316574118052 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1277 microversion: 2.1 time: 0.173038 Aug 21 02:01:11.194089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3038/6728] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:11 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:12.214747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:12.215359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:12.223437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:12.223930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:12.224365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:12.225104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:12.225596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:12.226007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:12.370575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:12.379746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ce0387c-2e42-45a2-80db-98994c4932a3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1277 microversion: 2.1 time: 0.168980 Aug 21 02:01:12.380342 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3691/6729] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:12 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:13.404814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:13.405735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:13.413709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:13.414200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:13.414646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:13.415347 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:13.415806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:13.416250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:13.562492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:13.571600 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba844fe5-b546-4276-afd1-6896507099c8 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.173647 Aug 21 02:01:13.572215 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3039/6730] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:13 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:14.598194 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:14.598988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:14.609004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:14.609807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:14.610517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:14.611018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:14.611464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:14.611876 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:14.758245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:14.766845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5a26448-18fc-496f-8054-af0231de133f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.174835 Aug 21 02:01:14.767659 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3692/6731] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:14 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:15.789507 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:15.791168 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:15.799471 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:15.800496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:15.813222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:15.813739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:15.814196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:15.814895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:15.815361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:15.815792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:15.962188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:15.975166 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b140d08b-e8f0-4085-9678-10820f47c427 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.188932 Aug 21 02:01:15.976030 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3040/6732] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:15 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:17.003366 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:17.004042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:17.007122 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:17.013459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:17.013964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:17.014423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:17.015168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:17.015641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:17.016326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:17.181863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:17.190159 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e345714-d4c9-4a52-be81-cb56a99a566e tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.192337 Aug 21 02:01:17.190739 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3693/6733] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:16 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:18.215319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:18.216310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:18.224984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:18.225475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:18.225913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:18.226784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:18.227458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:18.227891 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:18.389843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:18.398782 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a8b5475-63a0-4213-87fa-73ccd297d728 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.190142 Aug 21 02:01:18.399290 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3041/6734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:18 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:19.421976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:19.423273 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:19.431944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:19.432550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:19.433163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:19.434027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:19.434625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:19.435094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:19.580064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:19.589368 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1936551d-c6d1-431b-9d81-369983de4fd6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.172482 Aug 21 02:01:19.589962 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3694/6735] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:19 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:20.613153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:20.613848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:20.621763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:20.622256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:20.622703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:20.623412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:20.623870 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:20.624302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:20.773194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:20.785928 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-03d22623-7cff-4b54-a514-f468a0d9cc5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.177552 Aug 21 02:01:20.786674 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3042/6736] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:20 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:21.810379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:21.811237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:21.819396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:21.819869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:21.820301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:21.821029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:21.821468 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:21.821880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:21.971142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:21.979527 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d839e665-f0e0-4b8d-941d-4ed996108691 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.175183 Aug 21 02:01:21.980107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3695/6737] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:21 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:22.999792 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:23.000398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:23.007257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:23.007746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:23.008191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:23.008929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:23.009386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:23.009817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:23.174071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:23.183565 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-487ff3f4-dd75-44da-995e-8295ece0689b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.187698 Aug 21 02:01:23.184160 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3043/6738] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:22 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:23.211733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83147848-63cc-45d7-b1a1-2688c4437762", "name": "network-vif-plugged", "status": "completed", "tag": "7e3aad8e-759a-4459-88bb-62624667e12b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:01:23.221573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:23.222107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:23.222537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:23.234406 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] Creating event network-vif-plugged:7e3aad8e-759a-4459-88bb-62624667e12b for instance 83147848-63cc-45d7-b1a1-2688c4437762 on n-h2-master-1 Aug 21 02:01:23.239517 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3828c696-f7b4-441b-bd71-e8f1b143cabc req-49f351ae-9551-4b81-85bf-4dcd61341289 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107676 Aug 21 02:01:23.240119 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3696/6739] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:01:24.203830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:24.204424 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:24.211975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:24.212473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:24.212960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:24.213670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:24.214133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:24.214568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:24.360197 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:24.369499 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-528a470d-7264-4156-adb4-cd66867b841c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1265 microversion: 2.1 time: 0.169673 Aug 21 02:01:24.370083 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3044/6740] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:24 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:25.393448 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:25.394355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:25.401286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:25.401777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:25.402213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:25.402921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:25.403374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:25.403799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:25.554821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:25.566830 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-076cb5f0-51dc-4c02-a15b-b35567b133c9 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1451 microversion: 2.1 time: 0.178984 Aug 21 02:01:25.567826 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3697/6741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:25 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:25.587663 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:01:25.588273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:01:25.595403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:25.595915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:25.596366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:25.597115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:25.597664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:25.598091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:25.740886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:01:25.749940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5002682-0fb9-4f1d-8911-0abc408926d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1451 microversion: 2.1 time: 0.166494 Aug 21 02:01:25.750497 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3045/6742] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:01:25 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:01:27.528827 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83147848-63cc-45d7-b1a1-2688c4437762", "tag": "7e3aad8e-759a-4459-88bb-62624667e12b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:01:27.535436 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=33 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:27.541845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:01:27.542316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:01:27.542748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:01:27.545574 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=77 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:01:27.556438 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] Creating event network-changed:7e3aad8e-759a-4459-88bb-62624667e12b for instance 83147848-63cc-45d7-b1a1-2688c4437762 on n-h2-master-1 Aug 21 02:01:27.562255 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-33a3b0ac-2009-465c-b03c-47f36d69e937 req-0c9ac575-5504-48f4-a135-bc9202647631 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037177 Aug 21 02:01:27.563423 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3698/6743] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:03:10.034490 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:10.035256 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:10.039441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1557158124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-491001172", "security_groups": [{"name": "tempest-secgroup-smoke-237196080"}], "block_device_mapping_v2": [{"uuid": "22740f77-4480-4df9-8f50-fd2921364801", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "256b3b64-7990-48b1-a3e0-281644736acf"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:03:10.284796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] validate_networks() for [('256b3b64-7990-48b1-a3e0-281644736acf', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:03:10.728977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:03:10.729418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:03:10.729907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:03:10.730332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:03:10.730761 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:03:10.741586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:10.742083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:10.742531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:10.743272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:10.743736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:10.744170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:10.763732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:03:10.769547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Getting quotas for user d45ded05250841d08b1bcc7b637515c3 and project 4c38de005ef44a40a8eae4bee4f27a33. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:03:10.831874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:03:10.834727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22740f77-4480-4df9-8f50-fd2921364801',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:03:10.978958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4505118-cbc9-4e0a-b2d3-bc8b4dabe99d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.946713 Aug 21 02:03:10.979563 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3046/6744] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:03:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:03:10.989621 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:10.990833 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:10.996941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d6f0901-655d-40c1-b6f2-80a1e29a23c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:10.998973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d6f0901-655d-40c1-b6f2-80a1e29a23c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:11.110889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d6f0901-655d-40c1-b6f2-80a1e29a23c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:11.118522 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d6f0901-655d-40c1-b6f2-80a1e29a23c1 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1094 microversion: 2.1 time: 0.131467 Aug 21 02:03:11.119128 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3699/6745] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:10 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:12.140734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:12.141916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:12.149541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:12.150116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:12.150612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:12.151387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:12.151955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:12.152464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:12.237057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:12.246202 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bb9f17cc-5061-49b8-8f2f-1fa336a95aba tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1200 microversion: 2.1 time: 0.110848 Aug 21 02:03:12.246690 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3047/6746] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:12 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1200 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:13.267739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:13.268370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:13.278307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:13.279243 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:13.279671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:13.280421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:13.280902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:13.281318 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:13.433401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:13.442825 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-461e38d0-946f-4bbc-afc5-9aa88b6fa830 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1277 microversion: 2.1 time: 0.179339 Aug 21 02:03:13.456203 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3700/6747] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:13 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:13.766814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e7ba02-8d09-4ea6-80c6-732b00ce56bf", "tag": "3efac82d-8375-44d8-887a-72612b385758"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:03:13.778589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:13.779520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:13.779971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:13.793425 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] Creating event network-changed:3efac82d-8375-44d8-887a-72612b385758 for instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf on n-h1-master-1 Aug 21 02:03:13.799306 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5733a154-2c92-45bc-bd09-288bc174b3a9 req-b17d31db-01de-48fd-b3b1-eae97af40002 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137036 Aug 21 02:03:13.800476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3048/6748] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:03:14.463927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:14.464726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:14.472373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:14.472990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:14.473498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:14.474305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:14.474832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:14.475462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:14.618861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:14.627596 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-091c5c21-b852-4ecd-ada6-e4896988e553 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1277 microversion: 2.1 time: 0.167650 Aug 21 02:03:14.628340 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3701/6749] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:14 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:15.648716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:15.649585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:15.657033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:15.657522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:15.657968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:15.659025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:15.659491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:15.659921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:15.795171 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:15.803228 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6f6c5dc-358c-47f6-8c11-3a13862c482b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1277 microversion: 2.1 time: 0.159177 Aug 21 02:03:15.803797 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3049/6750] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:15 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:16.824379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:16.825474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:16.833056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:16.833573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:16.834154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:16.835055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:16.835512 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:16.835939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:16.975976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:16.985110 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-99594d6a-0261-415e-93cb-b47b790ddb5c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1277 microversion: 2.1 time: 0.164704 Aug 21 02:03:16.985722 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3702/6751] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:16 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:18.011123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:18.012026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:18.022932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:18.023421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:18.023865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:18.024568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:18.025050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:18.025478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:18.186828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:18.199307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a49f0af4-71b3-4788-84f0-7928e8554712 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.194903 Aug 21 02:03:18.200056 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3050/6752] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:18 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:19.226421 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:19.227048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:19.234771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:19.235269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:19.235707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:19.236430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:19.236931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:19.237368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:19.381132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:19.394443 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-199c3ae9-b71c-400d-99a5-6e3bb165bef0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.173319 Aug 21 02:03:19.395314 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3703/6753] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:19 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:20.416612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:20.417569 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:20.427849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:20.428606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:20.429084 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:20.429791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:20.430244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:20.430828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:20.592492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:20.606121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4f56f1a-0948-42e9-b7f8-a5116b0602d3 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.193651 Aug 21 02:03:20.606864 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3051/6754] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:20 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:21.632915 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:21.637095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:21.637708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:21.647803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:21.648276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:21.648720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:21.649494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:21.649941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:21.650428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:21.824860 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:03:21.825139 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf (ip 10.222.0.46) !!! Aug 21 02:03:21.839742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:21.849190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e8befd21-8c9a-44d0-8279-14b9f9e5e06d tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.218438 Aug 21 02:03:21.849783 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3704/6755] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:21 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:21.896026 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:03:21.896341 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:03:22.244814 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:03:22.245874 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:03:22.874545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:22.875216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:22.877301 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:22.878047 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:03:22.885408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:22.885929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:22.886422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:22.887155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:22.887620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:22.888057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:23.066072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:23.074727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-541855ac-ebee-4325-a187-09b08380a721 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.204360 Aug 21 02:03:23.075308 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3052/6756] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:22 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:24.097407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:24.098022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:24.107457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:24.108129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:24.108654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:24.109546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:24.109995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:24.110460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:24.265965 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:24.274805 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6901b192-014c-4639-9ffc-5090dbb31f89 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.182701 Aug 21 02:03:24.275420 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3705/6757] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:24 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:25.298778 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:25.299405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:25.310281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:25.310975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:25.311481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:25.312536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:25.313287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:25.313957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:25.456697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:25.466028 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4658548e-2a09-4ec9-8d73-94a221f9880c tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.173416 Aug 21 02:03:25.466603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3053/6758] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:25 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:26.487520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:26.488071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:26.495581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:26.496057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:26.496483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:26.497197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:26.497640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:26.498053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:26.636252 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:26.645712 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-256aadcd-ff1d-4ed1-b3f0-e97f245c11e5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.162310 Aug 21 02:03:26.646297 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3706/6759] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:26 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:27.680805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:27.681452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:27.688584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:27.689102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:27.689551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:27.690370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:27.691387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:27.691834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:27.840002 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:27.848335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-38c428d0-cda1-4bc5-8076-164bc40ea2a2 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.173644 Aug 21 02:03:27.848972 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3054/6760] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:27 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:27.962475 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e7ba02-8d09-4ea6-80c6-732b00ce56bf", "name": "network-vif-plugged", "status": "completed", "tag": "3efac82d-8375-44d8-887a-72612b385758"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:03:27.973270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:27.973755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:27.974185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:27.988506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] Creating event network-vif-plugged:3efac82d-8375-44d8-887a-72612b385758 for instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf on n-h1-master-1 Aug 21 02:03:27.994414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5e98c905-0ab3-4c3b-a717-a9979365281b req-a5cf84e6-434d-4c67-bc87-d87563600d74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035884 Aug 21 02:03:27.995045 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3707/6761] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:03:28.872512 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:28.873573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:28.885021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:28.885516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:28.885962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:28.886671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:28.887125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:28.887540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:29.031353 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:29.042771 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2544ed11-2b4d-4cea-ace4-11c801dbf23f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1265 microversion: 2.1 time: 0.176930 Aug 21 02:03:29.043381 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3055/6762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:28 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:30.066900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:30.067739 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:30.074633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:30.075120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:30.075552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:30.076255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:30.076821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:30.077280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:30.223832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:30.233431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1872c213-b47a-4ac9-9e92-20885632ec69 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1452 microversion: 2.1 time: 0.171859 Aug 21 02:03:30.234023 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3708/6763] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:30 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:30.256291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:03:30.256966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:03:30.265603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:30.266104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:30.266554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:30.267267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:30.267731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:30.268195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:30.430978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:03:30.439467 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2b15f8ce-dc87-4edb-98df-dacaa9db00cb tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1452 microversion: 2.1 time: 0.187104 Aug 21 02:03:30.440065 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3056/6764] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:03:30 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:03:32.196522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e7ba02-8d09-4ea6-80c6-732b00ce56bf", "tag": "3efac82d-8375-44d8-887a-72612b385758"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:03:32.205989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:03:32.206458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:03:32.206883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:03:32.220932 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] Creating event network-changed:3efac82d-8375-44d8-887a-72612b385758 for instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf on n-h1-master-1 Aug 21 02:03:32.227468 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-8676c911-72a3-4584-861f-575c2f2320e3 req-39b910e4-a178-40ac-9647-e65da7523b65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101499 Aug 21 02:03:32.228083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3709/6765] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:05:12.044106 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:12.046307 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:12.047084 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=58 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:12.051160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:12.051664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:12.053128 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=52 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:12.057908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e7ba02-8d09-4ea6-80c6-732b00ce56bf", "tag": "3efac82d-8375-44d8-887a-72612b385758"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:05:12.070909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:12.071219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:12.071525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:12.072291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:12.072757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:12.073376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:12.074351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:12.074351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:12.074671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:12.090550 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] Creating event network-changed:3efac82d-8375-44d8-887a-72612b385758 for instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf on n-h1-master-1 Aug 21 02:05:12.097225 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ebd169f1-49ca-4682-8732-4c6814400c30 req-ce4d01fa-862c-4572-a8f3-bc5f8b7d8195 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055532 Aug 21 02:05:12.097840 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3710/6766] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:05:12.105246 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:05:12.202401 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a602009e-ef10-4d84-8905-84b89ac4ecea tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 204 len: 0 microversion: 2.1 time: 0.163128 Aug 21 02:05:12.203840 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3057/6767] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:05:12 2022] DELETE /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:05:12.213322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:12.215162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:12.223126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:12.223820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:12.224590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:12.225494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:12.226097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:12.226731 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:12.595696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:12.604138 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a236da90-3f91-4778-94e4-d95e1fd83679 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1577 microversion: 2.1 time: 0.395159 Aug 21 02:05:12.604826 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3711/6768] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:12 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1577 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:13.627099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:13.627809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:13.635481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:13.635961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:13.636399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:13.637130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:13.637806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:13.638460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:14.090813 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:14.102811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7328b15a-8c13-46b5-b090-944b8d784d93 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1577 microversion: 2.1 time: 0.480302 Aug 21 02:05:14.112878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3058/6769] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:13 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1577 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:14.496339 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e7ba02-8d09-4ea6-80c6-732b00ce56bf", "name": "network-vif-deleted", "tag": "3efac82d-8375-44d8-887a-72612b385758"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:05:14.506483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:14.507257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:14.507611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:14.519129 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] Creating event network-vif-deleted:3efac82d-8375-44d8-887a-72612b385758 for instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf on n-h1-master-1 Aug 21 02:05:14.524408 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-51eb7ca5-be8c-400c-9cf5-934c30139cf8 req-530ad84e-a498-4fd0-aeba-995882d3308e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085317 Aug 21 02:05:14.525111 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3712/6770] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:05:15.125965 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:15.126577 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:15.134626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:15.135248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:15.135703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:15.136432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:15.136921 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:15.137397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:15.207770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:15.216469 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66e26930-842d-41aa-a86f-56322b21f506 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1225 microversion: 2.1 time: 0.094276 Aug 21 02:05:15.217217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3059/6771] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:15 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:16.238937 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:16.239618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:16.247643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:16.248133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:16.248590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:16.249332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:16.249807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:16.250226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:16.315350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:16.324145 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1dc4c66-104e-42c3-9adb-dca3571ecfa4 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1225 microversion: 2.1 time: 0.089663 Aug 21 02:05:16.324709 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3713/6772] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:16 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:17.345935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:17.346592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:17.353752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:17.354263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:17.354702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:17.355412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:17.355878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:17.356500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:17.419825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:17.428084 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7a58687a-f729-46ea-9060-13440fd599b0 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1225 microversion: 2.1 time: 0.086206 Aug 21 02:05:17.428685 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3060/6773] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:17 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:18.450347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:18.450950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:18.458647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:18.459121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:18.459577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:18.460287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:18.460738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:18.461166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:18.529887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:18.538328 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f5ea7f1-0f37-471c-9a45-98a2b7e7cd36 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 200 len: 1225 microversion: 2.1 time: 0.092394 Aug 21 02:05:18.542349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3714/6774] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:18 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:19.562188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:19.562800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: d5e7ba02-8d09-4ea6-80c6-732b00ce56bf] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:19.570134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:19.570650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:19.571098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:19.572538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:19.573028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:19.573466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:19.590253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf HTTP/1.1 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd5e7ba02-8d09-4ea6-80c6-732b00ce56bf'} Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:19.592518 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance d5e7ba02-8d09-4ea6-80c6-732b00ce56bf could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8e49e258-da96-4161-ba8d-f77517ccf015 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf" status: 404 len: 111 microversion: 2.1 time: 0.037294 Aug 21 02:05:19.597959 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3061/6775] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:19 2022] GET /compute/v2.1/servers/d5e7ba02-8d09-4ea6-80c6-732b00ce56bf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:05:25.886545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:25.887041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:25.895619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:25.896439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:25.897163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:25.898257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:25.898967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:25.899637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:25.929314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:05:25.984873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83147848-63cc-45d7-b1a1-2688c4437762", "tag": "7e3aad8e-759a-4459-88bb-62624667e12b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:05:25.996828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:25.997622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:25.998062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:26.009834 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] Creating event network-changed:7e3aad8e-759a-4459-88bb-62624667e12b for instance 83147848-63cc-45d7-b1a1-2688c4437762 on n-h2-master-1 Aug 21 02:05:26.017223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-388c9515-6dcd-494e-8f58-c991f920800a req-23883a14-8644-49f4-bcca-b4c20c2fa373 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091359 Aug 21 02:05:26.019020 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3062/6776] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:05:26.020847 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9df4fd1d-6fc5-424b-9b43-1e5d0c78deda tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 204 len: 0 microversion: 2.1 time: 0.135964 Aug 21 02:05:26.021955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3715/6777] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:05:25 2022] DELETE /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:05:26.030612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:26.031359 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:26.038305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:26.038796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:26.039236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:26.039943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:26.040400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:26.040854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:26.182816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:26.191583 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3602aeb0-e96c-4a29-a750-406f656c96b5 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1576 microversion: 2.1 time: 0.165198 Aug 21 02:05:26.192182 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3063/6778] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:26 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:27.213809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:27.214373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:27.222388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:27.222878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:27.223314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:27.224013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:27.224469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:27.224930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:27.384866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:27.394032 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ee1f4c90-2e68-435f-bed4-d49e4bcbb315 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1576 microversion: 2.1 time: 0.184702 Aug 21 02:05:27.394655 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3716/6779] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:27 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:28.311745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83147848-63cc-45d7-b1a1-2688c4437762", "name": "network-vif-deleted", "tag": "7e3aad8e-759a-4459-88bb-62624667e12b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:05:28.322741 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:28.323235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:28.323679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:28.336335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] Creating event network-vif-deleted:7e3aad8e-759a-4459-88bb-62624667e12b for instance 83147848-63cc-45d7-b1a1-2688c4437762 on n-h2-master-1 Aug 21 02:05:28.341337 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bce57744-523f-40f6-a2ad-4608f7ddef60 req-68ace057-c515-4775-8023-4237d83b6c28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 21 02:05:28.344923 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3064/6780] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:05:28.416378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:28.417053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:28.424832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:28.425316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:28.425772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:28.426470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:28.426944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:28.427370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:28.496275 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:28.505012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f351488a-b67f-44fb-b56d-e8643d09b09f tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1225 microversion: 2.1 time: 0.092486 Aug 21 02:05:28.505605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3717/6781] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:28 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:29.528571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:29.529279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:29.536426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:29.536963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:29.537408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:29.538120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:29.538576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:29.539007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:29.604707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:29.613177 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7d532f7-3435-4d0e-bba1-f0db318ff786 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1225 microversion: 2.1 time: 0.089775 Aug 21 02:05:29.613757 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3065/6782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:29 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:30.634806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:30.635545 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:30.643985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:30.644416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:30.644871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:30.645564 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:30.646023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:30.646578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:30.716564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:30.725839 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9bd5030-7abe-48fc-b1a9-eadbce51f7dd tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1225 microversion: 2.1 time: 0.094955 Aug 21 02:05:30.726451 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3718/6783] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:30 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:31.748068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:31.748826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:31.756330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:31.756918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:31.757369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:31.758161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:31.758669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:31.759102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:31.827076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:31.835214 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7d06d2a-3c87-436e-954e-f7aef6d1ea12 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1225 microversion: 2.1 time: 0.091205 Aug 21 02:05:31.835789 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3066/6784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:31 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:32.856364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:32.856986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:32.864217 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:32.864697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:32.865151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:32.865960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:32.866405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:32.866822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:32.901221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:32.901704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:32.902137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:32.902589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lazy-loading 'fault' on Instance uuid 83147848-63cc-45d7-b1a1-2688c4437762 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:05:32.948247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45ded05250841d08b1bcc7b637515c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c38de005ef44a40a8eae4bee4f27a33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:32.957515 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d15a379-1c84-4b43-a01c-13718e6ce05a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 200 len: 1184 microversion: 2.1 time: 0.105123 Aug 21 02:05:32.958102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3719/6785] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:32 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 1184 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:33.983649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:33.984575 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 83147848-63cc-45d7-b1a1-2688c4437762] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:33.991950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:33.992439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:33.992890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:33.993631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:33.994092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:33.994562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:34.008460 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 HTTP/1.1 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '83147848-63cc-45d7-b1a1-2688c4437762'} Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.010140 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 83147848-63cc-45d7-b1a1-2688c4437762 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3b7e517-c9ad-43d0-8f42-de9eb7a31f0a tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762" status: 404 len: 111 microversion: 2.1 time: 0.034675 Aug 21 02:05:34.015988 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3067/6786] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:33 2022] GET /compute/v2.1/servers/83147848-63cc-45d7-b1a1-2688c4437762 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:05:34.480650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:34.481292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:34.488618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:34.489144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:34.489579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:34.490271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:34.490718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:34.491135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:34.505329 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 HTTP/1.1 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '87f051cd-1536-43ff-9303-f3ef1b6e2cb6'} Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:05:34.507001 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6bf284a-f322-47e1-800b-51d9b1eabd8b tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 404 len: 111 microversion: 2.1 time: 0.031846 Aug 21 02:05:34.511822 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3720/6787] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:05:34 2022] DELETE /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:05:34.521174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:34.522047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] [instance: 87f051cd-1536-43ff-9303-f3ef1b6e2cb6] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:34.533351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:34.533850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:34.534305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:34.534992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:34.535456 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:34.535901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:34.549883 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] HTTP exception thrown: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Request method failure captured: Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 HTTP/1.1 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZBVD_bMtCbM4EGDarDjFfrXig76c0oCY-p-W_sxWV_Zk8jrgb438QLlULnplTbvbiVN3AQO9KzGTo76-_E_PM_lgRBFEgGcQSrJiQXywHlAQf3Le6MfeI4-ZwLJbknpI20oS2CtpknxNAFIaEsXIF1hu_ZiHacq6VVV7sDPxG6xyUw Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c38de005ef44a40a8eae4bee4f27a33", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c38de005ef44a40a8eae4bee4f27a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c38de005ef44a40a8eae4bee4f27a33"}]}] Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 4c38de005ef44a40a8eae4bee4f27a33 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229097769 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: d45ded05250841d08b1bcc7b637515c3 Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestVolumeBootPattern-1229097769-project Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '87f051cd-1536-43ff-9303-f3ef1b6e2cb6'} Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:05:34.551446 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Returning 404 to user: Instance 87f051cd-1536-43ff-9303-f3ef1b6e2cb6 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebfcc9c8-9974-46e0-874b-46c335e636e6 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6" status: 404 len: 111 microversion: 2.1 time: 0.038788 Aug 21 02:05:34.556356 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3068/6788] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:34 2022] GET /compute/v2.1/servers/87f051cd-1536-43ff-9303-f3ef1b6e2cb6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:05:37.982736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4ee7dc7f-baa1-4fe7-80f5-022595887568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] Calling method '.version_select at 0x7fc3f937eee0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:38.010802 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4ee7dc7f-baa1-4fe7-80f5-022595887568 tempest-TestVolumeBootPattern-1229097769 tempest-TestVolumeBootPattern-1229097769-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-491001172" status: 202 len: 0 microversion: 2.1 time: 0.031731 Aug 21 02:05:38.011819 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3721/6789] 10.222.0.46 () {58 vars in 1260 bytes} [Sun Aug 21 02:05:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-491001172 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:05:56.746516 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:56.747279 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:56.868555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-504353701", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:05:56.937556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] validate_networks() for None {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:05:57.512169 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:05:57.512756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:05:57.513457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:05:57.514057 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:05:57.514665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:05:57.529546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:57.530247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:57.530781 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:57.531882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:57.532853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:57.533425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:57.555278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Getting quotas for project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:05:57.560987 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Getting quotas for user 7b7aba122ecd4007b6eccb20cca5801d and project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:05:57.575310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:05:57.582073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:05:57.629887 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b47ce5cd-f459-4352-b8a1-b0a8bd5da80b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892690 Aug 21 02:05:57.630499 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3069/6790] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:05:57.641195 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:57.642213 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:05:57.647428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6eba4384-2fa0-49c7-9cd8-6865872d2a6c tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:57.648282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6eba4384-2fa0-49c7-9cd8-6865872d2a6c tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:57.710593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6eba4384-2fa0-49c7-9cd8-6865872d2a6c tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:57.717815 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6eba4384-2fa0-49c7-9cd8-6865872d2a6c tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1221 microversion: 2.1 time: 0.078389 Aug 21 02:05:57.718736 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3722/6791] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:57 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:58.741474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:58.742184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:58.750245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:58.750853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:58.751300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:58.752025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:58.752465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:58.752927 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:58.820861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:05:58.829268 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e156ff66-9edd-46d4-8b07-e5026ca74935 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1281 microversion: 2.1 time: 0.093430 Aug 21 02:05:58.829870 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3070/6792] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:58 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:05:59.852410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:05:59.853242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:05:59.862624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:59.863215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:59.863641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:05:59.864377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:05:59.864844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:05:59.865251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:00.085710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:00.094285 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-80240563-50f3-4a0e-90a1-dadcabcb3e08 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.246130 Aug 21 02:06:00.094969 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3723/6793] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:05:59 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:00.370522 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98130a6-af88-4026-9a08-65ccea20466d", "tag": "bd9b998e-6df8-4f66-aff9-58ec50692765"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:00.386738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:00.387223 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:00.387655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:00.403343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] Creating event network-changed:bd9b998e-6df8-4f66-aff9-58ec50692765 for instance e98130a6-af88-4026-9a08-65ccea20466d on n-h2-master-1 Aug 21 02:06:00.409018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a969260d-b6a4-4be0-9630-89472260cc41 req-af3c0a4c-0b0c-424c-9a17-57b9871cea37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043427 Aug 21 02:06:00.410170 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3071/6794] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:01.116562 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:01.117220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:01.124193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:01.124687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:01.125129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:01.125838 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:01.126260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:01.126699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:01.265234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:01.274136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1208dcfb-33ad-4307-a337-d32a95268a78 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.161659 Aug 21 02:06:01.274976 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3724/6795] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:01 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:02.300518 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:02.301594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:02.309394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:02.309394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:02.309816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:02.310539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:02.310978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:02.311439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:02.463181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:02.471264 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a4702c5a-2646-4649-8145-1dc579a5b688 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.178031 Aug 21 02:06:02.471850 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3072/6796] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:02 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:03.492258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:03.493019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:03.500594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:03.501120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:03.501521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:03.502246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:03.502711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:03.503109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:03.668692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:03.677575 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d3055b4-15b3-4592-9589-13d773910d96 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.189403 Aug 21 02:06:03.678157 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3725/6797] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:03 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:04.704972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:04.705861 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:04.715193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:04.715684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:04.716155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:04.716884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:04.717350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:04.717776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:04.870249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:04.878231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-375dbe9b-1e9c-4741-8cde-d8f09bcf83fb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.180446 Aug 21 02:06:04.878824 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3073/6798] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:04 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:05.906947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:05.908055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:05.915736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:05.916222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:05.916675 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:05.917414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:05.917885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:05.918311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:06.062971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:06.075326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-200c5577-126a-482a-b158-e88aa0febda8 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.172116 Aug 21 02:06:06.076106 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3726/6799] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:05 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:06.616829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98130a6-af88-4026-9a08-65ccea20466d", "name": "network-vif-plugged", "status": "completed", "tag": "bd9b998e-6df8-4f66-aff9-58ec50692765"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:06.626544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:06.627033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:06.627475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:06.639537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] Creating event network-vif-plugged:bd9b998e-6df8-4f66-aff9-58ec50692765 for instance e98130a6-af88-4026-9a08-65ccea20466d on n-h2-master-1 Aug 21 02:06:06.644677 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c63eaee9-067b-405b-9767-08760370fd7e req-5754e65e-8fde-4b74-b5c0-5e13d7c87643 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081545 Aug 21 02:06:06.645384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3074/6800] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:07.102017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:07.102960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:07.114693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:07.115177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:07.115603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:07.116295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:07.116740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:07.117205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:07.258990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:07.267698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-20e3a248-d8aa-40d1-8ac8-2e88580168bb tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1321 microversion: 2.1 time: 0.172965 Aug 21 02:06:07.268266 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3727/6801] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:07 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:08.291726 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:08.292544 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:08.297968 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:08.298742 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:08.306787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.307290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.307738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.308435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.308937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.309394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.452107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:08.460641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dca842c8-beef-49c8-8751-61b77b829bea tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1471 microversion: 2.1 time: 0.169890 Aug 21 02:06:08.461271 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3075/6802] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:08 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:08.484584 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:08.538765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9575723-318f-4ad0-9052-642f8d6a146c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '.version_select at 0x7fc3f883ec10>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:08.610970 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9575723-318f-4ad0-9052-642f8d6a146c tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b206fc51dc894b059cbf38b4e977cccf" status: 200 len: 371 microversion: 2.1 time: 0.131006 Aug 21 02:06:08.611529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3728/6803] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 02:06:08 2022] GET /compute/v2.1/os-quota-sets/b206fc51dc894b059cbf38b4e977cccf => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:08.623438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76dfd9f9-7ba2-4a82-b2bb-0c93f7523f44 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-97459615", "id": 1513285514, "os-flavor-access:is_public": "True"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:08.626550 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 02:06:08.626550 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 02:06:08.645096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76dfd9f9-7ba2-4a82-b2bb-0c93f7523f44 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025333 Aug 21 02:06:08.645615 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3076/6804] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:06:08 2022] POST /compute/v2.1/flavors => generated 436 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:08.662129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1513285514"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:08.664491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:08.670940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.671415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.671856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.672557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.673032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.673447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.894498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '30345084b33c4b40bb0af7e7f117f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b206fc51dc894b059cbf38b4e977cccf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:08.905507 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-97459615 {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:06:08.915205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.915688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.916126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.916884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:08.917335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:08.917761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:08.942942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Getting quotas for project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:06:08.948489 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Getting quotas for user 7b7aba122ecd4007b6eccb20cca5801d and project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:06:08.968840 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] ram quota exceeded for b206fc51dc894b059cbf38b4e977cccf, tried to resize instance. Aug 21 02:06:08.969401 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Request method failure captured: Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action HTTP/1.1 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 39 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZME96Ic86kO0rlJ9maLZBHO0s_Kuo3QUPu7zGE_65lycmSNX0u0YHegAOBP9IILwoSdbWifVIEVG9MzKneD6RKrjAVPs9Ht_RElxMWEqSDCn1EsVNMFN1g09yhbAEOM0vMN2wbcFvVOR1hif5xB9mkO75iwegCGceCyyRlFH_eHZ-Y Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: b206fc51dc894b059cbf38b4e977cccf Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader,admin Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader,admin Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b206fc51dc894b059cbf38b4e977cccf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b206fc51dc894b059cbf38b4e977cccf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b206fc51dc894b059cbf38b4e977cccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b206fc51dc894b059cbf38b4e977cccf"}]}] Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: b206fc51dc894b059cbf38b4e977cccf Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersAdminNegativeTestJSON-1172783515-project-admin Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 30345084b33c4b40bb0af7e7f117f777 Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1172783515-project-admin Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: {"resize": {"flavorRef": "1513285514"}} Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e98130a6-af88-4026-9a08-65ccea20466d', 'body': {'resize': {'flavorRef': '1513285514'}}} Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:08.971374 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d5630c0-5f8f-4052-ad3e-625a62952100 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action" status: 403 len: 118 microversion: 2.1 time: 0.317170 Aug 21 02:06:08.977020 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3729/6805] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:06:08 2022] POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action => generated 118 bytes in 319 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:06:08.983120 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6283695e-3f6c-4264-b660-e83c66ac6f62 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:08.984267 n-d-master-1 devstack@n-api.service[122483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 02:06:08.984267 n-d-master-1 devstack@n-api.service[122483]: warnings.warn(msg) Aug 21 02:06:09.009359 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6283695e-3f6c-4264-b660-e83c66ac6f62 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1513285514" status: 202 len: 0 microversion: 2.1 time: 0.030737 Aug 21 02:06:09.009937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3077/6806] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 02:06:08 2022] DELETE /compute/v2.1/flavors/1513285514 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 02:06:09.018348 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af0a5a85-89a5-410e-bbfd-c6a8167a99e1 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.039752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af0a5a85-89a5-410e-bbfd-c6a8167a99e1 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025217 Aug 21 02:06:09.040374 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3730/6807] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 02:06:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:06:09.060486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4284258a-7623-4624-86be-d1295659c717 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '.version_select at 0x7fc403122ca0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.134743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4284258a-7623-4624-86be-d1295659c717 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/b206fc51dc894b059cbf38b4e977cccf" status: 200 len: 371 microversion: 2.1 time: 0.077941 Aug 21 02:06:09.135428 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3078/6808] 10.222.0.46 () {58 vars in 1242 bytes} [Sun Aug 21 02:06:09 2022] GET /compute/v2.1/os-quota-sets/b206fc51dc894b059cbf38b4e977cccf => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:09.148304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48d7e27d-aea1-4f3e-8a82-9420ef353a69 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-37350081", "id": 1431649128, "os-flavor-access:is_public": "True"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:09.151416 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 02:06:09.151416 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 02:06:09.169150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48d7e27d-aea1-4f3e-8a82-9420ef353a69 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.025778 Aug 21 02:06:09.169634 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3731/6809] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:06:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:09.182851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1431649128"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:09.185270 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:09.191460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.191961 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.192445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.193614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.194087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.194532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.380895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '30345084b33c4b40bb0af7e7f117f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b206fc51dc894b059cbf38b4e977cccf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:09.388096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-37350081 {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:06:09.395547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.396325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.396806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.397545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.397996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.398423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.427530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Getting quotas for project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:06:09.433156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Getting quotas for user 7b7aba122ecd4007b6eccb20cca5801d and project cd999ed44fc04ba3a8aa7d78f1ea52e5. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:06:09.446952 n-d-master-1 devstack@n-api.service[122483]: INFO nova.compute.api [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] cores quota exceeded for b206fc51dc894b059cbf38b4e977cccf, tried to resize instance. Aug 21 02:06:09.447508 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Request method failure captured: Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action HTTP/1.1 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 39 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZME96Ic86kO0rlJ9maLZBHO0s_Kuo3QUPu7zGE_65lycmSNX0u0YHegAOBP9IILwoSdbWifVIEVG9MzKneD6RKrjAVPs9Ht_RElxMWEqSDCn1EsVNMFN1g09yhbAEOM0vMN2wbcFvVOR1hif5xB9mkO75iwegCGceCyyRlFH_eHZ-Y Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: b206fc51dc894b059cbf38b4e977cccf Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader,admin Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader,admin Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b206fc51dc894b059cbf38b4e977cccf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b206fc51dc894b059cbf38b4e977cccf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b206fc51dc894b059cbf38b4e977cccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b206fc51dc894b059cbf38b4e977cccf"}]}] Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: b206fc51dc894b059cbf38b4e977cccf Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1172783515 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminNegativeTestJSON-1172783515-project-admin Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 30345084b33c4b40bb0af7e7f117f777 Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1172783515-project-admin Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: {"resize": {"flavorRef": "1431649128"}} Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e98130a6-af88-4026-9a08-65ccea20466d', 'body': {'resize': {'flavorRef': '1431649128'}}} Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:09.449687 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d9097a8e-660a-41d1-ad49-a919a18c4ac3 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action" status: 403 len: 113 microversion: 2.1 time: 0.273553 Aug 21 02:06:09.459205 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3079/6810] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:06:09 2022] POST /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d/action => generated 113 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:06:09.466315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5eb7a851-b286-447f-a507-4860f364a264 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.466315 n-d-master-1 devstack@n-api.service[122482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 02:06:09.466315 n-d-master-1 devstack@n-api.service[122482]: warnings.warn(msg) Aug 21 02:06:09.483384 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5eb7a851-b286-447f-a507-4860f364a264 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1431649128" status: 202 len: 0 microversion: 2.1 time: 0.026912 Aug 21 02:06:09.483938 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3732/6811] 10.222.0.46 () {58 vars in 1161 bytes} [Sun Aug 21 02:06:09 2022] DELETE /compute/v2.1/flavors/1431649128 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:06:09.493170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b633dd61-03dc-4c45-8bf4-73da95ce74d7 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.513999 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b633dd61-03dc-4c45-8bf4-73da95ce74d7 tempest-ServersAdminNegativeTestJSON-1172783515 tempest-ServersAdminNegativeTestJSON-1172783515-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024433 Aug 21 02:06:09.514558 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3080/6812] 10.222.0.46 () {58 vars in 1146 bytes} [Sun Aug 21 02:06:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:09.534588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.535161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:09.543380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.543855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.544285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.545019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.545463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.545861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.570669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:06:09.652356 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63442700-e3ec-45a4-9652-66f801490d12 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 204 len: 0 microversion: 2.1 time: 0.121789 Aug 21 02:06:09.653183 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3733/6813] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:06:09 2022] DELETE /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:06:09.662770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:09.663441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:09.669862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.670372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.670822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.671536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:09.672005 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:09.672443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:09.832108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:09.841049 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bfd85701-f653-45d4-85da-b99103ec8760 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1477 microversion: 2.1 time: 0.182906 Aug 21 02:06:09.841613 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3081/6814] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:09 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:10.868405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:10.869663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:10.881565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:10.882156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:10.882598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:10.883310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:10.883823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:10.884254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:11.027219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:11.036021 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34fb7f8c-1a85-4b90-a8e3-446274f4ef10 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1477 microversion: 2.1 time: 0.175692 Aug 21 02:06:11.036604 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3734/6815] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:10 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:11.666516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98130a6-af88-4026-9a08-65ccea20466d", "name": "network-vif-deleted", "tag": "bd9b998e-6df8-4f66-aff9-58ec50692765"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:11.679764 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:11.680352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:11.680894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:11.695741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] Creating event network-vif-deleted:bd9b998e-6df8-4f66-aff9-58ec50692765 for instance e98130a6-af88-4026-9a08-65ccea20466d on n-h2-master-1 Aug 21 02:06:11.702164 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-db48793b-465e-46d6-be6a-f45daf01bd2a req-8b012887-481f-4732-8f29-020c85c49d80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039705 Aug 21 02:06:11.703154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3082/6816] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:12.058398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:12.059120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:12.066051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:12.066533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:12.066971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:12.067686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:12.068151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:12.068561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:12.102361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:12.103021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:12.103606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:12.104151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lazy-loading 'fault' on Instance uuid e98130a6-af88-4026-9a08-65ccea20466d {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:06:12.159258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b7aba122ecd4007b6eccb20cca5801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd999ed44fc04ba3a8aa7d78f1ea52e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:12.168017 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-374b118a-984a-43a1-8c74-3d68a790d92b tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 200 len: 1311 microversion: 2.1 time: 0.114221 Aug 21 02:06:12.168608 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3735/6817] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:12 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:13.192281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:13.193098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] [instance: e98130a6-af88-4026-9a08-65ccea20466d] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:13.201719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:13.202220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:13.202667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:13.203379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:13.203845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:13.204282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:13.218665 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] HTTP exception thrown: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Request method failure captured: Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d HTTP/1.1 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZMDtwxr6gMy2iIBQNqNX4DFCKNWS4FF1c3qPsa4iBjAmgAfuH5QemLsIQvs1THiEUF6Tdo6Y_dST50O-bDNsyNReDPYr-oMBj09Idf5UMGTx-FRk381TW_Y-pbjGqj7YQeTCXYCJjt2aziLgC2yZkqsx85Lx8tgH-xB8eXIKG9ZTeg Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: cd999ed44fc04ba3a8aa7d78f1ea52e5 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1551113948 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cd999ed44fc04ba3a8aa7d78f1ea52e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cd999ed44fc04ba3a8aa7d78f1ea52e5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cd999ed44fc04ba3a8aa7d78f1ea52e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cd999ed44fc04ba3a8aa7d78f1ea52e5"}]}] Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1551113948 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: cd999ed44fc04ba3a8aa7d78f1ea52e5 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1551113948 Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersAdminNegativeTestJSON-1551113948-project Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7b7aba122ecd4007b6eccb20cca5801d Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1551113948-project Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e98130a6-af88-4026-9a08-65ccea20466d'} Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:13.220269 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] Returning 404 to user: Instance e98130a6-af88-4026-9a08-65ccea20466d could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-48a82579-79e7-4ab5-bc9b-4a7bd1df5777 tempest-ServersAdminNegativeTestJSON-1551113948 tempest-ServersAdminNegativeTestJSON-1551113948-project] 10.222.0.46 "GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d" status: 404 len: 111 microversion: 2.1 time: 0.035495 Aug 21 02:06:13.226434 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3083/6818] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:13 2022] GET /compute/v2.1/servers/e98130a6-af88-4026-9a08-65ccea20466d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:06:19.518877 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:19.519720 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:19.642096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1793849906", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "3ce3a779-8cbd-42de-87e2-9c824d9a9dd3"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:19.697289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] validate_networks() for [('3ce3a779-8cbd-42de-87e2-9c824d9a9dd3', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:06:20.091747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:06:20.092164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:06:20.092709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:06:20.093156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:06:20.093563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:06:20.104276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:20.104927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:20.105555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:20.106288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:20.106741 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:20.107159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:20.125180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Getting quotas for project c126d8141af543d0829cd995c44069cc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:06:20.131090 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Getting quotas for user c74a6df542e043c09471cf8725bd9ff7 and project c126d8141af543d0829cd995c44069cc. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:06:20.145262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:06:20.147677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:06:20.196039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e9f145c1-58d4-40e1-9744-722d6b011a4d tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682853 Aug 21 02:06:20.196697 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3736/6819] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:06:20.207827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9347f7cf-780c-4dd3-bfd5-6f75b92a2487 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:20.208709 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9347f7cf-780c-4dd3-bfd5-6f75b92a2487 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:20.212412 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:20.213583 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:20.279533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9347f7cf-780c-4dd3-bfd5-6f75b92a2487 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:20.287221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9347f7cf-780c-4dd3-bfd5-6f75b92a2487 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1215 microversion: 2.1 time: 0.083496 Aug 21 02:06:20.287840 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3084/6820] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:20 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:21.307859 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:21.309168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:21.318456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:21.319393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:21.320007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:21.320916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:21.321568 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:21.322158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:21.398785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:21.406638 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c60d8835-0e8d-4c67-b47b-6016a7f164e6 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1285 microversion: 2.1 time: 0.102871 Aug 21 02:06:21.407983 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3737/6821] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:21 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:22.431428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:22.433273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:22.442368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:22.443824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:22.445447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:22.446686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:22.448107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:22.449019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:22.623260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:22.632147 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7bd2190d-f959-4413-b806-fb5f11409b0f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.206721 Aug 21 02:06:22.632752 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3085/6822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:22 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:22.743373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:22.756495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:22.757170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:22.757560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:22.775259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] Creating event network-changed:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h2-master-1 Aug 21 02:06:22.780798 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2a2acd31-f895-4a87-810e-ef58a28f0952 req-879b3097-c390-4dec-bea5-e4c22fb254bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041859 Aug 21 02:06:22.781561 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3738/6823] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:06:23.653910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:23.654538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:23.662279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:23.662776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:23.664052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:23.664804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:23.665279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:23.665722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:23.804338 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:23.813712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6fac0382-9b76-4da9-86cf-21a5b3d8e1ed tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.163654 Aug 21 02:06:23.814245 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3086/6824] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:23 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:24.839663 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:24.840893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:24.849119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:24.849594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:24.850022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:24.850942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:24.851443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:24.851851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:25.019307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:25.029303 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89d8da98-bb9d-4827-9c07-1d8795ac594f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.195969 Aug 21 02:06:25.030299 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3739/6825] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:24 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:26.055023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:26.055630 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:26.063176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:26.063691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:26.064136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:26.064876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:26.065338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:26.065772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:26.198747 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:26.206885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8cbf1818-d961-4bd1-99bb-3be7fcc5cd54 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.156170 Aug 21 02:06:26.207462 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3087/6826] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:26 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:27.228461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:27.229047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:27.236383 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:27.236896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:27.237328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:27.238031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:27.238487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:27.238896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:27.373290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:27.381095 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-211547ed-eadb-45d5-98ca-810fd24c2bad tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.156659 Aug 21 02:06:27.381687 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3740/6827] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:27 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:28.406397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:28.407713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:28.411396 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:28.421224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:28.421726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:28.422194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:28.423216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:28.423883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:28.424425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:28.429105 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=72 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:28.569339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:28.577247 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af61d33c-145f-4fa8-b341-29a9481a64f5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.177845 Aug 21 02:06:28.577827 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3088/6828] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:28 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:28.624351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:28.630809 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:28.638238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:28.638720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:28.639151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:28.643507 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:28.652845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] Creating event network-vif-plugged:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h2-master-1 Aug 21 02:06:28.658733 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bed9fe9c-c640-4fe2-b146-036798b60c0d req-a6fc02f8-2213-46bb-ba86-5efefcc1158f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038069 Aug 21 02:06:28.659433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3741/6829] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:06:29.602516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:29.603523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:29.614266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:29.614946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:29.615552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:29.616467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:29.616966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:29.617403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:29.757164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:29.765556 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b663ad0f-2b4e-4156-9801-e55eeb475d59 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1315 microversion: 2.1 time: 0.169803 Aug 21 02:06:29.766120 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3089/6830] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:29 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:30.788490 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:30.789736 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:30.796240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:30.797922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:30.809895 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:30.809978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:30.810402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:30.811175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:30.811631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:30.812051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:30.953242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:30.961843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89ecce8e-0b6e-4a1d-a242-63692478f6d0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1503 microversion: 2.1 time: 0.176458 Aug 21 02:06:30.962390 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3742/6831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:30 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:30.979193 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:30.984571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:06:30.987589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:30.994686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:30.995179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:30.995627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:30.996327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:30.996805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:30.997241 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:31.027961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:31.034403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:06:31.041785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:06:31.042211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:06:31.042700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:06:31.043100 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:06:31.043525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:06:31.116392 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffb0fd0e-1b3d-40d2-b71f-f9b087493840 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "POST /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7/action" status: 202 len: 0 microversion: 2.1 time: 0.138006 Aug 21 02:06:31.116974 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3090/6832] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:06:30 2022] POST /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:06:31.125314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:31.125928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:31.132280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:31.132757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:31.133208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:31.133896 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:31.134940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:31.135401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:31.315134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:31.324057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4bd51a3c-0771-4dd7-a37e-68f71cfc4652 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1512 microversion: 2.1 time: 0.202572 Aug 21 02:06:31.324646 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3743/6833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:31 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:32.346443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:32.347714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:32.354842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:32.355385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:32.355829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:32.356524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:32.357045 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:32.357459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:32.490491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:32.499044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28137b5d-0a10-4868-b1c8-fb6c9d74ef53 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1512 microversion: 2.1 time: 0.157447 Aug 21 02:06:32.499653 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3091/6834] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:32 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:33.520418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:33.520970 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:33.528489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:33.529015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:33.529435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:33.530143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:33.530595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:33.531054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:33.677617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:33.685995 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e6f82c77-78fe-475a-93f3-02a57328314b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.169541 Aug 21 02:06:33.686615 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3744/6835] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:33 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:34.712725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:34.713803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:34.721733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:34.722224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:34.722671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:34.723382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:34.723814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:34.724284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:34.871986 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:34.883802 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-62c67364-2b6d-4fe1-91ac-825da496e4de tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.177344 Aug 21 02:06:34.884560 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3092/6836] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:34 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:35.911071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:35.912093 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:35.926214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:35.927747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:35.929125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:35.930316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:35.931080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:35.931795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:36.089035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:36.099186 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ede6618e-e75a-4170-b605-ca31bfd1963f tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.195065 Aug 21 02:06:36.099959 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3745/6837] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:35 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:37.125124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:37.126112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:37.137828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:37.138328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:37.138774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:37.139493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:37.139958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:37.140390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:37.290337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:37.298430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54923326-b1d7-41fb-a976-ed4ac95e2848 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.179960 Aug 21 02:06:37.299009 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3093/6838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:37 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:38.323938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:38.325322 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:38.336950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:38.337783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:38.338505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:38.339648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:38.340479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:38.340931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:38.487358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:38.498771 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a1a3108e-4456-49dd-a43f-5c211da7f681 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.181107 Aug 21 02:06:38.499595 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3746/6839] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:38 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:39.527970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:39.529028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:39.540956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:39.541801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:39.542516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:39.543787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:39.544249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:39.544677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:39.690265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:39.700717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2dab778e-869b-43b0-985b-a20e8f308050 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.179374 Aug 21 02:06:39.701565 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3094/6840] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:39 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:40.728019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:40.728664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:40.736083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:40.736585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:40.737048 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:40.737748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:40.738202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:40.738625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:40.873869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:40.882063 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73b2e53b-1026-4f97-9006-4aae31c216e0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.158149 Aug 21 02:06:40.882658 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3747/6841] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:40 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:41.908215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:41.909262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:41.920938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:41.921450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:41.921890 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:41.922592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:41.923049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:41.923473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:42.065756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:42.073907 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17332a4f-8098-4d6c-8eb0-7fbe0030af99 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.172836 Aug 21 02:06:42.074478 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3095/6842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:41 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:42.257512 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:06:42.257753 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:06:43.096227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:43.096817 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:43.104107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:43.104582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:43.105053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:43.105744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:43.106184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:43.106601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:43.258814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:43.267342 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3141bfe9-95e8-408a-9d85-ef12e3a73b92 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.175522 Aug 21 02:06:43.267913 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3748/6843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:43 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:44.293372 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:44.294396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:44.304632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:44.305167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:44.305613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:44.306337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:44.306777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:44.307204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:44.448525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:44.456840 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95c5a2de-e5e5-4d8b-894c-ad0c9cfb4090 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.170030 Aug 21 02:06:44.457441 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3096/6844] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:44 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:45.478469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:45.479113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:45.486232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:45.486719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:45.487153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:45.487843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:45.488291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:45.488709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:45.694547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:45.703187 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f53d855f-eb78-4383-a381-ea448c99ddb0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.228578 Aug 21 02:06:45.703776 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3749/6845] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:45 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:46.725474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:46.726106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:46.733896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:46.734434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:46.734906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:46.736083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:46.736083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:46.736585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:46.872343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:46.880744 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-01aec82e-afcf-42b3-a50a-1b900de29350 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.159723 Aug 21 02:06:46.881374 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3097/6846] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:46 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:47.913866 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:47.914912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:47.924559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:47.925074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:47.925516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:47.926210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:47.926667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:47.927091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:48.067841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:48.076012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a814862f-f6fb-414d-84b8-42e68e4e32a5 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.169019 Aug 21 02:06:48.076605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3750/6847] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:47 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:49.100918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:49.101588 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:49.111554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:49.112205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:49.112817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:49.113756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:49.114364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:49.114933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:49.262602 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:49.271745 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2a2e6671-50be-4651-8aa9-701f01188092 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.176514 Aug 21 02:06:49.272291 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3098/6848] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:49 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:50.296251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:50.297342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:50.305478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:50.306011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:50.306488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:50.307242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:50.307744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:50.308220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:50.452872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:50.461274 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-017f4cea-facd-46a3-971b-6de3a884cf14 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.171028 Aug 21 02:06:50.461838 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3751/6849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:50 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:51.490225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:51.491049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:51.502371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:51.502860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:51.503323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:51.504023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:51.504477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:51.504940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:51.654839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:51.666807 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc7183e1-4cb1-4641-9441-ab22423f9f65 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.183425 Aug 21 02:06:51.667643 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3099/6850] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:51 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:52.690972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:52.691583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:52.699039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:52.699515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:52.699942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:52.700621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:52.701097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:52.701515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:52.854429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:52.862606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81d9e573-b76e-4313-8d25-898e133db2c0 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.176453 Aug 21 02:06:52.863212 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3752/6851] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:52 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:53.889955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:53.890532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:53.898465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:53.898955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:53.899399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:53.900124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:53.900583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:53.901137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:54.042090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:54.050795 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-06228699-609d-4e04-9748-0ef03f114e77 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.164828 Aug 21 02:06:54.051377 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3100/6852] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:53 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:55.073661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:55.074270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:55.081685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:55.082164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:55.082602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:55.083295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:55.083748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:55.084172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:55.222195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:55.230211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-043fe894-a108-4b90-a3cf-db1a8249722c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.160500 Aug 21 02:06:55.230791 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3753/6853] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:55 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:56.253572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:56.254154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:56.261930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:56.262430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:56.262909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:56.263604 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:56.264067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:56.264539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:56.398982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:56.407220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e4df83b7-d342-4b38-af97-39c8723906a3 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.157504 Aug 21 02:06:56.408297 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3101/6854] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:56 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:57.430302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:57.431002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:57.440337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:57.440836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:57.441299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:57.442000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:57.442452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:57.442865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:57.576323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:57.584300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4988ffdb-5ff3-4209-a350-eb32a0ae334c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.159566 Aug 21 02:06:57.584901 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3754/6855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:57 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:58.610480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:58.611539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:58.614473 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=32 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:58.620016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:58.620510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:58.620990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:58.621701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:58.622160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:58.622575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:58.625351 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:06:58.760265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:58.770863 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7c358de7-f05d-4757-a870-b28ea0904525 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.167072 Aug 21 02:06:58.771456 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3102/6856] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:58 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:06:59.793628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:06:59.794333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:06:59.803194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:59.803791 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:59.804335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:59.805262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:06:59.805848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:06:59.806377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:06:59.947211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:06:59.959400 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d5fb23d-64c5-4b11-ac13-1dc4c5ccc75c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1517 microversion: 2.1 time: 0.170807 Aug 21 02:06:59.960262 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3755/6857] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:06:59 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:00.957592 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "name": "network-vif-unplugged", "status": "completed", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:00.969100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:00.969710 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:00.970195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:00.983443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Creating event network-vif-unplugged:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h1-master-1 Aug 21 02:07:00.985180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:00.985798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:00.990519 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=30 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:00.990697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:07:00.994285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:00.994777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:00.995215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:00.995931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:00.996416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:00.996865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:01.001916 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=86 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:01.004703 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-52bcad97-7cf6-49f8-9c70-ed8f872e0c57 req-a740653e-936a-4677-a724-df0a65e4cc28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051173 Aug 21 02:07:01.005568 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3103/6858] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:01.154525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:01.163018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec866d2a-672d-4e11-85c5-f3bf6172284e tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1516 microversion: 2.1 time: 0.181999 Aug 21 02:07:01.164139 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3756/6859] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:00 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:02.185933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:02.187260 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:02.195035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:02.195526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:02.195977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:02.196698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:02.197187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:02.197625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:02.347184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:02.355290 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-92e0d961-e074-4b27-992e-80ad9d41e99c tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1514 microversion: 2.1 time: 0.173702 Aug 21 02:07:02.355864 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3104/6860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:02 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:03.035519 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:03.046350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:03.046813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:03.047234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:03.059761 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Creating event network-changed:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h1-master-1 Aug 21 02:07:03.065797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:07:03.076926 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-871fce17-bbba-465c-9b57-1dcceb91a63b req-c7938ec5-f708-4104-80dc-4ed1a7c94f87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048338 Aug 21 02:07:03.077529 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3757/6861] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:03.376740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:03.377440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:03.384590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:03.385115 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:03.385563 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:03.386323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:03.387002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:03.387638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:03.594081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:03.602477 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a69ef5c4-c3f0-4792-917e-e959384d7933 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1511 microversion: 2.1 time: 0.230391 Aug 21 02:07:03.603034 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3105/6862] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:03 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:03.625770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:03.626359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:03.633159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:03.633492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:03.633927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:03.634875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:03.635329 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:03.635751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:03.667398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:07:03.724551 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Found an unconfirmed migration during delete, id: 16, status: finished Aug 21 02:07:05.728793 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-20f6e715-e905-4c42-b1d1-7f1b581e3745 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 204 len: 0 microversion: 2.1 time: 2.107032 Aug 21 02:07:05.729481 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3758/6863] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:07:03 2022] DELETE /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 0 bytes in 2109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:07:05.737817 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:05.738473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:05.746188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:05.746634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:05.747085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:05.747792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:05.748286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:05.748722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:05.889438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:05.899236 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-85266b41-0ca2-4b23-bfd3-8ee375ddc26b tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1503 microversion: 2.1 time: 0.165312 Aug 21 02:07:05.899822 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3106/6864] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:05 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:06.921875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:06.922621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:06.930544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:06.931064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:06.931502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:06.932241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:06.932694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:06.933148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:06.951211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:06.965721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:06.968006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:06.968540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:06.992104 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] Creating event network-vif-plugged:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h1-master-1 Aug 21 02:07:06.998927 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ce97ed9a-8df5-43b6-b5c4-ac397507ead7 req-59e7d0cd-35c3-4b1a-8bba-f2cd7c653540 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051887 Aug 21 02:07:07.000942 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3107/6865] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:07.081184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74a6df542e043c09471cf8725bd9ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c126d8141af543d0829cd995c44069cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:07.089513 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e9a7bed-f5c5-4e6a-b757-31a76ac364a7 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 200 len: 1503 microversion: 2.1 time: 0.172116 Aug 21 02:07:07.090105 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3759/6866] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:06 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:07.465748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8cc9ea-376f-456c-8415-a5e72c92a0f7", "name": "network-vif-deleted", "tag": "54e9fce5-c462-44f9-ac4a-1691de5a67c7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:07.477286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:07.478586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:07.479235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:07.493941 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] Creating event network-vif-deleted:54e9fce5-c462-44f9-ac4a-1691de5a67c7 for instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 on n-h1-master-1 Aug 21 02:07:07.500114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-3cd7d603-a74f-4400-8a0d-da0c0ddd4fd3 req-c50c0797-abf7-4d8c-97ef-e64edbe2b7f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038032 Aug 21 02:07:07.501108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3108/6867] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:08.115438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:08.116452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:08.128139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.129003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.129795 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.130608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.131069 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.131490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.146163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] HTTP exception thrown: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Request method failure captured: Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 HTTP/1.1 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZMbCJvXv9vJ7XiBIqxdcShfJzW4sl6tsvn-F9BEn5kaPQD-od8gsSKD1aN7LfOOcvEqJMyM6ntaVgJFAmZC7QytZfpxcFZicI5HVKt_9xEzxCcn2V6kFhokYknnVqQnIzJaLp0hXoJdInYsyruThvrHU0ZyluCt_vCM22bSP3qzkP0 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c126d8141af543d0829cd995c44069cc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c126d8141af543d0829cd995c44069cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}] Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c74a6df542e043c09471cf8725bd9ff7 Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6c8cc9ea-376f-456c-8415-a5e72c92a0f7'} Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.147844 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Returning 404 to user: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-947ba049-bb24-4a06-ae6c-bb3710954279 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 404 len: 111 microversion: 2.1 time: 0.041040 Aug 21 02:07:08.151426 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3760/6868] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:08 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:07:08.166216 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:08.166799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:08.173524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.174015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.174449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.175143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.175595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.176025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.190064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] HTTP exception thrown: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Request method failure captured: Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 HTTP/1.1 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZMbCJvXv9vJ7XiBIqxdcShfJzW4sl6tsvn-F9BEn5kaPQD-od8gsSKD1aN7LfOOcvEqJMyM6ntaVgJFAmZC7QytZfpxcFZicI5HVKt_9xEzxCcn2V6kFhokYknnVqQnIzJaLp0hXoJdInYsyruThvrHU0ZyluCt_vCM22bSP3qzkP0 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c126d8141af543d0829cd995c44069cc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c126d8141af543d0829cd995c44069cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}] Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: c74a6df542e043c09471cf8725bd9ff7 Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '6c8cc9ea-376f-456c-8415-a5e72c92a0f7'} Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:07:08.191711 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Returning 404 to user: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7038d7db-3131-4fcc-96ac-a922960a6f25 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 404 len: 111 microversion: 2.1 time: 0.032228 Aug 21 02:07:08.195150 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3109/6869] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:07:08 2022] DELETE /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:07:08.204536 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:08.205494 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] [instance: 6c8cc9ea-376f-456c-8415-a5e72c92a0f7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:08.214529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.215203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.215788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.216722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:08.217321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:08.217892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:08.234155 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] HTTP exception thrown: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Request method failure captured: Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 HTTP/1.1 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZMbCJvXv9vJ7XiBIqxdcShfJzW4sl6tsvn-F9BEn5kaPQD-od8gsSKD1aN7LfOOcvEqJMyM6ntaVgJFAmZC7QytZfpxcFZicI5HVKt_9xEzxCcn2V6kFhokYknnVqQnIzJaLp0hXoJdInYsyruThvrHU0ZyluCt_vCM22bSP3qzkP0 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c126d8141af543d0829cd995c44069cc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c126d8141af543d0829cd995c44069cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c126d8141af543d0829cd995c44069cc"}]}] Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c126d8141af543d0829cd995c44069cc Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-DeleteServersTestJSON-386305155 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: c74a6df542e043c09471cf8725bd9ff7 Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-DeleteServersTestJSON-386305155-project Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '6c8cc9ea-376f-456c-8415-a5e72c92a0f7'} Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:07:08.235704 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] Returning 404 to user: Instance 6c8cc9ea-376f-456c-8415-a5e72c92a0f7 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-552d7b01-8396-4db5-b921-0b47ee265178 tempest-DeleteServersTestJSON-386305155 tempest-DeleteServersTestJSON-386305155-project] 10.222.0.46 "GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7" status: 404 len: 111 microversion: 2.1 time: 0.038809 Aug 21 02:07:08.240045 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3761/6870] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:08 2022] GET /compute/v2.1/servers/6c8cc9ea-376f-456c-8415-a5e72c92a0f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:07:16.782692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1233583763", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "c4409971-c9fd-401c-b52c-ac28ba024b0e"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:16.839780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] validate_networks() for [('c4409971-c9fd-401c-b52c-ac28ba024b0e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:07:17.579611 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:07:17.580072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:07:17.580528 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:07:17.581142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:07:17.581566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:07:17.591085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:17.591772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:17.595577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:17.596603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:17.597144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:17.597620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:17.617646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:07:17.623906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for user 7f0d463954f54cc6b266fc4920697515 and project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:07:17.638314 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:07:17.640750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:07:17.689936 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c2eb1b9-a004-4604-8d3d-7bf2e83869ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070158 Aug 21 02:07:17.690877 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3110/6871] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:07:17.702761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cfb08d3f-2750-4557-86f9-6872be127c03 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:17.703457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cfb08d3f-2750-4557-86f9-6872be127c03 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:17.772391 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cfb08d3f-2750-4557-86f9-6872be127c03 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:17.782905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cfb08d3f-2750-4557-86f9-6872be127c03 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1218 microversion: 2.1 time: 0.083788 Aug 21 02:07:17.783596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3762/6872] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:17 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:18.819628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:18.821531 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:18.832761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:18.834162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:18.834843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:18.836012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:18.836874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:18.837612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:18.937658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:18.946700 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f3704c5-9912-4d42-b86b-6b16f1a78499 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1288 microversion: 2.1 time: 0.135070 Aug 21 02:07:18.947437 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3111/6873] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:18 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:19.969838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:19.971355 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:19.982941 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:19.986447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:19.987441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:19.988119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:19.989238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:19.990405 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:19.991081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:20.174847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:20.191499 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:20.200709 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cbf27379-c4e3-4f10-abd2-c5152fece02b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.233859 Aug 21 02:07:20.203332 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3763/6874] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:19 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:20.209061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:20.209817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:20.210491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:20.229631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] Creating event network-changed:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h1-master-1 Aug 21 02:07:20.236693 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a6679113-7647-412c-8f2e-df75fed51258 req-1130fb79-c54e-4181-8d5d-54de222ee391 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049768 Aug 21 02:07:20.237902 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3112/6875] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:21.226105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:21.226746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:21.237285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:21.237877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:21.238332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:21.239234 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:21.239856 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:21.240459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:21.380803 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:21.389093 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71458085-2aca-4263-a202-e98c82d2b525 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.169015 Aug 21 02:07:21.389643 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3764/6876] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:21 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:22.411096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:22.411837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:22.419811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:22.420311 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:22.420777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:22.421505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:22.421975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:22.422477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:22.571727 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:22.584371 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8211016c-5ea7-4bae-855d-bb8783ef44e8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.177648 Aug 21 02:07:22.585274 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3113/6877] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:22 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:23.611132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:23.611830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:23.619888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:23.620369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:23.620777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:23.621520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:23.621962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:23.622375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:23.759870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:23.767756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d473e84-2f6f-4150-ae5c-6765bbcb4671 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.164749 Aug 21 02:07:23.768349 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3765/6878] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:23 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:24.791323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:24.792095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:24.800893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:24.801479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:24.802006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:24.802830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:24.803374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:24.803925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:24.946859 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:24.954736 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc75e65b-8cf0-4c99-bbbe-9e01b64c0ce2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.168310 Aug 21 02:07:24.955330 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3114/6879] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:24 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:25.009346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "name": "network-vif-plugged", "status": "completed", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:25.023726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:25.024215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:25.024645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:25.037617 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] Creating event network-vif-plugged:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h1-master-1 Aug 21 02:07:25.043291 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-25b7dd48-b43f-4f9d-a6ab-04ad65491fda req-349689d1-9a4f-4c14-adc7-fe349c63f67d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039895 Aug 21 02:07:25.044175 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3766/6880] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:07:25.978480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:25.979097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:25.986509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:25.987010 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:25.987450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:25.988164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:25.988630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:25.989100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:26.146211 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:26.158653 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0dcd636d-49d4-4790-b268-bc412171e954 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1318 microversion: 2.1 time: 0.185015 Aug 21 02:07:26.159258 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3115/6881] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:25 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:27.184903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:27.185846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:27.194930 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.195479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.195911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.196659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.197152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.197591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.366539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:27.374944 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b888e5b-a549-4b70-9b55-b65a1e57c1b9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1509 microversion: 2.1 time: 0.194575 Aug 21 02:07:27.375500 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3767/6882] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:27 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:27.395879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:27.396431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:27.403725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.404216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.404659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.405393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.405852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.406283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.546639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:27.554820 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1646f636-b3a0-421a-9e89-658b8ff463ba tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1509 microversion: 2.1 time: 0.162969 Aug 21 02:07:27.555402 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3116/6883] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:27 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:27.575153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:27.577572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:27.583785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.584265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.584734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.585488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.585941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.586361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.657364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-14f42651-7d45-4efd-b3ec-37d966208f1c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "PUT /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1081 microversion: 2.1 time: 0.085288 Aug 21 02:07:27.658014 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3768/6884] 10.222.0.46 () {60 vars in 1256 bytes} [Sun Aug 21 02:07:27 2022] PUT /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1081 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:27.679421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:27.680123 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:27.682862 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:27.683564 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:27.690298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.691097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.691747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.692868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.693510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.694226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.830637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:27.839713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ff30a8c-8331-4762-8a11-21b4171ca80b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1507 microversion: 2.1 time: 0.166853 Aug 21 02:07:27.840302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3117/6885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:27 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:27.859773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:27.860384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:27.862488 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:27.868365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.868877 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.869304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:27.869973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:27.870416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:27.870830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:28.013780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:28.021685 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72d521c9-2807-4627-87d2-e05240685a93 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1507 microversion: 2.1 time: 0.165825 Aug 21 02:07:28.022260 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3769/6886] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:27 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:28.042383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:07:28.044850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:28.051167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:28.051688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:28.052114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:28.052861 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:28.053323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:28.053761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:28.082839 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:28.089096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:07:28.096128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:07:28.096564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:07:28.097083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:07:28.097505 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:07:28.097932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:07:28.173527 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f0976cc2-899a-42ba-a633-d002ad453f55 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.135445 Aug 21 02:07:28.174154 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3118/6887] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:07:28 2022] POST /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:07:28.183054 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:28.183931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:28.193183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:28.194084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:28.194922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:28.195659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:28.196179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:28.196621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:28.335400 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:28.343457 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-81f2e75d-8e36-41ad-90a7-71c34976de9c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1518 microversion: 2.1 time: 0.164959 Aug 21 02:07:28.344041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3770/6888] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:28 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:07:29.365175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:29.365801 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:29.367749 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:29.373421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:29.373924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:29.374361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:29.375069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:29.375527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:29.375958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:29.380684 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:29.568060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:29.576217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d4f17f9-938c-4f10-863b-caf230fc5f42 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1518 microversion: 2.1 time: 0.216156 Aug 21 02:07:29.576955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3119/6889] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:29 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:30.599878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:30.600486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:30.608102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:30.608511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:30.608984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:30.609683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:30.610263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:30.610689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:30.751256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:30.763392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-57c3b434-6fae-476d-bcd7-8da89a838a0d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1518 microversion: 2.1 time: 0.167372 Aug 21 02:07:30.764249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3771/6890] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:30 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:31.794023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:31.794597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:31.802069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:31.802554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:31.803002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:31.803698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:31.804148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:31.804577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:31.952702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:31.960937 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fcfb522-cf38-4d3a-a781-120c3b1213b8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.172436 Aug 21 02:07:31.961487 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3120/6891] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:31 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:32.983763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:32.984491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:32.987952 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:32.994529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:32.995135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:32.995661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:32.996490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:32.997368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:32.997557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:33.138455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:33.146746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fa943904-7647-4efb-b9a1-5918979a85d7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.167779 Aug 21 02:07:33.147328 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3772/6892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:32 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:34.170139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:34.170780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:34.178130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:34.178627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:34.179081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:34.179797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:34.180260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:34.180693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:34.345864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:34.354003 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3c47ca68-3088-4b12-a81d-5a76a894d712 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.189512 Aug 21 02:07:34.354584 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3121/6893] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:34 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:35.380203 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:35.381238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:35.392315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:35.392974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:35.393657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:35.394706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:35.395410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:35.396051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:35.549161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:35.561202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c78eba4d-d365-444f-8aa0-ddca73b69535 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.187218 Aug 21 02:07:35.561883 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3773/6894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:35 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:36.591264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:36.592664 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:36.601330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:36.601825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:36.602270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:36.603025 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:36.603418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:36.603908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:36.742769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:36.751193 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ca6c2469-edca-4697-836b-32604ba8e9bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.170327 Aug 21 02:07:36.751979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3122/6895] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:36 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:37.776863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:37.777917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:37.790285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:37.791079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:37.791770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:37.792974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:37.793722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:37.794425 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:37.933788 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:37.945660 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5793842-dc5c-41d8-af0a-414d8bd226a4 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.175104 Aug 21 02:07:37.946518 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3774/6896] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:37 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:38.967710 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:38.968421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:38.975666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:38.976165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:38.976612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:38.977352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:38.977835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:38.978269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:39.126355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:39.135445 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a9d876b3-0496-4bb9-8526-b92a1467c1f6 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.171748 Aug 21 02:07:39.136063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3123/6897] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:38 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:40.161650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:40.162379 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:40.169411 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:40.169886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:40.170297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:40.171011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:40.171460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:40.171884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:40.310946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:40.319695 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-705ad716-4ede-452f-81e1-ad2764da826c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.161975 Aug 21 02:07:40.320277 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3775/6898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:40 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:41.341812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:41.342404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:41.349725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:41.350218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:41.350660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:41.351369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:41.351826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:41.352259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:41.496106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:41.504664 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e3d6d798-2d0a-437f-9adb-64256a355e2c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.166914 Aug 21 02:07:41.505285 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3124/6899] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:41 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:42.530428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:42.531709 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:42.539012 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:42.539489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:42.539918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:42.540608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:42.541095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:42.541514 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:42.703705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:42.712159 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0da2f2ef-7ea2-464b-bfe7-2f92c1c21372 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.188173 Aug 21 02:07:42.712729 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3776/6900] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:42 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:43.733720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:43.734702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:43.742062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:43.742556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:43.743004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:43.743718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:43.744181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:43.744619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:43.890336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:43.903224 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c7d703a2-2a76-4cb0-8122-62ad406c2f9b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.173182 Aug 21 02:07:43.904072 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3125/6901] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:43 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:44.928531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:44.929466 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:44.939450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:44.940105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:44.940711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:44.941645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:44.942248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:44.942810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:45.094809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:45.107740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9ee2155-cc22-45ea-b48d-005134567a6f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.184165 Aug 21 02:07:45.108657 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3777/6902] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:44 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:46.138225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:46.139106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:46.151349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:46.152211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:46.153016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:46.154197 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:46.154972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:46.155754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:46.293887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:46.301730 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8a4597e6-06ec-4db2-adef-c3d23543c4bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.170302 Aug 21 02:07:46.302309 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3126/6903] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:46 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:47.327229 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:47.327834 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:47.335260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:47.335737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:47.336166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:47.336873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:47.337320 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:47.337730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:47.483083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:47.491689 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f1c74d81-cc0a-4a7c-8e96-e3f7e3e3549f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.171022 Aug 21 02:07:47.492291 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3778/6904] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:47 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:48.516521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:48.517443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:48.528966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:48.529784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:48.530519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:48.531828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:48.532291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:48.532720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:48.668509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:48.678831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bde12ff8-4147-4b42-a19a-c0fd0324f0f5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.168566 Aug 21 02:07:48.679621 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3127/6905] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:48 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:49.701179 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:49.701924 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:49.712148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:49.713097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:49.714086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:49.715550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:49.716356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:49.717259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:49.744988 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:07:49.861567 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:49.869654 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a9815f5-e8aa-45e8-be7a-d0e6e92136a9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.173355 Aug 21 02:07:49.870192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3779/6906] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:49 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:50.891932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:50.892604 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:50.900542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:50.901081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:50.901549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:50.902291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:50.902779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:50.903231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:51.045414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:51.055975 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-09043605-f89d-4341-ada5-410c1045a775 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.169065 Aug 21 02:07:51.056554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3128/6907] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:50 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:52.083459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:52.084415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:52.095249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:52.095723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:52.096149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:52.096861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:52.097295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:52.097706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:52.246181 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:52.255434 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-226398b5-0004-4f4b-bc97-52a52e8ade1e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.179103 Aug 21 02:07:52.256019 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3780/6908] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:52 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:53.280693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:53.282080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:53.293943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:53.294754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:53.295487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:53.296704 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:53.297276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:53.297672 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:53.453798 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:53.465448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b204029-1369-4ef6-9133-118e9ab76335 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.190907 Aug 21 02:07:53.466249 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3129/6909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:53 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:54.489649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:54.490383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:54.500298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:54.500810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:54.501232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:54.501920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:54.502361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:54.502779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:54.655191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:54.669950 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da2171b0-c806-49c5-8dd8-a80d7999295d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.185598 Aug 21 02:07:54.670733 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3781/6910] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:54 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:55.696118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:55.697187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:55.709178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:55.710014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:55.710761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:55.711944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:55.712713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:55.713473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:55.851021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:55.859067 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26d04847-41bb-49e9-b6ee-32618d95ff1f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.169526 Aug 21 02:07:55.859753 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3130/6911] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:55 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:56.882957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:56.883751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:56.893009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:56.893493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:56.893924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:56.894606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:56.895057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:56.895475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:57.041065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:57.049212 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6c6379a9-b36a-4c85-a5c1-ce2bd1c41b08 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.172011 Aug 21 02:07:57.049799 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3782/6912] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:56 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:07:58.074836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:58.075897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:58.087187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:58.087877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:58.088657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:58.089882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:58.090659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:58.091385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:58.243082 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:58.253386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d3d51dc-d2b5-4549-8691-11fe90ca333f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.185464 Aug 21 02:07:58.253961 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3131/6913] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:58 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:07:59.288112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:07:59.289171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:07:59.298724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:59.299207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:59.299639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:59.300328 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:07:59.300804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:07:59.301225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:07:59.449287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:07:59.457911 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-18601d9e-e9b6-4404-9237-26b73bf750c9 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.178046 Aug 21 02:07:59.458484 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3783/6914] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:07:59 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:00.479470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:00.480027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:00.484251 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=26 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:00.487633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:00.488116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:00.488555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:00.489290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:00.489746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:00.490170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:00.493279 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=78 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:00.627744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:00.635594 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9fa6734-8913-406d-860e-d4d977f79f11 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.160203 Aug 21 02:08:00.636143 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3132/6915] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:00 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:01.657559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:01.658160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:01.665787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:01.666269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:01.666696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:01.667396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:01.667834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:01.668250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:01.803154 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:01.811428 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1d2817ea-b9c9-404a-884e-28d85006052b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1523 microversion: 2.1 time: 0.158666 Aug 21 02:08:01.812201 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3784/6916] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:01 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:02.835721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:02.836332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:02.843520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:02.844277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:02.844745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:02.846207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:02.846645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:02.847714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:02.993509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:03.001750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6da735ce-160a-4b6b-aa24-1484d0265d62 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1522 microversion: 2.1 time: 0.170837 Aug 21 02:08:03.002256 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3133/6917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:02 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:03.117641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:03.123906 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=26 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:03.136082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:03.136593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:03.137055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:03.150686 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Creating event network-vif-unplugged:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h2-master-1 Aug 21 02:08:03.156854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] Instance d5b99342-533a-460b-b3d8-618fd5538bfe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:08:03.168125 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-77011352-b29c-40fc-98ad-5ee8ec6d5938 req-9328cd81-ff2e-47b4-a49a-778bba7f5efd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054276 Aug 21 02:08:03.168955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3785/6918] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:04.027488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:04.028154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:04.037151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:04.037650 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:04.038098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:04.038817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:04.039288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:04.039722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:04.175795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:04.183825 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d3d6b707-1540-4e1e-8b4c-b29dd7140b4b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1520 microversion: 2.1 time: 0.162957 Aug 21 02:08:04.184428 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3134/6919] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:04 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:05.186168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:05.197170 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:05.197665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:05.198111 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:05.205703 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:05.206328 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:05.210521 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Creating event network-changed:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h2-master-1 Aug 21 02:08:05.213098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:05.213589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:05.214032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:05.214745 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:05.215201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:05.215633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:05.215939 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] Instance d5b99342-533a-460b-b3d8-618fd5538bfe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:08:05.227423 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-70da511c-d458-42d2-b605-3f23132ffe1d req-82c1f76d-a42c-4313-9c8e-80eff036b86c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Aug 21 02:08:05.228018 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3786/6920] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:05.449584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:05.457539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1932fd27-55b0-495f-8c9a-7dd86c921d65 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1520 microversion: 2.1 time: 0.256004 Aug 21 02:08:05.458097 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3135/6921] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:05 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:06.479387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:06.480082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:06.488656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:06.489191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:06.489719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:06.490640 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:06.491062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:06.491510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:06.693667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:06.702687 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4e53454-6754-4267-865f-419e501e357e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1520 microversion: 2.1 time: 0.227511 Aug 21 02:08:06.703262 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3787/6922] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:06 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:07.732040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:07.732632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:07.740976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:07.741406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:07.741866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:07.742573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:07.743039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:07.743473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:07.884849 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:07.896749 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d20e9e3-38aa-497a-9b8c-facc074b175c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1517 microversion: 2.1 time: 0.168550 Aug 21 02:08:07.897534 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3136/6923] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:07 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:07.917860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:07.918384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:07.925892 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:07.926367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:07.926816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:07.927504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:07.927939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:07.928351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:08.003469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-00f7de55-b28d-46c2-9006-296f0d51ad2d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe/action" status: 204 len: 0 microversion: 2.1 time: 0.089187 Aug 21 02:08:08.004047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3788/6924] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:08:07 2022] POST /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:08:08.013549 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:08.014241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:08.021469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:08.022176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:08.022918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:08.024051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:08.024609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:08.025468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:08.288279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:08.298274 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a23831fe-f8e1-4fa0-a5ea-17c4e3e0b30c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1517 microversion: 2.1 time: 0.289531 Aug 21 02:08:08.298976 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3137/6925] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:08 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1517 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:09.041504 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "name": "network-vif-plugged", "status": "completed", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:09.055440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:09.055915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:09.056338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:09.068489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Creating event network-vif-plugged:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h2-master-1 Aug 21 02:08:09.074180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] Instance d5b99342-533a-460b-b3d8-618fd5538bfe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:08:09.085869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e472a9a6-9323-4e49-8646-c52547e91398 req-382d4ecb-77d7-44b7-a8f9-3fdffe1d7eaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048858 Aug 21 02:08:09.086472 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3789/6926] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:09.319266 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:09.319892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:09.326880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:09.327304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:09.327748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:09.328472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:09.328965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:09.329426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:09.470382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:09.478331 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0afc89df-5786-4806-b667-36ef6375c380 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1509 microversion: 2.1 time: 0.163083 Aug 21 02:08:09.478906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3138/6927] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:09 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:09.499829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:09.500524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:09.506899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:09.507380 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:09.507812 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:09.508498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:09.508958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:09.509384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:09.650080 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:09.659273 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5347b97a-4c88-487a-8011-119c25c15aa2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1509 microversion: 2.1 time: 0.163833 Aug 21 02:08:09.659846 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3790/6928] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:09 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:09.683393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70a583a2-0f1c-4854-85e6-e7dcad83857f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'create', calling method: .version_select at 0x7fc3fde4f550>, body: {"keypair": {"name": "tempest-keypair-1654587848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXK6ep1yNoDgqAmq9GF133SOy60jPjdTrlIcZKrvmGhJ6eS3/BH6+SnCXR1nQQBrxZBKl/nHinvU272xMlF18zT+prkHIhrdeY2Q3SNTY0zLcSqm7yJPj9fnnW1koNtA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:09.700983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-70a583a2-0f1c-4854-85e6-e7dcad83857f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:08:09.707075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-70a583a2-0f1c-4854-85e6-e7dcad83857f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for user 7f0d463954f54cc6b266fc4920697515 and project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:08:09.739661 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70a583a2-0f1c-4854-85e6-e7dcad83857f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060323 Aug 21 02:08:09.740302 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3139/6929] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:11.311248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:11.311854 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:11.319107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:11.319638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:11.320018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:11.320711 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:11.321192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:11.321613 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:11.462343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:11.470591 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5dc65fbd-5965-49ef-aa67-0bfc6ca5b025 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 200 len: 1509 microversion: 2.1 time: 0.163272 Aug 21 02:08:11.471179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3791/6930] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:11 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:11.496420 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:11.496974 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:11.508099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:11.508599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:11.509077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:11.509793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:11.510257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:11.510697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:11.537739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:08:11.630239 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-537c8f96-c808-4bbe-aff7-8fc441d5af8f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 204 len: 0 microversion: 2.1 time: 0.137398 Aug 21 02:08:11.630925 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3140/6931] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:08:11 2022] DELETE /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:08:11.693311 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-222888624", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "c4409971-c9fd-401c-b52c-ac28ba024b0e"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:11.750305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] validate_networks() for [('c4409971-c9fd-401c-b52c-ac28ba024b0e', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:08:12.147471 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:08:12.147890 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:08:12.148361 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:08:12.148758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:08:12.149188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:08:12.159841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:12.160346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:12.160752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:12.161490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:12.161935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:12.162348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:12.180401 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:08:12.186187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Getting quotas for user 7f0d463954f54cc6b266fc4920697515 and project a04100f9970f4ed2a2d21bc1a84cf74d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:08:12.199520 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:08:12.201883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:08:12.249516 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5adb519-247a-46ba-86da-e4e9613e109e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560335 Aug 21 02:08:12.250300 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3792/6932] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:08:12.261989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-de20ba9e-8ce7-4e30-841b-3189b3030ee2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:12.262702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-de20ba9e-8ce7-4e30-841b-3189b3030ee2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:12.319500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-de20ba9e-8ce7-4e30-841b-3189b3030ee2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:12.326777 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-de20ba9e-8ce7-4e30-841b-3189b3030ee2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1217 microversion: 2.1 time: 0.069208 Aug 21 02:08:12.327351 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3141/6933] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:12 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:13.347726 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:13.348320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:13.355293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:13.356025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:13.356460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:13.357194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:13.357634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:13.358231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:13.428595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:13.436807 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4d62ec70-9706-443e-b7be-11d922294382 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1269 microversion: 2.1 time: 0.093933 Aug 21 02:08:13.438362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3793/6934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:13 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:13.591949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b99342-533a-460b-b3d8-618fd5538bfe", "name": "network-vif-deleted", "tag": "121f4d5a-45b1-4349-9d2f-5cb3190a42aa"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:13.606073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:13.606796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:13.607395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:13.622750 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] Creating event network-vif-deleted:121f4d5a-45b1-4349-9d2f-5cb3190a42aa for instance d5b99342-533a-460b-b3d8-618fd5538bfe on n-h2-master-1 Aug 21 02:08:13.629917 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bf17766e-9983-4c47-b145-394f28f0a382 req-1d8eda60-ffae-48e1-99eb-65d880973f3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041847 Aug 21 02:08:13.630896 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3142/6935] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:14.459897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:14.460848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:14.468336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:14.468760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:14.469277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:14.470001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:14.470452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:14.470870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:14.610855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:14.619271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6c6664e-4c15-41e8-b253-2276b1e851c0 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.163370 Aug 21 02:08:14.619818 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3794/6936] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:14 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:08:14.887098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:14.900494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:14.901095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:14.901560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:14.913836 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] Creating event network-changed:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h2-master-1 Aug 21 02:08:14.919280 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ff2038ca-c1ca-4600-996a-1d0795d189a7 req-ef0f4e51-b776-4a99-92cd-2730a6fc72a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037456 Aug 21 02:08:14.920250 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3143/6937] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:15.640796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:15.641459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:15.649869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:15.650356 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:15.650789 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:15.651467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:15.651948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:15.652373 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:15.791668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:15.804323 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8594b4a-c16e-4604-acd8-91edd93589fb tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.167263 Aug 21 02:08:15.805191 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3795/6938] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:15 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:16.833164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:16.833855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:16.840583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:16.841102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:16.841549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:16.842249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:16.842716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:16.843144 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:16.994086 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:17.007648 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ec8a68f-6896-4f9e-8cb3-75646a1a4d45 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.180830 Aug 21 02:08:17.008630 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3144/6939] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:16 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:18.029444 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:18.030062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:18.038390 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:18.038958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:18.039419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:18.040105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:18.040547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:18.040996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:18.175972 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:18.179486 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:18.188601 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8852f799-c940-4b36-b6f1-dfe39920d241 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.163026 Aug 21 02:08:18.189257 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3796/6940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:18 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:19.213339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:19.214263 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:19.225131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:19.225796 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:19.226438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:19.227522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:19.228192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:19.228852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:19.377330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:19.385723 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c7e2d56c-16ac-4be5-a996-cd20238f2b34 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.178344 Aug 21 02:08:19.386308 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3145/6941] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:19 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:20.409941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:20.410516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:20.417863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:20.418339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:20.418759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:20.419449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:20.419890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:20.420305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:20.567441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:20.575742 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55119beb-2962-4422-b948-f3747598c922 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.172074 Aug 21 02:08:20.576324 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3797/6942] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:20 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:21.146007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "name": "network-vif-plugged", "status": "completed", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:21.157196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:21.157665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:21.158116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:21.169754 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] Creating event network-vif-plugged:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h2-master-1 Aug 21 02:08:21.174837 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c651d926-e51f-4f07-91fa-1b70b17b4fde req-9e4aea96-4090-4fb8-b49f-3fe3cfb412bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Aug 21 02:08:21.175438 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3146/6943] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:21.598249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:21.598943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:21.607625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:21.608192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:21.608728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:21.609582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:21.610110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:21.610603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:21.906442 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:08:21.906695 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 (ip 10.222.0.46) !!! Aug 21 02:08:22.069253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:22.077192 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6f5b92cf-0215-4276-8e75-3c8e7736c666 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1317 microversion: 2.1 time: 0.483663 Aug 21 02:08:22.077761 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3798/6944] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:21 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:23.099435 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:23.106235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:23.107408 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:23.116057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.116547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.117106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.117810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.118271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.118705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.274944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:23.287929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e2e7133b-5674-4c02-8105-5a2bdea49d19 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1507 microversion: 2.1 time: 0.191746 Aug 21 02:08:23.288792 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3147/6945] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:23 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:23.312829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:23.313560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:23.315610 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:23.316298 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:23.323080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.323565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.324005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.324702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.325182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.325604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.493641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:23.501732 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-776dba0d-7b52-45b1-80f4-70af041098b2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1507 microversion: 2.1 time: 0.192901 Aug 21 02:08:23.503040 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3799/6946] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:23 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:23.525474 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:23.528876 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:23.537449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.537941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.538372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.539064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.539515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.539939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.571458 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:23.577655 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:08:23.585509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:08:23.585928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:08:23.586434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:08:23.586820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:08:23.587231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:08:23.663342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d0bf2231-c1ec-433b-8989-088904f367bc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076/action" status: 202 len: 0 microversion: 2.1 time: 0.144273 Aug 21 02:08:23.667430 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3148/6947] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:08:23 2022] POST /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:08:23.672899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:23.673614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:23.689717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.690128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.690565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.691265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:23.691719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:23.692141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:23.864893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:23.873167 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4938faf-8249-4c3d-97cd-f63ab232617a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1514 microversion: 2.1 time: 0.204261 Aug 21 02:08:23.873773 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3800/6948] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:23 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:24.895390 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:24.896978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:24.903579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:24.904079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:24.904558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:24.905277 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:24.906069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:24.906498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:25.119454 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:25.121836 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:25.129276 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0a900ab-25e3-4d3e-82ad-5df23f5e426a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1514 microversion: 2.1 time: 0.239410 Aug 21 02:08:25.130176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3149/6949] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:24 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:26.151070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:26.151671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:26.162351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:26.163060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:26.163508 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:26.164478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:26.165118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:26.165531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:26.316244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:26.328181 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9142244f-93c4-438a-bcd4-6924356477af tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.181214 Aug 21 02:08:26.328981 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3801/6950] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:26 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:27.351741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:27.352345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:27.362895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:27.363551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:27.364062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:27.364937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:27.365476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:27.365983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:27.524743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:27.536111 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ccf16798-48cc-4deb-b699-2e90c2cc048f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.189280 Aug 21 02:08:27.536692 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3150/6951] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:27 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:28.566809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:28.567756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:28.578645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:28.579245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:28.579680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:28.580387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:28.580832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:28.581567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:28.716445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:28.724912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f7add97-6d26-4fcf-ade2-478be03e5659 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.164948 Aug 21 02:08:28.725492 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3802/6952] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:28 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:29.746329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:29.746932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:29.754784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:29.755307 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:29.755759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:29.756470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:29.756978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:29.757390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:29.900346 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:29.912596 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ad23859-a18b-4486-8988-0d81786034fa tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.170094 Aug 21 02:08:29.913386 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3151/6953] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:29 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:30.938835 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:30.939490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:30.947039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:30.947523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:30.947957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:30.948652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:30.949141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:30.949565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:31.113820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:31.124650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a6f1e8e-6645-4209-9df0-af3fc19d7bab tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.190219 Aug 21 02:08:31.125512 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3803/6954] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:30 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:32.147698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:32.148347 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:32.151092 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:32.156942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:32.157423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:32.157860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:32.158553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:32.159008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:32.159585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:32.299135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:32.308102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7d15d278-79fa-46d0-9fec-40851ea48846 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.164627 Aug 21 02:08:32.308649 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3152/6955] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:32 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:33.330173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:33.330805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:33.334153 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:33.340481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:33.341047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:33.341531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:33.342306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:33.342809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:33.343281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:33.488955 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:33.500846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0fea7809-7aa4-48ad-964b-f0ae4b13294b tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.174709 Aug 21 02:08:33.501656 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3804/6956] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:33 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:34.525825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:34.526753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:34.537922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:34.538583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:34.539113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:34.540121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:34.540738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:34.541361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:34.704615 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:34.717974 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-897db8de-db35-4d42-97fb-cfb8d0b45f3d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.198309 Aug 21 02:08:34.718761 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3153/6957] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:34 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:35.741848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:35.742464 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:35.750082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:35.750562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:35.750995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:35.751684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:35.752133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:35.752552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:35.892042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:35.900913 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55e08b73-e439-4c4b-8be9-55586643542f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.163416 Aug 21 02:08:35.901484 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3805/6958] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:35 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:36.936395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:36.937867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:36.947148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:36.947635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:36.948080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:36.948805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:36.949287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:36.949723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:37.098962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:37.107439 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bd619ca0-8a8b-4c44-8f8e-83fa7d52d431 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.177635 Aug 21 02:08:37.108092 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3154/6959] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:36 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:38.132905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:38.134026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:38.146218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:38.146515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:38.147162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:38.147900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:38.148353 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:38.148748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:38.284028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:38.292237 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cbcd1820-f75c-4179-95e3-848ec06d7f98 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.166133 Aug 21 02:08:38.292820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3806/6960] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:38 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:39.315206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:39.315880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:39.323852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:39.324344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:39.324807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:39.325524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:39.325982 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:39.326411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:39.460751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:39.468999 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15f53c90-8a39-4003-867e-d40ff64a71cc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.158561 Aug 21 02:08:39.469581 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3155/6961] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:39 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:40.493077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:40.493643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:40.500910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:40.501403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:40.501843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:40.502550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:40.503010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:40.503438 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:40.648630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:40.657120 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53634cad-a76b-489a-90f0-caa48e45acd5 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.170203 Aug 21 02:08:40.657698 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3807/6962] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:40 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:41.681751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:41.682343 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:41.689658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:41.690204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:41.690647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:41.691356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:41.691839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:41.692272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:41.827310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:41.835305 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-28f0ec83-1eae-4a95-a8a4-43966e4c6b6d tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.158997 Aug 21 02:08:41.835962 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3156/6963] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:41 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:42.859062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:42.859673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:42.870814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:42.871551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:42.872120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:42.873027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:42.873623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:42.874156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:43.018626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:43.027557 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd9e8005-1edc-4d3d-a97a-1cd2229bee49 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.174567 Aug 21 02:08:43.028121 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3808/6964] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:42 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:44.053373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:44.053990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:44.061341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:44.061851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:44.062269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:44.062967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:44.063435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:44.063865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:44.196422 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:44.209387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e3aae0d-1905-4cf0-9cfb-096faeebf601 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.161010 Aug 21 02:08:44.210297 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3157/6965] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:44 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:45.232502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:45.233244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:45.241975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:45.242649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:45.243098 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:45.243813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:45.244274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:45.244704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:45.391369 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:45.399586 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f4d2aeb-8bf8-4ed0-946d-0175e06119ff tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.171710 Aug 21 02:08:45.400107 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3809/6966] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:45 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:46.426071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:46.426931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:46.436929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:46.437382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:46.437840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:46.438555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:46.439022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:46.439454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:46.592332 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:46.604534 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f9a56e26-44ec-4059-8f3f-f7b236d61b78 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.185171 Aug 21 02:08:46.605165 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3158/6967] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:46 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:47.630225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:47.631205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:47.639457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:47.639939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:47.640370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:47.641135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:47.641610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:47.642172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:47.789611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:47.798410 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-280c79ac-dc7b-45e1-9383-ec8f5c6a2d31 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.174794 Aug 21 02:08:47.798987 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3810/6968] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:47 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:48.823292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:48.824279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:48.834978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:48.835631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:48.836152 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:48.837123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:48.837749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:48.838350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:48.987888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:49.005594 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3e4bb3f-9f63-4867-91e1-e315c9294a5a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.188519 Aug 21 02:08:49.006323 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3159/6969] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:48 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:50.039274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:50.040267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:50.052173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:50.053056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:50.053772 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:50.054916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:50.055656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:50.056352 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:50.200459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:50.208556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d602dbfb-1539-432b-a7b4-5e9093eaa49f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.175963 Aug 21 02:08:50.209169 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3811/6970] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:50 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:51.230229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:51.231046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:51.238488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:51.239017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:51.239462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:51.240161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:51.240637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:51.241096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:51.379820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:51.387721 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3aa147f9-4b66-4aa5-9068-03adbae37ce3 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1519 microversion: 2.1 time: 0.161686 Aug 21 02:08:51.388295 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3160/6971] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:51 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:52.409732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:52.410274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:52.417314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:52.417839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:52.418283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:52.419129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:52.419670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:52.420150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:52.424973 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=92 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:52.570343 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:52.578920 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-05a597b4-f143-4b33-bb98-28ded2f3dde7 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1518 microversion: 2.1 time: 0.173653 Aug 21 02:08:52.579495 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3812/6972] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:52 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:52.918093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "name": "network-vif-unplugged", "status": "completed", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:52.929995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:52.930666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:52.931289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:52.946628 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Creating event network-vif-unplugged:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h1-master-1 Aug 21 02:08:52.952404 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:08:52.963739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-128396ae-1ba1-4e7d-82d2-513a12a2b5aa req-45deb438-bb4b-4da7-b386-5c5b8fe2af00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049746 Aug 21 02:08:52.964395 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3161/6973] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:53.601651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:53.602260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:53.609844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:53.610339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:53.610986 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:53.611715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:53.612169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:53.612596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:53.762447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:53.772688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4147c814-3bc9-4524-a8a2-27bd3b1ceb15 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1518 microversion: 2.1 time: 0.175026 Aug 21 02:08:53.773338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3813/6974] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:53 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:54.800267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:54.801059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:54.808011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:54.808510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:54.809000 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:54.809707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:54.810168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:54.810605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:54.952684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:54.961171 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e48866c5-01a7-4f5c-948b-02c32e7c714f tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1516 microversion: 2.1 time: 0.168350 Aug 21 02:08:54.961750 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3162/6975] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:54 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:54.979620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:54.991339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:54.991817 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:54.992253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:55.004680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Creating event network-changed:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h1-master-1 Aug 21 02:08:55.012224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:08:55.028410 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-77029ae3-f97c-4468-ab15-3736546ea863 req-9064f614-7d52-4423-9a00-427b764251a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052262 Aug 21 02:08:55.029235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3814/6976] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:55.985920 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:55.986949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:55.997841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:55.998485 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:55.999118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.000179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:56.000844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:56.001552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.139568 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:56.148003 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ac8c85b-f61a-41ca-8ac1-4f3d9879edfc tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1513 microversion: 2.1 time: 0.167903 Aug 21 02:08:56.148583 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3163/6977] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:55 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:56.170701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:56.171314 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:56.178245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:56.178752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:56.179181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.179849 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:56.180287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:56.180704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.250344 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1215ccfa-fd38-47b5-b0a4-dd1efc631507 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "POST /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076/action" status: 204 len: 0 microversion: 2.1 time: 0.084802 Aug 21 02:08:56.250910 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3815/6978] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:08:56 2022] POST /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:08:56.259711 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:56.260356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:56.266477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:56.266972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:56.267638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.268408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:56.268936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:56.269390 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:56.476648 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:56.485253 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e5b9874-94d0-474d-8fbe-b7b99609f881 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1513 microversion: 2.1 time: 0.229431 Aug 21 02:08:56.486107 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3164/6979] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:56 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:57.513430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:57.514138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:57.521821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:57.522317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:57.522788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:57.523478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:57.523926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:57.524350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:57.666894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:57.684263 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5346efcf-8d42-4033-8775-5f5a904e1cec tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1513 microversion: 2.1 time: 0.172014 Aug 21 02:08:57.684950 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3816/6980] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:57 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:58.707480 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:58.708107 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:58.715082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:58.715574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:58.716020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:58.716719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:58.717214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:58.717645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:58.720365 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=90 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:08:58.851905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:58.863850 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea428b97-ff14-4935-a6f2-15c4690ae74c tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1505 microversion: 2.1 time: 0.161220 Aug 21 02:08:58.864649 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3165/6981] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:58 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:58.884629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:58.885264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:58.892279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:58.892751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:58.893225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:58.894038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:58.894384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:58.894961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.059186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:59.067590 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8a0aa4c4-cf6a-4f45-a938-305a3236c3d2 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1505 microversion: 2.1 time: 0.186860 Aug 21 02:08:59.068155 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3817/6982] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:58 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:59.088133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:59.088723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:59.095169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.095653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.096093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.096799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.097511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.098075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.263898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:59.273425 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-742d2229-0642-4995-8f46-f00c6675719a tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1505 microversion: 2.1 time: 0.189112 Aug 21 02:08:59.273988 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3166/6983] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:59 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:08:59.295481 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:59.295988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:59.302970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.303463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.303898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.304611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.305109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.305538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.331347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:08:59.393304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "name": "network-vif-plugged", "status": "completed", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:08:59.413872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.414839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.415637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.431882 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5017bf73-6a5c-4025-a5e0-6e21d958f231 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 204 len: 0 microversion: 2.1 time: 0.140002 Aug 21 02:08:59.432663 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3818/6984] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:08:59 2022] DELETE /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:08:59.453174 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] Creating event network-vif-plugged:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h1-master-1 Aug 21 02:08:59.453883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:59.454668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:59.462575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-643ebe2e-0d00-4850-a030-db9cbb1b6354 req-dca5a55d-98a9-48ab-88e1-b8d33ad0b93b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075608 Aug 21 02:08:59.463849 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3167/6985] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:08:59.464432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.465123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.465396 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.466260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.466882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.467197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.497365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:08:59.551321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.compute.api [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Instance is already in deleting state, ignoring this request Aug 21 02:08:59.552325 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-599fc329-7a09-4b18-92c3-16e340ea4182 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 204 len: 0 microversion: 2.1 time: 0.105923 Aug 21 02:08:59.552955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3819/6986] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:08:59 2022] DELETE /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:08:59.562903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:08:59.563651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:08:59.570518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.571007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.571489 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.572193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:08:59.572651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:08:59.573120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:08:59.714519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:08:59.724555 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d37392e0-b2da-4b3d-a4d3-6b698996e4d8 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1511 microversion: 2.1 time: 0.165891 Aug 21 02:08:59.725262 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3168/6987] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:08:59 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:00.747988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:00.748585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:00.756628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:00.757169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:00.757604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:00.758309 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:00.758761 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:00.759253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:00.905245 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0d463954f54cc6b266fc4920697515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04100f9970f4ed2a2d21bc1a84cf74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:00.914295 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7021f2af-2bf2-46ad-b4b9-530018e0aa8e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 200 len: 1511 microversion: 2.1 time: 0.170955 Aug 21 02:09:00.914934 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3820/6988] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:00 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:01.303634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9e53b-f9b0-4f4c-be88-795d108ca076", "name": "network-vif-deleted", "tag": "2ef8dae9-720d-44f6-be55-944b3f94c255"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:01.314617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:01.323797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:01.324362 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:01.340386 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] Creating event network-vif-deleted:2ef8dae9-720d-44f6-be55-944b3f94c255 for instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 on n-h1-master-1 Aug 21 02:09:01.345840 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-09accf2c-1d69-4d21-a89d-237df2d62a00 req-e6a11a0b-ff34-4730-9525-2340438ad25b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046520 Aug 21 02:09:01.346854 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3169/6989] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:09:01.935916 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:01.936556 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: ddd9e53b-f9b0-4f4c-be88-795d108ca076] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:01.944286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:01.944797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:01.945223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:01.945919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:01.946370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:01.946775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:01.960449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] HTTP exception thrown: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Request method failure captured: Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 HTTP/1.1 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZNUA4KJbE1DCkXCCGTOfzUDArXsk_CkxfwJ8xkUO7TsvW7Vw3Fn8lLBZVSkO86bRCdTb9yWrpkPDsPCiAOcxuvbBtTM_WdiLaT8YazRYb2o0xzomRiEyrkw0MoPezm5vf7UiQXh6wjr6yUhHipoxjnEmrEpCjNthxOhJiQ7pjZZPZs Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a04100f9970f4ed2a2d21bc1a84cf74d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}] Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7f0d463954f54cc6b266fc4920697515 Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: exception: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'ddd9e53b-f9b0-4f4c-be88-795d108ca076'} Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:01.962129 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Returning 404 to user: Instance ddd9e53b-f9b0-4f4c-be88-795d108ca076 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-080e79a7-befa-4ee3-b809-5c64b537ce6e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076" status: 404 len: 111 microversion: 2.1 time: 0.031671 Aug 21 02:09:01.966385 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3821/6990] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:01 2022] GET /compute/v2.1/servers/ddd9e53b-f9b0-4f4c-be88-795d108ca076 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:09:01.973127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d885f732-d5db-4f6a-bfde-ae3755672452 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '.version_select at 0x7fc3fe01bc10>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:01.996760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d885f732-d5db-4f6a-bfde-ae3755672452 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654587848" status: 202 len: 0 microversion: 2.1 time: 0.027888 Aug 21 02:09:01.997388 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3170/6991] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 02:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654587848 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:09:02.637167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:02.637706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:02.646470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:02.647145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:02.647717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:02.648748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:02.649441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:02.650078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:02.670421 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] HTTP exception thrown: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Request method failure captured: Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe HTTP/1.1 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZNUA4KJbE1DCkXCCGTOfzUDArXsk_CkxfwJ8xkUO7TsvW7Vw3Fn8lLBZVSkO86bRCdTb9yWrpkPDsPCiAOcxuvbBtTM_WdiLaT8YazRYb2o0xzomRiEyrkw0MoPezm5vf7UiQXh6wjr6yUhHipoxjnEmrEpCjNthxOhJiQ7pjZZPZs Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a04100f9970f4ed2a2d21bc1a84cf74d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}] Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 7f0d463954f54cc6b266fc4920697515 Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd5b99342-533a-460b-b3d8-618fd5538bfe'} Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:09:02.671994 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Returning 404 to user: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e40c4a5-9395-4d7c-8a8b-19c26cbdee4e tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 404 len: 111 microversion: 2.1 time: 0.042993 Aug 21 02:09:02.676070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3822/6992] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:09:02 2022] DELETE /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:09:02.686049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:02.687053 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] [instance: d5b99342-533a-460b-b3d8-618fd5538bfe] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:02.689952 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:02.697539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:02.698122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:02.698571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:02.699273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:02.699743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:02.700178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:02.714547 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] HTTP exception thrown: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Request method failure captured: Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe HTTP/1.1 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZNUA4KJbE1DCkXCCGTOfzUDArXsk_CkxfwJ8xkUO7TsvW7Vw3Fn8lLBZVSkO86bRCdTb9yWrpkPDsPCiAOcxuvbBtTM_WdiLaT8YazRYb2o0xzomRiEyrkw0MoPezm5vf7UiQXh6wjr6yUhHipoxjnEmrEpCjNthxOhJiQ7pjZZPZs Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a04100f9970f4ed2a2d21bc1a84cf74d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a04100f9970f4ed2a2d21bc1a84cf74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a04100f9970f4ed2a2d21bc1a84cf74d"}]}] Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a04100f9970f4ed2a2d21bc1a84cf74d Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1948849283 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 7f0d463954f54cc6b266fc4920697515 Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerDiskConfigTestJSON-1948849283-project Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: exception: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'd5b99342-533a-460b-b3d8-618fd5538bfe'} Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:09:02.716219 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] Returning 404 to user: Instance d5b99342-533a-460b-b3d8-618fd5538bfe could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-97f1529c-615a-41af-b804-96c6459b8718 tempest-ServerDiskConfigTestJSON-1948849283 tempest-ServerDiskConfigTestJSON-1948849283-project] 10.222.0.46 "GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe" status: 404 len: 111 microversion: 2.1 time: 0.038593 Aug 21 02:09:02.720256 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3171/6993] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:02 2022] GET /compute/v2.1/servers/d5b99342-533a-460b-b3d8-618fd5538bfe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:09:11.364183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cafef2cd-0323-4ca5-8b7a-e9f06c86515d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: .version_select at 0x7fc3f937e4c0>, body: {"keypair": {"name": "tempest-keypair-1291094441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJITRIg+JZ1wLTxiTWdn9F/dnYN8BhNY0zQyoj65A5HL6cx767l2Qx3FOGFAwal8ongZZDwYuD1wAWyiy/Dd1q2rPnPG7geS5FWJ3F0yuNFNS6yJynvc88oPdTek20lkgQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:11.370013 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:11.383377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cafef2cd-0323-4ca5-8b7a-e9f06c86515d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:09:11.389026 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cafef2cd-0323-4ca5-8b7a-e9f06c86515d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:09:11.421895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cafef2cd-0323-4ca5-8b7a-e9f06c86515d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180418 Aug 21 02:09:11.422439 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3823/6994] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:09:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:09:13.077056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1452748768", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288c85ae-8436-4697-acea-78e835b1f27f"}], "security_groups": [{"name": "tempest-securitygroup--876159644"}], "key_name": "tempest-keypair-1291094441", "user_data": "}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:13.088867 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:13.089561 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=23 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:13.198672 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] validate_networks() for [('288c85ae-8436-4697-acea-78e835b1f27f', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:09:13.598124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:09:13.598558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:09:13.599042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:09:13.599452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:09:13.600007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:09:13.609147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:13.609641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:13.610094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:13.610822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:13.611287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:13.611718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:13.629109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:09:13.634692 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:09:13.648272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:09:13.650653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:09:13.699308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ea30bd3-ba65-40b5-a46a-441e4cd755c9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.627006 Aug 21 02:09:13.700281 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3172/6995] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:09:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:09:13.708601 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:13.713523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94d439b7-db3b-4d41-b76a-0e15b664c272 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:13.714253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-94d439b7-db3b-4d41-b76a-0e15b664c272 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:13.804920 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-94d439b7-db3b-4d41-b76a-0e15b664c272 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:13.812392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94d439b7-db3b-4d41-b76a-0e15b664c272 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1239 microversion: 2.1 time: 0.105347 Aug 21 02:09:13.813565 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3824/6996] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:13 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:09:14.835342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:14.836034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:14.844174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:14.844674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:14.845160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:14.845875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:14.846391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:14.846826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:14.927871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:14.936335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5738d8b5-3639-446f-b336-ae99e8a162cd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1299 microversion: 2.1 time: 0.105543 Aug 21 02:09:14.937350 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3173/6997] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:14 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:15.957658 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:15.960017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:15.968218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:15.968730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:15.969216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:15.970235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:15.970899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:15.971880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:16.118243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:16.126268 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49f92a7c-d9f5-4dde-b817-4ca2a8336cdb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.172611 Aug 21 02:09:16.126848 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3825/6998] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:15 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:16.362671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:16.374380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:16.375131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:16.375578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:16.387548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] Creating event network-changed:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h2-master-1 Aug 21 02:09:16.392560 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c5827bce-1fce-402b-888c-24d71a43392a req-88391d8c-8c87-4a5d-bb03-cc543ed12674 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033681 Aug 21 02:09:16.393201 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3174/6999] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:09:17.153620 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:17.154587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:17.166430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:17.167754 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:17.169035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:17.170071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:17.170723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:17.171660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:17.316415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:17.327863 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a34f77a2-d28c-4af0-9c9a-799848bb1a3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.180933 Aug 21 02:09:17.328695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3826/7000] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:17 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:18.354654 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:18.355487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:18.363261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:18.363872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:18.364783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:18.365648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:18.366191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:18.366712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:18.505823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:18.513986 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0d8a16e-1631-4aa9-9463-448b081c9786 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.166005 Aug 21 02:09:18.514532 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3175/7001] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:18 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:19.535886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:19.536488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:19.543935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:19.544422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:19.544886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:19.545595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:19.546042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:19.546467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:19.690994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:19.699933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83eda97e-e577-4b0d-b600-8ef6c1bd94b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.168005 Aug 21 02:09:19.700556 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3827/7002] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:19 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:20.725827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:20.726464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:20.733725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:20.734221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:20.734661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:20.735368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:20.735843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:20.736244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:20.881029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:20.891443 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1ad02fd-ea13-4c0a-87a7-42e4fbfe741c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.174234 Aug 21 02:09:20.892253 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3176/7003] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:20 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:21.919231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:21.919868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:21.927766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:21.928176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:21.928607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:21.929340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:21.929786 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:21.930222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:22.083899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:22.092264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d70be85-1840-4bfb-a6d1-eb6deac1cfb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.177000 Aug 21 02:09:22.092836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3828/7004] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:21 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:23.118852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:23.119818 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:23.129832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:23.130422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:23.130876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:23.131654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:23.132107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:23.132539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:23.297621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:23.305768 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d803d8e3-a9a1-461d-b661-3bb4e5da087a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.194783 Aug 21 02:09:23.306341 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3177/7005] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:23 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:23.368021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "name": "network-vif-plugged", "status": "completed", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:23.379580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:23.380036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:23.380664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:23.392392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] Creating event network-vif-plugged:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h2-master-1 Aug 21 02:09:23.397698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b3cf4236-fef7-4a55-afdd-70d558fb11b6 req-f43e3244-d986-49ae-9c45-447d1b452a72 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 Aug 21 02:09:23.398279 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3829/7006] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:09:24.331535 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:24.332593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:24.334910 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:24.335582 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:24.342242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:24.342733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:24.343180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:24.343874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:24.344324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:24.344747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:24.480380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:24.488267 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fa48e6b2-4d71-45a8-8f67-efd7d6b6b40b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1364 microversion: 2.1 time: 0.163925 Aug 21 02:09:24.489135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3178/7007] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:24 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:25.509423 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:09:25.517997 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:25.519163 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:25.531241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:25.532051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:25.532819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:25.533987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:25.534751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:25.535603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:25.682512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:09:25.694482 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fafe870-965d-46d3-9fc6-f0ef4b655c54 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1551 microversion: 2.1 time: 0.186548 Aug 21 02:09:25.695429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3830/7008] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:09:25 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1551 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:09:25.716056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:09:25.716650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:09:25.724291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:25.724807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:25.725265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:25.725974 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:25.726441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:25.726877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:25.816700 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04c34fed-bce2-44df-a3a5-32dbccc8fd95 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104531 Aug 21 02:09:25.817839 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3179/7009] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:09:25 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:09:26.821671 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:09:26.832268 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:09:26.833530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:09:26.834038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:09:26.845584 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] Creating event network-changed:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h2-master-1 Aug 21 02:09:26.851298 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-470e84e7-ddbb-4894-915d-d5e2ddbca829 req-da746f57-45fb-4a7f-9c73-d289475e2881 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034192 Aug 21 02:09:26.851919 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3831/7010] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:10:31.085149 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:31.086368 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=38 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:31.093868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:31.094791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:31.104074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.104639 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.105278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.106213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.106738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.107275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.307146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:31.317410 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-99432aca-5051-4e2f-b74a-aa6770d9baf8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.237003 Aug 21 02:10:31.318040 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3180/7011] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:31 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:31.345800 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:31.346521 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=34 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:31.351083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:31.351780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:31.359879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.360372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.360847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.361558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.362028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.362491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.576244 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:31.584791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0490d0f4-9a40-4da9-8580-df606dd614dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.242084 Aug 21 02:10:31.585600 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3832/7012] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:31 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:31.614282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:31.614828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:31.621357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.621822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.622267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.623247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.623713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.624145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.770022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:31.778330 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-286bb5c1-9470-413c-8a97-3d105fc164b1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.168700 Aug 21 02:10:31.778904 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3181/7013] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:31 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:31.799668 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:31.801942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:31.808322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.808811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.809258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.809944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.810497 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.810921 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.841358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:31.848508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:10:31.857594 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:10:31.858294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:10:31.859151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:10:31.859865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:10:31.860971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:10:31.935053 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9fdbf3a6-cda5-42e8-94de-902bfda5992b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/action" status: 202 len: 0 microversion: 2.1 time: 0.139422 Aug 21 02:10:31.935662 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3833/7014] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:10:31 2022] POST /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:10:31.944127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:31.944840 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:31.951250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.951730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.952192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:31.952925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:31.953675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:31.954140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:32.088632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:32.097720 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02113f82-5697-45ca-b3ca-c79428ae552b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1679 microversion: 2.1 time: 0.157558 Aug 21 02:10:32.098300 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3182/7015] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:31 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:33.124593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:33.125460 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:33.135469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:33.136347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:33.137255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:33.138563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:33.139440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:33.140272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:33.280982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:33.289127 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e622ad12-8fe9-49c2-ad35-1d958b403fd4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1679 microversion: 2.1 time: 0.172575 Aug 21 02:10:33.289707 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3834/7016] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:33 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:34.310240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:34.310829 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:34.318750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:34.319236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:34.319671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:34.320365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:34.320810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:34.321267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:34.477529 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:34.486148 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50b3c66a-75ba-4ed9-90c8-c20e6dbbcddc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.179876 Aug 21 02:10:34.486722 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3183/7017] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:34 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:35.519103 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:35.519998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:35.531959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:35.532756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:35.533585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:35.534792 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:35.535518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:35.535964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:35.679159 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:35.687242 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9b8aca5-6277-4d3b-b7bf-a424ba5a4481 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.175308 Aug 21 02:10:35.687839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3835/7018] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:35 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:36.710240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:36.710873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:36.718598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:36.719090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:36.719533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:36.720234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:36.720694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:36.721170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:36.863248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:36.871870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5cdf3f77-eb12-45db-af6c-43dc4cf8361f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.166083 Aug 21 02:10:36.872450 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3184/7019] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:36 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:37.898169 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:37.899193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:37.911561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:37.912054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:37.912496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:37.913226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:37.913687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:37.914115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:38.054863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:38.062748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7251d973-cc6f-47b3-a936-2a493c1c0fb5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.172069 Aug 21 02:10:38.063272 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3836/7020] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:37 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:39.086379 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:39.087098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:39.095333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:39.095878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:39.096371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:39.097205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:39.097963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:39.098486 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:39.243510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:39.251822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86bc1b5f-46db-4bfa-bd68-39eb56f40657 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.170625 Aug 21 02:10:39.252392 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3185/7021] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:39 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:40.287674 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:40.288290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:40.296112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:40.296643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:40.297125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:40.297825 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:40.298306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:40.298729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:40.452364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:40.461834 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af0668a8-ea67-4509-a3ac-26da1323170a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.181110 Aug 21 02:10:40.462429 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3837/7022] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:40 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:41.487008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:41.487879 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:41.496376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:41.496907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:41.497371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:41.498086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:41.498561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:41.499018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:41.643677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:41.652490 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc395432-0b8b-4cfa-8d0f-379df073817e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.172069 Aug 21 02:10:41.653102 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3186/7023] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:41 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:42.685502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:42.686151 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:42.693771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:42.694286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:42.694745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:42.695454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:42.695913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:42.696342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:42.832237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:42.840806 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ba181704-0f4e-4c6a-a3d5-1e9c52ded8f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.159340 Aug 21 02:10:42.841358 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3838/7024] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:42 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:43.863099 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:43.863700 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:43.872336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:43.872857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:43.873306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:43.874016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:43.874476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:43.874910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:44.018005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:44.026459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f87af0b-ad66-431e-9207-61f3ff2ca005 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.167691 Aug 21 02:10:44.027043 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3187/7025] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:43 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:45.053770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:45.054513 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:45.064740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:45.065485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:45.066121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:45.067106 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:45.067776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:45.068464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:45.214060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:45.222202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad178a5d-716b-431a-bc1f-2aeff476a056 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1684 microversion: 2.1 time: 0.174311 Aug 21 02:10:45.222734 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3839/7026] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:45 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:46.250302 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:46.250834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:46.258034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:46.258537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:46.258984 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:46.259698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:46.260161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:46.260600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:46.487966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:46.496556 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19297fb0-d73c-41d9-ab70-d0146f80252e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1683 microversion: 2.1 time: 0.250270 Aug 21 02:10:46.497384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3188/7027] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:46 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:46.564418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "name": "network-vif-unplugged", "status": "completed", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:46.574058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:46.574526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:46.574943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:46.586543 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Creating event network-vif-unplugged:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h1-master-1 Aug 21 02:10:46.592135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] Instance b84aed25-5d8b-475d-96c5-17a97d82d30a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:10:46.604459 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a88488dc-8c24-4eb2-bfae-015fd2d0f5c6 req-08fad6a2-f062-48c0-a88c-d0c1395f470d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104443 Aug 21 02:10:46.605264 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3840/7028] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:10:47.519949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:47.520715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:47.528544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:47.529430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:47.529883 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:47.530601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:47.531083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:47.531658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:47.761786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:47.770090 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f024cf3-052f-4dc2-bb18-e3025d1fb2b6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1683 microversion: 2.1 time: 0.255485 Aug 21 02:10:47.770688 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3189/7029] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:47 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1683 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:48.632797 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:48.643004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:48.643486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:48.643917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:48.656202 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Creating event network-changed:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h1-master-1 Aug 21 02:10:48.662261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] Instance b84aed25-5d8b-475d-96c5-17a97d82d30a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:10:48.673249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-2190ca3b-dd8b-4448-b1f1-da6dde6b774c req-37129d73-6259-41c9-8c00-819ae26f2618 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047863 Aug 21 02:10:48.673875 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3841/7030] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:10:48.792229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:48.792834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:48.800408 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:48.800946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:48.801394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:48.802112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:48.803055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:48.803496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:49.002581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:49.011194 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c23ccf8a-9897-49bb-992e-762ae487e30d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1681 microversion: 2.1 time: 0.222936 Aug 21 02:10:49.011782 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3190/7031] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:48 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:50.037360 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:50.038057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:50.045628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.046110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.046541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.047239 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.047684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.048110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.204757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:50.217149 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9963d72-3bb7-4394-b61b-9904eb2c1a89 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1678 microversion: 2.1 time: 0.186576 Aug 21 02:10:50.217919 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3842/7032] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:50 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:50.240380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:50.240932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:50.248252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.248792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.249239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.249942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.250401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.250837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.319019 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-356bcc85-9f1a-439f-836c-0017c84124cb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/action" status: 204 len: 0 microversion: 2.1 time: 0.082391 Aug 21 02:10:50.319566 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3191/7033] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:10:50 2022] POST /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:10:50.328119 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:50.328810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:50.335377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.336031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.336404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.337157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:50.337704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:50.338136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:50.485254 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:50.496269 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f4c6c993-3a72-48ca-8eb8-8b8df2d8f022 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1678 microversion: 2.1 time: 0.172129 Aug 21 02:10:50.497171 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3843/7034] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:50 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:51.520324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:51.520992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:51.527677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:51.528178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:51.528622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:51.529726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:51.530188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:51.530618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:51.674874 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:51.685599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29b7d460-7608-4002-be25-eae7438a376f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1678 microversion: 2.1 time: 0.170605 Aug 21 02:10:51.686177 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3192/7035] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:51 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:52.707364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:52.707974 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:52.717215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:52.717867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:52.718461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:52.719423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:52.720036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:52.720594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:52.871286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:52.881768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ec4fb65b-5486-4590-ae4c-65c6424b6ba3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.178175 Aug 21 02:10:52.882565 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3844/7036] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:52 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:52.908050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:52.908688 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:52.916448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:52.916999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:52.917445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:52.918160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:52.918622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:52.919059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.053963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:53.062342 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3250bfb0-b749-4d0f-bc0e-0eb9fd8c5edd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.158751 Aug 21 02:10:53.062899 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3193/7037] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:52 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:53.082493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:53.083106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:53.089389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.089872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.090306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.091001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.091450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.091872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.227474 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:53.235482 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-240f5aa3-0134-41b8-b43e-f281f0808e3e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1670 microversion: 2.1 time: 0.156918 Aug 21 02:10:53.236088 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3845/7038] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:53 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:53.256229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:53.256494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:53.262960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.263445 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.263881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.264570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.265091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.265518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.302345 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:10:53.329714 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:53.387978 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f4c2b89-152c-463f-8dbd-81a5f5542a05 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 204 len: 0 microversion: 2.1 time: 0.135746 Aug 21 02:10:53.388659 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3194/7039] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:10:53 2022] DELETE /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:10:53.401455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:53.402395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:53.409066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.409555 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.409994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.410695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.411144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.411605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.546096 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:53.554838 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cacd174-0c82-413f-a08c-31fd2bdcbbda tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1676 microversion: 2.1 time: 0.157345 Aug 21 02:10:53.555403 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3846/7040] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:53 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:53.932257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "name": "network-vif-plugged", "status": "completed", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:53.944729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:53.945255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:53.945694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:53.956603 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] Creating event network-vif-plugged:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h1-master-1 Aug 21 02:10:53.961645 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5dba01f0-0116-4e9b-ab17-a7ae23326a69 req-a1c7f474-50b2-46e2-aa65-993b4aca264b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Aug 21 02:10:53.962253 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3195/7041] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:10:54.577138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:54.577745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:54.585391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:54.585878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:54.586298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:54.587023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:54.587475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:54.587899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:54.727106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:54.730762 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:10:54.735581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f90aa31d-23de-4350-9a7f-3a73fdd68767 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 200 len: 1676 microversion: 2.1 time: 0.162563 Aug 21 02:10:54.736171 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3847/7042] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:54 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:55.554718 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84aed25-5d8b-475d-96c5-17a97d82d30a", "name": "network-vif-deleted", "tag": "012fc77a-4c9a-433f-a8dd-4645dd2accc6"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:55.564736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:55.565256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:55.565668 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:55.578048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] Creating event network-vif-deleted:012fc77a-4c9a-433f-a8dd-4645dd2accc6 for instance b84aed25-5d8b-475d-96c5-17a97d82d30a on n-h1-master-1 Aug 21 02:10:55.583552 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-962fcc8d-6346-44f2-af49-f82ae7249d77 req-5ddebd3d-b79e-4e51-8a40-26677a5f4143 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034414 Aug 21 02:10:55.584208 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3196/7043] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:10:55.759733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:55.760383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:55.769141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:55.769874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:55.770585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:55.771460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:55.771913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:55.772760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:55.789371 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a HTTP/1.1 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b84aed25-5d8b-475d-96c5-17a97d82d30a'} Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:10:55.791377 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.795848 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.797192 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:10:55.798257 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b4b37e8-47b6-45d8-9745-0cb70bd4f57c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 404 len: 111 microversion: 2.1 time: 0.044988 Aug 21 02:10:55.799083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3848/7044] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:55 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:10:55.811665 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:55.812363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:55.818655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:55.819168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:55.819845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:55.820546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:55.821032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:55.821466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:55.834859 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a HTTP/1.1 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b84aed25-5d8b-475d-96c5-17a97d82d30a'} Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:10:55.836675 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c36cd0a7-e7cf-450e-9454-1e35c7ff1fc2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 404 len: 111 microversion: 2.1 time: 0.031025 Aug 21 02:10:55.840108 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3197/7045] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:55 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:10:55.888681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-47640850", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "288c85ae-8436-4697-acea-78e835b1f27f"}], "security_groups": [{"name": "tempest-securitygroup--876159644"}], "key_name": "tempest-keypair-1291094441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:55.997543 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] validate_networks() for [('288c85ae-8436-4697-acea-78e835b1f27f', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:10:56.397871 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:10:56.398299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:10:56.398768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:10:56.399173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:10:56.399761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:10:56.409729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:56.410212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:56.410650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:56.411384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:56.411868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:56.412289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:56.431342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:10:56.438597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:10:56.452523 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:10:56.455153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:10:56.505398 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5cb5294a-efa8-4a66-8b94-e840d449d1ef tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.620679 Aug 21 02:10:56.506369 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3849/7046] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:10:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:10:56.517417 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e85f1d3-aeb3-472b-ba7c-6c065fa0942b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:56.518363 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e85f1d3-aeb3-472b-ba7c-6c065fa0942b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:56.584213 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e85f1d3-aeb3-472b-ba7c-6c065fa0942b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:56.592957 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e85f1d3-aeb3-472b-ba7c-6c065fa0942b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1237 microversion: 2.1 time: 0.079445 Aug 21 02:10:56.593702 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3198/7047] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:56 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:10:57.615111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:57.615721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:57.625957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:57.627414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:57.627865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:57.628583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:57.629073 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:57.629483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:57.707608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:57.716358 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a14b39be-c531-43da-a9c9-9cf05aca0c74 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1297 microversion: 2.1 time: 0.106296 Aug 21 02:10:57.716955 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3850/7048] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:57 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:58.745954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:10:58.746558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:10:58.753865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:58.754376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:58.754817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:58.755552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:58.756014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:58.756448 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:59.124698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:10:59.133823 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e5d16ee9-8d7a-4e18-99c8-ddc785d7ba65 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.392645 Aug 21 02:10:59.134519 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3199/7049] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:10:58 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:10:59.406457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:10:59.419446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:10:59.420036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:10:59.420476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:10:59.432065 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] Creating event network-changed:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h2-master-1 Aug 21 02:10:59.438615 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-3806aed2-cd2d-40ef-861b-1b4e606077ff req-042eda25-bdc6-4ef0-9571-2b0c2f487a77 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037477 Aug 21 02:10:59.439231 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3851/7050] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:11:00.157093 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:00.157740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:00.165712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:00.166211 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:00.166654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:00.167387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:00.167854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:00.168287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:00.303206 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:00.311302 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9965712f-b5e0-4661-8f30-35d51529104e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.158658 Aug 21 02:11:00.311878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3200/7051] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:00 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:01.341457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:01.342047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:01.349384 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:01.349875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:01.350316 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:01.351027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:01.351478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:01.351905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:01.497984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:01.505982 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f159d76-c55f-41ff-934b-9f0de9bc01e7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.169601 Aug 21 02:11:01.506539 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3852/7052] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:01 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:02.529352 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:02.530217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:02.533262 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:02.539101 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:02.539526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:02.539980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:02.540691 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:02.541174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:02.541599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:02.791551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:02.800463 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0d1cb36-6f6e-412f-a32a-ef4532f7ebb0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.275979 Aug 21 02:11:02.801096 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3201/7053] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:02 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:03.823059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:03.823677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:03.826688 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:03.831902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:03.832403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:03.832870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:03.833581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:03.834036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:03.834459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:03.971559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:03.980190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c2bfd1a-42c7-43d2-8579-21850192652b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.161124 Aug 21 02:11:03.980800 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3853/7054] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:03 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:05.006695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:05.007770 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:05.017242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:05.017742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:05.018190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:05.018893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:05.019355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:05.019788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:05.167738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:05.176281 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4dcb38bc-2c56-4632-9481-5026140b0108 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.176266 Aug 21 02:11:05.176878 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3202/7055] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:04 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:05.850451 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "name": "network-vif-plugged", "status": "completed", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:11:05.861516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:05.862025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:05.862423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:05.874706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] Creating event network-vif-plugged:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h2-master-1 Aug 21 02:11:05.879822 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f3b3cadc-873f-4643-896e-1cd7cdda1598 req-796d98ef-e0ea-4453-a5fd-a9c9067f31af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Aug 21 02:11:05.880440 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3854/7056] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:11:06.205321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:06.205862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:06.213399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:06.213942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:06.214716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:06.215523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:06.216022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:06.216539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:06.358174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:06.370643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be753945-e5e0-47c5-842c-bc52b38c5e45 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.169180 Aug 21 02:11:06.371359 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3203/7057] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:06 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:07.389388 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:07.390182 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:07.395239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:07.395948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:07.404271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:07.404801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:07.405255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:07.405957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:07.406415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:07.406845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:07.545820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:07.554156 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea014f35-0c25-4444-8cb5-041ca811510c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1362 microversion: 2.1 time: 0.165807 Aug 21 02:11:07.554732 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3855/7058] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:07 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:08.576877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:08.577537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:08.579668 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:11:08.586843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:08.587386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:08.587887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:08.588663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:08.589207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:08.589682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:08.735502 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:11:08.747741 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b1e70622-d1d4-493e-95d4-c49a3f410c3d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1548 microversion: 2.1 time: 0.175001 Aug 21 02:11:08.748487 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3204/7059] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:11:08 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:11:08.774591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:11:08.775099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:11:08.784800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:08.785271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:08.785702 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:08.786392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:08.786837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:08.787238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:08.878088 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4577712-da12-4315-8d06-ef85bea46035 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107062 Aug 21 02:11:08.878894 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3856/7060] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:11:08 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:11:09.912029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:11:09.921840 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:11:09.922317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:11:09.922758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:11:09.933934 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] Creating event network-changed:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h2-master-1 Aug 21 02:11:09.939125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-74dd47b2-a74c-4cdd-ba80-896aed8ed368 req-3fff1460-23a0-4873-a3ff-8f2d81b7c7f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101923 Aug 21 02:11:09.939720 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3205/7061] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:11:41.953793 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:11:41.954566 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:11:42.272998 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:11:42.273609 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:12:11.594566 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=7 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:11.595883 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=36 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:11.603535 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:11.612146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:11.612631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:11.613093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:11.640964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Going to try to stop instance {{(pid=122482) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 02:12:11.693889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8897de0-79ca-481c-9e81-f2e3e0845b9f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action" status: 202 len: 0 microversion: 2.1 time: 0.103881 Aug 21 02:12:11.694694 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3857/7062] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:12:11 2022] POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:12:11.702659 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=9 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:11.703837 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:11.709075 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:11.709993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:11.718212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:11.718712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:11.719186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:11.719903 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:11.720368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:11.720809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:11.863503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:11.871958 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5c4b982d-c91c-4fc7-9902-1215a956d2d2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.172402 Aug 21 02:12:11.872540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3206/7063] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:11 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:12.898751 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:12.899860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:12.908285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:12.909022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:12.909450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:12.910149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:12.910605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:12.911031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:13.062947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:13.070991 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-898ebfc3-f624-4c42-84a6-490d4580f603 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.179984 Aug 21 02:12:13.071548 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3858/7064] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:12 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:14.098128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:14.099145 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:14.109574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:14.110065 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:14.110505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:14.111206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:14.111670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:14.112103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:14.260030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:14.267994 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b053d34c-175e-4b35-89cb-2395ccd34131 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.176884 Aug 21 02:12:14.268550 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3207/7065] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:14 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:15.290060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:15.290649 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:15.298326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:15.298839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:15.299281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:15.299983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:15.300429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:15.300870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:15.437000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:15.449939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e650eb31-4937-4dfc-bb21-79997fd8e915 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.163590 Aug 21 02:12:15.450753 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3859/7066] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:15 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:16.474016 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:16.474702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:16.483215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:16.483773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:16.484317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:16.485185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:16.485716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:16.486236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:16.627164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:16.635176 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e4963e33-3fa7-4cee-9516-f765f395a2ab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.166001 Aug 21 02:12:16.635771 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3208/7067] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:16 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:17.659514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:17.660117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:17.667608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:17.668099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:17.668536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:17.669276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:17.669733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:17.670165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:17.824270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:17.836713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-155c9365-19e4-4aab-93e4-4162fed1729a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.181476 Aug 21 02:12:17.837751 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3860/7068] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:17 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:18.862366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:18.862973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:18.872610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:18.873462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:18.874179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:18.875255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:18.876091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:18.876826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:19.275373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:19.285293 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0db31483-c97c-4076-b374-6eccb3411166 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.428591 Aug 21 02:12:19.285868 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3209/7069] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:18 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:20.307813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:20.308405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:20.315936 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:20.316417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:20.316874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:20.317572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:20.318013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:20.318430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:20.458980 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:20.471315 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b9ceedc-9b5a-4ae1-b1d0-bba81341dff4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.167296 Aug 21 02:12:20.472099 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3861/7070] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:20 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:12:21.497464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:21.498237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:21.506659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:21.507148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:21.507588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:21.508289 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:21.508742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:21.509201 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:21.655217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:21.663831 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c9181879-452c-4f27-a9ed-437546fc3dcf tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.172849 Aug 21 02:12:21.664403 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3210/7071] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:21 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:22.688547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:22.689313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:22.697890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:22.698461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:22.698993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:22.699780 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:22.700312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:22.700810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:22.848640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:22.860751 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b8cc9ea5-521b-4dea-b97f-8d6e62b9a3d9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1654 microversion: 2.1 time: 0.176771 Aug 21 02:12:22.861919 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3862/7072] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:22 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:22.889028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:22.891909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:22.899027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:22.899531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:22.899968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:22.900693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:22.901186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:22.901621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:22.931264 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:22.937881 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:12:22.945961 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:12:22.946403 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:12:22.946814 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:12:22.947239 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:12:22.947646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:12:23.021681 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1779ee60-88eb-42ec-ac6f-c97e366f497f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action" status: 202 len: 0 microversion: 2.1 time: 0.136599 Aug 21 02:12:23.022724 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3211/7073] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:12:22 2022] POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:12:23.031351 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:23.032307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:23.039005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:23.039489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:23.039925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:23.040685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:23.041340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:23.041924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:23.191636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:23.200390 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d427f05-b328-4d50-890c-8367c49997de tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.173366 Aug 21 02:12:23.201284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3863/7074] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:23 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:24.221500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:24.222170 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:24.231206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:24.231626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:24.232075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:24.232798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:24.233273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:24.233708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:24.387517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:24.397699 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3f86c4b1-9646-4464-9971-c1e64182b0a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1677 microversion: 2.1 time: 0.180165 Aug 21 02:12:24.398517 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3212/7075] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:24 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:25.421373 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:25.422017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:25.429358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:25.429842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:25.430274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:25.430999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:25.431450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:25.431874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:25.601136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:25.612118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0cd6a9fe-e769-4afd-ad4e-f24eaeccef3a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1682 microversion: 2.1 time: 0.194805 Aug 21 02:12:25.612798 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3864/7076] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:25 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:26.637407 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:26.638017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:26.645756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:26.646257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:26.646707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:26.647424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:26.647888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:26.648322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:26.793556 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:26.804195 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-00e44f65-4617-4569-9985-ac9373ed76c3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1682 microversion: 2.1 time: 0.170496 Aug 21 02:12:26.804800 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3213/7077] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:26 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:27.448197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "name": "network-vif-unplugged", "status": "completed", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:27.459215 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:27.459841 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:27.460166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:27.473870 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Creating event network-vif-unplugged:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h1-master-1 Aug 21 02:12:27.479613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:12:27.491873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-acc01009-121d-4677-bcc5-3fa9d7dc51bd req-0024b6ef-b7a2-468e-9195-696f731db2a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047739 Aug 21 02:12:27.492490 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3865/7078] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:27.825545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:27.826188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:27.833019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:27.833522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:27.833979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:27.834700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:27.835167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:27.835616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:28.051702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:28.059512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02f329c4-b054-4feb-a0f0-e9de47519b13 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1681 microversion: 2.1 time: 0.238318 Aug 21 02:12:28.060077 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3214/7079] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:27 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:29.089502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:29.090673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:29.098980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:29.099473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:29.099916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:29.100619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:29.101113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:29.101544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:29.249405 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:29.258136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c016bf7-4165-4520-9ac3-0fbc20b3b36f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1679 microversion: 2.1 time: 0.176314 Aug 21 02:12:29.258706 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3866/7080] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:29 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:29.524111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:29.535670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:29.536151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:29.536596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:29.549624 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Creating event network-changed:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h1-master-1 Aug 21 02:12:29.555836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:12:29.566865 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8521846e-2c3f-42b0-a157-f84b76f5bf20 req-b1634cf6-78d2-4123-9afe-f95a4bc44778 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046505 Aug 21 02:12:29.567457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3215/7081] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:30.280410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:30.282425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:30.289855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.290358 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.291136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.291859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.292470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.292932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.447011 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:30.457824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4f0494c6-a7ba-46c4-a834-08a46138e93d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1675 microversion: 2.1 time: 0.181923 Aug 21 02:12:30.458408 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3867/7082] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:30 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:30.479809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:30.480448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:30.486925 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.487480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.487980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.489313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.489783 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.490224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.556309 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-15325bbd-d79c-45d2-9238-c71095ba34be tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action" status: 204 len: 0 microversion: 2.1 time: 0.081600 Aug 21 02:12:30.557014 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3216/7083] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:12:30 2022] POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:12:30.566292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:30.567030 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:30.574238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.574768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.575257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.576022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:30.576576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:30.577113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:30.733008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:30.745513 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e48dc8cf-eb90-4d2a-b10b-9e0362cac17c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1675 microversion: 2.1 time: 0.183568 Aug 21 02:12:30.746386 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3868/7084] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:30 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:31.770888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:31.771603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:31.778735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:31.779231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:31.779674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:31.780531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:31.781068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:31.781623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:31.952526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:31.963315 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e0faccf0-9a33-451d-a2b8-279d4d0dff1a tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1675 microversion: 2.1 time: 0.199027 Aug 21 02:12:31.963900 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3217/7085] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:31 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:12:32.432878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "name": "network-vif-plugged", "status": "completed", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:32.443742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:32.444221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:32.444647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:32.457033 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] Creating event network-vif-plugged:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h1-master-1 Aug 21 02:12:32.462311 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-98056968-685b-4c71-b323-15b46477d815 req-1a154e97-cf7c-4660-be44-e2d58f25c597 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096314 Aug 21 02:12:32.463017 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3869/7086] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:32.991691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:32.992690 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:33.002859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.003518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.004160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.005129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.005755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.006338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.148438 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:33.157153 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-680cd815-1440-49da-b841-9d0d2cd003b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1654 microversion: 2.1 time: 0.170665 Aug 21 02:12:33.157738 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3218/7087] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:32 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:33.186860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:33.188003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:33.197443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.198218 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.198863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.199922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.200610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.201330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.337211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:33.348402 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db29eaf7-734f-489f-ab47-442270b96040 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1654 microversion: 2.1 time: 0.168718 Aug 21 02:12:33.349000 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3870/7088] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:33 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:33.369224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:33.375819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.376503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.377026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.399834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Going to try to start instance {{(pid=122483) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 02:12:33.423617 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:33.457126 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d54ee74-9386-4c3e-8dab-354815603654 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action" status: 202 len: 0 microversion: 2.1 time: 0.091402 Aug 21 02:12:33.457932 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3219/7089] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:12:33 2022] POST /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:12:33.466713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:33.467304 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:33.474775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.475305 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.475807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.476551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:33.477036 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:33.477465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:33.615992 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:33.624005 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98cafe9c-5528-41f2-b59d-2d7cef9b7d90 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1663 microversion: 2.1 time: 0.161395 Aug 21 02:12:33.624603 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3871/7090] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:33 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:34.646780 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:34.647583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:34.654488 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:34.655007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:34.655449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:34.656154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:34.656597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:34.657058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:34.874105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:34.883090 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-502d9789-2578-48cc-9eae-4eb42646ee85 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1667 microversion: 2.1 time: 0.241507 Aug 21 02:12:34.883673 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3220/7091] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:34 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:34.904371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:34.904945 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:34.912024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:34.912503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:34.912978 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:34.913698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:34.914169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:34.914543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:34.943287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:12:34.976679 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:35.034388 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-becaea03-0ee7-4035-9c2e-9209c17d8404 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 204 len: 0 microversion: 2.1 time: 0.134098 Aug 21 02:12:35.034998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3872/7092] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:12:34 2022] DELETE /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:12:35.043878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:35.044519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:35.050747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:35.051242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:35.051698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:35.052429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:35.052907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:35.053343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:35.203837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:35.212287 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cf22ca38-b14e-422a-b88e-6a9fea73085b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1673 microversion: 2.1 time: 0.172434 Aug 21 02:12:35.212895 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3221/7093] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:35 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:36.237783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:36.238522 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:36.246043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:36.246531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:36.246967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:36.247671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:36.248126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:36.248556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:36.393979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:36.401942 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b86afb45-37bb-4b9c-bee9-092385dd7dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1673 microversion: 2.1 time: 0.170316 Aug 21 02:12:36.402880 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3873/7094] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:36 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:37.214380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98a5c77-9cad-4ef7-8447-1ec392bda8bb", "name": "network-vif-deleted", "tag": "21c4522b-8c9e-4a46-9c85-c2baa6b66dc7"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:37.232129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:37.232850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:37.233394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:37.246591 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] Creating event network-vif-deleted:21c4522b-8c9e-4a46-9c85-c2baa6b66dc7 for instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb on n-h1-master-1 Aug 21 02:12:37.253330 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0453ba6f-06bb-428c-a67f-9a344de64d32 req-4e2744bf-f713-441f-8763-8e5a947588b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042909 Aug 21 02:12:37.254270 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3222/7095] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:37.424685 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:37.425692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:37.433594 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:37.434414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:37.435105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:37.436064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:37.436610 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:37.437134 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:37.476465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:37.476988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:37.477418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:37.477843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lazy-loading 'fault' on Instance uuid f98a5c77-9cad-4ef7-8447-1ec392bda8bb {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:12:37.526583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:37.534879 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-63676aa0-fada-4067-9ccb-6e7992900ec6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 200 len: 1327 microversion: 2.1 time: 0.114581 Aug 21 02:12:37.535469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3874/7096] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:37 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:38.563441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:38.564138 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:38.571245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:38.571738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:38.572179 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:38.572912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:38.573374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:38.574004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:38.593715 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb HTTP/1.1 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f98a5c77-9cad-4ef7-8447-1ec392bda8bb'} Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:12:38.595432 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f49578a9-51cc-4eee-9f99-3da1bcac90b0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 404 len: 111 microversion: 2.1 time: 0.041913 Aug 21 02:12:38.600272 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3223/7097] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:38 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:12:38.613376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:38.613998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:38.621274 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:38.621745 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:38.622192 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:38.622947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:38.623363 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:38.623836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:38.638087 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb HTTP/1.1 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f98a5c77-9cad-4ef7-8447-1ec392bda8bb'} Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:12:38.639793 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2dccff1d-7e01-4f86-b6fe-7bc013980c11 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 404 len: 111 microversion: 2.1 time: 0.032573 Aug 21 02:12:38.644345 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3875/7098] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:38 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:12:38.693980 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2003283622", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "288c85ae-8436-4697-acea-78e835b1f27f"}], "security_groups": [{"name": "tempest-securitygroup--876159644"}], "key_name": "tempest-keypair-1291094441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:38.804543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] validate_networks() for [('288c85ae-8436-4697-acea-78e835b1f27f', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:12:39.268498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:12:39.269078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:12:39.269561 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:12:39.269972 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:12:39.270387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:12:39.280735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:39.281257 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:39.281694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:39.282533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:39.282992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:39.283422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:39.301112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:12:39.306828 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:12:39.320468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:12:39.322834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:12:39.381822 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6c8cde0-dd77-48cd-b820-f73e6edef353 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691739 Aug 21 02:12:39.382475 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3224/7099] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:12:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:12:39.393841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aa27d91f-a970-460a-aad6-4fcdafb1ef36 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:39.394570 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aa27d91f-a970-460a-aad6-4fcdafb1ef36 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:39.449934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aa27d91f-a970-460a-aad6-4fcdafb1ef36 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:39.457682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aa27d91f-a970-460a-aad6-4fcdafb1ef36 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1239 microversion: 2.1 time: 0.067811 Aug 21 02:12:39.458240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3876/7100] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:39 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:40.480635 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:40.481231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:40.490526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:40.491117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:40.491632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:40.492396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:40.493109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:40.493657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:40.571491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:40.580212 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5009df06-84c6-4bef-b19a-57c4095fa7e5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1299 microversion: 2.1 time: 0.103877 Aug 21 02:12:40.581320 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3225/7101] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:40 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:41.601670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:41.602294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:41.610530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:41.611022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:41.611537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:41.612404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:41.612790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:41.613259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:41.747800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:41.756392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c98ff7b9-b45b-45c2-81d1-8c3918449d04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.158662 Aug 21 02:12:41.756999 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3877/7102] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:41 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:12:41.943273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:41.949531 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:41.957038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:41.957525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:41.958640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:41.972711 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] Creating event network-changed:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:12:41.978082 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-33098aee-5dff-461c-ba54-ee2c381478d6 req-56afdeb8-84db-4236-8421-57d86aaef169 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038678 Aug 21 02:12:41.978682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3226/7103] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:42.781779 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:42.782561 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:42.786317 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:42.793869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:42.794507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:42.795087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:42.796122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:42.796721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:42.797413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:42.933027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:42.941820 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-70c0bdc0-326b-4735-8821-ef6dba07363f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.166003 Aug 21 02:12:42.942401 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3878/7104] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:42 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:43.972852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:43.973594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:43.981082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:43.981577 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:43.982019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:43.982750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:43.983215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:43.983665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:44.133758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:44.143227 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54f8d178-c7b8-4293-a082-29de7d9fb52b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.176956 Aug 21 02:12:44.143913 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3227/7105] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:43 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:45.170505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:45.171378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:45.180691 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:45.181219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:45.181665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:45.182374 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:45.182836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:45.183262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:45.321901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:45.330396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c064868-c4e3-44cc-b51f-54d33829a762 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.167061 Aug 21 02:12:45.330986 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3879/7106] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:45 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:46.358504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:46.359110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:46.366880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:46.367367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:46.367817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:46.368541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:46.369055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:46.369493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:46.507046 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:46.514963 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26760bab-29a7-4e4d-99dc-dfc25b4b542e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.160719 Aug 21 02:12:46.515515 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3228/7107] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:46 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:47.539410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:47.540110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:47.548683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:47.549287 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:47.549798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:47.550609 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:47.551266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:47.551762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:47.693745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:47.701848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9ccb3907-c47c-4896-aa76-44ea31cd2a9b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.167577 Aug 21 02:12:47.702417 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3880/7108] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:47 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:48.339006 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-plugged", "status": "completed", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:48.349684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:48.350160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:48.350610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:48.362533 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] Creating event network-vif-plugged:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:12:48.367594 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-30c9461c-15cd-4d62-8710-51f7e4a8d524 req-8c93438a-3827-4d05-82d8-7fb0d541f805 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Aug 21 02:12:48.368382 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3229/7109] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:48.726807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:48.727747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:48.738181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:48.738742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:48.739186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:48.739893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:48.740349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:48.740798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:48.878897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:48.890802 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c7f58b20-b5b4-4ca9-9abf-7ab91457be6d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.169918 Aug 21 02:12:48.891622 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3881/7110] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:48 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:49.911782 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:49.912605 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:49.917794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:49.918498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:49.925564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:49.926200 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:49.926641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:49.927351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:49.927799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:49.928231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:50.063497 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:50.071823 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f87444b-6d4c-4b0a-bf64-b6600a18747c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1364 microversion: 2.1 time: 0.161019 Aug 21 02:12:50.072388 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3230/7111] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:49 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:51.097591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:51.098514 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:51.101372 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:12:51.111782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:51.113072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:51.113622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:51.114378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:51.114990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:51.115295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:51.251672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:12:51.260060 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5382261-536c-4453-b23d-19d5ad549eb7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1551 microversion: 2.1 time: 0.169176 Aug 21 02:12:51.260605 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3882/7112] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:12:51 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:12:51.281356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:12:51.281862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:12:51.289496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:51.289999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:51.290450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:51.291158 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:51.291623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:51.292059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:51.380885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59637e2e-d704-449f-8c6a-1324859ed219 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103658 Aug 21 02:12:51.381518 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3231/7113] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:12:51 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:12:52.666055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:12:52.677515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:12:52.677992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:12:52.678420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:12:52.690973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] Creating event network-changed:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:12:52.696364 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-83e4c8dd-921d-4eca-a0ce-04bfee7a8e06 req-d4ba2752-3ad1-4176-a778-5eb015697ca1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034052 Aug 21 02:12:52.697042 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3883/7114] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:13:21.941581 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:13:21.942395 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:13:54.337762 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=11 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:54.338537 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:54.342963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:13:54.345418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:54.353578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:54.354081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:54.354533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:54.355281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:54.355751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:54.356188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:54.385923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:54.392215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:13:54.399037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:13:54.399470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:13:54.399970 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:13:54.400394 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:13:54.400805 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:13:54.467125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9f6985f9-aa30-4757-bded-c1cc0de584a2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/action" status: 202 len: 0 microversion: 2.1 time: 0.131752 Aug 21 02:13:54.467902 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3232/7115] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:13:54 2022] POST /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:13:54.475471 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=11 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:54.476220 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:13:54.481467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:13:54.482207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:54.490450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:54.491099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:54.491539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:54.492354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:54.493385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:54.493913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:54.683342 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:54.693201 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-633c5032-3e17-4efa-a259-015a96df2d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1679 microversion: 2.1 time: 0.220651 Aug 21 02:13:54.693790 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3884/7116] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:13:54 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:13:55.716020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:13:55.716714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:55.723555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:55.724051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:55.724497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:55.725405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:55.725874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:55.726358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:55.958027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:55.966797 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9d4da4c8-b6be-4edf-bc0f-a2734a273036 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1679 microversion: 2.1 time: 0.255511 Aug 21 02:13:55.967276 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3233/7117] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:13:55 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:13:56.991426 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:13:56.992190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:57.002606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:57.003236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:57.003824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:57.004672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:57.005298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:57.005872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:57.146971 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:57.155628 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8669fee7-70a1-47be-8364-446475b14823 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.169483 Aug 21 02:13:57.156199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3885/7118] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:13:56 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:13:58.178117 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:13:58.178746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:58.185807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:58.186302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:58.186749 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:58.187454 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:58.187915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:58.188352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:58.334406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:58.345254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-510f04d7-64f6-4bdf-8ff7-23ace9db3415 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.170885 Aug 21 02:13:58.346062 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3234/7119] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:13:58 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:13:59.371994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:13:59.373036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:13:59.383803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:59.384547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:59.385269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:59.386341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:13:59.387044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:13:59.387706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:13:59.554883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:13:59.565309 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc3ce3ab-2ef3-4018-a46d-7f267bd0ac7e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.200091 Aug 21 02:13:59.568525 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3886/7120] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:13:59 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:00.590896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:00.591931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:00.603559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:00.604423 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:00.605222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:00.606398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:00.607187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:00.607916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:00.752928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:00.761700 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a2be4fef-1d12-4ad5-9097-0e4347a51f33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.177570 Aug 21 02:14:00.762476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3235/7121] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:00 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:01.783922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:01.784517 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:01.792126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:01.792615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:01.793083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:01.793788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:01.794242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:01.794666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:01.933157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:01.941607 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31eb9546-f375-4395-b603-516315f88cd6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.161741 Aug 21 02:14:01.942476 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3887/7122] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:01 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:02.966203 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:02.967034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:02.976683 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:02.977393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:02.977991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:02.978937 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:02.979555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:02.980138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:03.124253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:03.133278 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea670bfb-9002-4bc0-abfb-de1648f2cb75 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.172166 Aug 21 02:14:03.134418 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3236/7123] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:02 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:04.158891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:04.159765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:04.167541 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:04.168114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:04.168543 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:04.169275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:04.169726 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:04.170142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:04.320262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:04.333987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0be05159-8445-46aa-ab4e-e21806f35e17 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.179143 Aug 21 02:14:04.334315 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3888/7124] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:04 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:05.362766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:05.363410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:05.370762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:05.371281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:05.371729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:05.372413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:05.372933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:05.373377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:05.516954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:05.525167 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c167d100-b51b-4f11-bf65-dcc03c3dd924 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.166300 Aug 21 02:14:05.525748 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3237/7125] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:05 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:06.551617 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:06.552615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:06.560630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:06.561153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:06.561604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:06.562296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:06.562759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:06.563188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:06.698487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:06.707531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-930e09ff-48eb-4cc7-b9cf-3e0e339c8117 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.162478 Aug 21 02:14:06.708117 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3889/7126] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:06 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:07.732693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:07.733520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:07.743224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:07.743867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:07.744702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:07.745675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:07.746284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:07.746862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:07.896808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:07.909329 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9a2ee662-195b-4ba0-b863-9c3583f2d819 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1684 microversion: 2.1 time: 0.181680 Aug 21 02:14:07.910111 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3238/7127] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:07 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:08.931394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:08.932008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:08.939120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:08.939590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:08.940021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:08.940903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:08.941347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:08.941762 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:08.975492 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-unplugged", "status": "completed", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:08.988328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:08.989016 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:08.989304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:09.003598 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Creating event network-vif-unplugged:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h1-master-1 Aug 21 02:14:09.010321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:14:09.023810 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7849c581-ce86-4036-9d8b-bcab1ed64fa1 req-d5006458-bb0f-4dfa-9a7b-b48532042eab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051304 Aug 21 02:14:09.024633 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3239/7128] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:09.081180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:09.091361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb6502f3-272a-47b7-b12c-c60cce2f47af tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1683 microversion: 2.1 time: 0.164223 Aug 21 02:14:09.091956 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3890/7129] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:08 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:10.115357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:10.116050 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:10.122946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:10.123711 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:10.124128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:10.124898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:10.125366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:10.130085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:10.315007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:10.323528 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0716932-81a7-4eae-8b24-450d457d7221 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1683 microversion: 2.1 time: 0.213281 Aug 21 02:14:10.324159 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3240/7130] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:10 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:11.069701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:11.086797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:11.087181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:11.087622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:11.099933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Creating event network-changed:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h1-master-1 Aug 21 02:14:11.106267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:14:11.118166 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-02cf8e27-ae0e-41a7-8f89-d72b1aab101e req-09f33572-dac2-490d-a687-1753ab1cca82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054944 Aug 21 02:14:11.118824 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3891/7131] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:11.345733 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:11.346273 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:11.353791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:11.354292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:11.354735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:11.355571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:11.356104 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:11.356557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:11.757355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:11.766996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e1c24ce-9ed4-45b0-b6a1-0f94f7834b73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1681 microversion: 2.1 time: 0.425325 Aug 21 02:14:11.767598 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3241/7132] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:11 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:12.790643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:12.791611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:12.799559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:12.799977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:12.800416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:12.801156 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:12.801607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:12.802035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:12.937564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:12.947321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-986c460d-1295-4de1-ad2d-8826099fdb91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1678 microversion: 2.1 time: 0.161234 Aug 21 02:14:12.947902 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3892/7133] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:12 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:12.967916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:12.968479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:12.976073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:12.976566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:12.977116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:12.977819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:12.978275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:12.978700 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:13.020695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:13.021463 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:13.021918 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:13.022825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:13.023298 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:13.023762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:13.045296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:14:13.050645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:14:13.162453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4fb11b1-efe9-4859-ba2b-2a8cac15c66c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/action" status: 202 len: 0 microversion: 2.1 time: 0.197736 Aug 21 02:14:13.163413 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3242/7134] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:14:12 2022] POST /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:14:13.171767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:13.172654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:13.180184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:13.180928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:13.181550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:13.182409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:13.183010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:13.183571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:13.331614 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:13.340236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be80712c-1bc6-4509-8e10-e967161bad2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.172422 Aug 21 02:14:13.340895 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3893/7135] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:13 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:14:14.365929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:14.366870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:14.374060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:14.374553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:14.374997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:14.375868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:14.376351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:14.376805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:14.516975 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:14.525522 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e283de32-7a33-47f6-9f2c-3ad34f0fe914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.166069 Aug 21 02:14:14.526439 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3243/7136] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:14 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:14.881307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-plugged", "status": "completed", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:14.894659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:14.895157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:14.895573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:14.908979 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Creating event network-vif-plugged:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h1-master-1 Aug 21 02:14:14.914371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:14:14.926816 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-19f50c57-7e4c-491d-af76-3285074e6b23 req-33c2a6a1-e2d5-46e7-ad85-a11ad8f6a470 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050512 Aug 21 02:14:14.927435 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3894/7137] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:15.548095 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:15.548689 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:15.556236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:15.556739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:15.557259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:15.557953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:15.558424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:15.558963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:15.580127 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:15.707584 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:15.716516 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-08a4ac4d-9dcf-43d9-918c-179ad961f111 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.172527 Aug 21 02:14:15.717121 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3244/7138] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:15 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:16.229579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-unplugged", "status": "completed", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:16.245721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:16.246592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:16.247410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:16.261003 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Creating event network-vif-unplugged:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:14:16.266524 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:14:16.280036 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-64a31c92-62f8-4790-917f-3af444966a0d req-d6fbf5b0-1ffc-43da-833a-f1bb15c1bf3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054955 Aug 21 02:14:16.280857 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3895/7139] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:16.738508 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:16.739116 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:16.746859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:16.747350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:16.747789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:16.748500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:16.748991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:16.749399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:16.973643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:16.982128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-81cca858-765f-4c98-9254-50acdef79204 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.247715 Aug 21 02:14:16.982747 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3245/7140] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:16 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:18.010902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:18.012037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:18.022538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:18.023321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:18.024040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:18.025062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:18.025949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:18.026369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:18.174765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:18.183153 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-034069d0-abb6-4944-9741-623f559ca394 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.181397 Aug 21 02:14:18.183753 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3896/7141] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:17 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:18.325939 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:18.336742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:18.337255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:18.337761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:18.349713 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Creating event network-changed:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:14:18.355481 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:14:18.366374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-228ce1fc-f880-47ab-8f95-cb1f6850dc6f req-e10074cd-13cb-460c-968b-55a056996bab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044383 Aug 21 02:14:18.367294 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3246/7142] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:19.213450 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:19.214095 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:19.221577 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:19.222075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:19.222521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:19.223223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:19.223840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:19.224280 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:19.364552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:19.374647 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-70406e96-05c2-491d-8084-6a5511aa75bc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1677 microversion: 2.1 time: 0.168163 Aug 21 02:14:19.375238 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3897/7143] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:19 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:20.397641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:20.398356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:20.405567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.406098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.406558 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:20.407261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.407780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.408213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:20.556395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:20.569518 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da3a6b6c-df7e-4d13-aaa1-97f49d68deb6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1670 microversion: 2.1 time: 0.176782 Aug 21 02:14:20.570447 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3247/7144] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:20 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:20.593662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:20.594283 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:20.601593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.602088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.602524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:20.603272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.603729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.604155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:20.744595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:20.753609 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e0da527-165d-4c7d-b7d6-29655d90c4ec tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1670 microversion: 2.1 time: 0.164517 Aug 21 02:14:20.754205 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3898/7145] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:20 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:20.775064 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:20.776024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:20.782611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.783114 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.783588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:20.784305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:20.784794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:20.785313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:21.244167 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:21.254157 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-31977460-cbe7-46a9-b49c-9d9aec7a4b28 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1670 microversion: 2.1 time: 0.483034 Aug 21 02:14:21.254979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3248/7146] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:20 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1670 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:21.275043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:21.275868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:21.282544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:21.283031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:21.283434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:21.284169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:21.284614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:21.285056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:21.311235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:14:21.364234 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:21.396519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6208330f-f330-46a1-8d32-be0a1cc9872d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 204 len: 0 microversion: 2.1 time: 0.125098 Aug 21 02:14:21.397070 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3899/7147] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:14:21 2022] DELETE /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:14:21.406333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:21.407078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:21.414134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:21.414637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:21.415089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:21.415799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:21.416266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:21.416701 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:21.561442 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:21.570014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e6d2a8ce-8893-485d-9f0a-5959dbd20647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1676 microversion: 2.1 time: 0.167989 Aug 21 02:14:21.570596 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3249/7148] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:21 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:22.597406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:22.598551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:22.609206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:22.609692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:22.610124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:22.610811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:22.611258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:22.611677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:22.752656 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:22.760737 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0b0e666d-06f0-4e1b-a8ff-f83ef2c53e50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1676 microversion: 2.1 time: 0.170715 Aug 21 02:14:22.761486 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3900/7149] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:22 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:22.787713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-plugged", "status": "completed", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:22.799836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:22.800335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:22.800802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:22.813140 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] Creating event network-vif-plugged:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:14:22.817951 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1ac5c624-d100-4f15-9566-a505ae6d827a req-8aaa4984-5070-4630-9dc3-5c38cba41dd9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Aug 21 02:14:22.818554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3250/7150] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:23.783388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:23.784645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:23.792140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:23.792974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:23.793424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:23.794146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:23.794601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:23.795025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:23.866810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:23.875073 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-874830e7-6500-4b0a-93ff-10d9e039a154 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 200 len: 1609 microversion: 2.1 time: 0.095838 Aug 21 02:14:23.875653 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3901/7151] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:23 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 1609 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:23.952291 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:23.958299 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dd4df6-1487-418f-850c-8f7e5249cba2", "name": "network-vif-deleted", "tag": "3e6e88e3-37ab-428a-a324-71f5dc77e93e"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:23.972183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:23.973082 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:23.973774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:23.987220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] Creating event network-vif-deleted:3e6e88e3-37ab-428a-a324-71f5dc77e93e for instance c0dd4df6-1487-418f-850c-8f7e5249cba2 on n-h2-master-1 Aug 21 02:14:23.992727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d24ec17b-556f-489a-a63a-0bc77b7097fe req-95be0b04-aa9f-465f-acde-da4819df76c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041272 Aug 21 02:14:23.993383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3251/7152] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:24.898928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:24.899729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:24.904177 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:24.908912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:24.909422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:24.909865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:24.910578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:24.911034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:24.911458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:24.928431 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 HTTP/1.1 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: exception: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c0dd4df6-1487-418f-850c-8f7e5249cba2'} Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:14:24.930455 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c398100b-40fd-45db-bf92-d24f6522bf04 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 404 len: 111 microversion: 2.1 time: 0.038286 Aug 21 02:14:24.935018 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3902/7153] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:24 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:14:24.948598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:24.949608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:24.951753 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:24.958308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:24.958900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:24.959444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:24.960246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:24.960803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:24.961308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:24.976812 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 HTTP/1.1 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c0dd4df6-1487-418f-850c-8f7e5249cba2'} Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:14:24.978514 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:14:24.983082 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:14:24.984401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:14:24.985430 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3d59440-abb4-4488-9367-a2361037fc4e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 404 len: 111 microversion: 2.1 time: 0.041411 Aug 21 02:14:24.988802 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3252/7154] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:24 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:14:25.035635 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1158634891", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "288c85ae-8436-4697-acea-78e835b1f27f"}], "security_groups": [{"name": "tempest-securitygroup--876159644"}], "key_name": "tempest-keypair-1291094441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:25.155985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] validate_networks() for [('288c85ae-8436-4697-acea-78e835b1f27f', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:14:25.618100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:14:25.618609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:14:25.619292 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:14:25.619876 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:14:25.620442 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:14:25.635090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:25.635703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:25.636586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:25.637663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:25.638128 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:25.638563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:25.656988 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:14:25.662383 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:14:25.676053 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:14:25.678499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:14:25.732179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1adf8ab-6dca-436c-9ccb-ba9db258ea33 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700625 Aug 21 02:14:25.732823 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3903/7155] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:14:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:14:25.744445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6bd61647-bd40-4a4f-8de3-51d2c812763f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:25.745135 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6bd61647-bd40-4a4f-8de3-51d2c812763f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:25.801281 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6bd61647-bd40-4a4f-8de3-51d2c812763f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:25.809752 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6bd61647-bd40-4a4f-8de3-51d2c812763f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1239 microversion: 2.1 time: 0.069241 Aug 21 02:14:25.810487 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3253/7156] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:25 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:26.832213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:26.832978 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:26.840223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:26.840882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:26.841322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:26.842064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:26.842516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:26.842970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:26.918775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:26.927451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d552d304-44a3-4acd-b30a-07c3ef62f914 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1299 microversion: 2.1 time: 0.100043 Aug 21 02:14:26.928272 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3904/7157] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:26 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:27.951039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:27.951760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:27.959214 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:27.959730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:27.960164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:27.960916 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:27.961322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:27.961782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:28.186537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:28.195419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2f2c1c60-6c07-48a4-a474-07c1c90db9b2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.248863 Aug 21 02:14:28.195990 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3254/7158] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:27 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:28.462547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:28.475469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:28.476251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:28.476684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:28.488374 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] Creating event network-changed:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:14:28.493845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-74d5735f-1990-4225-a756-cadf4c9a4488 req-37d0290b-f260-48e4-bc4f-79aaec63f7ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035079 Aug 21 02:14:28.494455 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3905/7159] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:29.220578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:29.221401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:29.230877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:29.231506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:29.232096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:29.233019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:29.233587 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:29.234126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:29.378637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:29.389988 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8ac3804-b10b-430b-9607-e68526c3b0ff tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.174532 Aug 21 02:14:29.390542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3255/7160] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:29 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:30.414467 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:30.415079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:30.422194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:30.422707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:30.423117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:30.423821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:30.424277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:30.424705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:30.567453 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:30.576562 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8b8776ea-2166-489b-89f3-d5fb7e49e191 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.168367 Aug 21 02:14:30.577211 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3906/7161] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:30 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:31.600130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:31.600921 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:31.609555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:31.610080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:31.610531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:31.611258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:31.611714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:31.612155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:31.748539 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:31.759199 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a93643b-2796-4abd-adec-2eeba4520e37 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.163748 Aug 21 02:14:31.760089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3256/7162] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:31 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:32.781911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:32.782606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:32.790061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:32.790546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:32.790969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:32.791744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:32.792193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:32.792608 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:32.944370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:32.957193 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb23b373-1fdc-4816-bbdb-b1b2c90ea4f2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.179076 Aug 21 02:14:32.958302 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3907/7163] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:32 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:33.984854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:33.985543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:33.993699 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:33.994251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:33.994747 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:33.995518 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:33.996056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:33.996757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:34.155040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:34.163293 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9ff233d5-fa97-4faf-a9f9-de74ccec34c6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.183564 Aug 21 02:14:34.163867 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3257/7164] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:33 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:34.841087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-plugged", "status": "completed", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:34.851758 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:34.852245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:34.852810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:34.867131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] Creating event network-vif-plugged:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:14:34.872573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-812da49b-68df-4969-a102-b5d9801b869d req-3ef644ec-6dba-449b-beaa-ef7de348d5f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035298 Aug 21 02:14:34.873581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3908/7165] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:14:35.185124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:35.185789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:35.193233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:35.193732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:35.194181 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:35.194896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:35.195360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:35.195792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:35.341674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:35.354372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d68d30d7-9228-4ee9-96eb-e30841f440c2 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.173052 Aug 21 02:14:35.355031 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3258/7166] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:35 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:36.383043 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:36.383835 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:36.390083 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:36.391449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:36.399958 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:36.400960 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:36.401499 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:36.402368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:36.402924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:36.403446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:36.548731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:36.556531 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e4425f8-6ab8-4401-8667-f034310af20f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1364 microversion: 2.1 time: 0.174891 Aug 21 02:14:36.557212 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3909/7167] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:36 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:37.582005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:37.582789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:37.585313 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:14:37.594333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:37.595243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:37.596107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:37.597402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:37.598218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:37.599017 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:37.743962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:14:37.752113 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-230be3dc-2027-4d76-b9e0-d3cab0c8ec2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1551 microversion: 2.1 time: 0.175658 Aug 21 02:14:37.752682 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3259/7168] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:14:37 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1551 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:14:37.773333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:14:37.773874 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:14:37.782005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:37.782490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:37.782926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:37.783622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:37.784075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:37.784533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:37.865263 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f5904e5b-2677-4255-a5e9-2da710bb2ffb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095503 Aug 21 02:14:37.866131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3910/7169] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:14:37 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:14:39.131736 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:14:39.143205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:14:39.143769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:14:39.144300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:14:39.156669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] Creating event network-changed:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:14:39.161919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-50673844-2040-47ef-8167-c820c42180a0 req-ce15c1b1-dfea-43bb-ae10-9babfab13843 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033948 Aug 21 02:14:39.162520 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3260/7170] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:15:01.964745 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:15:01.964745 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:15:02.285452 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:15:02.286171 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:15:42.272322 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:42.273102 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=48 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:42.277771 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:42.278372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:42.285628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:42.286096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:42.286724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:42.287476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:42.287923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:42.288339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:42.509865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:42.521895 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b64d37ce-5c43-4609-9221-90fba4eb3747 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1670 microversion: 2.1 time: 0.252246 Aug 21 02:15:42.522472 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3911/7171] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:42 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:42.541856 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=19 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:42.542617 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=74 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:42.547744 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68453883-ea4c-4a46-83cd-29a826e81118"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:15:42.550253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:42.557972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:42.558468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:42.558919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:42.559623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:42.560089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:42.560513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:43.064079 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-19b6867f-b057-4180-8ea4-11ad3e0714b7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523724 Aug 21 02:15:43.065222 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3261/7172] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:15:42 2022] POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:15:53.852065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:15:53.854940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:53.857782 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:53.858590 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:53.864924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:53.865414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:53.865870 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:53.866584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:53.867034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:53.867459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:53.898497 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:53.905772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Old instance type m1.heat2, new instance type m1.heat {{(pid=122482) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:15:53.914262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:15:53.914926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:15:53.915805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:15:53.916650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:15:53.917441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:15:54.000191 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6788f3ec-55a8-4f70-a0dc-ac8187e0cfa1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/action" status: 202 len: 0 microversion: 2.1 time: 0.152188 Aug 21 02:15:54.000810 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3912/7173] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:15:53 2022] POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:15:54.007536 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:54.009265 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:15:54.014423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:54.014911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:54.022615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:54.023302 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:54.023828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:54.024998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:54.025538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:54.026589 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:54.178880 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:54.188593 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-80001859-b156-440b-bc74-79af22fc27ee tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1725 microversion: 2.1 time: 0.183046 Aug 21 02:15:54.189211 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3262/7174] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:54 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:55.212585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:55.214297 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:55.221725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:55.222379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:55.222907 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:55.223617 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:55.224102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:55.224527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:55.365121 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:55.373706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16241469-9c99-4fc2-9316-e1738d7894b9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1725 microversion: 2.1 time: 0.167323 Aug 21 02:15:55.374284 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3913/7175] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:55 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:56.397836 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:56.398485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:56.406666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:56.407159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:56.407612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:56.408315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:56.408808 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:56.409247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:56.549483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:56.558971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ae043583-6868-4818-b964-0da4407ad9dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.167280 Aug 21 02:15:56.559569 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3263/7176] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:56 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:57.580702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:57.581326 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:57.589088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:57.589597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:57.590122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:57.590884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:57.591331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:57.591736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:57.738931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:57.752101 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b668033-d9d5-4bc8-9d84-251b3459bfae tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.175395 Aug 21 02:15:57.752941 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3914/7177] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:57 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:58.774143 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:58.774750 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:58.782163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:58.782670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:58.783117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:58.783830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:58.784303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:58.784737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:58.942905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:15:58.954199 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-851f5d55-946a-4305-a4ab-d3c9f930b429 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.184438 Aug 21 02:15:58.954788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3264/7178] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:58 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:15:59.979127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:15:59.979948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:15:59.987114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:59.987595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:59.988034 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:15:59.988799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:15:59.989257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:15:59.989685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:00.136135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:00.146683 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0612dc95-8820-4043-9238-389c498110a9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.173488 Aug 21 02:16:00.147511 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3915/7179] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:15:59 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:01.171317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:01.172523 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:01.180637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:01.181560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:01.182387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:01.183678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:01.184509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:01.185360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:01.321808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:01.330740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-63176255-317e-4dd2-8651-56813e2ccac9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.163722 Aug 21 02:16:01.331255 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3265/7180] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:01 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:02.354347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:02.355058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:02.364515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:02.365203 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:02.365794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:02.366732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:02.367335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:02.367922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:02.513731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:02.524238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e0d91bb-64b7-47d6-9952-3c8054880be3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.175257 Aug 21 02:16:02.524915 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3916/7181] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:02 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:03.546460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:03.547089 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:03.554767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:03.555284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:03.555763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:03.556491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:03.556979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:03.557397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:03.705653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:03.714726 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c63e4665-4e66-42e6-b505-b06c8c886a50 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.172496 Aug 21 02:16:03.715337 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3266/7182] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:03 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:04.736661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:04.737315 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:04.744804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:04.745300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:04.745737 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:04.746489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:04.746891 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:04.747313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:04.896855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:04.906821 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f04994b9-6875-4b12-abfe-41bf55f3ccb9 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.174218 Aug 21 02:16:04.907384 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3917/7183] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:04 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:05.935835 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:05.936445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:05.943071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:05.943565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:05.944007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:05.944718 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:05.945216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:05.945651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:06.094925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:06.103820 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45cff9f1-3d9f-47bd-918a-fe81b212477e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.174963 Aug 21 02:16:06.104414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3267/7184] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:05 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:07.134147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:07.134831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:07.144799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:07.145482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:07.146066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:07.147021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:07.147622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:07.148181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:07.304782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:07.314425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9153e395-3a3e-43ad-960f-3144ceeddcfe tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.185707 Aug 21 02:16:07.315254 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3918/7185] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:07 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:08.339673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:08.340495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:08.351187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:08.351936 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:08.352621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:08.353670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:08.354373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:08.355041 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:08.492001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:08.501159 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f420b97-d23f-4a97-b990-f974ec986457 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.167147 Aug 21 02:16:08.501709 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3268/7186] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:08 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:09.527137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:09.527911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:09.536937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:09.537601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:09.538185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:09.539025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:09.539517 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:09.539964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:09.693559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:09.705160 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4010a59-34b7-4d6c-9f76-339360652efc tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.184697 Aug 21 02:16:09.705729 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3919/7187] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:09 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:10.727051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:10.727837 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:10.736037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:10.736602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:10.737279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:10.738029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:10.738500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:10.739057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:10.898252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:10.907963 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-57935e26-4941-47bf-ba13-5302e298102d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.185187 Aug 21 02:16:10.908532 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3269/7188] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:10 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:11.933863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:11.934899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:11.946174 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:11.946951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:11.947602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:11.948311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:11.948760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:11.949288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:12.110638 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:12.122645 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7722d07b-bc05-49ec-9904-0fa3ff501d4f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.195266 Aug 21 02:16:12.123226 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3920/7189] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:11 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:13.145525 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:13.146153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:13.154098 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:13.154605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:13.155054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:13.155806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:13.156270 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:13.156743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:13.289887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:13.299221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c409ea7-3356-48fa-90ca-69b3374d9647 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.157753 Aug 21 02:16:13.299804 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3270/7190] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:13 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:14.321312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:14.322228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:14.330113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:14.330601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:14.331037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:14.331735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:14.332208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:14.332632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:14.476260 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:14.486028 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-546281f5-aa63-4d1d-abef-8258260a5f97 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1730 microversion: 2.1 time: 0.168650 Aug 21 02:16:14.486606 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3921/7191] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:14 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:15.508279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:15.508892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:15.516986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:15.517476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:15.517934 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:15.518670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:15.519127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:15.519560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:15.702055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:15.711606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-015167b1-d37d-4c03-9e8d-eb25cfe7a3ba tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1729 microversion: 2.1 time: 0.207606 Aug 21 02:16:15.712301 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3271/7192] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:15 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:16.130388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-unplugged", "status": "completed", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:16.140925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:16.141395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:16.141829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:16.155653 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Creating event network-vif-unplugged:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h1-master-1 Aug 21 02:16:16.161378 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] Instance a9031fcf-38b3-4562-9745-3b27c51665aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:16:16.173446 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1ca7f712-fbcf-4124-891f-9520e33fe182 req-1e67a4c4-e1a0-45a2-b9a0-c0d97479dd1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102453 Aug 21 02:16:16.173970 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3922/7193] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:16.734450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:16.735034 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:16.742499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:16.743002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:16.743444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:16.744122 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:16.744798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:16.745273 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:16.963368 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:16.976606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29024037-7776-411f-935e-2a3f30e1ee8d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1729 microversion: 2.1 time: 0.246016 Aug 21 02:16:16.977488 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3272/7194] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:16 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:18.002382 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:18.003051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:18.010099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:18.010584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:18.011299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:18.012009 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:18.012926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:18.013385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:18.157897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:18.166587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbcd0e3e-0921-4e8e-9276-a15a9ebb582e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.170376 Aug 21 02:16:18.167253 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3923/7195] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:17 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:18.190488 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:18.201080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:18.201565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:18.202008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:18.213724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Creating event network-changed:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h1-master-1 Aug 21 02:16:18.219283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] Instance a9031fcf-38b3-4562-9745-3b27c51665aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:16:18.230172 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d08e1a81-fbbc-4499-a23a-ceaf49bff8ea req-2290a066-d9b2-4de8-a0dd-3762f3ea6e7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Aug 21 02:16:18.230792 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3273/7196] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:19.187938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:19.188574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:19.196464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:19.197061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:19.197620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:19.198395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:19.198924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:19.199410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:19.337529 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:19.346302 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e51a0709-f0df-4b93-a7cc-184633cbcea1 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.162555 Aug 21 02:16:19.346862 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3924/7197] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:19 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:20.370019 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:20.370762 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:20.377515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:20.378077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:20.378510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:20.379275 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:20.379736 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:20.380348 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:20.521325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:20.531335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c880f525-2a53-40c3-b886-fb5d277d0c2f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.166762 Aug 21 02:16:20.531979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3274/7198] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:20 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:21.554381 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:21.555088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:21.562779 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:21.563265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:21.563703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:21.564400 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:21.564880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:21.565297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:21.706865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:21.715441 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19c30706-4e1c-4ab7-b619-c531150454b4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.165605 Aug 21 02:16:21.716185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3925/7199] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:21 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:22.740127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:22.740953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:22.748613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:22.749128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:22.749581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:22.750305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:22.750739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:22.751188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:22.894527 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:22.908493 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afbd7342-d22d-49bf-8eae-8053b13bd1dd tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.174281 Aug 21 02:16:22.909107 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3275/7200] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:22 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:23.937305 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:23.938277 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:23.942880 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=33 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:23.951619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:23.952101 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:23.952544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:23.953286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:23.953740 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:23.954165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:23.956989 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:24.107926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:24.116757 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-32fc8841-9b69-4b71-af18-7859128b4192 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.186584 Aug 21 02:16:24.117355 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3926/7201] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:23 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:25.146793 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:25.147734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:25.152549 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:25.160529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:25.161219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:25.161830 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:25.162794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:25.163344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:25.163772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:25.167133 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=83 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:25.307973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:25.321137 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5e8e154b-c381-43e9-be12-1c8bb1f39e91 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.180265 Aug 21 02:16:25.321906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3276/7202] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:25 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:26.345883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:26.346541 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:26.354708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:26.355251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:26.355739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:26.356523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:26.357062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:26.357531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:26.497279 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:26.505873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e862ae64-41c5-431d-bd1d-7c674e19ff52 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.164479 Aug 21 02:16:26.506460 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3927/7203] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:26 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:27.532324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:27.533366 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:27.544169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:27.544989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:27.545799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:27.546528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:27.546993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:27.547427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:27.699079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:27.708372 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e12caa64-546a-48ed-b695-9b82026644eb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.182202 Aug 21 02:16:27.708948 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3277/7204] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:27 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:28.732993 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:28.733774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:28.741601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:28.742166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:28.742677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:28.743491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:28.744023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:28.744515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:28.894259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:28.903131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da7ce7cc-2568-47fb-bfcc-53d66014873e tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1727 microversion: 2.1 time: 0.175241 Aug 21 02:16:28.903717 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3928/7205] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:28 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:29.924743 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:29.925445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:29.932633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:29.933237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:29.933689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:29.934397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:29.934863 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:29.935299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.078935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:30.087893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0e8991fe-91ba-4976-be31-453befc5f67c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1724 microversion: 2.1 time: 0.167281 Aug 21 02:16:30.088480 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3278/7206] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:29 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:30.108712 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:30.109276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:30.116121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.116605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.117082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.117775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.118229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.118655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.159793 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.160290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.160839 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.161465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.161915 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.162339 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.183643 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:16:30.189644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Getting quotas for user a97638d5939f4c10a9326e705db5843c and project 79bcc7627b8b42349425ac3245102d4d. Resources: {'cores', 'ram'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:16:30.306037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24d258ef-f937-4f75-9a53-c654868497db tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/action" status: 202 len: 0 microversion: 2.1 time: 0.201259 Aug 21 02:16:30.306584 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3929/7207] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:16:30 2022] POST /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:16:30.315126 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:30.315832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:30.322174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.322705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.323263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.323872 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:30.324340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:30.324792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:30.486254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:30.495072 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ebd9610a-ddf2-4f79-8d8b-ada7ec32c6e6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.183996 Aug 21 02:16:30.495664 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3279/7208] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:30 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:31.477528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-plugged", "status": "completed", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:31.490887 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:31.491345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:31.491840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:31.505680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Creating event network-vif-plugged:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h1-master-1 Aug 21 02:16:31.511906 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] Instance a9031fcf-38b3-4562-9745-3b27c51665aa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:16:31.527792 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b6b43990-5ef3-433b-b13b-489fb6da1f6b req-b5132675-8a53-4ceb-8e2a-18fbf11ba6e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053825 Aug 21 02:16:31.528014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:31.528736 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3930/7209] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:31.529544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:31.538715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:31.539293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:31.539812 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:31.540640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:31.541191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:31.541847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:31.780893 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:31.789689 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93a3d82c-7ab0-4769-ab23-7d3abf0ebc56 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.269974 Aug 21 02:16:31.790246 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3280/7210] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:31 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:32.819714 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:32.820864 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:32.830943 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:32.831463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:32.831867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:32.832597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:32.833092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:32.833523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:32.971986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:32.981027 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3ca7af92-d863-40f6-a048-63a2d6cee99f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.170729 Aug 21 02:16:32.981619 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3931/7211] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:32 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:34.003541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:34.004140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:34.011655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:34.012147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:34.012562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:34.013297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:34.013755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:34.014186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:34.154380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:34.163575 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7faf1eaa-2f4b-4b1c-9705-f305399c9a73 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.164069 Aug 21 02:16:34.164141 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3281/7212] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:33 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:35.186180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:35.187196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:35.195230 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:35.195798 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:35.196233 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:35.197006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:35.197513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:35.197957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:35.342388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:35.351933 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8ffe50b4-6765-4e2e-8f93-e435806024d4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.170206 Aug 21 02:16:35.352502 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3932/7213] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:35 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:36.317904 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-unplugged", "status": "completed", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:36.329748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:36.330237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:36.330809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:36.343512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Creating event network-vif-unplugged:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:16:36.349307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] Instance a9031fcf-38b3-4562-9745-3b27c51665aa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:16:36.360522 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-d1d14c2c-35da-4f93-b643-0bdddb3016fa req-bb89ebbd-f77d-4a09-bfd5-fb9047d0520d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047115 Aug 21 02:16:36.361159 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3282/7214] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:36.373137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:36.373777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:36.382783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:36.383282 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:36.383713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:36.385295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:36.385500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:36.385982 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:36.535445 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:36.544025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8c3479fe-2840-4cc9-a00c-16c40df01508 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.174762 Aug 21 02:16:36.544504 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3933/7215] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:36 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:37.567560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:37.568288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:37.575337 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:37.575774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:37.576230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:37.577124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:37.577596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:37.578074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:37.723723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:37.732668 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b17a6a0-e802-4a92-87bd-c0ccdc55f0d3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.170757 Aug 21 02:16:37.733276 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3283/7216] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:37 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:38.403903 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:38.415638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:38.416118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:38.416549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:38.428759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Creating event network-changed:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:16:38.434885 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] Instance a9031fcf-38b3-4562-9745-3b27c51665aa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:16:38.446545 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-544d6ec8-01a2-45b2-b2c3-85b54ef244df req-e666c3ce-eac9-4743-8aad-f47ba29c3a57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046699 Aug 21 02:16:38.447376 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3934/7217] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:38.757055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:38.757767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:38.765880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:38.766398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:38.766859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:38.767594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:38.768097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:38.769146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:39.069752 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:39.079130 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9badb007-5210-4abb-85a8-9766c34979ca tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.328018 Aug 21 02:16:39.080371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3284/7218] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:38 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:40.104237 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:40.105429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:40.112013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:40.113377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:40.113828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:40.114540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:40.115007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:40.115407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:40.172178 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:40.255691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:40.266113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ace6c8b-18d1-4f1d-b200-4575a88b5070 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.167130 Aug 21 02:16:40.266795 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3935/7219] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:40 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:41.289336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:41.289928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:41.297614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:41.298092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:41.298574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:41.299284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:41.300206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:41.300340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:41.443466 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:41.452727 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a333aed-5ad2-4555-aff9-53ed260073f4 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.167341 Aug 21 02:16:41.453319 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3285/7220] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:41 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:42.311422 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:16:42.312166 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:16:42.478539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:42.479107 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:42.489639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:42.490249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:42.490861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:42.491884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:42.492510 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:42.493147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:42.634596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:42.644883 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-36b33e55-d391-4c0d-8cf6-21ac961ed431 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.173269 Aug 21 02:16:42.645507 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3936/7221] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:42 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:43.678354 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:43.678966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:43.686899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:43.687403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:43.688157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:43.688911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:43.689377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:43.689810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:43.830011 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:43.841349 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66568506-fc17-417e-a76b-4fcfd78963e8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.169711 Aug 21 02:16:43.842252 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3286/7222] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:43 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:44.867591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:44.868325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:44.877407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:44.878014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:44.878566 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:44.879446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:44.880573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:44.881161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:45.018488 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:45.028409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7f6d20c-605a-4124-9f7c-2e38acc82115 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.167387 Aug 21 02:16:45.029039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3937/7223] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:44 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:46.060021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:46.061517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:46.070800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:46.071294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:46.071746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:46.072449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:46.072942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:46.073376 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:46.223720 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:46.232318 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54a516e2-7da3-4979-8c8a-c7d324d557b8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.181662 Aug 21 02:16:46.232906 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3287/7224] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:46 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:47.266571 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:47.268087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:47.277553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:47.278040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:47.278474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:47.287324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:47.287794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:47.288229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:47.451778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:47.460551 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bc804784-41e0-4a60-87f3-6f049b62dfc6 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.201977 Aug 21 02:16:47.461180 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3938/7225] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:47 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:48.485882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:48.486753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:48.497535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:48.498272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:48.498899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:48.499928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:48.500615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:48.501304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:48.641915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:48.651177 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8f8ea05-0595-42d5-9b06-f9ba5f41fc2c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.171391 Aug 21 02:16:48.651798 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3288/7226] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:48 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:49.673764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:49.674377 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:49.681996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:49.682501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:49.682937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:49.683632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:49.684076 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:49.684498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:49.824062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:49.832539 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f819ab2e-15fd-40ab-82ff-189064b0475b tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1723 microversion: 2.1 time: 0.162920 Aug 21 02:16:49.833147 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3939/7227] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:49 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:50.860430 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:50.861501 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:50.869240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:50.869738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:50.870188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:50.870904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:50.871402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:50.871835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.012097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:51.021599 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d099182a-e53f-4ca8-9eb4-db11c6c356f0 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1716 microversion: 2.1 time: 0.168012 Aug 21 02:16:51.022209 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3289/7228] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:50 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:51.045394 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:51.046013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:51.055571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.056062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.056500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.057254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.057700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.058100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.076627 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:51.215881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:51.224490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dbcb75e2-078e-4481-acd4-b19df5b73357 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1716 microversion: 2.1 time: 0.185492 Aug 21 02:16:51.225085 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3940/7229] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:51 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1716 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:51.253177 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:51.254105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:51.261320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.261817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.262260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.262972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.263434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.263868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.398724 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:51.407093 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d2ea169-e5bf-420e-a320-da64b1a03be7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1716 microversion: 2.1 time: 0.157994 Aug 21 02:16:51.407658 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3290/7230] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:51 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:51.428376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:51.428786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:51.434998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.435482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.435923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.436625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.437145 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.437569 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.464294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:16:51.547943 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-98bbdf75-56dd-4692-99be-3576b5f938f5 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 204 len: 0 microversion: 2.1 time: 0.123683 Aug 21 02:16:51.548531 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3941/7231] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:16:51 2022] DELETE /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:16:51.557909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:51.558554 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:51.564616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.566090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.566881 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.567605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:51.568071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:51.568502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:51.705014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:51.713968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71e1e671-f780-46a6-8070-3250ecca6c57 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1722 microversion: 2.1 time: 0.160492 Aug 21 02:16:51.714525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3291/7232] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:51 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:52.740715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:52.742003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:52.753310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:52.754194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:52.754947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:52.756049 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:52.756500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:52.757245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:52.914582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:52.924014 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ddb8ac6-8e4f-41d8-9974-ac167b76c75c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1722 microversion: 2.1 time: 0.190311 Aug 21 02:16:52.924624 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3942/7233] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:52 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:53.514491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-plugged", "status": "completed", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:53.534933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:53.535430 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:53.535897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:53.550110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] Creating event network-vif-plugged:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:16:53.556033 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7a848ebf-15f6-407b-88c7-95f679e8d951 req-f8ab47ab-068a-4a97-9217-3836bbaf16f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045541 Aug 21 02:16:53.556861 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3292/7234] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:53.946028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:53.946597 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:53.954747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:53.955220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:53.955651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:53.956354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:53.956834 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:53.957256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:54.095930 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:54.105889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a5033b42-a870-43e0-80d1-91bb30486dce tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1722 microversion: 2.1 time: 0.163918 Aug 21 02:16:54.106596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3943/7235] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:53 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:54.649284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9031fcf-38b3-4562-9745-3b27c51665aa", "name": "network-vif-deleted", "tag": "3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:16:54.659866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:54.660593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:54.661075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:54.673148 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] Creating event network-vif-deleted:3bb5ce43-b9c5-4bfb-b515-11d0e7aaad99 for instance a9031fcf-38b3-4562-9745-3b27c51665aa on n-h2-master-1 Aug 21 02:16:54.678761 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-9e720822-239b-4b14-8388-de032880cf56 req-7553bd28-4528-4850-83b7-c5db9c23e4ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035323 Aug 21 02:16:54.679668 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3293/7236] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:16:55.127985 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:55.129262 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:55.136444 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:55.138627 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:55.139340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:55.140000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:55.140956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:55.141722 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:55.142409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:55.217544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:55.226756 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fef121ef-42cd-45b2-8cec-e22c77d1fab3 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1370 microversion: 2.1 time: 0.102699 Aug 21 02:16:55.227424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3944/7237] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:55 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:56.249704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:56.250444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:56.252434 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:56.258478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:56.259007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:56.259450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:56.260163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:56.260626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:56.261086 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:56.263795 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=98 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:16:56.329962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:56.339311 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f044613-1125-421d-8a39-c2473e3f95bb tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1370 microversion: 2.1 time: 0.094873 Aug 21 02:16:56.339924 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3294/7238] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:56 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:57.361647 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:57.362256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:57.372493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:57.373180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:57.373957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:57.374829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:57.375290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:57.375690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:57.441618 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:57.451173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2136e59e-86b7-4af4-a463-485b33f595a8 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1370 microversion: 2.1 time: 0.093579 Aug 21 02:16:57.451760 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3945/7239] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:57 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:58.472435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:58.473054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:58.480297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:58.480797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:58.481259 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:58.481962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:58.482414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:58.482842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:58.547894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97638d5939f4c10a9326e705db5843c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79bcc7627b8b42349425ac3245102d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:16:58.557641 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f8ba0bc6-2a57-4e02-a10d-abc0ae618702 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 200 len: 1370 microversion: 2.1 time: 0.089290 Aug 21 02:16:58.558234 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3295/7240] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:58 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:16:59.582943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:59.584503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:59.594911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:59.595749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:59.596561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:59.598256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:59.599835 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:59.600278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:59.618258 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa HTTP/1.1 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: exception: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a9031fcf-38b3-4562-9745-3b27c51665aa'} Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:16:59.619940 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5809a9f-ea49-40bc-a9b5-2cb214a5f723 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 404 len: 111 microversion: 2.1 time: 0.045781 Aug 21 02:16:59.624041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3946/7241] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:16:59 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:16:59.685877 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:16:59.688141 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:16:59.695420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:59.695911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:59.696354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:59.697094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:16:59.697555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:16:59.697975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:16:59.714304 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-volume_attachments HTTP/1.1 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'a9031fcf-38b3-4562-9745-3b27c51665aa'} Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:16:59.716028 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-067ae5c8-a76e-494f-bd74-06399e27b060 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035946 Aug 21 02:16:59.720317 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3296/7242] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:16:59 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.065178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.065820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.073718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.074295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.074776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.075560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.076079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.076697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.091812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa HTTP/1.1 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: exception: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a9031fcf-38b3-4562-9745-3b27c51665aa'} Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.093521 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e74fd1ce-45b4-484f-bdfc-a96b442a5fab tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 404 len: 111 microversion: 2.1 time: 0.034136 Aug 21 02:17:03.097388 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3947/7243] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:03 2022] DELETE /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.104295 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.104981 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: a9031fcf-38b3-4562-9745-3b27c51665aa] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.112333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.112875 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.113383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.114096 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.114665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.115103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.129246 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa HTTP/1.1 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: exception: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'a9031fcf-38b3-4562-9745-3b27c51665aa'} Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.130820 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance a9031fcf-38b3-4562-9745-3b27c51665aa could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9e216d6e-65b4-4637-88bb-6063921c0966 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa" status: 404 len: 111 microversion: 2.1 time: 0.032119 Aug 21 02:17:03.134913 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3297/7244] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:03 2022] GET /compute/v2.1/servers/a9031fcf-38b3-4562-9745-3b27c51665aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.141146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.141655 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.148687 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.149212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.149642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.150336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.150783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.151202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.165458 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 HTTP/1.1 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: exception: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c0dd4df6-1487-418f-850c-8f7e5249cba2'} Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.167013 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd2d455e-1e8e-4fcb-923c-3413982a23d7 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 404 len: 111 microversion: 2.1 time: 0.031199 Aug 21 02:17:03.170989 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3948/7245] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:03 2022] DELETE /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.177421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.178051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: c0dd4df6-1487-418f-850c-8f7e5249cba2] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.184725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.185265 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.185686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.186416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.186941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.187410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.202795 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 HTTP/1.1 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c0dd4df6-1487-418f-850c-8f7e5249cba2'} Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.204428 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance c0dd4df6-1487-418f-850c-8f7e5249cba2 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.208782 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d1e283cf-b973-4f2f-8a16-7a9df1563e0c tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2" status: 404 len: 111 microversion: 2.1 time: 0.032712 Aug 21 02:17:03.210010 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3298/7246] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:03 2022] GET /compute/v2.1/servers/c0dd4df6-1487-418f-850c-8f7e5249cba2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.214791 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.215295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.221734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.222226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.222665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.223375 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.223873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.224293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.239534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb HTTP/1.1 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: exception: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'f98a5c77-9cad-4ef7-8447-1ec392bda8bb'} Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.241235 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6927cc3b-dd4b-4906-92d8-de511fa9cc77 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 404 len: 111 microversion: 2.1 time: 0.031874 Aug 21 02:17:03.244891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3949/7247] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:03 2022] DELETE /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.251594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.252205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: f98a5c77-9cad-4ef7-8447-1ec392bda8bb] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.258911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.259412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.260020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.260811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.261034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.261470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.276047 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb HTTP/1.1 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: exception: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'f98a5c77-9cad-4ef7-8447-1ec392bda8bb'} Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.277746 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance f98a5c77-9cad-4ef7-8447-1ec392bda8bb could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-602fa8aa-ffad-4270-a1ab-8b5e3b25389d tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 21 02:17:03.281371 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3299/7248] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:03 2022] GET /compute/v2.1/servers/f98a5c77-9cad-4ef7-8447-1ec392bda8bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.287956 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.288499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.294641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.295121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.295558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.296279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.296728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.297232 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.310939 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a HTTP/1.1 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b84aed25-5d8b-475d-96c5-17a97d82d30a'} Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.312528 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-479a9b32-9d53-4664-a2e8-f72cc6fd1a61 tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 21 02:17:03.319549 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3950/7249] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:03 2022] DELETE /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.322719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.323342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] [instance: b84aed25-5d8b-475d-96c5-17a97d82d30a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:03.329914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.331072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.331519 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.332226 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:03.332687 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:03.333234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:03.346929 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] HTTP exception thrown: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Request method failure captured: Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a HTTP/1.1 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZPHf_hyEtmhMq_NyDjTiSfZtQqgdZGzWDisRp3XtNJRMfjqlBRXuI5KmD-Q8OBDaBMOgzZO-tu0YPVKxk_tL5gkddfrL4w4lTG9VRB-q4Km_EwDuiuHOJYcsKMyuHIsbKatNf00kipOwfi0_1DOtW8rti1gVE6pmgTvlY28e81-bFY Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_79bcc7627b8b42349425ac3245102d4d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/79bcc7627b8b42349425ac3245102d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/79bcc7627b8b42349425ac3245102d4d"}]}] Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 79bcc7627b8b42349425ac3245102d4d Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServerActionsTestJSON-963740593 Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: a97638d5939f4c10a9326e705db5843c Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServerActionsTestJSON-963740593-project Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: exception: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'b84aed25-5d8b-475d-96c5-17a97d82d30a'} Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:03.349252 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Returning 404 to user: Instance b84aed25-5d8b-475d-96c5-17a97d82d30a could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bc5f5119-00a9-4513-80c3-53b1d662b10f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a" status: 404 len: 111 microversion: 2.1 time: 0.031833 Aug 21 02:17:03.352956 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3300/7250] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:03 2022] GET /compute/v2.1/servers/b84aed25-5d8b-475d-96c5-17a97d82d30a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:03.359661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ad455f14-3142-423e-8676-ec418330f80f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] Calling method '.version_select at 0x7fc3f9b8fb80>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:03.386310 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ad455f14-3142-423e-8676-ec418330f80f tempest-ServerActionsTestJSON-963740593 tempest-ServerActionsTestJSON-963740593-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291094441" status: 202 len: 0 microversion: 2.1 time: 0.030440 Aug 21 02:17:03.386895 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3951/7251] 10.222.0.46 () {58 vars in 1221 bytes} [Sun Aug 21 02:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291094441 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:17:12.737058 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1273812848", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "c0d7172a-0509-4b88-989a-8fea29f7e5e6"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:12.799392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] validate_networks() for [('c0d7172a-0509-4b88-989a-8fea29f7e5e6', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:17:13.238385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:17:13.238812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:17:13.239317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:17:13.239730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:17:13.240146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:17:13.249970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:13.250451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:13.250888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:13.251610 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:13.252060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:13.252484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:13.275150 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Getting quotas for project c2ee3a950b274e36b952100c954522f2. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:17:13.281484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Getting quotas for user 9dd42bfac29d4e39a6af2779d6e00c9a and project c2ee3a950b274e36b952100c954522f2. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:17:13.295118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:17:13.297504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:17:13.347885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7620a7f4-55c3-46e6-a348-798ff6858fef tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745359 Aug 21 02:17:13.348917 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3301/7252] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:17:13.357565 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:13.361887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8477042a-aa8f-45bb-9d8d-7acb2e02554a tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:13.362499 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8477042a-aa8f-45bb-9d8d-7acb2e02554a tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:13.451964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8477042a-aa8f-45bb-9d8d-7acb2e02554a tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:13.460018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8477042a-aa8f-45bb-9d8d-7acb2e02554a tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1217 microversion: 2.1 time: 0.104040 Aug 21 02:17:13.460899 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3952/7253] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:13 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:14.482543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:14.483166 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:14.490506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:14.491185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:14.491775 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:14.492515 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:14.493004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:14.493438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:14.611342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:14.621789 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e470f6b6-0739-4682-9478-3033d01cfe20 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1277 microversion: 2.1 time: 0.144296 Aug 21 02:17:14.637051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3302/7254] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:14 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:15.643756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:15.644547 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:15.653148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:15.653983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:15.654659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:15.655607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:15.657372 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:15.658457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:15.811867 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:15.820556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b031702-6a82-4068-bee7-a5172ad9842d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.180761 Aug 21 02:17:15.821735 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3953/7255] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:15 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:15.934564 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96962fda-cb3e-4c67-ad52-e6c8fe7838e8", "tag": "5bbf5da8-cca5-4795-a6a9-72d4c5d687d0"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:15.953545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:15.954221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:15.954693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:15.970049 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] Creating event network-changed:5bbf5da8-cca5-4795-a6a9-72d4c5d687d0 for instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 on n-h2-master-1 Aug 21 02:17:15.975534 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-10f9e0c4-df0f-4ec3-93ba-3e21f2af3fc6 req-64fb6426-1f16-42d6-9049-335b8b72a9a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045676 Aug 21 02:17:15.976525 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3303/7256] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:16.846532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:16.847350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:16.856296 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:16.856788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:16.857242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:16.857940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:16.858397 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:16.858820 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:16.999318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:17.008173 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-deceffa5-315a-432d-91a1-9cf4cbab559b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.168211 Aug 21 02:17:17.008756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3954/7257] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:16 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:18.034976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:18.036153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:18.049381 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:18.050198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:18.050954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:18.052120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:18.052910 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:18.054365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:18.188158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:18.196816 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8dd676a5-7c2b-4415-ad25-764de9609603 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.169094 Aug 21 02:17:18.197472 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3304/7258] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:18 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:19.221008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:19.221947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:19.230459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:19.230948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:19.231385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:19.232083 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:19.232528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:19.233003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:19.367979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:19.376205 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-865560c5-8a82-4439-8580-447b577357d0 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.161397 Aug 21 02:17:19.376752 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3955/7259] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:19 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:20.403173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:20.404230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:20.415193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:20.415690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:20.416139 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:20.416920 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:20.417389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:20.417854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:20.568254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:20.577316 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bfb97f8e-91b0-4c64-9796-76537ac07f5b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.181585 Aug 21 02:17:20.577954 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3305/7260] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:20 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:21.598742 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:21.599358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:21.606493 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:21.606973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:21.607409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:21.608114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:21.608562 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:21.609022 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:21.753003 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:21.765414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-33bda6bc-8a3f-433c-807e-af9bbe27b7cb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.170271 Aug 21 02:17:21.766274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3956/7261] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:21 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:22.789767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:22.790844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:22.798287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:22.798782 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:22.799230 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:22.799941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:22.800406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:22.800877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:22.942411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:22.950717 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0f687ecd-5bd1-4014-937a-6f381ae81ba8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.166439 Aug 21 02:17:22.951328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3306/7262] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:22 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:23.616948 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96962fda-cb3e-4c67-ad52-e6c8fe7838e8", "name": "network-vif-plugged", "status": "completed", "tag": "5bbf5da8-cca5-4795-a6a9-72d4c5d687d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:23.623446 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:23.629581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:23.630061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:23.630496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:23.642217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] Creating event network-vif-plugged:5bbf5da8-cca5-4795-a6a9-72d4c5d687d0 for instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 on n-h2-master-1 Aug 21 02:17:23.650960 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-c2a9d028-c822-4c41-adac-3c5c1b434938 req-1f8a5877-9971-4088-9013-9c9087a1c890 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Aug 21 02:17:23.652066 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3957/7263] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:23.975537 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:23.976172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:23.979234 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:23.979952 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:23.988915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:23.989480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:23.990073 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:23.991059 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:23.991679 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:23.992402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:24.144360 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:24.162223 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e306485-0bb9-44b9-8ac0-bdfa1c6e46bf tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.192838 Aug 21 02:17:24.162979 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3307/7264] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:23 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:25.186428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:25.187131 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:25.191152 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:25.197200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:25.197686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:25.198148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:25.198848 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:25.199301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:25.199714 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:25.333932 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:25.342288 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fadfb33a-3dbd-48d3-a027-919d812c774b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1317 microversion: 2.1 time: 0.161317 Aug 21 02:17:25.342862 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3958/7265] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:25 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:26.367729 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:26.368855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:26.373338 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:26.383726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:26.384629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:26.385541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:26.386770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:26.387545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:26.388219 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:26.391523 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=56 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:26.533591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:26.542971 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f286989f-ca80-45bb-87e3-554290e8936b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.181961 Aug 21 02:17:26.543566 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3308/7266] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:26 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:26.604564 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1269116002", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "c0d7172a-0509-4b88-989a-8fea29f7e5e6"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:26.661563 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] validate_networks() for [('c0d7172a-0509-4b88-989a-8fea29f7e5e6', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:17:27.047774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:17:27.048200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:17:27.048677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:17:27.049137 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:17:27.049553 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:17:27.058753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:27.059236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:27.059724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:27.060571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:27.061053 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:27.061482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:27.079439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Getting quotas for project c2ee3a950b274e36b952100c954522f2. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:17:27.084921 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Getting quotas for user 9dd42bfac29d4e39a6af2779d6e00c9a and project c2ee3a950b274e36b952100c954522f2. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:17:27.098042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:17:27.100429 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:17:27.152684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-39da9325-9a84-4558-bd35-1ec32b166319 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552088 Aug 21 02:17:27.156695 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3959/7267] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:17:27.169651 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33d2d4c1-34fa-450c-9b62-64260b84622b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:27.170272 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33d2d4c1-34fa-450c-9b62-64260b84622b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:27.227652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33d2d4c1-34fa-450c-9b62-64260b84622b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:27.234622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33d2d4c1-34fa-450c-9b62-64260b84622b tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1217 microversion: 2.1 time: 0.070858 Aug 21 02:17:27.235174 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3309/7268] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:27 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:28.255595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:28.256438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:28.264357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:28.265027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:28.265531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:28.266293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:28.266945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:28.267442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:28.336579 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:28.348587 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fd668add-ae99-4e6c-949e-e436ce65676e tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1277 microversion: 2.1 time: 0.097782 Aug 21 02:17:28.349288 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3960/7269] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:28 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:29.371023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:29.371676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:29.380187 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:29.380759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:29.381339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:29.382279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:29.382737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:29.383169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:29.591503 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:29.600103 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29a2599f-71fe-4857-937a-e16432320b7c tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1317 microversion: 2.1 time: 0.233346 Aug 21 02:17:29.600650 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3310/7270] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:29 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:29.679652 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ce97d0-3d31-418e-8454-346edb1183d0", "tag": "9a341679-5b67-4290-b3f9-814b2e66e3c5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:29.701187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:29.701721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:29.702149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:29.714598 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] Creating event network-changed:9a341679-5b67-4290-b3f9-814b2e66e3c5 for instance 33ce97d0-3d31-418e-8454-346edb1183d0 on n-h1-master-1 Aug 21 02:17:29.720421 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9b0377e5-4abf-4dcc-a377-f359d947f3b8 req-53e01a2b-f36a-412f-98b3-e1000d4452b7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044786 Aug 21 02:17:29.721059 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3961/7271] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:30.622633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:30.623361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:30.630770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:30.631271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:30.631717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:30.632437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:30.632944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:30.633382 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:30.768485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:30.777451 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1052bfff-71a3-4e81-b7de-f1b53dcaf5ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1317 microversion: 2.1 time: 0.159042 Aug 21 02:17:30.778005 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3311/7272] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:30 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:31.801261 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:31.801964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:31.808949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:31.809447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:31.809929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:31.811059 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:31.811682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:31.812108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:31.959073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:31.967204 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a002aa17-aa98-4895-96ee-614f345ac6b8 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1317 microversion: 2.1 time: 0.171447 Aug 21 02:17:31.967808 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3962/7273] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:31 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:17:32.989032 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:32.989815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:32.997919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:32.998462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:32.998956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:32.999740 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:33.000251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:33.000735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:33.140725 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:33.149549 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e13f04a9-62d2-46ae-a2cb-1f3c846ef01d tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1317 microversion: 2.1 time: 0.165040 Aug 21 02:17:33.150130 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3312/7274] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:32 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:33.899299 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ce97d0-3d31-418e-8454-346edb1183d0", "name": "network-vif-plugged", "status": "completed", "tag": "9a341679-5b67-4290-b3f9-814b2e66e3c5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:33.908942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:33.909416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:33.909843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:33.921218 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] Creating event network-vif-plugged:9a341679-5b67-4290-b3f9-814b2e66e3c5 for instance 33ce97d0-3d31-418e-8454-346edb1183d0 on n-h1-master-1 Aug 21 02:17:33.926198 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bac4cd99-f292-4b3c-aa70-34fa0415f998 req-ac073418-8e32-4d42-b99f-dc370e7759ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113924 Aug 21 02:17:33.926812 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3963/7275] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:34.174193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:34.174863 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:34.185722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:34.186221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:34.186669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:34.187387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:34.187852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:34.188283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:34.343636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:34.355473 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a9ce2eff-ab57-47b4-bcc2-9930189cf731 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1317 microversion: 2.1 time: 0.187516 Aug 21 02:17:34.356313 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3313/7276] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:34 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:35.388585 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:35.389293 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:35.396300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.396968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.397757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.398444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.398889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.399304 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.544559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:35.552547 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-38d4f93f-b9b9-4080-b72c-4c710bcc4c24 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1506 microversion: 2.1 time: 0.172359 Aug 21 02:17:35.553193 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3964/7277] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:35 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:35.573603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:35.574208 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:35.581661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.582154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.582603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.583303 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.583770 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.584209 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.611887 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:17:35.694493 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acadb010-e07d-4c9a-8130-b31845ecd625 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 204 len: 0 microversion: 2.1 time: 0.124599 Aug 21 02:17:35.694937 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3314/7278] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:35 2022] DELETE /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 02:17:35.705407 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:35.706389 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:35.715548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.716494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.716988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.717690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:35.718137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:35.718589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:35.855747 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:35.867015 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-13796c23-5091-418b-bdbb-a17ba4eb34ad tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1512 microversion: 2.1 time: 0.167243 Aug 21 02:17:35.867841 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3965/7279] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:35 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:36.892228 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:36.892916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:36.900594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:36.901121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:36.901579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:36.902293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:36.902761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:36.903198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:37.130331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:37.139127 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76469639-46b2-474b-8284-a18b972ed3d1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 200 len: 1512 microversion: 2.1 time: 0.251946 Aug 21 02:17:37.152858 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3315/7280] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:36 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:37.497281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ce97d0-3d31-418e-8454-346edb1183d0", "name": "network-vif-deleted", "tag": "9a341679-5b67-4290-b3f9-814b2e66e3c5"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:37.504585 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:37.505364 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:37.509672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:37.510151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:37.510590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:37.537576 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] Creating event network-vif-deleted:9a341679-5b67-4290-b3f9-814b2e66e3c5 for instance 33ce97d0-3d31-418e-8454-346edb1183d0 on n-h1-master-1 Aug 21 02:17:37.543037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a264ffdb-be21-492e-a94b-58193f926b5e req-21b91b5e-828b-4b79-983e-79601c3a7691 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049904 Aug 21 02:17:37.544052 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3966/7281] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:38.162871 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:38.163486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:38.165697 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:38.173962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.174444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.174886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.175616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.176074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.176501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.191029 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 HTTP/1.1 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '33ce97d0-3d31-418e-8454-346edb1183d0'} Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:38.192698 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 404 to user: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2ae7421d-3b06-4134-b93b-a02bb68b68ab tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 404 len: 111 microversion: 2.1 time: 0.035546 Aug 21 02:17:38.196848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3316/7282] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:38 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:38.204829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:38.205558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:38.211977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.212469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.212937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.213641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.214095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.214521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.349094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:38.357130 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ef47a0cd-b854-4ad0-af4c-8f0d5ba16089 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.157035 Aug 21 02:17:38.357726 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3967/7283] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:38 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:38.380538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:38.384025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: c0827bed-8e1c-401c-a65b-c08039895f42] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:38.392216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/c0827bed-8e1c-401c-a65b-c08039895f42/action HTTP/1.1 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 32 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: {"resize": {"flavorRef": "452"}} Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'c0827bed-8e1c-401c-a65b-c08039895f42', 'body': {'resize': {'flavorRef': '452'}}} Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:38.393823 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 404 to user: Instance c0827bed-8e1c-401c-a65b-c08039895f42 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71066699-9969-4128-9fa5-2d9c2599b383 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "POST /compute/v2.1/servers/c0827bed-8e1c-401c-a65b-c08039895f42/action" status: 404 len: 111 microversion: 2.1 time: 0.021326 Aug 21 02:17:38.398109 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3317/7284] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:17:38 2022] POST /compute/v2.1/servers/c0827bed-8e1c-401c-a65b-c08039895f42/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:38.404320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:38.404994 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:38.411576 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.412058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.412494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.413308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.413760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.414181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.891555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:38.899966 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0b43610-acf0-4afe-8450-150eb01fffcb tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.499553 Aug 21 02:17:38.900545 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3968/7285] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:38 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:38.922957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:38.923582 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:38.931055 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.931548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.931992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:38.932698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:38.933191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:38.933627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.070652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:39.079699 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7cf91bcd-b15d-4d73-9f33-307364010de3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.162528 Aug 21 02:17:39.080288 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3318/7286] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:38 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:39.116954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d84de05c-5b93-4db3-a2bf-71c4cf5cd34b"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:39.120300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.129657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.130474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.131168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.132331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.133140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.133855 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.178915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:39.184866 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: request: POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action HTTP/1.1 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 65 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: {"resize": {"flavorRef": "d84de05c-5b93-4db3-a2bf-71c4cf5cd34b"}} Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: exception: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '96962fda-cb3e-4c67-ad52-e6c8fe7838e8', 'body': {'resize': {'flavorRef': 'd84de05c-5b93-4db3-a2bf-71c4cf5cd34b'}}} Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:39.186796 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 400 to user: Flavor d84de05c-5b93-4db3-a2bf-71c4cf5cd34b could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2cd4a30a-67b2-4415-955e-56193c8f74f2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action" status: 400 len: 107 microversion: 2.1 time: 0.077580 Aug 21 02:17:39.191317 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3969/7287] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:17:39 2022] POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action => generated 107 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 02:17:39.198395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.199029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.206481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.206981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.207427 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.208136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.208596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.209060 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.356695 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:39.368711 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a0897835-387b-45ac-b1fe-ef81f7da3a45 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.174000 Aug 21 02:17:39.369424 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3319/7288] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:39 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:39.395574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.396480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.406014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.406522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.406954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.407698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.408080 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.408496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.542340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:39.555569 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b5b6f19-f434-4abd-beff-5bb946180586 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.166237 Aug 21 02:17:39.556338 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3970/7289] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:39 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:39.578110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a0f8239-28b0-488b-8eeb-a1b4677a87c1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a0f8239-28b0-488b-8eeb-a1b4677a87c1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: request: POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action HTTP/1.1 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 29 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: {"resize": {"flavorRef": ""}} Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '96962fda-cb3e-4c67-ad52-e6c8fe7838e8', 'body': {'resize': {'flavorRef': ''}}} Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise error Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi '' Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.581899 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0a0f8239-28b0-488b-8eeb-a1b4677a87c1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0a0f8239-28b0-488b-8eeb-a1b4677a87c1 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action" status: 400 len: 113 microversion: 2.1 time: 0.009349 Aug 21 02:17:39.586292 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3320/7290] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:17:39 2022] POST /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 21 02:17:39.591776 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.592398 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.598886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.599365 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.599794 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.600483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.601031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.601450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.740286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:39.748606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b7a80fd-b9b4-4869-81a7-3ce8a1fa73ca tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1507 microversion: 2.1 time: 0.160646 Aug 21 02:17:39.749224 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3971/7291] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:39 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:39.772799 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.773315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.780673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.781324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.781763 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.782459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.782912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.783385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.797292 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 HTTP/1.1 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '33ce97d0-3d31-418e-8454-346edb1183d0'} Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:39.798957 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 404 to user: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7655fa19-d69a-4626-beb4-181f170d7df3 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "DELETE /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 404 len: 111 microversion: 2.1 time: 0.032008 Aug 21 02:17:39.802933 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3321/7292] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:39 2022] DELETE /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:39.816084 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.816699 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 33ce97d0-3d31-418e-8454-346edb1183d0] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.823447 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.823925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.824348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.825158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.825604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.826017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.840179 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 HTTP/1.1 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '33ce97d0-3d31-418e-8454-346edb1183d0'} Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:39.841763 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 404 to user: Instance 33ce97d0-3d31-418e-8454-346edb1183d0 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c2e99f4-c597-47b1-99a1-5da7ba5025b2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0" status: 404 len: 111 microversion: 2.1 time: 0.031114 Aug 21 02:17:39.846458 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3972/7293] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:39 2022] GET /compute/v2.1/servers/33ce97d0-3d31-418e-8454-346edb1183d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:17:39.852254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.852815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.859598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.860177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.860759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.861531 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.861988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.862416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.887660 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:17:39.973344 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-34a7d17b-ec64-41c3-a2b4-7daa1b9a9fe2 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "DELETE /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 204 len: 0 microversion: 2.1 time: 0.124539 Aug 21 02:17:39.973860 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3322/7294] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:17:39 2022] DELETE /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 02:17:39.983213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:39.983850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:39.990326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.990810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.991245 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:39.991981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:39.992429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:39.992872 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:40.142855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:40.148036 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=100 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:17:40.156581 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3cdeacd5-8425-47fd-a59a-4e9b5531e9e6 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1513 microversion: 2.1 time: 0.177258 Aug 21 02:17:40.156815 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3973/7295] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:39 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:41.178336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:41.179043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:41.186108 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:41.186592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:41.187120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:41.188229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:41.188475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:41.188924 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:41.338204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:41.346629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d8527a66-f08e-41a2-beaf-2df05b626352 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1513 microversion: 2.1 time: 0.172648 Aug 21 02:17:41.347176 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3323/7296] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:41 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:42.211872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96962fda-cb3e-4c67-ad52-e6c8fe7838e8", "name": "network-vif-deleted", "tag": "5bbf5da8-cca5-4795-a6a9-72d4c5d687d0"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:17:42.229629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:42.230213 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:42.230720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:42.242518 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] Creating event network-vif-deleted:5bbf5da8-cca5-4795-a6a9-72d4c5d687d0 for instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 on n-h2-master-1 Aug 21 02:17:42.248583 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-005550cd-b664-462c-b7a9-9929f123d957 req-69c4e811-a123-492c-8f5b-b43dc347e2fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040328 Aug 21 02:17:42.249560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3974/7297] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:17:42.368059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:42.368746 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:42.375922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:42.376420 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:42.376886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:42.377605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:42.378068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:42.378503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:42.410380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:42.410901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:42.411346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:42.411807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lazy-loading 'fault' on Instance uuid 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:17:42.459784 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd42bfac29d4e39a6af2779d6e00c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ee3a950b274e36b952100c954522f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:17:42.468251 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0245f07-bb00-43fd-a276-6c30d1361e42 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 200 len: 1307 microversion: 2.1 time: 0.104305 Aug 21 02:17:42.469098 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3324/7298] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:42 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:17:43.494515 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:17:43.495258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] [instance: 96962fda-cb3e-4c67-ad52-e6c8fe7838e8] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:17:43.504257 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:43.504893 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:43.505470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:43.506347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:17:43.506917 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:17:43.507454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:17:43.527487 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] HTTP exception thrown: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Request method failure captured: Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 HTTP/1.1 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZWo_HKZRsvCKrYznG3jP9bzfxjUJhBNuk2Hwf3klaGVoou45jUTBjA1rYc0jDvgJIHPTqOc691blw9EhymLWp5tTCYZtTmldeHx8TmnFw_SfVYwq2k10_KlfuBCiU7_jyYKUxucCnC8VsZoh0a6bsfMUyDmJAmIgQ1Ea0-mvsxXmOI Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c2ee3a950b274e36b952100c954522f2", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c2ee3a950b274e36b952100c954522f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c2ee3a950b274e36b952100c954522f2"}]}] Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: c2ee3a950b274e36b952100c954522f2 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2096808056 Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9dd42bfac29d4e39a6af2779d6e00c9a Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-ServersNegativeTestJSON-2096808056-project Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '96962fda-cb3e-4c67-ad52-e6c8fe7838e8'} Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:17:43.529182 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] Returning 404 to user: Instance 96962fda-cb3e-4c67-ad52-e6c8fe7838e8 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a3f1aef1-c125-4c54-8ac6-bb34ae9765f9 tempest-ServersNegativeTestJSON-2096808056 tempest-ServersNegativeTestJSON-2096808056-project] 10.222.0.46 "GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8" status: 404 len: 111 microversion: 2.1 time: 0.042741 Aug 21 02:17:43.533201 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3975/7299] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:17:43 2022] GET /compute/v2.1/servers/96962fda-cb3e-4c67-ad52-e6c8fe7838e8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:18:16.011848 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:16.012336 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:16.186760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: .version_select at 0x7fc3fceccca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1099367843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVWFLBqQnjkhgZ63qC41RTY62aliHQF/o08i9y+mkF9n4r4obL0phtwxnok3v3KZBmwHfb9pfrn7zbIf0ZWIjnCgJu6MHte4x0AWoXSKyLi897mGxcFtF76vRM19eMO0Q=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:16.204470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:18:16.209777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:18:16.224710 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:18:17.232561 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 50204. Aug 21 02:18:17.254286 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b67364f3-fbba-48ba-a047-f9f413cff98a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.249208 Aug 21 02:18:17.254955 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3325/7300] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:18:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:18:17.309887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-281189544", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1099367843", "networks": [{"uuid": "3955748a-5f1e-4659-aeb7-f98dacd175a2"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:17.323362 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:17.323362 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:17.370147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] validate_networks() for [('3955748a-5f1e-4659-aeb7-f98dacd175a2', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:18:17.765346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:18:17.765777 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:18:17.766249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:18:17.766823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:18:17.767267 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:18:17.777507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:17.777994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:17.778431 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:17.779154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:17.779606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:17.780025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:17.798897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:18:17.804312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:18:17.817591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:18:17.820022 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:18:17.869688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dfbb9657-57e2-4104-986d-2d4889335a30 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563978 Aug 21 02:18:17.870582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3976/7301] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:18:17.882092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbf56778-6bdb-44de-9e28-3a91fa3f64db tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:17.883111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbf56778-6bdb-44de-9e28-3a91fa3f64db tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:17.959494 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbf56778-6bdb-44de-9e28-3a91fa3f64db tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:17.966979 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbf56778-6bdb-44de-9e28-3a91fa3f64db tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1262 microversion: 2.1 time: 0.089187 Aug 21 02:18:17.967576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3326/7302] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:17 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:18.991287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:18.992639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:18.999719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:19.000630 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:19.001135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:19.001988 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:19.002450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:19.002875 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:19.102940 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:19.111824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b57f7792-16c6-46ec-9a61-b9ca68025315 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1322 microversion: 2.1 time: 0.127475 Aug 21 02:18:19.112628 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3977/7303] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:18 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:20.135014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:20.136451 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:20.144756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:20.145328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:20.145761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:20.146868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:20.147322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:20.147776 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:20.347898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:20.356459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-02d4fe93-0d2d-4f1d-9963-8e232e757068 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.225634 Aug 21 02:18:20.357468 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3327/7304] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:20 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:20.432865 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40b25f-5058-47a8-824a-6931a59c2ede", "tag": "f0ae3ee9-e314-44f3-8076-83c66a2f8f73"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:20.444180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:20.444723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:20.445863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:20.461314 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] Creating event network-changed:f0ae3ee9-e314-44f3-8076-83c66a2f8f73 for instance ea40b25f-5058-47a8-824a-6931a59c2ede on n-h2-master-1 Aug 21 02:18:20.466752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e2cdff8e-6b0e-4425-b42d-9435a16da398 req-43da36df-8169-42f2-b858-cf483d203c0e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037665 Aug 21 02:18:20.468041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3978/7305] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:18:21.378619 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:21.379245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:21.386723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:21.387224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:21.387674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:21.388368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:21.388880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:21.389317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:21.524869 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:21.532912 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-caecec53-4477-4535-bf7e-73144359c30f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.158338 Aug 21 02:18:21.533526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3328/7306] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:21 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:22.559847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:22.560828 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:22.569193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:22.569682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:22.570122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:22.570859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:22.571317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:22.571750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:22.712642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:22.720506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fdf8a424-d5ab-48c7-ab76-df8a7abe0b49 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.169142 Aug 21 02:18:22.721541 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3979/7307] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:22 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:23.744055 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:23.745882 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:23.755227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:23.755739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:23.756318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:23.757606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:23.758313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:23.758942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:23.906831 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:23.916185 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f61e75a5-099c-47b7-9129-1acc9f17ef1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.177390 Aug 21 02:18:23.916847 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3329/7308] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:23 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:24.940754 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:24.941447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:24.949360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:24.949859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:24.950295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:24.951003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:24.951458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:24.951886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:25.107855 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:25.118011 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cf940d3a-3b20-4ef5-acb2-2131f316f365 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.183201 Aug 21 02:18:25.118599 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3980/7309] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:24 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:26.140090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:26.140719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:26.152839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:26.153657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:26.154388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:26.155549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:26.156305 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:26.157193 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:26.313930 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:26.322441 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-47c01cde-efc6-493e-830f-0d5e66497d9d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.186463 Aug 21 02:18:26.323001 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3330/7310] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:26 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:27.348041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:27.349113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:27.360462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:27.361322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:27.362046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:27.363231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:27.364077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:27.364995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:27.504214 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:27.515433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-94f72e47-0ed6-4c9c-8709-6675d7d61feb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.173882 Aug 21 02:18:27.516079 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3981/7311] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:27 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:27.911928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40b25f-5058-47a8-824a-6931a59c2ede", "name": "network-vif-plugged", "status": "completed", "tag": "f0ae3ee9-e314-44f3-8076-83c66a2f8f73"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:27.922529 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:27.923004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:27.923629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:27.935743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] Creating event network-vif-plugged:f0ae3ee9-e314-44f3-8076-83c66a2f8f73 for instance ea40b25f-5058-47a8-824a-6931a59c2ede on n-h2-master-1 Aug 21 02:18:27.940955 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4ec9c7fd-54d3-45ed-8680-2f82384c3856 req-396e43be-f7c3-43d9-b1f1-272147c71d49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Aug 21 02:18:27.941551 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3331/7312] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:28.540109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:28.540716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:28.542835 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:28.543522 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:28.553204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:28.553699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:28.554244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:28.555354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:28.556152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:28.556660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:28.710274 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:28.718354 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0a2d89e-c64d-4497-b4ec-876c0d6dca22 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1362 microversion: 2.1 time: 0.183538 Aug 21 02:18:28.718922 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3982/7313] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:28 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:29.737825 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:29.743680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:29.744395 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:29.751476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:29.751963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:29.752410 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:29.753149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:29.753601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:29.754035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:29.894196 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:29.906610 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-392b5f77-f63b-44e4-aa54-79b333f08b02 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1554 microversion: 2.1 time: 0.170467 Aug 21 02:18:29.907444 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3332/7314] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:29 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:29.929258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:29.929818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:29.937045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:29.937523 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:29.937977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:29.938668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:29.939107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:29.939525 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:30.078615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:30.090320 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-471ac224-281f-4d03-a466-2ff9c3ee3fbf tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1554 microversion: 2.1 time: 0.165419 Aug 21 02:18:30.090899 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3983/7315] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:29 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:31.771976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ae201c5-240e-4e62-ae84-6c6825b2eab0"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:31.774509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:31.782199 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:31.782703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:31.783151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:31.783864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:31.784334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:31.784792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:32.089448 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66af58c6-d284-4bff-9fee-65b166e706f9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321441 Aug 21 02:18:32.090082 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3333/7316] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:18:31 2022] POST /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:43.941461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:43.942232 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:43.944940 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:43.945586 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:43.951716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:43.952195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:43.952628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:43.953350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:43.953800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:43.954221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:44.041746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'services' on Instance uuid ea40b25f-5058-47a8-824a-6931a59c2ede {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:18:44.123790 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-532c99cb-a972-418d-8012-1c891db2cbfb tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments/2ae201c5-240e-4e62-ae84-6c6825b2eab0" status: 202 len: 0 microversion: 2.1 time: 0.186422 Aug 21 02:18:44.124383 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3984/7317] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:18:43 2022] DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments/2ae201c5-240e-4e62-ae84-6c6825b2eab0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:18:44.138428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:44.142676 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:44.149766 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:44.150983 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:18:44.159602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:44.160203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:44.160817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:44.161685 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:44.162202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:44.162734 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:44.200437 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a6b67eb-dd4a-42a5-b432-f1eb26ed3857 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071136 Aug 21 02:18:44.201158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3334/7318] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:44 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:45.215821 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:45.218317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:45.225250 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:45.225732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:45.226155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:45.226843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:45.227289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:45.227709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:45.263489 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87f0e23e-e17c-4e04-8dd5-3afd28cf1fcc tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052208 Aug 21 02:18:45.264077 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3985/7319] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:45 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:46.280706 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:46.283012 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:46.291207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:46.291716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:46.292161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:46.292911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:46.293370 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:46.293784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:46.327996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-34ff9963-7c12-432b-ad0c-2d59bdd51475 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052275 Aug 21 02:18:46.328629 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3335/7320] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:46 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:47.340946 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:47.343243 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:47.350902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:47.351389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:47.351826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:47.352539 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:47.353011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:47.353430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:47.384496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-48b1a596-7aa3-4e07-9a4b-4c5239eae09f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Aug 21 02:18:47.385118 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3986/7321] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:47 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:48.398252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:48.400452 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:48.407869 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:48.408368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:48.408821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:48.409567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:48.410029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:48.410476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:48.443282 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2cc9d643-ecb3-4a28-b3f6-04a816d8ad51 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049712 Aug 21 02:18:48.443799 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3336/7322] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:48 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:49.458228 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:49.460931 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:49.470229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:49.470854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:49.471407 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:49.472312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:49.473031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:49.473967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:49.509094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77f1d903-eca2-4685-afc3-bce9ec94fef8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056865 Aug 21 02:18:49.509673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3987/7323] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:18:49 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 02:18:49.521614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:49.522158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:49.529697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:49.530188 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:49.530633 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:49.531387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:49.531851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:49.532283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:49.611767 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance ea40b25f-5058-47a8-824a-6931a59c2ede is not attached to volume 2ae201c5-240e-4e62-ae84-6c6825b2eab0 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments/2ae201c5-240e-4e62-ae84-6c6825b2eab0 HTTP/1.1 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ea40b25f-5058-47a8-824a-6931a59c2ede is not attached to volume 2ae201c5-240e-4e62-ae84-6c6825b2eab0 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'ea40b25f-5058-47a8-824a-6931a59c2ede', 'id': '2ae201c5-240e-4e62-ae84-6c6825b2eab0'} Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2ae201c5-240e-4e62-ae84-6c6825b2eab0. Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40b25f-5058-47a8-824a-6931a59c2ede is not attached to volume 2ae201c5-240e-4e62-ae84-6c6825b2eab0 Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:18:49.621679 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40b25f-5058-47a8-824a-6931a59c2ede is not attached to volume 2ae201c5-240e-4e62-ae84-6c6825b2eab0 Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance ea40b25f-5058-47a8-824a-6931a59c2ede is not attached to volume 2ae201c5-240e-4e62-ae84-6c6825b2eab0 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5047b0b-4ae5-41c1-8b7f-a0feb3d1577f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments/2ae201c5-240e-4e62-ae84-6c6825b2eab0" status: 404 len: 154 microversion: 2.1 time: 0.106102 Aug 21 02:18:49.626130 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3337/7324] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:18:49 2022] DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede/os-volume_attachments/2ae201c5-240e-4e62-ae84-6c6825b2eab0 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:18:53.176681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:53.177785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:53.184942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:53.185430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:53.185869 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:53.186565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:53.187147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:53.187579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:53.216947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:18:53.303396 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d21d333f-9f1d-41f2-9f18-4362f9f7ff08 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 204 len: 0 microversion: 2.1 time: 0.130822 Aug 21 02:18:53.304554 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3988/7325] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:18:53 2022] DELETE /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:18:53.312878 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:53.314105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:53.322394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:53.322885 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:53.323363 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:53.324069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:53.324524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:53.324991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:53.464616 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:53.473128 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-16f165bb-a60f-4337-af3d-b6f27e27ac41 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1560 microversion: 2.1 time: 0.164123 Aug 21 02:18:53.473909 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3338/7326] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:53 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:54.495943 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:54.496531 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:54.504325 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:54.504801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:54.505273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:54.505967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:54.506415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:54.506833 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:54.666212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:54.679136 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e323a3e1-8eac-4075-809f-476ce1064bb2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1560 microversion: 2.1 time: 0.187338 Aug 21 02:18:54.679946 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3989/7327] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:54 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:55.541140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40b25f-5058-47a8-824a-6931a59c2ede", "name": "network-vif-deleted", "tag": "f0ae3ee9-e314-44f3-8076-83c66a2f8f73"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:55.553318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:55.553807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:55.554242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:55.567044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] Creating event network-vif-deleted:f0ae3ee9-e314-44f3-8076-83c66a2f8f73 for instance ea40b25f-5058-47a8-824a-6931a59c2ede on n-h2-master-1 Aug 21 02:18:55.572400 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f076e00d-450a-4ba8-9c97-92b135c5c2a6 req-b70965df-0b93-4c53-bf34-2b08808b5196 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035102 Aug 21 02:18:55.573352 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3339/7328] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:55.705979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:55.706611 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:55.714801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:55.715295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:55.715727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:55.716417 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:55.716903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:55.717466 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:55.749645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:55.750026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:55.751186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:55.751186 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'fault' on Instance uuid ea40b25f-5058-47a8-824a-6931a59c2ede {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:18:55.810534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:55.818555 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-25b4c4d7-c78e-44cc-84ed-1be46797194e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 200 len: 1352 microversion: 2.1 time: 0.117417 Aug 21 02:18:55.819124 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3990/7329] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:55 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:56.844908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:56.845612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: ea40b25f-5058-47a8-824a-6931a59c2ede] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:56.853591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:56.854161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:56.854623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:56.855392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:56.855999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:56.856359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:56.871458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede HTTP/1.1 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: exception: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'ea40b25f-5058-47a8-824a-6931a59c2ede'} Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:56.873193 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance ea40b25f-5058-47a8-824a-6931a59c2ede could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-524018fa-3aaf-4716-a514-da19c232338a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede" status: 404 len: 111 microversion: 2.1 time: 0.038057 Aug 21 02:18:56.877614 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3340/7330] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:56 2022] GET /compute/v2.1/servers/ea40b25f-5058-47a8-824a-6931a59c2ede => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:18:56.884021 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1df74794-10cc-4978-9a57-9f68bb8ddd15 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '.version_select at 0x7fc3f8f7bca0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:56.907899 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1df74794-10cc-4978-9a57-9f68bb8ddd15 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1099367843" status: 202 len: 0 microversion: 2.1 time: 0.028031 Aug 21 02:18:56.908480 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3991/7331] 10.222.0.46 () {58 vars in 1278 bytes} [Sun Aug 21 02:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1099367843 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:18:56.929277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5c9b3bc0-81d8-4174-9de8-374e8ab0d4fa tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: .version_select at 0x7fc3fe3151f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-878772207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ9zEbTRolixlIiVn3vZbsab/lxgR/nqNNjyS5Xd1i7wE3R5FSJC2E/Bz+kdA1OD47PWK61wxYbHSA/HgRZasT9T911jZ8WBSIJlBt+uSW/Tlk71HYliG36/hJQ0yYPqQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:56.950284 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5c9b3bc0-81d8-4174-9de8-374e8ab0d4fa tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:18:56.959472 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-5c9b3bc0-81d8-4174-9de8-374e8ab0d4fa tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:18:56.986544 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5c9b3bc0-81d8-4174-9de8-374e8ab0d4fa tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.063773 Aug 21 02:18:56.987159 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3341/7332] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:18:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:18:57.040174 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-67545596", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-878772207", "networks": [{"uuid": "3955748a-5f1e-4659-aeb7-f98dacd175a2"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:18:57.098340 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] validate_networks() for [('3955748a-5f1e-4659-aeb7-f98dacd175a2', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:18:57.488368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:18:57.488796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:18:57.489473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:18:57.490108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:18:57.490733 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:18:57.500415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:57.500939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:57.501340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:57.502104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:57.502580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:57.503014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:57.521298 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:18:57.527457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:18:57.541721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:18:57.544135 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:18:57.607271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b1b4013e-2936-421a-9332-74fa1f9b41e2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571234 Aug 21 02:18:57.607964 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3992/7333] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:18:57.618843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-496eb8bf-0f9c-4000-9f0b-155b40624688 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:57.619473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-496eb8bf-0f9c-4000-9f0b-155b40624688 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:57.675320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-496eb8bf-0f9c-4000-9f0b-155b40624688 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:57.684220 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-496eb8bf-0f9c-4000-9f0b-155b40624688 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1260 microversion: 2.1 time: 0.069268 Aug 21 02:18:57.684808 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3342/7334] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:57 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1260 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:58.706363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:58.707020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:58.714251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:58.715066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:58.715502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:58.716211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:58.716654 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:58.717105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:58.785472 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:18:58.794264 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b5668f5b-fb10-4bd9-b5b2-e3e48662746c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1320 microversion: 2.1 time: 0.092712 Aug 21 02:18:58.794873 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3993/7335] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:58 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1320 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:18:59.816076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:18:59.816716 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:18:59.824437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:59.825116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:59.825659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:18:59.826476 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:18:59.827022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:18:59.827572 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:00.023680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:00.032098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aad392b2-bb1c-4de0-9237-8faa1118f789 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.220153 Aug 21 02:19:00.032664 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3343/7336] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:18:59 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:00.104120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d5c8b9-1980-4f7a-b8f7-4a278865180e", "tag": "1a289458-262b-4a45-9498-0b446fa695e4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:00.115077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:00.115636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:00.116177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:00.133006 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] Creating event network-changed:1a289458-262b-4a45-9498-0b446fa695e4 for instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e on n-h2-master-1 Aug 21 02:19:00.138631 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-674f87fd-8b9d-4e05-bc63-064c4f259324 req-ad331d6f-a2cc-4834-9f80-3c361d8acd56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038603 Aug 21 02:19:00.139460 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3994/7337] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:01.055071 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:01.055691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:01.063398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:01.063914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:01.064359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:01.065155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:01.065626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:01.066064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:01.205521 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:01.214087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc268a61-67a3-47a4-99ad-cccce5f9639e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.163366 Aug 21 02:19:01.214693 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3344/7338] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:01 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:02.240873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:02.243171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:02.253966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:02.254767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:02.255474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:02.256953 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:02.257430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:02.257861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:02.399559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:02.407462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-431701d5-caac-4b7a-b852-6b16cad3518b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.175185 Aug 21 02:19:02.408008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3995/7339] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:02 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:03.431513 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:03.432225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:03.439628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:03.440123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:03.440571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:03.441327 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:03.441789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:03.442240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:03.580993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:03.592938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fd47c15-a0be-4867-aa04-2163d1337304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.166768 Aug 21 02:19:03.593768 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3345/7340] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:03 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:04.619838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:04.620441 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:04.628039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:04.628524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:04.629014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:04.629707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:04.630162 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:04.630591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:04.776111 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:04.784555 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-68792de0-8501-4560-80d0-adbcd5a97026 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.171098 Aug 21 02:19:04.785158 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3996/7341] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:04 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:05.808504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:05.809487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:05.819013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:05.819667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:05.820269 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:05.821425 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:05.821893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:05.822334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:05.966485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:05.974622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db65081d-f522-462c-b88e-0e5471e02547 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.171537 Aug 21 02:19:05.975193 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3346/7342] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:05 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:06.996878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:06.997473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:07.004644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:07.005159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:07.005590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:07.006281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:07.006730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:07.007147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:07.159879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:07.168118 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7cacb60d-2ab5-4946-8eab-57cab956a934 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.175729 Aug 21 02:19:07.168701 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3997/7343] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:06 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:08.002041 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d5c8b9-1980-4f7a-b8f7-4a278865180e", "name": "network-vif-plugged", "status": "completed", "tag": "1a289458-262b-4a45-9498-0b446fa695e4"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:08.008292 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:08.016097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:08.016583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:08.017070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:08.029085 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] Creating event network-vif-plugged:1a289458-262b-4a45-9498-0b446fa695e4 for instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e on n-h2-master-1 Aug 21 02:19:08.034329 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c95f8787-8099-447a-8c1d-fd219b272c15 req-8c61d04a-73fd-4d55-853c-f5d1d8a27602 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036298 Aug 21 02:19:08.034941 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3347/7344] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:08.190321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:08.191110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:08.193149 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:08.194268 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:08.202096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:08.202657 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:08.203088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:08.203945 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:08.204457 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:08.204963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:08.337486 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:08.348007 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5c4bffe6-afd3-4653-a533-88e3decdf88e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.161238 Aug 21 02:19:08.348785 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3998/7345] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:08 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:09.381870 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:09.383060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:09.394325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:09.395033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:09.396138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:09.397359 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:09.398131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:09.399040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:09.548049 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:09.556636 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-863f2e9d-68d1-41fe-af9e-052cbb55497c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1360 microversion: 2.1 time: 0.183438 Aug 21 02:19:09.557262 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3348/7346] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:09 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:10.580746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:10.581664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:10.591085 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:10.591574 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:10.592015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:10.592719 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:10.593220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:10.593650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:10.748225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:10.761240 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-da72f8af-824c-4106-9add-1b251ff19e8e tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1552 microversion: 2.1 time: 0.186083 Aug 21 02:19:10.761929 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 3999/7347] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:10 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:10.784139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:10.784782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:10.791954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:10.792450 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:10.792930 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:10.793640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:10.794133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:10.794588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:10.932125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:10.940298 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-26d12372-dd7a-419b-910e-8d2a6ab03571 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1552 microversion: 2.1 time: 0.160198 Aug 21 02:19:10.940953 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3349/7348] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:10 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:12.486841 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066e6713-2807-4bc3-8490-50edecfb0bc1"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:12.489308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:12.498880 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:12.499567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:12.500151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:12.501266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:12.501987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:12.502598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:12.508466 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:12.804903 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-254f65b6-8501-42da-8d2e-54b54ce84861 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321896 Aug 21 02:19:12.805586 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4000/7349] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:19:12 2022] POST /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:23.551001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:23.551498 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:23.554604 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:23.555420 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=72 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:23.563170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:23.563716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:23.564240 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:23.564994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:23.565462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:23.565904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:23.649538 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'services' on Instance uuid d2d5c8b9-1980-4f7a-b8f7-4a278865180e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:19:23.734435 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1d588ddf-e24d-4839-a9ef-5aa5f220a6e8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments/066e6713-2807-4bc3-8490-50edecfb0bc1" status: 202 len: 0 microversion: 2.1 time: 0.187606 Aug 21 02:19:23.735080 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3350/7350] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:19:23 2022] DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments/066e6713-2807-4bc3-8490-50edecfb0bc1 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:19:23.741647 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:23.742423 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:23.748505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:23.751371 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:23.762784 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:23.763294 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:23.763734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:23.764452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:23.764942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:23.765377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:23.801256 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bacc2ee6-090a-4f58-ab6c-8a932a8ff48c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061364 Aug 21 02:19:23.801855 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4001/7351] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:23 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:24.818684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:24.823026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:24.834860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:24.835674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:24.836409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:24.837628 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:24.838385 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:24.839256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:24.871096 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-59b45b94-a09b-433a-8e0c-3245e62b7438 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059639 Aug 21 02:19:24.871700 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3351/7352] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:24 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:25.883502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:25.886007 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:25.893756 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:25.894242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:25.894679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:25.895734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:25.896183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:25.896593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:25.929180 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3212dafa-319f-41a8-88be-4671b8de0e92 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049563 Aug 21 02:19:25.929756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4002/7353] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:25 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:26.942311 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:26.944640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:26.952680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:26.953205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:26.953658 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:26.954398 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:26.954880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:26.955291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:26.987307 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8da8d3b-a4c2-49c4-a662-c1ac3ba8de25 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049279 Aug 21 02:19:26.987885 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3352/7354] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:26 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:28.000395 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:28.002646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:28.010011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:28.010521 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:28.010974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:28.011673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:28.012140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:28.012533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:28.044057 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d6e36c77-01ca-4a40-b041-a578e0724d21 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047925 Aug 21 02:19:28.044861 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4003/7355] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:27 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:29.061445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:29.065065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:29.075438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:29.075886 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:29.076313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:29.077053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:29.077516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:29.077946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:29.108310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c888123a-f88c-490a-9737-445f49221d35 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053881 Aug 21 02:19:29.108919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3353/7356] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:19:29 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 02:19:29.123878 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:29.125212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:29.136530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:29.137052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:29.137487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:29.138207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:29.138659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:29.139082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:29.227588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e is not attached to volume 066e6713-2807-4bc3-8490-50edecfb0bc1 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments/066e6713-2807-4bc3-8490-50edecfb0bc1 HTTP/1.1 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e is not attached to volume 066e6713-2807-4bc3-8490-50edecfb0bc1 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': 'd2d5c8b9-1980-4f7a-b8f7-4a278865180e', 'id': '066e6713-2807-4bc3-8490-50edecfb0bc1'} Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 066e6713-2807-4bc3-8490-50edecfb0bc1. Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e is not attached to volume 066e6713-2807-4bc3-8490-50edecfb0bc1 Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:19:29.229568 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e is not attached to volume 066e6713-2807-4bc3-8490-50edecfb0bc1 Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e is not attached to volume 066e6713-2807-4bc3-8490-50edecfb0bc1 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-252c767a-bd38-4c22-9fc5-40a291198b4a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments/066e6713-2807-4bc3-8490-50edecfb0bc1" status: 404 len: 154 microversion: 2.1 time: 0.115043 Aug 21 02:19:29.236321 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4004/7357] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:19:29 2022] DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e/os-volume_attachments/066e6713-2807-4bc3-8490-50edecfb0bc1 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:19:32.588810 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:32.590013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:32.596901 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:32.597402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:32.597859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:32.598575 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:32.599040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:32.599477 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:32.627608 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:19:32.720618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8c18ae4b-7c75-4f8b-ba94-189710c619a1 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 204 len: 0 microversion: 2.1 time: 0.137811 Aug 21 02:19:32.721484 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3354/7358] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:19:32 2022] DELETE /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:19:32.730148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:32.730805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:32.737859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:32.738351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:32.738788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:32.739495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:32.739952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:32.740378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:32.879282 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:32.888001 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a276aab-389b-4c98-a7cb-d1516837eaa2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1558 microversion: 2.1 time: 0.162053 Aug 21 02:19:32.888863 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4005/7359] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:32 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:33.915495 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:33.916607 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:33.928849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:33.929703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:33.930479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:33.931657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:33.932446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:33.933229 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:34.088795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:34.097119 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ddcba66c-bd6d-4606-95a2-4276a502f74d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1558 microversion: 2.1 time: 0.189013 Aug 21 02:19:34.097695 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3355/7360] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:33 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:34.930836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d5c8b9-1980-4f7a-b8f7-4a278865180e", "name": "network-vif-deleted", "tag": "1a289458-262b-4a45-9498-0b446fa695e4"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:34.942264 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:34.942736 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:34.943337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:34.955681 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] Creating event network-vif-deleted:1a289458-262b-4a45-9498-0b446fa695e4 for instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e on n-h2-master-1 Aug 21 02:19:34.960809 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5f20d945-d902-438e-ba1c-925b1b8cfca1 req-f14de9a6-624a-4d8f-82e0-0db0b5151a4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033697 Aug 21 02:19:34.961397 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4006/7361] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:35.119555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:35.120091 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:35.130014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:35.130014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:35.130014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:35.130014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:35.130014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:35.130503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:35.162979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:35.163471 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:35.163942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:35.164378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'fault' on Instance uuid d2d5c8b9-1980-4f7a-b8f7-4a278865180e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:19:35.206767 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:35.219214 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-228043d5-dade-4a9e-856a-15abd415202a tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 200 len: 1350 microversion: 2.1 time: 0.103527 Aug 21 02:19:35.219973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3356/7362] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:35 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:19:36.249470 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:36.250168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: d2d5c8b9-1980-4f7a-b8f7-4a278865180e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:36.256894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:36.257386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:36.257823 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:36.258527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:36.258989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:36.259418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:36.273844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e HTTP/1.1 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: exception: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'd2d5c8b9-1980-4f7a-b8f7-4a278865180e'} Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:36.275487 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance d2d5c8b9-1980-4f7a-b8f7-4a278865180e could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d34c700-908f-4320-8323-32aa24b61b99 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e" status: 404 len: 111 microversion: 2.1 time: 0.035344 Aug 21 02:19:36.280190 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4007/7363] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:36 2022] GET /compute/v2.1/servers/d2d5c8b9-1980-4f7a-b8f7-4a278865180e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:19:36.287243 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d549756e-52d7-4809-8558-95f9036339d8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '.version_select at 0x7fc3fceccdc0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:36.310616 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d549756e-52d7-4809-8558-95f9036339d8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-878772207" status: 202 len: 0 microversion: 2.1 time: 0.027504 Aug 21 02:19:36.311651 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3357/7364] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-878772207 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:19:36.335197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0a202cf5-5c42-4a91-9cbc-3952fa5b34e5 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: .version_select at 0x7fc3f88cd670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-172652955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPMzPUIIaIkTly/VjZ+qPZM2fDRnt8ZzBdswzXNZ1yCJPZRvaQJl8/fpJRsrU3CADWL2B6rwjOJq3ezdlRPLbkKcT/VncUmQ6ruyoaF0Ay4OtoBbaaJ46WAbUOfwlPsqQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:36.358092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0a202cf5-5c42-4a91-9cbc-3952fa5b34e5 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:19:36.363628 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-0a202cf5-5c42-4a91-9cbc-3952fa5b34e5 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:19:36.392449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0a202cf5-5c42-4a91-9cbc-3952fa5b34e5 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.063498 Aug 21 02:19:36.393001 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4008/7365] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:19:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:36.447340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1413834785", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-172652955", "networks": [{"uuid": "3955748a-5f1e-4659-aeb7-f98dacd175a2"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:36.500259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] validate_networks() for [('3955748a-5f1e-4659-aeb7-f98dacd175a2', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:19:37.011659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:19:37.012489 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:19:37.013421 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:19:37.014062 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:19:37.014888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:19:37.029827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:37.030328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:37.030801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:37.031520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:37.031987 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:37.032432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:37.050487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:19:37.055966 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Getting quotas for user 25a1b2f053d9484990f839272109fdca and project a41e2267dc9c45c6b6c24f3c9102662e. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:19:37.069940 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:19:37.072324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:19:37.128628 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0bb424d-4291-4b43-bd1e-1dd0df35cf0c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685220 Aug 21 02:19:37.129324 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3358/7366] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:19:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:19:37.140306 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a4923ecc-8a3a-4013-915f-21886e006c2b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:37.140962 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a4923ecc-8a3a-4013-915f-21886e006c2b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:37.195639 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a4923ecc-8a3a-4013-915f-21886e006c2b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:37.204579 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a4923ecc-8a3a-4013-915f-21886e006c2b tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1262 microversion: 2.1 time: 0.068332 Aug 21 02:19:37.205203 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4009/7367] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:37 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:38.227077 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:38.229154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:38.235308 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:38.235802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:38.236247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:38.236995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:38.237481 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:38.237912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:38.339001 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:38.347646 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2cbe28cd-8824-4070-8c00-47063dd50b01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1322 microversion: 2.1 time: 0.125546 Aug 21 02:19:38.348187 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3359/7368] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:38 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1322 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:39.371346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:39.372679 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:39.381167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:39.381625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:39.382301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:39.383026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:39.383481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:39.383977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:39.523706 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:39.531795 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-06572063-3001-4a9a-9e22-0160a2b0c561 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.166937 Aug 21 02:19:39.532593 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4010/7369] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:39 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:39.768073 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c90422-636b-49b3-bbc9-407ba9b22e0f", "tag": "bf640149-3f79-46be-a8fe-266d467a35b2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:39.783739 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:39.784321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:39.784787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:39.798719 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] Creating event network-changed:bf640149-3f79-46be-a8fe-266d467a35b2 for instance b5c90422-636b-49b3-bbc9-407ba9b22e0f on n-h2-master-1 Aug 21 02:19:39.804421 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-01427357-7a4a-46cb-b23c-0a48a42c9a12 req-82ab0eee-e131-4142-95fe-0f22de4ef929 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041383 Aug 21 02:19:39.805455 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3360/7370] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:40.557204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:40.557790 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:40.566158 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:40.566636 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:40.567062 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:40.567751 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:40.568195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:40.568614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:40.711810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:40.721901 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-354387cc-f02b-4302-9265-faee2df8d133 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.171035 Aug 21 02:19:40.722491 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4011/7371] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:40 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:41.746060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:41.746911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:41.755550 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:41.756163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:41.756677 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:41.757557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:41.758112 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:41.758651 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:41.905977 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:41.917426 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af3224f5-dada-4701-8b52-953399aad304 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.177623 Aug 21 02:19:41.918180 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3361/7372] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:41 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:42.941967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:42.942889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:42.951102 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:42.951616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:42.952133 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:42.952897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:42.953346 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:42.953764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:43.089873 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:43.098572 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c4b50420-2c2a-4da7-a9b7-6a7021627f94 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.162474 Aug 21 02:19:43.099181 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4012/7373] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:42 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:44.120026 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:44.120760 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:44.128395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:44.129013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:44.129542 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:44.130304 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:44.130807 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:44.131444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:44.267252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:44.275670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-852061bc-37e0-4290-a564-d891f5305592 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.159886 Aug 21 02:19:44.276278 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3362/7374] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:44 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:45.298303 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:45.299077 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:45.307628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:45.308153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:45.308632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:45.309437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:45.310572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:45.311065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:45.455495 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:45.463606 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a9c01e13-3d09-420c-8a1c-1fa00cd93ce9 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.170241 Aug 21 02:19:45.464185 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4013/7375] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:45 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:46.176187 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c90422-636b-49b3-bbc9-407ba9b22e0f", "name": "network-vif-plugged", "status": "completed", "tag": "bf640149-3f79-46be-a8fe-266d467a35b2"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:46.187844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:46.188380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:46.190038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:46.204915 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] Creating event network-vif-plugged:bf640149-3f79-46be-a8fe-266d467a35b2 for instance b5c90422-636b-49b3-bbc9-407ba9b22e0f on n-h2-master-1 Aug 21 02:19:46.209942 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-142ee692-0174-4746-8d16-d59f033bbc8f req-5f8fdc31-d194-4205-b129-1f588b5800a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037621 Aug 21 02:19:46.210521 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3363/7376] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:19:46.486582 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:46.487207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:46.494589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:46.495004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:46.495444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:46.496143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:46.496595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:46.497063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:46.644155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:46.652304 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e629e275-5d9f-492d-a6bc-5a90a7493855 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.170127 Aug 21 02:19:46.652866 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4014/7377] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:46 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:47.671225 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:47.672038 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:47.677225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:47.677941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:47.685409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:47.685837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:47.686287 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:47.686997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:47.687459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:47.687894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:47.825912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:47.836673 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e4a15dd9-3a97-41f8-968d-9ac2f9512c01 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1362 microversion: 2.1 time: 0.166198 Aug 21 02:19:47.837504 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3364/7378] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:47 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:48.861396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:48.862217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:48.864733 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:19:48.874797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:48.875536 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:48.876176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:48.877418 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:48.878322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:48.878993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:49.027546 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:49.040307 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-26c6162b-1de1-4583-a078-be1d62f8c273 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1555 microversion: 2.1 time: 0.184230 Aug 21 02:19:49.041125 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4015/7379] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:48 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:49.062066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:19:49.062674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:49.070007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:49.070502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:49.070955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:49.071666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:49.072131 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:49.072576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:49.211730 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:19:49.220226 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f3caf383-0a2b-4939-86e2-daa1628b3b9f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1555 microversion: 2.1 time: 0.162492 Aug 21 02:19:49.220792 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3365/7380] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:19:49 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:19:50.787917 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0869d8ed-9e80-4ce2-abb8-0cc83fc4c215"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:19:50.790346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:19:50.800371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:50.801090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:50.801705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:50.802530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:19:50.803118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:19:50.803718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:19:51.077746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b92bbc0-8cbb-423a-bf3c-4326e1752910 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "POST /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294327 Aug 21 02:19:51.078357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4016/7381] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:19:50 2022] POST /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:01.831083 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:01.831667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:01.837908 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:01.838561 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:01.840178 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:01.841133 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:01.841797 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:01.842928 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:01.843583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:01.844203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:01.936164 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'services' on Instance uuid b5c90422-636b-49b3-bbc9-407ba9b22e0f {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:20:02.026824 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-234b64c9-b3d1-47b1-8946-006f9141da46 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments/0869d8ed-9e80-4ce2-abb8-0cc83fc4c215" status: 202 len: 0 microversion: 2.1 time: 0.199519 Aug 21 02:20:02.027457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3366/7382] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:20:01 2022] DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments/0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:20:02.034460 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:02.036327 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:02.041392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:02.044063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:02.051462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:02.052333 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:02.052974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:02.053685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:02.054332 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:02.054738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:02.089281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e110a55e-44f6-4584-92f7-294cfd00741c tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056870 Aug 21 02:20:02.090556 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4017/7383] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:02 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:03.104219 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:03.107237 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:03.115328 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:03.115844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:03.116297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:03.117057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:03.117528 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:03.117976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:03.151899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee64a8bb-f117-4464-a201-f2e4388e87a4 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053078 Aug 21 02:20:03.152470 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3367/7384] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:03 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:04.163833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:04.166043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:04.173685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:04.174160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:04.174589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:04.175285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:04.175728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:04.176141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:04.209915 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16a49f1a-00e0-4c23-82bc-7ea205e71150 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050031 Aug 21 02:20:04.210485 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4018/7385] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:04 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:05.221802 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:05.224022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:05.231854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:05.232509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:05.232996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:05.233721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:05.234180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:05.234613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:05.266579 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1bce156b-443d-4842-9720-b5c39aff6d77 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048935 Aug 21 02:20:05.267153 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3368/7386] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:05 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:06.279015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:06.281259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:06.288688 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:06.289201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:06.289634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:06.290340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:06.290787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:06.291205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:06.322854 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-56d010aa-5ec2-4be6-99ce-c9cdc00b39f2 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047878 Aug 21 02:20:06.323433 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4019/7387] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:06 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:07.337526 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:07.340671 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:07.349491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:07.350038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:07.350566 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:07.351451 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:07.351952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:07.352424 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:07.389670 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ba012796-af95-460f-82cd-c0bb659e9d1f tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057439 Aug 21 02:20:07.390346 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3369/7388] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:20:07 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 02:20:07.402213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:07.402731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:07.410868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:07.411369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:07.411809 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:07.412509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:07.413005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:07.413437 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:07.495889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f is not attached to volume 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments/0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 HTTP/1.1 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f is not attached to volume 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': 'b5c90422-636b-49b3-bbc9-407ba9b22e0f', 'id': '0869d8ed-9e80-4ce2-abb8-0cc83fc4c215'} Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215. Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f is not attached to volume 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:20:07.497926 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f is not attached to volume 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f is not attached to volume 0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8f026c50-1d7e-4916-83c0-e987e1c882a8 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments/0869d8ed-9e80-4ce2-abb8-0cc83fc4c215" status: 404 len: 154 microversion: 2.1 time: 0.101495 Aug 21 02:20:07.501922 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4020/7389] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:20:07 2022] DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f/os-volume_attachments/0869d8ed-9e80-4ce2-abb8-0cc83fc4c215 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:20:10.862735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:10.863312 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:10.870356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:10.870841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:10.871280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:10.871980 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:10.872435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:10.872902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:10.900896 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:20:10.983494 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bfcfe99a-d8e4-43a1-8f36-e467256886c7 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 204 len: 0 microversion: 2.1 time: 0.124846 Aug 21 02:20:10.984496 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3370/7390] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:20:10 2022] DELETE /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:20:10.993502 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:10.994099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:11.001720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:11.002211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:11.002650 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:11.003472 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:11.003950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:11.004361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:11.142239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:11.150824 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-61e264e2-39ce-4698-8fd7-344fe5208371 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1561 microversion: 2.1 time: 0.162069 Aug 21 02:20:11.151441 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4021/7391] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:10 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:12.175147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:12.175864 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:12.183392 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:12.184018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:12.184472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:12.185228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:12.185686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:12.186120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:12.334732 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:12.343034 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fe22b47-9427-4fd3-bda5-938af5be5393 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1561 microversion: 2.1 time: 0.173461 Aug 21 02:20:12.343587 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3371/7392] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:12 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:13.183031 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c90422-636b-49b3-bbc9-407ba9b22e0f", "name": "network-vif-deleted", "tag": "bf640149-3f79-46be-a8fe-266d467a35b2"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:20:13.194324 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:13.194807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:13.195238 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:13.215170 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] Creating event network-vif-deleted:bf640149-3f79-46be-a8fe-266d467a35b2 for instance b5c90422-636b-49b3-bbc9-407ba9b22e0f on n-h2-master-1 Aug 21 02:20:13.221053 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bc819017-4198-4e9e-9670-831fad6ffc8d req-4d5fa84b-6c79-40f1-a508-5a71265d890a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041918 Aug 21 02:20:13.221684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4022/7393] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:13.366059 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:13.366722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:13.377446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:13.378252 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:13.378744 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:13.379822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:13.380510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:13.381080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:13.416626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:13.417053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:13.417494 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:13.417955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lazy-loading 'fault' on Instance uuid b5c90422-636b-49b3-bbc9-407ba9b22e0f {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:20:13.471470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a1b2f053d9484990f839272109fdca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41e2267dc9c45c6b6c24f3c9102662e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:13.483273 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fa80bce-ec93-4d97-a8d2-53ab3b124f1d tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 200 len: 1352 microversion: 2.1 time: 0.122997 Aug 21 02:20:13.484067 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3372/7394] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:13 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:14.507295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:14.508017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] [instance: b5c90422-636b-49b3-bbc9-407ba9b22e0f] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:14.514845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:14.515334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:14.515770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:14.516507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:14.517019 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:14.517518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:14.531891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] HTTP exception thrown: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Request method failure captured: Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f HTTP/1.1 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZXiTwYMbDuMZWq5skqJBEO0GV8tqp0xkQEjYmA0-m_odRF_HZF3OQfl9XqjbZMWJy6bXZ7nJ_HNQbUUNYtBPDiX9Z3daH5g9YEvOg3PWnN-ob0i9CaDUmodmMstPqP5tA44WDpZNoge3Nbd0sF_xD5-9pyxqtHoTbqomK-VcOsyrUI Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a41e2267dc9c45c6b6c24f3c9102662e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a41e2267dc9c45c6b6c24f3c9102662e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a41e2267dc9c45c6b6c24f3c9102662e"}]}] Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: a41e2267dc9c45c6b6c24f3c9102662e Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1504491260 Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 25a1b2f053d9484990f839272109fdca Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestEncryptedCinderVolumes-1504491260-project Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b5c90422-636b-49b3-bbc9-407ba9b22e0f'} Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:14.533823 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Returning 404 to user: Instance b5c90422-636b-49b3-bbc9-407ba9b22e0f could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fce04116-dd91-48fd-8e30-52b9c7924286 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f" status: 404 len: 111 microversion: 2.1 time: 0.033571 Aug 21 02:20:14.537845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4023/7395] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:14 2022] GET /compute/v2.1/servers/b5c90422-636b-49b3-bbc9-407ba9b22e0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:20:14.544460 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-da63eb4b-353f-46d8-90ff-55577a0ac087 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] Calling method '.version_select at 0x7fc3fdadb4c0>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:14.568171 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-da63eb4b-353f-46d8-90ff-55577a0ac087 tempest-TestEncryptedCinderVolumes-1504491260 tempest-TestEncryptedCinderVolumes-1504491260-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-172652955" status: 202 len: 0 microversion: 2.1 time: 0.027641 Aug 21 02:20:14.568752 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3373/7396] 10.222.0.46 () {58 vars in 1275 bytes} [Sun Aug 21 02:20:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-172652955 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:20:41.726276 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c533ce2-c794-48a4-9d53-c470db99f6b7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: .version_select at 0x7fc3fa253e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2114232987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9UNR52FEThXuiK/McM0ENqaLb49EdOI5Nu9XTL6d0LCeAqOemymCs9aGZVKU0bYNYSjsr2yn7+GthYq5qjlHjOlXGvwVWU6XLQd6Gr3tUMJ9U7IwGb9e7XLsK+A/CUXA=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:20:41.732093 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:41.732822 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=34 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:41.745413 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7c533ce2-c794-48a4-9d53-c470db99f6b7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:20:41.751576 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-7c533ce2-c794-48a4-9d53-c470db99f6b7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for user 9a95ca48487c4d469371ce0755e04aed and project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:20:41.778808 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c533ce2-c794-48a4-9d53-c470db99f6b7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056721 Aug 21 02:20:41.779418 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4024/7397] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:20:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:41.832218 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:41.833031 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:41.837249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-509787461", "imageRef": "a4f8e831-a2cc-42d1-99c7-943dbd8c1b91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2114232987", "networks": [{"uuid": "1b6e5bab-b326-4d29-b022-315df9b5fc57"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:20:42.020324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] validate_networks() for [('1b6e5bab-b326-4d29-b022-315df9b5fc57', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:20:42.426806 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:20:42.427380 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:20:42.428037 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:20:42.428633 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:20:42.429291 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:20:42.442043 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:42.442544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:42.442991 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:42.443732 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:42.444195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:42.444738 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:42.467140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:20:42.473662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for user 9a95ca48487c4d469371ce0755e04aed and project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:20:42.486745 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:20:42.489076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4f8e831-a2cc-42d1-99c7-943dbd8c1b91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:20:42.538549 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-257691cd-2567-45e3-9e32-198804573446 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708506 Aug 21 02:20:42.539204 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3374/7398] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:20:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:20:42.550795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a7cd3a3-8aaf-44b8-a38c-9976995712e9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:42.551419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a7cd3a3-8aaf-44b8-a38c-9976995712e9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:42.718106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a7cd3a3-8aaf-44b8-a38c-9976995712e9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:42.726193 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a7cd3a3-8aaf-44b8-a38c-9976995712e9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1258 microversion: 2.1 time: 0.180123 Aug 21 02:20:42.726789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4025/7399] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:42 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:43.747749 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:43.748336 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:43.756465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:43.757083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:43.757532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:43.758367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:43.758759 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:43.759264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:43.826758 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:43.835206 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d4900389-1948-42b8-8d63-0c7ff95bacb6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1316 microversion: 2.1 time: 0.091720 Aug 21 02:20:43.835788 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3375/7400] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:43 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:44.859176 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:44.859952 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:44.868235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:44.868840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:44.869371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:44.870187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:44.870647 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:44.871237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:45.009195 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:45.019935 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aab348bf-fa55-40ef-9003-a55c01956c23 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.164658 Aug 21 02:20:45.021008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4026/7401] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:44 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:46.043080 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:46.043868 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:46.051504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:46.052030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:46.052640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:46.053560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:46.054019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:46.054446 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:46.196628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:46.205077 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-52fc0791-2c83-4f24-824f-136625b5986f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.167476 Aug 21 02:20:46.206314 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3376/7402] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:46 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:47.227217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:47.228732 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:47.238765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:47.239340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:47.240029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:47.240739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:47.241204 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:47.241625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:47.417455 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:47.426009 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7a6bd14f-80d9-4365-b825-1d44e4aad309 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.203927 Aug 21 02:20:47.430637 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4027/7403] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:47 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:48.446699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:48.448416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:48.455824 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:48.456321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:48.456792 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:48.457509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:48.457967 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:48.458393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:48.602435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:48.612314 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36e5e9d0-7745-48fb-9904-cf10552142c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.169605 Aug 21 02:20:48.613256 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3377/7404] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:48 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:49.634047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:49.634814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:49.642522 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:49.643273 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:49.643999 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:49.644693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:49.645912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:49.645912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:49.812804 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:49.821030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5a281d3a-00ff-46dc-a7c4-d338eca7ee15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.190869 Aug 21 02:20:49.821616 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4028/7405] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:49 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:50.841985 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:50.842822 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:50.851393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:50.851905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:50.852545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:50.853315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:50.853785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:50.854630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:50.997514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:51.006415 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-36c333ec-80a5-40dd-ba46-53af211272fd tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.168321 Aug 21 02:20:51.007210 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3378/7406] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:50 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:52.032539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:52.034362 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:52.042453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:52.042951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:52.043393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:52.044089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:52.044542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:52.045050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:52.184516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:52.193161 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-caa279b8-5979-4622-b352-8650854854c2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.167186 Aug 21 02:20:52.193752 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4029/7407] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:52 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:53.218586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:53.219274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:53.223540 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:53.224493 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:53.234218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:53.235018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:53.235765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:53.236911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:53.237373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:53.237805 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:53.371241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:53.380419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-49721ba0-2b74-41d5-9b79-df5a0e63f41c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.168740 Aug 21 02:20:53.381044 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3379/7408] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:53 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:54.405746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:54.406637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:54.409436 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:20:54.415961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:54.416448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:54.416906 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:54.417612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:54.418064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:54.418483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:54.557682 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:54.566673 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d29689a5-e24b-492d-8085-9db9ede720cc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.167563 Aug 21 02:20:54.567248 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4030/7409] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:54 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:55.469757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:20:55.481771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:55.483429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:55.483953 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:55.496919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] Creating event network-changed:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:20:55.502210 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8ba71dfa-db1d-408f-8945-2bdb4fd34fc8 req-e3cc5da0-3a33-4105-bfbe-c8ea39565015 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037481 Aug 21 02:20:55.502836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3380/7410] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:20:55.587745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:55.588375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:55.595578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:55.596173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:55.596625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:55.597393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:55.597842 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:55.598260 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:55.740256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:55.749114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-402a8451-c485-42e2-af51-aa2e5eaf0db4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.165071 Aug 21 02:20:55.750056 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4031/7411] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:55 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:56.774621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:56.775257 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:56.781977 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:56.782467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:56.782913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:56.783617 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:56.784076 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:56.784513 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:56.929339 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:56.937453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-af7d0cf6-acc7-417d-86fe-014aeaefae22 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.169321 Aug 21 02:20:56.937997 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3381/7412] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:56 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:57.962434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:57.963365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:57.974387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:57.974868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:57.975286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:57.975984 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:57.976421 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:57.976884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:58.123108 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:58.132117 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-283d0965-66c7-466a-864b-3999ed582a1f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.176302 Aug 21 02:20:58.133003 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4032/7413] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:57 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:20:59.158993 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:20:59.159649 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:20:59.170278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:59.170990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:59.171660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:59.172733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:20:59.173360 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:20:59.173905 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:20:59.337952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:20:59.350799 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2315bf95-64f4-40ac-af34-9c35c8941dde tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.198121 Aug 21 02:20:59.351649 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3382/7414] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:20:59 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:00.372134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:00.372806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:00.379612 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:00.380095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:00.380537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:00.381289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:00.381765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:00.382188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:00.519290 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:00.527965 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-512a7e8c-b828-4f42-97b8-070eb6dd7310 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.159989 Aug 21 02:21:00.528596 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4033/7415] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:00 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:01.549886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:01.550448 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:01.558472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:01.558960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:01.559422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:01.560242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:01.560686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:01.561159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:01.705941 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:01.715196 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eada18f7-a3c0-4a78-b24d-13a72d02d905 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.169246 Aug 21 02:21:01.715794 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3383/7416] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:01 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:02.496227 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "name": "network-vif-plugged", "status": "completed", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:21:02.508501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:02.508501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:02.508860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:02.521074 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] Creating event network-vif-plugged:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:21:02.526326 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-513585b1-85b7-4c57-a123-03d4f738fd5b req-083e7337-ae98-4f57-a99c-81dbd40c6187 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Aug 21 02:21:02.526937 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4034/7417] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:21:02.736479 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:02.737110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:02.744695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:02.745244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:02.745696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:02.746414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:02.746876 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:02.747310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:02.884098 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:02.891962 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c28e572f-8f51-4705-b2f5-249eccdfe7c6 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.159699 Aug 21 02:21:02.892526 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3384/7418] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:02 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:03.917642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:03.918346 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:03.925140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:03.925632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:03.926075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:03.926781 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:03.927237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:03.927805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:04.082066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:04.094646 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c99717e2-4136-4b59-ae9e-cc52fa0bffbf tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1358 microversion: 2.1 time: 0.182637 Aug 21 02:21:04.095535 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4035/7419] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:03 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:05.117726 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:05.118308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:05.126090 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.126593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.127027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.127779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.128237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.128673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.271288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:05.279712 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-328c15e1-0170-4810-8a08-9e4680be996d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1549 microversion: 2.1 time: 0.166149 Aug 21 02:21:05.280328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3385/7420] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:05 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:05.308476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:05.309250 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:05.316368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.316879 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.317313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.318015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.318699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.319549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.465713 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:05.473844 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc397b89-50be-4fda-ae8d-86d8d4bb4d56 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1549 microversion: 2.1 time: 0.169427 Aug 21 02:21:05.474464 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4036/7421] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:05 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:05.493825 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:05.498441 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:05.499236 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Searching by: {'deleted': False, 'project_id': '32f5be9d42ac40b1a916f2c09324d761'} {{(pid=122483) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 02:21:05.505120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.505908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.506356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.507080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.507536 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.507960 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.536262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.multi_cell_list [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 02:21:05.562888 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ca50507-b8f8-416c-9725-1b7dc24b57b4 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073090 Aug 21 02:21:05.563463 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3386/7422] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 02:21:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:21:05.575256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:05.575870 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:05.582496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.582983 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.583401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.584196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:05.584748 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:05.585196 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:05.724258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:05.737028 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c0f7f3e-f86f-48ae-9ad5-8bc491257c16 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1549 microversion: 2.1 time: 0.165349 Aug 21 02:21:05.738175 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4037/7423] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:05 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:21:07.319103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "416b73e6-2013-4481-b8ec-83dd461d01c7"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:21:07.321558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:07.328856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:07.329354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:07.329799 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:07.330505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:07.330966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:07.331400 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:07.621310 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a9f8556-e37b-4958-8915-d14b4c2af11f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306156 Aug 21 02:21:07.622037 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3387/7424] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:21:07 2022] POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:21:20.736490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:20.737123 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:20.740215 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:20.740898 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=68 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:20.748146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:20.748670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:20.749153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:20.749862 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:20.750310 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:20.750730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:20.897199 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:20.906460 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d726ecbe-dd23-4b5a-b979-e2f83f14f235 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1595 microversion: 2.1 time: 0.173983 Aug 21 02:21:20.907038 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4038/7425] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:20 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1595 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:22.952739 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:22.953557 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:22.954442 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:21:23.049244 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:21:23.060746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:23.061545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:23.061990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:23.074862 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] Creating event network-changed:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:21:23.080622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-29f5752a-674f-45bc-8312-86023a16132e req-14bae0b7-7130-454a-8e58-d87fb8ecd9ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129457 Aug 21 02:21:23.081656 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3388/7426] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:21:24.088015 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-691299143"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:21:24.088624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:24.095507 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:24.095993 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:24.096428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:24.097175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:24.097633 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:24.098056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:24.229278 n-d-master-1 devstack@n-api.service[122482]: INFO nova.network.security_group_api [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Adding security group e0422490-0193-4557-aff9-6d6cacde9ea7 to port 5326b861-728f-486a-9b86-1d3b80086e4b Aug 21 02:21:24.594565 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-28fffc0e-8422-4fc3-aca9-d77e7ea3d854 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action" status: 202 len: 0 microversion: 2.1 time: 0.510613 Aug 21 02:21:24.595195 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4039/7427] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:21:24 2022] POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:21:24.605124 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:21:24.605856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:21:24.612649 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:24.613189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:24.613646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:24.614367 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:24.614833 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:24.615272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:24.778250 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:21:24.787102 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d9fa0fa-58a9-4842-b446-a09294fc746a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1760 microversion: 2.1 time: 0.187335 Aug 21 02:21:24.787810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3389/7428] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:21:24 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:21:25.097153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:21:25.107584 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:21:25.108050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:21:25.108494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:21:25.120172 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] Creating event network-changed:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:21:25.125417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0c5773f7-98d9-457b-a504-6d3803318b46 req-b42deced-02c8-440a-b873-f76c1df759fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032878 Aug 21 02:21:25.130891 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4040/7429] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:21:41.957612 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:21:41.958335 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:23:21.978657 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:23:21.979774 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:23:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:23:22.302899 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:23:22.303731 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:23:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:23:36.381531 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:23:36.382484 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:23:36.383015 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:36.383774 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:36.387926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:23:36.390305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:23:36.397938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:36.398371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:36.398820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:36.399525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:36.399983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:36.400418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:36.487452 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4835d4a8-b349-48f9-8612-54f64139679e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action" status: 202 len: 0 microversion: 2.1 time: 0.107767 Aug 21 02:23:36.488106 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3390/7430] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:23:36 2022] POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:23:36.494574 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:23:36.495569 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:23:36.496136 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:36.497041 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:23:36.501914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:23:36.502544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:23:36.510453 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:36.510941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:36.511378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:36.512075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:36.512527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:36.512987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:36.667737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:23:36.676791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cc7dd15e-0cac-495a-9caa-b90ce6be65a7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1762 microversion: 2.1 time: 0.183994 Aug 21 02:23:36.677402 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4041/7431] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:23:36 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1762 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:23:37.704936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:23:37.705693 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:23:37.715860 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:37.716354 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:37.716803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:37.717549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:37.718007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:37.718432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:37.724243 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 51060. Aug 21 02:23:37.727729 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 51062. Aug 21 02:23:37.873553 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:23:37.882287 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64a75034-ede0-4dda-84ca-19e52dfb7975 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1767 microversion: 2.1 time: 0.185696 Aug 21 02:23:37.882863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3391/7432] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:23:37 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1767 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:23:38.908875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:23:38.909707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:23:38.924223 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:38.924796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:38.925538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:38.926253 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:23:38.926704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:23:38.927122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:23:38.936237 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 51066. Aug 21 02:23:38.938072 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 51068. Aug 21 02:23:39.086919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:23:39.095688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b0bd885b-58ec-4128-a91a-1044af314b5a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1760 microversion: 2.1 time: 0.193539 Aug 21 02:23:39.096278 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4042/7433] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:23:38 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1760 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:01.969474 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:25:01.969474 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:25:10.619312 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:10.620535 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:10.628186 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-691299143"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:10.629108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:10.642395 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:10.642972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:10.643624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:10.644335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:10.644806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:10.645244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:10.791111 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Removing security group e0422490-0193-4557-aff9-6d6cacde9ea7 from port 5326b861-728f-486a-9b86-1d3b80086e4b Aug 21 02:25:11.122724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6033c915-964c-471a-8bd8-0a712c832486 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action" status: 202 len: 0 microversion: 2.1 time: 0.506710 Aug 21 02:25:11.123334 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3392/7434] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:25:10 2022] POST /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:25:11.135642 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:11.137595 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:11.227175 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:11.241700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:11.242186 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:11.242810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:11.256787 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] Creating event network-changed:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:25:11.267306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-daa52b89-01e0-4052-b24d-59ea2e16e383 req-69665b4d-4ce7-4234-b5a0-2acaec4d19b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138018 Aug 21 02:25:11.268344 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4043/7435] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:12.274198 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:12.287295 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:12.288411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:12.288983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:12.304419 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] Creating event network-changed:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:25:12.309870 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-90572af2-7240-428b-9c9c-2e6908691026 req-1abcd655-6598-45b0-8ef9-cae51e1752ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039642 Aug 21 02:25:12.310574 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3393/7436] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:12.322380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:12.322969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:12.329668 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:12.330164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:12.330606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:12.331313 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:12.331767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:12.332191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:12.415872 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lazy-loading 'services' on Instance uuid c571b1ec-d8de-4ba3-adc1-af9974228e59 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:25:12.492174 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4730a3e6-b4b0-417d-a872-a43038d0e552 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments/416b73e6-2013-4481-b8ec-83dd461d01c7" status: 202 len: 0 microversion: 2.1 time: 0.175408 Aug 21 02:25:12.493047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4044/7437] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:25:12 2022] DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments/416b73e6-2013-4481-b8ec-83dd461d01c7 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:25:12.502097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:12.504641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:12.511050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:12.511540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:12.512154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:12.512914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:12.513377 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:12.513804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:12.543940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0418e006-a0c3-486d-9905-642d1c7f4326 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 21 02:25:12.544550 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3394/7438] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:12 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:13.557380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:13.559619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:13.567491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:13.567992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:13.568409 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:13.569142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:13.569580 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:13.570020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:13.601216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5f0edc6c-a720-4291-92e4-8650365f3d9d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Aug 21 02:25:13.601774 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4045/7439] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:13 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:14.614088 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:14.616406 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:14.624601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:14.625281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:14.625832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:14.626661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:14.627119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:14.627546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:14.664052 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-679a2c22-ef37-4170-9e8a-9167784beb50 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054061 Aug 21 02:25:14.664863 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3395/7440] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:14 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:15.675979 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:15.678302 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:15.685513 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:15.686004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:15.686479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:15.687214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:15.687712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:15.688142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:15.719924 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-53a8fdc5-9dbc-4287-872a-7ea5e3a7a597 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 Aug 21 02:25:15.720612 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4046/7441] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:15 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:16.732255 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:16.734398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:16.742052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:16.742547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:16.743013 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:16.743731 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:16.744196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:16.744620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:16.779165 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d95ca705-b320-4414-8c72-12763f893eed tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051089 Aug 21 02:25:16.779733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3396/7442] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:16 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:17.795428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:17.799226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:17.810057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:17.810787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:17.811444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:17.812922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:17.813256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:17.813672 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:17.844490 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0f8ce404-167a-4c1a-adab-c72eb82bcbaa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055321 Aug 21 02:25:17.845089 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4047/7443] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:25:17 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 02:25:17.859189 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:17.860231 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:17.867816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:17.868317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:17.868789 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:17.869602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:17.870067 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:17.870506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:17.969411 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] HTTP exception thrown: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 is not attached to volume 416b73e6-2013-4481-b8ec-83dd461d01c7 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Request method failure captured: Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: request: DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments/416b73e6-2013-4481-b8ec-83dd461d01c7 HTTP/1.1 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZZr4x1Rj4BrDzoTMAvSigWk3NpT_q-Wk5Vz8cKKC46B7Wm4yiuVL-1FewdV2b4O5-12vFMN4XK0BoaTM6NqWGoH82vAuSiow4HbWvDCfGNoiqF2MG7hcLWPlYTGyuGcPFp04ThKmw8_q6Xy5DE2VxzyYQab-nze5Rl-ygZCzA45-hY Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32f5be9d42ac40b1a916f2c09324d761", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}] Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 9a95ca48487c4d469371ce0755e04aed Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: exception: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 is not attached to volume 416b73e6-2013-4481-b8ec-83dd461d01c7 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: action_args: {'server_id': 'c571b1ec-d8de-4ba3-adc1-af9974228e59', 'id': '416b73e6-2013-4481-b8ec-83dd461d01c7'} Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 416b73e6-2013-4481-b8ec-83dd461d01c7. Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 is not attached to volume 416b73e6-2013-4481-b8ec-83dd461d01c7 Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:25:17.971105 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 is not attached to volume 416b73e6-2013-4481-b8ec-83dd461d01c7 Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Returning 404 to user: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 is not attached to volume 416b73e6-2013-4481-b8ec-83dd461d01c7 {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cefd3c43-a4df-48a6-9661-0dadb9188e1a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments/416b73e6-2013-4481-b8ec-83dd461d01c7" status: 404 len: 154 microversion: 2.1 time: 0.120254 Aug 21 02:25:17.975387 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3397/7444] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:25:17 2022] DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59/os-volume_attachments/416b73e6-2013-4481-b8ec-83dd461d01c7 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:25:21.230700 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:21.231461 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:21.239004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:21.239941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:21.240644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:21.241527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:21.242026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:21.242449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:21.271831 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:25:21.371021 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ea06485f-0319-4146-ad23-d4f5f516a7ce tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 204 len: 0 microversion: 2.1 time: 0.144221 Aug 21 02:25:21.371652 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4048/7445] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:25:21 2022] DELETE /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:25:21.380925 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:21.381545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:21.389153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:21.389657 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:21.390159 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:21.390956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:21.391346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:21.392105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:21.531888 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:21.540325 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-998fb865-5b3c-4ccd-b790-8802d4a3bd03 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1555 microversion: 2.1 time: 0.163704 Aug 21 02:25:21.540890 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3398/7446] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:21 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:25:22.566783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:22.567829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:22.578680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:22.579179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:22.579753 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:22.580444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:22.580918 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:22.581337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:22.715984 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:22.724444 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02a3fbf4-65be-4c0e-9c9c-db5ef07492ee tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1555 microversion: 2.1 time: 0.164414 Aug 21 02:25:22.724975 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4049/7447] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:22 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:23.745483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:23.746111 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:23.753804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:23.754483 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:23.754929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:23.756350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:23.756845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:23.757213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:23.757708 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571b1ec-d8de-4ba3-adc1-af9974228e59", "name": "network-vif-deleted", "tag": "5326b861-728f-486a-9b86-1d3b80086e4b"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:23.770923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:23.771545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:23.772040 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:23.785376 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] Creating event network-vif-deleted:5326b861-728f-486a-9b86-1d3b80086e4b for instance c571b1ec-d8de-4ba3-adc1-af9974228e59 on n-h2-master-1 Aug 21 02:25:23.790720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-05b9e6d7-767f-44d8-b6a6-421e5b04a380 req-d2b193a5-c8fd-4b0a-9d9f-54e1c09dac6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037515 Aug 21 02:25:23.791424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4050/7448] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:23.827769 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:23.837014 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0797bf0b-d3a9-456f-b432-7ce81e0bf83c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 200 len: 1513 microversion: 2.1 time: 0.095327 Aug 21 02:25:23.837640 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3399/7449] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:23 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 1513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:24.863967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:24.864704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: c571b1ec-d8de-4ba3-adc1-af9974228e59] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:24.871732 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:24.872249 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:24.872708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:24.873474 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:24.873954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:24.874385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:24.888514 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] HTTP exception thrown: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Request method failure captured: Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 HTTP/1.1 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZZr4x1Rj4BrDzoTMAvSigWk3NpT_q-Wk5Vz8cKKC46B7Wm4yiuVL-1FewdV2b4O5-12vFMN4XK0BoaTM6NqWGoH82vAuSiow4HbWvDCfGNoiqF2MG7hcLWPlYTGyuGcPFp04ThKmw8_q6Xy5DE2VxzyYQab-nze5Rl-ygZCzA45-hY Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32f5be9d42ac40b1a916f2c09324d761", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}] Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9a95ca48487c4d469371ce0755e04aed Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: exception: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'c571b1ec-d8de-4ba3-adc1-af9974228e59'} Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:25:24.890263 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Returning 404 to user: Instance c571b1ec-d8de-4ba3-adc1-af9974228e59 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6d03316-5946-4404-8b42-d533c306388f tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59" status: 404 len: 111 microversion: 2.1 time: 0.035126 Aug 21 02:25:24.895650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4051/7450] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:24 2022] GET /compute/v2.1/servers/c571b1ec-d8de-4ba3-adc1-af9974228e59 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:25:24.901598 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-89e08ac1-5769-441c-a91f-7e4ffff7b788 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '.version_select at 0x7fc3fcecca60>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:24.932203 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-89e08ac1-5769-441c-a91f-7e4ffff7b788 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114232987" status: 202 len: 0 microversion: 2.1 time: 0.034543 Aug 21 02:25:24.933057 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3400/7451] 10.222.0.46 () {58 vars in 1272 bytes} [Sun Aug 21 02:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114232987 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:25:34.079069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cea73a41-e9b5-4e42-bc87-00c098ca456d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: .version_select at 0x7fc3f93abf70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-380062915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODfZF2Rg/cSyD3Y3SZEF6M6NW+omg8mxF/yg4qROyVeVPP7zVuCz0sltgzvwBr0nmrZ3+TCl6h9P7azVFrExP3JbrqashuPeP9tbnBHbX3EU92WTNFO2Z1NziJUTMBezw=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:34.095104 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cea73a41-e9b5-4e42-bc87-00c098ca456d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:25:34.101775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cea73a41-e9b5-4e42-bc87-00c098ca456d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for user 9a95ca48487c4d469371ce0755e04aed and project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:25:34.133114 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cea73a41-e9b5-4e42-bc87-00c098ca456d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.108907 Aug 21 02:25:34.133705 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4052/7452] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:25:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:34.186875 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-76943745", "imageRef": "797ee0d4-22a4-4bb0-9058-3b0aa6750fa8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-380062915", "networks": [{"uuid": "1b6e5bab-b326-4d29-b022-315df9b5fc57"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:34.197321 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=42 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:34.253915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] validate_networks() for [('1b6e5bab-b326-4d29-b022-315df9b5fc57', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:25:34.719185 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:25:34.719637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:25:34.720188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:25:34.720589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:25:34.721708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:25:34.731022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:34.731523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:34.731971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:34.732713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:34.733212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:34.733647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:34.753081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:25:34.758929 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Getting quotas for user 9a95ca48487c4d469371ce0755e04aed and project 32f5be9d42ac40b1a916f2c09324d761. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:25:34.773609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:25:34.775867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='797ee0d4-22a4-4bb0-9058-3b0aa6750fa8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:25:34.827818 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e03cb7b5-498a-466c-8409-b53dc805b6bb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644892 Aug 21 02:25:34.828478 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3401/7453] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:25:34.840171 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bc2ac2d2-5692-4651-85f7-822f253b5e6a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:34.840810 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bc2ac2d2-5692-4651-85f7-822f253b5e6a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:34.879890 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:34.904716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bc2ac2d2-5692-4651-85f7-822f253b5e6a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:34.914419 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bc2ac2d2-5692-4651-85f7-822f253b5e6a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1256 microversion: 2.1 time: 0.078107 Aug 21 02:25:34.915073 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4053/7454] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:34 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1256 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:25:35.936795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:35.937465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:35.944859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:35.945379 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:35.945821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:35.946526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:35.946983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:35.947409 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:36.034834 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:36.042984 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bf548ad5-e47d-4a9d-88e6-eff5cc5c469b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1316 microversion: 2.1 time: 0.111104 Aug 21 02:25:36.043608 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3402/7455] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:35 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:37.063493 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:37.064894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:37.077614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:37.078336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:37.078920 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:37.079816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:37.080498 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:37.081518 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:37.229427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:37.239282 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8187ebf7-5adf-4d56-94d3-cde835919d06 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.179565 Aug 21 02:25:37.242541 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4054/7456] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:37 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:38.261268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:38.261854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:38.269134 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:38.269976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:38.270662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:38.271724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:38.272434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:38.272963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:38.413809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:38.421965 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5a0d2601-4d04-4581-b7f4-61bc6eb3fd5c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.164890 Aug 21 02:25:38.423172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3403/7457] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:38 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:39.443910 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:39.445162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:39.452649 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:39.453704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:39.454220 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:39.455065 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:39.455593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:39.456110 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:39.599806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:39.608723 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1608b730-bedb-473a-a959-a3b5cd0480d3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.169275 Aug 21 02:25:39.616892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4055/7458] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:39 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:40.630224 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:40.630851 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:40.638058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:40.638552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:40.638996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:40.639713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:40.640173 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:40.640609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:40.796524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:40.805479 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-89419e7e-c7dd-4711-a1d5-29ebf4dcc4ac tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.179094 Aug 21 02:25:40.806372 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3404/7459] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:40 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:41.827711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:41.828588 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:41.831916 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:41.837739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:41.838225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:41.838660 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:41.839371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:41.839818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:41.840240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:42.042927 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:42.051236 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1a18e61f-2d10-4521-8a35-80db39e00dc5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.228253 Aug 21 02:25:42.051809 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4056/7460] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:41 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:43.071800 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:43.072534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:43.075644 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:43.082407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:43.082917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:43.083369 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:43.084094 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:43.084559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:43.085015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:43.359955 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:43.368674 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-93f2dbfe-4922-4ffe-87f0-7a0fc83e8700 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.300817 Aug 21 02:25:43.369385 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3405/7461] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:43 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:44.391144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:44.392062 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:44.400393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:44.400912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:44.401351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:44.402060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:44.402501 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:44.402946 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:44.572055 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:44.587249 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eef4e148-5dc2-4a58-a79f-b3ac0213488d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.199928 Aug 21 02:25:44.588131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4057/7462] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:44 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:45.619560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:45.620401 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:45.625392 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:45.626254 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:45.633873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:45.634638 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:45.635262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:45.636364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:45.637127 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:45.637735 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:45.784924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:45.793358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-acf55d8b-bb1a-45f7-ad06-e8c934e2b9a5 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.178858 Aug 21 02:25:45.793914 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3406/7463] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:45 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:46.818144 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:46.818857 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:46.821006 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:25:46.828570 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:46.829159 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:46.829673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:46.830485 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:46.831052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:46.831656 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:46.972737 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:46.981006 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71fda95d-0a3e-42d4-a17b-646c0d918264 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.168774 Aug 21 02:25:46.981582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4058/7464] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:46 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:48.002282 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:48.003415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:48.011129 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:48.011637 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:48.012092 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:48.013169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:48.013635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:48.014077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:48.239697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:48.248259 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-afc8fc2e-484d-461b-9586-c16468c429fc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.250401 Aug 21 02:25:48.249064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3407/7465] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:47 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:48.495458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:48.507533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:48.508004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:48.508428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:48.520835 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] Creating event network-changed:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:25:48.526005 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5c3f389f-3847-410d-8b12-11d51ca172c8 req-42a2ee33-2a8b-47c8-a8e2-8910c617f71a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034896 Aug 21 02:25:48.526798 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4059/7466] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:25:49.273038 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:49.273605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:49.280952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:49.281443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:49.281884 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:49.282597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:49.283056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:49.283467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:49.430190 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:49.442458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60fab71a-e4a2-4562-8e99-e0b523d4c4bc tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.173940 Aug 21 02:25:49.443290 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3408/7467] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:49 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:50.469686 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:50.470251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:50.477290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:50.477764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:50.478201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:50.478894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:50.479342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:50.479764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:50.618678 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:50.627013 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-033e80e1-c1be-4535-9235-2d9df95ed497 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.162749 Aug 21 02:25:50.627650 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4060/7468] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:50 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:51.654826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:51.655911 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:51.668468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:51.669263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:51.670036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:51.671212 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:51.671958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:51.672715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:51.814188 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:51.825695 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b10f66c-cb4e-46ff-a58c-db205fa4056d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.177188 Aug 21 02:25:51.826452 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3409/7469] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:51 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:52.852099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:52.852812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:52.863683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:52.864312 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:52.864977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:52.865979 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:52.866597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:52.867166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:53.006138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:53.014235 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71c6eb1a-cb31-4d23-9c0e-3d4396bd83a3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.168499 Aug 21 02:25:53.014814 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4061/7470] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:52 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:54.035973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:54.036621 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:54.044204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:54.044618 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:54.045070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:54.045882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:54.046547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:54.046769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:54.180750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "name": "network-vif-plugged", "status": "completed", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:54.185225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:54.190500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:54.190967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:54.191402 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:54.193548 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fbd88331-4229-419d-bb08-f0d1a3738d8b tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.161618 Aug 21 02:25:54.194125 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3410/7471] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:54 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:54.202588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] Creating event network-vif-plugged:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:25:54.207759 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-538709f3-3934-49c2-99b1-f5654991a625 req-c09f07f8-1195-4126-857e-65fd51e85f39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156911 Aug 21 02:25:54.208337 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4062/7472] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:55.218830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:55.219856 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:55.228136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:55.228621 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:55.229091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:55.229787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:55.230246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:55.230676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:55.369229 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:55.377136 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-24ae0ec5-387c-4910-9491-03ed6c8812fe tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1356 microversion: 2.1 time: 0.165024 Aug 21 02:25:55.377780 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3411/7473] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:55 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:56.403819 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:56.404701 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:56.413362 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.413840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.414266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.414990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.415432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.415846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.563410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:56.572184 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0df275ee-8ce2-4215-bbea-ea04717c3a9c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1546 microversion: 2.1 time: 0.176541 Aug 21 02:25:56.572751 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4063/7474] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:56 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:56.592815 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:56.593520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:56.600694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.601231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.601647 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.602352 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.602815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.603283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.765586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:56.774472 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bfd6a19-6606-4bfb-be63-db22ce89498a tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1546 microversion: 2.1 time: 0.185629 Aug 21 02:25:56.775066 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3412/7475] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:56 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:56.797721 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:56.803259 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:56.804035 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Searching by: {'deleted': False, 'project_id': '32f5be9d42ac40b1a916f2c09324d761'} {{(pid=122482) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 21 02:25:56.809807 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.810286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.810720 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.811446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.811878 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.812326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.840603 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.multi_cell_list [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 21 02:25:56.875433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-74ed164d-7d12-499e-b497-1fc64599b1fb tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.084318 Aug 21 02:25:56.876025 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4064/7476] 10.222.0.46 () {58 vars in 1125 bytes} [Sun Aug 21 02:25:56 2022] GET /compute/v2.1/servers => generated 341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:25:56.890506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:25:56.891139 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:56.898336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.898832 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.899290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:56.900015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:56.900473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:56.900952 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:57.043738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:25:57.054537 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-423caf40-eeed-4390-af3b-961a5d59820d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1546 microversion: 2.1 time: 0.168092 Aug 21 02:25:57.055151 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3413/7477] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:25:56 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:25:58.606480 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41aefbab-95a9-46c3-94c2-40d78278e791"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:25:58.608893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:25:58.616926 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:58.617414 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:58.617853 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:58.618558 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:25:58.619015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:25:58.619443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:25:58.915290 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f311b93-7ba3-496b-af7a-99efdc31fcd7 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312813 Aug 21 02:25:58.915827 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4065/7478] 10.222.0.46 () {60 vars in 1323 bytes} [Sun Aug 21 02:25:58 2022] POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:26:09.755249 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:26:09.755886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:26:09.758358 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=17 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:09.759155 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=74 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:09.765627 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:09.766151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:09.766959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:09.767675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:09.768169 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:09.768605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:09.903013 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:26:09.915977 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-787d6b18-3e9d-40d9-b275-cc1e127398ba tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1592 microversion: 2.1 time: 0.164687 Aug 21 02:26:09.916576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3414/7479] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:26:09 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1592 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:26:12.291075 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:12.292212 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=19 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:12.293254 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:26:12.298101 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:26:12.310171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:12.310836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:12.311347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:12.327254 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] Creating event network-changed:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:26:12.335018 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6c126946-ce36-49a2-84ee-edbff1e6f8a1 req-67b6c664-b494-4747-80db-6a4a10bab39e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045619 Aug 21 02:26:12.337049 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4066/7480] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:26:13.451697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-445475345"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:26:13.452415 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:26:13.459643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:13.460130 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:13.460576 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:13.461301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:13.461753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:13.462432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:13.594643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.network.security_group_api [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Adding security group 5b8ae1c3-eaf6-4c40-901a-269bad9e6835 to port 4dfa08cf-b871-4ef0-a1aa-c1fe3228109a Aug 21 02:26:13.925422 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9b5fa521-0488-4f26-833a-0ea1834a8ff0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action" status: 202 len: 0 microversion: 2.1 time: 0.477914 Aug 21 02:26:13.926051 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3415/7481] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:26:13 2022] POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:26:13.938516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:26:13.939934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:26:13.949689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:13.950202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:13.950638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:13.951416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:13.951866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:13.952359 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:14.104756 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:26:14.113789 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc7c75f7-d720-4cea-b6fe-a280ff697a70 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1757 microversion: 2.1 time: 0.182405 Aug 21 02:26:14.114496 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4067/7482] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:26:13 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:26:14.352097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:26:14.362434 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:26:14.363011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:26:14.363478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:26:14.375942 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] Creating event network-changed:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:26:14.381583 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-1d02e5ef-d17b-4ea1-823a-176e0f7d5d1a req-37899621-33f5-4b67-b5a5-85406c543e1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033428 Aug 21 02:26:14.382184 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3416/7483] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:27:02.028375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:27:02.030780 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:02.033190 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:27:02.033862 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:27:02.039446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:02.039950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:02.040388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:02.041124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:02.041583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:02.042109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:02.120178 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-246fb1a2-0b2e-4bc6-be95-4c37935a7d36 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action" status: 202 len: 0 microversion: 2.1 time: 0.096084 Aug 21 02:27:02.123805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4068/7484] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:27:02 2022] POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:27:02.131702 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:02.132445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:02.136832 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:27:02.137563 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:27:02.142599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:02.143124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:02.143632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:02.144480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:02.145019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:02.145455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:02.383028 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:02.392416 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8af38eda-37c4-4223-aef6-ec0897cee784 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1749 microversion: 2.1 time: 0.266860 Aug 21 02:27:02.393042 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3417/7485] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:02 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1749 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:03.420248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:03.420840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:03.427808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:03.428298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:03.428735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:03.429491 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:03.429923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:03.430357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:03.589484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:03.602552 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-62dcaee2-b08c-4e91-991c-fda2dd437038 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.190012 Aug 21 02:27:03.603353 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4069/7486] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:03 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:04.629340 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:04.630383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:04.639892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:04.640393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:04.640882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:04.641942 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:04.642413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:04.642858 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:04.809242 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:04.818180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45b4c618-3222-4163-b9ea-8dbd98dd493d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.195579 Aug 21 02:27:04.818762 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3418/7487] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:04 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:27:05.842781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:05.843525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:05.852509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:05.853147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:05.853690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:05.854552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:05.855140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:05.855629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:06.013071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:06.022668 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d7f306e2-2e84-4768-a866-03adc6a12b15 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.185414 Aug 21 02:27:06.023249 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4070/7488] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:05 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:07.046329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:07.046947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:07.054479 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:07.054972 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:07.055417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:07.056106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:07.056603 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:07.057038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:07.206349 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:07.217739 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-54608794-cf7a-4b50-8412-276c496386d1 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.175360 Aug 21 02:27:07.218350 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3419/7489] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:07 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:08.243325 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:08.244287 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:08.252231 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:08.252718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:08.253183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:08.253881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:08.254335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:08.254759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:08.406337 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:08.415414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2d36c2c0-d49b-445d-a0bf-145508e4fc48 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.178809 Aug 21 02:27:08.415968 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4071/7490] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:08 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:09.442860 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:09.443721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:09.454722 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:09.455522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:09.456254 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:09.457436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:09.458195 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:09.458909 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:09.627461 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:09.636743 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3d42a7f8-f875-46a1-8ce0-383e82ea1b85 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.201065 Aug 21 02:27:09.637360 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3420/7491] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:09 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:27:10.659182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:10.659783 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:10.666712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:10.667904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:10.668349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:10.669090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:10.669537 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:10.669956 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:10.830641 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:10.840634 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a0ea242a-cd94-4ccd-953e-5f445037121c tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.185726 Aug 21 02:27:10.841258 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4072/7492] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:10 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:11.867106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:11.868085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:11.880629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:11.881533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:11.882279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:11.883449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:11.884213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:11.885012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:12.050276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:12.058828 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8d4cf94b-273a-4728-a6ba-150b2414e7f3 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.198388 Aug 21 02:27:12.059414 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3421/7493] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:11 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:13.080684 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:13.081321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:13.088931 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:13.089424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:13.089929 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:13.090723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:13.091177 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:13.091603 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:13.249661 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:13.262863 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5da4d79a-e50f-43c4-ab07-140c18c63764 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1754 microversion: 2.1 time: 0.186117 Aug 21 02:27:13.263559 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4073/7494] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:13 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:27:14.289546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:27:14.290507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:27:14.303216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:14.304040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:14.304806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:14.306037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:27:14.306859 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:27:14.307631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:27:14.462532 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:27:14.471247 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b971aaa-9697-4c29-9bd3-440aa0329d2d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1757 microversion: 2.1 time: 0.188601 Aug 21 02:27:14.471817 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3422/7495] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:27:14 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:02.997189 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-445475345"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:02.997799 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:03.000208 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:03.000902 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:03.007150 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:03.007637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:03.008079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:03.008797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:03.009443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:03.009886 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:03.144698 n-d-master-1 devstack@n-api.service[122482]: INFO nova.network.security_group_api [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Removing security group 5b8ae1c3-eaf6-4c40-901a-269bad9e6835 from port 4dfa08cf-b871-4ef0-a1aa-c1fe3228109a Aug 21 02:28:03.475038 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d5b72d7e-9031-421c-8c4d-3a3cb2bb76f2 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action" status: 202 len: 0 microversion: 2.1 time: 0.482417 Aug 21 02:28:03.475973 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4074/7496] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:28:02 2022] POST /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:28:03.505659 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:03.506442 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:03.592741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:03.602897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:03.603495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:03.604146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:03.616259 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] Creating event network-changed:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:28:03.621975 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c6496439-f2d4-4443-8435-9c12b5cccc4b req-1df9e227-b86a-4d28-ba59-df1a7b785894 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121968 Aug 21 02:28:03.627506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3423/7497] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:04.998847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:04.999384 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:05.006644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:05.007124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:05.007559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:05.008256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:05.008699 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:05.009347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:05.094938 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lazy-loading 'services' on Instance uuid 9706201b-406e-43d1-abb7-7cbbd966c042 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:28:05.173080 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-64f23137-4de1-44bf-8862-5eb697756267 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments/41aefbab-95a9-46c3-94c2-40d78278e791" status: 202 len: 0 microversion: 2.1 time: 0.178006 Aug 21 02:28:05.174089 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4075/7498] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:28:04 2022] DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments/41aefbab-95a9-46c3-94c2-40d78278e791 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:28:05.184283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:05.186715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:05.193447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:05.194027 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:05.194543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:05.195373 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:05.195889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:05.196501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:05.234923 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ae448b4-1e39-4576-ab52-e98a6331911e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056198 Aug 21 02:28:05.235506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3424/7499] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:05 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:05.639693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:05.651063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:05.651605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:05.652052 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:05.667229 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] Creating event network-changed:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:28:05.672206 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-516dac7b-6754-42c3-980a-eca678ebfcba req-98e2606e-06ad-4eb9-826d-1aa9b06f0efb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036605 Aug 21 02:28:05.672833 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4076/7500] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:06.248626 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:06.250934 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:06.259047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:06.259541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:06.259986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:06.260712 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:06.261194 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:06.261629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:06.296187 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95c20452-3507-4005-8177-f39ffbe4c98d tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051570 Aug 21 02:28:06.296735 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3425/7501] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:06 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:07.310328 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:07.312814 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:07.319937 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:07.320428 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:07.320913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:07.321686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:07.322441 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:07.322925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:07.357530 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d9430ea0-9a2b-4f33-bfd3-d557cc7fa3ca tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053092 Aug 21 02:28:07.358126 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4077/7502] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:07 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:08.371061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:08.373321 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:08.380056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:08.380548 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:08.381032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:08.381730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:08.382183 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:08.382609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:08.413620 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f8cf234e-4fcc-447e-b2b5-963321d10f57 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046910 Aug 21 02:28:08.414069 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3426/7503] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:08 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:09.427184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:09.429358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:09.436199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:09.436694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:09.437155 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:09.437858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:09.438308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:09.438733 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:09.469646 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8e6248b-0491-4509-9f0e-268a991cf4a9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047016 Aug 21 02:28:09.470234 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4078/7504] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:09 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:10.483563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:10.485844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:10.493568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:10.494132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:10.494574 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:10.495272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:10.495723 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:10.496151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:10.526644 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c6e6ce06-ade1-4825-af94-9f05d2b95a77 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047121 Aug 21 02:28:10.527216 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3427/7505] 10.222.0.46 () {58 vars in 1302 bytes} [Sun Aug 21 02:28:10 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 21 02:28:10.537923 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:10.538476 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:10.545622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:10.546104 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:10.546592 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:10.547292 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:10.547735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:10.548151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:10.624650 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] HTTP exception thrown: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 is not attached to volume 41aefbab-95a9-46c3-94c2-40d78278e791 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Request method failure captured: Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: request: DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments/41aefbab-95a9-46c3-94c2-40d78278e791 HTTP/1.1 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZZr4x1Rj4BrDzoTMAvSigWk3NpT_q-Wk5Vz8cKKC46B7Wm4yiuVL-1FewdV2b4O5-12vFMN4XK0BoaTM6NqWGoH82vAuSiow4HbWvDCfGNoiqF2MG7hcLWPlYTGyuGcPFp04ThKmw8_q6Xy5DE2VxzyYQab-nze5Rl-ygZCzA45-hY Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32f5be9d42ac40b1a916f2c09324d761", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}] Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9a95ca48487c4d469371ce0755e04aed Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 is not attached to volume 41aefbab-95a9-46c3-94c2-40d78278e791 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: action_args: {'server_id': '9706201b-406e-43d1-abb7-7cbbd966c042', 'id': '41aefbab-95a9-46c3-94c2-40d78278e791'} Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 41aefbab-95a9-46c3-94c2-40d78278e791. Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 is not attached to volume 41aefbab-95a9-46c3-94c2-40d78278e791 Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:28:10.626333 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 is not attached to volume 41aefbab-95a9-46c3-94c2-40d78278e791 Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Returning 404 to user: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 is not attached to volume 41aefbab-95a9-46c3-94c2-40d78278e791 {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ca640a0d-0a2a-4d26-a0e4-3b88d082abfa tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments/41aefbab-95a9-46c3-94c2-40d78278e791" status: 404 len: 154 microversion: 2.1 time: 0.094010 Aug 21 02:28:10.630818 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4079/7506] 10.222.0.46 () {58 vars in 1416 bytes} [Sun Aug 21 02:28:10 2022] DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042/os-volume_attachments/41aefbab-95a9-46c3-94c2-40d78278e791 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:28:13.888909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:13.889667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:13.897914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:13.898391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:13.898841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:13.899543 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:13.900020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:13.900428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:13.926915 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:28:14.021707 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4064c287-a584-4c9c-96c0-c456b8f28140 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 204 len: 0 microversion: 2.1 time: 0.136895 Aug 21 02:28:14.022589 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3428/7507] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:28:13 2022] DELETE /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:28:14.034057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:14.034746 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:14.044462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:14.045322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:14.045750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:14.046458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:14.046902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:14.047386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:14.193213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:14.202117 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-55a253df-986d-4127-ade3-d23343858ae8 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1552 microversion: 2.1 time: 0.173996 Aug 21 02:28:14.202676 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4080/7508] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:14 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:15.229040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:15.229988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:15.237371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:15.237898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:15.238353 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:15.239069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:15.239532 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:15.239970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:15.392640 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:15.400848 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-389f2f5b-6ed9-47d1-b7a8-dd26efd1657e tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1552 microversion: 2.1 time: 0.179138 Aug 21 02:28:15.401433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3429/7509] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:15 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:16.423612 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:16.424753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:16.432905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:16.433642 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:16.434244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:16.435139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:16.435743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:16.437074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:16.481056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9706201b-406e-43d1-abb7-7cbbd966c042", "name": "network-vif-deleted", "tag": "4dfa08cf-b871-4ef0-a1aa-c1fe3228109a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:16.493102 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:16.493596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:16.494034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:16.505109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a95ca48487c4d469371ce0755e04aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32f5be9d42ac40b1a916f2c09324d761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:16.507495 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] Creating event network-vif-deleted:4dfa08cf-b871-4ef0-a1aa-c1fe3228109a for instance 9706201b-406e-43d1-abb7-7cbbd966c042 on n-h2-master-1 Aug 21 02:28:16.513964 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-c08d005f-928e-4096-a937-3f55a18b139d req-31eb9b63-24be-4312-9f53-2cadc06b04b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037395 Aug 21 02:28:16.514589 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6cfc1c40-dad0-4b49-a8e6-f3a52ef185f9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 200 len: 1510 microversion: 2.1 time: 0.096187 Aug 21 02:28:16.515079 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3430/7510] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:16.515240 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4081/7511] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:16 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:17.541049 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:17.542248 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] [instance: 9706201b-406e-43d1-abb7-7cbbd966c042] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:17.549721 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:17.550206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:17.550641 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:17.551347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:17.551800 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:17.552224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:17.566113 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] HTTP exception thrown: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Request method failure captured: Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 HTTP/1.1 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZZr4x1Rj4BrDzoTMAvSigWk3NpT_q-Wk5Vz8cKKC46B7Wm4yiuVL-1FewdV2b4O5-12vFMN4XK0BoaTM6NqWGoH82vAuSiow4HbWvDCfGNoiqF2MG7hcLWPlYTGyuGcPFp04ThKmw8_q6Xy5DE2VxzyYQab-nze5Rl-ygZCzA45-hY Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32f5be9d42ac40b1a916f2c09324d761", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32f5be9d42ac40b1a916f2c09324d761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32f5be9d42ac40b1a916f2c09324d761"}]}] Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 32f5be9d42ac40b1a916f2c09324d761 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1416922613 Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 9a95ca48487c4d469371ce0755e04aed Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestMinimumBasicScenario-1416922613-project Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '9706201b-406e-43d1-abb7-7cbbd966c042'} Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:28:17.567673 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Returning 404 to user: Instance 9706201b-406e-43d1-abb7-7cbbd966c042 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ab9973a0-5432-4491-bbd5-72c340248ea0 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042" status: 404 len: 111 microversion: 2.1 time: 0.034653 Aug 21 02:28:17.572251 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4082/7512] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:17 2022] GET /compute/v2.1/servers/9706201b-406e-43d1-abb7-7cbbd966c042 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:28:17.578954 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dbca6b63-570d-4a26-8687-4d90f95e3bd9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] Calling method '.version_select at 0x7fc403299940>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:17.603528 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dbca6b63-570d-4a26-8687-4d90f95e3bd9 tempest-TestMinimumBasicScenario-1416922613 tempest-TestMinimumBasicScenario-1416922613-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-380062915" status: 202 len: 0 microversion: 2.1 time: 0.028849 Aug 21 02:28:17.604095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3431/7513] 10.222.0.46 () {58 vars in 1269 bytes} [Sun Aug 21 02:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-380062915 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 02:28:21.980918 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:28:21.981531 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:28:21.993749 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:28:21.993940 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:28:22.330676 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:28:22.331249 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:28:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:28:27.475146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f24aabe7-1da0-49ac-9b45-5214e2458b52 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: .version_select at 0x7fc3f9de6160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1593078311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh7GpXPp4//l2ppkJosSGIdskPXw3mBYEhf49RTwFj7vfU8e1Op0HAVCyASyWbU9wNiYuOGjaqUxYr54Hu7UsvEf3tc/vWl0+OBoUBClAgCEYvEIxo+heYbCDZyJvdKhw=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:27.493893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f24aabe7-1da0-49ac-9b45-5214e2458b52 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:28:27.501142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-f24aabe7-1da0-49ac-9b45-5214e2458b52 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:28:27.537259 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f24aabe7-1da0-49ac-9b45-5214e2458b52 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.270081 Aug 21 02:28:27.537716 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4083/7514] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:28:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:33.492097 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:33.493677 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:33.498618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2002229815", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "2bcdc04f-7b22-45b2-b986-23d76e460f8e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1593078311", "security_groups": [{"name": "tempest-secgroup-smoke-1403936834"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:33.631304 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] validate_networks() for [('2bcdc04f-7b22-45b2-b986-23d76e460f8e', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:28:34.044004 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:28:34.044440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:28:34.044949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:28:34.045369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:28:34.045785 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:28:34.055008 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:34.055500 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:34.055948 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:34.056721 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:34.057215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:34.057772 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:34.075764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:28:34.081370 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:28:34.094412 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:28:34.096867 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:28:34.146534 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e8c166d4-c96b-4f1f-95c0-ad9c9f5691ac tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656794 Aug 21 02:28:34.147457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3432/7515] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:28:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:28:34.158646 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a400d321-1e05-46e0-a142-0ae5b6549369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:34.159231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a400d321-1e05-46e0-a142-0ae5b6549369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:34.161191 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:34.162636 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:34.224953 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a400d321-1e05-46e0-a142-0ae5b6549369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:34.233028 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a400d321-1e05-46e0-a142-0ae5b6549369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1267 microversion: 2.1 time: 0.078414 Aug 21 02:28:34.236949 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4084/7516] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:34 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:35.258907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:35.259573 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:35.272349 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:35.274803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:35.275853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:35.277659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:35.278568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:35.279322 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:35.357873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:35.370078 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-084b2516-37d1-4ba9-bd65-586c9b08023f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1319 microversion: 2.1 time: 0.118083 Aug 21 02:28:35.370724 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3433/7517] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:35 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1319 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:36.392452 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:36.393157 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:36.403816 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:36.404299 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:36.404735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:36.405476 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:36.405928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:36.406350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:36.548715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:36.557399 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f34ab15a-6d36-4c47-9e95-03e8b14a61b2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.169221 Aug 21 02:28:36.557993 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4085/7518] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:36 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:36.844333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d432b-32b3-4823-8fec-eb7afaa92884", "tag": "97a1954e-2f45-4eb3-83c4-282f1c3325d8"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:36.856690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:36.857581 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:36.858018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:36.873018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] Creating event network-changed:97a1954e-2f45-4eb3-83c4-282f1c3325d8 for instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 on n-h2-master-1 Aug 21 02:28:36.878769 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-37e9eb46-98db-4300-9db6-f233dc8821bd req-2f8356b5-4024-4c61-8591-d2487cdf52e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038338 Aug 21 02:28:36.880974 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3434/7519] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:37.582845 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:37.583889 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:37.595846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:37.596652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:37.597450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:37.598616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:37.599377 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:37.600093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:37.737609 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:37.748348 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0dbeb431-aab1-4eb7-a10a-abb61b3b71f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.172118 Aug 21 02:28:37.748914 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4086/7520] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:37 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:38.772326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:38.773090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:38.780330 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:38.780862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:38.781317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:38.782037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:38.782497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:38.782939 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:38.940931 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:38.949742 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7792ad30-ef25-4217-ab3b-8919be77ab38 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.182580 Aug 21 02:28:38.950334 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3435/7521] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:38 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:39.974113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:39.974752 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:39.982547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:39.983011 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:39.983475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:39.984256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:39.984632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:39.985081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:40.137875 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:40.147556 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e24a7a2-edcf-487c-9716-b8b104067a27 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.179727 Aug 21 02:28:40.148181 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4087/7522] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:39 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:41.170191 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:41.170807 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:41.178415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:41.178911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:41.179368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:41.180081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:41.180556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:41.181032 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:41.325296 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:41.333362 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e557a596-0e68-4d79-87b2-1ca37bdc2dba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.167975 Aug 21 02:28:41.333919 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3436/7523] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:41 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:42.358222 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:42.358823 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:42.365940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:42.366427 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:42.366859 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:42.367572 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:42.368027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:42.368452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:42.528626 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:42.540985 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-87dc5140-b5ec-42ef-a592-c915d7eaa022 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.187668 Aug 21 02:28:42.541640 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4088/7524] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:42 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:42.850315 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d432b-32b3-4823-8fec-eb7afaa92884", "name": "network-vif-plugged", "status": "completed", "tag": "97a1954e-2f45-4eb3-83c4-282f1c3325d8"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:42.862333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:42.862811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:42.863251 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:42.875346 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] Creating event network-vif-plugged:97a1954e-2f45-4eb3-83c4-282f1c3325d8 for instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 on n-h2-master-1 Aug 21 02:28:42.880675 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-637986c7-f045-41ce-8676-06ae9e17a7e2 req-56cdb298-15e7-43e3-b2fb-ad52b25e60fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Aug 21 02:28:42.881333 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3437/7525] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:43.562954 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:43.563629 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:43.570968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:43.571450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:43.571932 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:43.572626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:43.573118 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:43.573542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:43.726048 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:43.735030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bd89c5aa-c11e-4066-bcd8-1ce7d15c46af tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1393 microversion: 2.1 time: 0.176402 Aug 21 02:28:43.735617 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4089/7526] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:43 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:44.762051 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:44.762965 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:44.767908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:44.768674 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:44.775900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:44.776387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:44.776867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:44.777624 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:44.778126 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:44.778559 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:44.920350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:44.928581 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8ef35a25-e9d0-4149-94bd-d17599a13e2b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1564 microversion: 2.1 time: 0.168435 Aug 21 02:28:44.929190 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3438/7527] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:44 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:44.949184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:44.949792 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:44.951738 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:28:44.958141 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:44.958618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:44.959045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:44.959796 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:44.960179 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:44.960581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:45.106775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:45.114899 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-73f8ee0e-7fc3-4c84-8eb9-46e02c10e048 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1564 microversion: 2.1 time: 0.169695 Aug 21 02:28:45.115544 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4090/7528] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:44 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:28:46.767030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:28:46.767688 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d432b-32b3-4823-8fec-eb7afaa92884", "tag": "97a1954e-2f45-4eb3-83c4-282f1c3325d8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:28:46.768121 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:28:46.776527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:46.777357 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:46.778062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:46.778877 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:46.779000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:28:46.779354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:46.779507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:28:46.780028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:46.780293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:28:46.792574 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] Creating event network-changed:97a1954e-2f45-4eb3-83c4-282f1c3325d8 for instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 on n-h2-master-1 Aug 21 02:28:46.798425 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b8f697f0-6bd5-4ab9-877e-9c926d5648d6 req-0e4f6566-2d66-4092-b49e-ad09fa14a236 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035021 Aug 21 02:28:46.799362 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4091/7529] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:28:46.985571 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:28:46.995643 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7061138e-95fc-41aa-8fc1-6818b9c7c8a4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1564 microversion: 2.1 time: 0.234911 Aug 21 02:28:46.999081 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3439/7530] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:28:46 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:20.348398 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=17 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:20.349511 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=38 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:20.353825 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:20.356138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:20.363120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:20.363602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:20.364037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:20.364695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:20.365201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:20.365712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:20.439424 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-08281341-64c7-4166-81b0-61988d3a5945 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action" status: 200 len: 24576 microversion: 2.1 time: 0.094451 Aug 21 02:29:20.439991 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4092/7531] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:29:20 2022] POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action => generated 24576 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:29:50.653700 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:50.654767 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:50.661147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:50.661989 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:50.670579 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:50.671317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:50.671990 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:50.673011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:50.673480 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:50.673929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:50.759459 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e1d75b89-f854-4abc-9434-ab0570b610a7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action" status: 202 len: 0 microversion: 2.1 time: 0.108545 Aug 21 02:29:50.761576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3440/7532] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:29:50 2022] POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:29:50.770240 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:50.771286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:50.774865 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:50.775500 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:29:50.780033 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:50.780546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:50.780995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:50.781739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:50.782408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:50.783335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:50.933702 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:50.942306 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-85229477-0e3d-4b9b-9405-a265138d52b8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1688 microversion: 2.1 time: 0.177378 Aug 21 02:29:50.942877 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4093/7533] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:50 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:51.970645 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:51.972108 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:51.982834 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:51.983653 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:51.984496 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:51.985755 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:51.986221 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:51.986750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:52.135936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:52.145211 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e0a26b65-350d-4fed-9fbc-34b5fe4a9abc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1668 microversion: 2.1 time: 0.183713 Aug 21 02:29:52.145815 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3441/7534] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:51 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:53.248664 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:53.252059 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:53.260131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.260620 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.261095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.261788 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.262244 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.262673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.333361 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bd848a39-8c5e-45c8-80c2-d51962ca41f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action" status: 200 len: 32649 microversion: 2.1 time: 0.091552 Aug 21 02:29:53.334360 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4094/7535] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:29:53 2022] POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action => generated 32649 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:29:53.352429 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:53.353365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:53.363670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.364161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.364641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.365374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.365837 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.366267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.439752 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e7329e1c-eb61-4858-8ca4-1fd24c25ff86 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action" status: 202 len: 0 microversion: 2.1 time: 0.093973 Aug 21 02:29:53.440561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3442/7536] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:29:53 2022] POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 02:29:53.449619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:53.450317 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:53.457971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.458460 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.458883 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.459588 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:53.460042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:53.460450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:53.596599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:53.608244 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-803d77ab-ef41-4596-a990-ab39b2efb206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1675 microversion: 2.1 time: 0.162867 Aug 21 02:29:53.609053 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4095/7537] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:53 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:54.636999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:54.637824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:54.647075 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:54.647806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:54.648418 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:54.649523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:54.650196 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:54.650816 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:54.796381 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:54.808604 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-468e745b-757b-4f1d-ac6d-bcd21bbafcf8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1683 microversion: 2.1 time: 0.180091 Aug 21 02:29:54.809442 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3443/7538] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:54 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:54.913862 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:54.916136 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:54.924125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:54.924734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:54.925289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:54.925950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:54.926413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:54.926827 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:54.992276 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b7060215-e561-4f59-98d0-99d999602940 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action" status: 200 len: 38457 microversion: 2.1 time: 0.081809 Aug 21 02:29:54.993235 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4096/7539] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:29:54 2022] POST /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884/action => generated 38457 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:29:56.358767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d432b-32b3-4823-8fec-eb7afaa92884", "tag": "97a1954e-2f45-4eb3-83c4-282f1c3325d8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:56.360473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:56.361065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:56.368375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:56.368995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:56.369431 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:56.370163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:56.370620 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:56.371054 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:56.371519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:56.372067 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:56.372567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:56.385397 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] Creating event network-changed:97a1954e-2f45-4eb3-83c4-282f1c3325d8 for instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 on n-h2-master-1 Aug 21 02:29:56.391081 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0ba81eb2-a48e-433e-ac94-1372e958f835 req-29229ec2-46df-440b-af6a-4de7a418a918 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036993 Aug 21 02:29:56.392037 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4097/7540] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:29:56.398318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:29:56.491447 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f80c12e2-0011-4582-a8f4-6a2c78819aa0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 204 len: 0 microversion: 2.1 time: 0.139621 Aug 21 02:29:56.492265 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3444/7541] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:29:56 2022] DELETE /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:29:56.503018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:56.504063 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:56.510935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:56.511519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:56.512021 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:56.512824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:56.513349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:56.513968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:57.024793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:57.032731 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9f946fa-957d-4a15-9788-cfb46ec31cad tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1689 microversion: 2.1 time: 0.535347 Aug 21 02:29:57.033383 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4098/7542] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:56 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1689 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:58.056624 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:58.057445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:58.064854 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:58.065355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:58.065802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:58.066497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:58.066976 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:58.067411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:58.225127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:58.234037 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e75863f6-3d54-4e00-ac40-2e2f3bfd2705 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1689 microversion: 2.1 time: 0.181862 Aug 21 02:29:58.234620 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3445/7543] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:58 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:29:59.029138 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d432b-32b3-4823-8fec-eb7afaa92884", "name": "network-vif-deleted", "tag": "97a1954e-2f45-4eb3-83c4-282f1c3325d8"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:29:59.045845 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:59.046511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:59.046952 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:59.059096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] Creating event network-vif-deleted:97a1954e-2f45-4eb3-83c4-282f1c3325d8 for instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 on n-h2-master-1 Aug 21 02:29:59.065185 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-f55da584-f6d7-44b9-b73e-c588a7f3a3ed req-91ed85f3-d49c-4126-bcdb-40ced7096acf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Aug 21 02:29:59.065836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4099/7544] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:29:59.265699 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:29:59.266428 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:29:59.278061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:59.278713 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:59.279346 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:59.280547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:59.281794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:59.283473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:59.323504 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:29:59.323999 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:29:59.324441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:29:59.324923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lazy-loading 'fault' on Instance uuid 7c7d432b-32b3-4823-8fec-eb7afaa92884 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:29:59.372048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:29:59.380533 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a7e00156-45a0-442a-8a8a-411236bbd2dc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 200 len: 1357 microversion: 2.1 time: 0.121628 Aug 21 02:29:59.381217 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3446/7545] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:29:59 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 1357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:00.404219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:00.404879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 7c7d432b-32b3-4823-8fec-eb7afaa92884] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:00.413165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:00.413692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:00.414171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:00.414939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:00.415440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:00.415902 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:00.431848 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] HTTP exception thrown: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Request method failure captured: Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 HTTP/1.1 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZhKiVbJSNOg-wKy9IrhbsDDOKM2yhIHlExziZuE0iDt05gUAqcZKhN25YN90UnA1lJJjfUqj8ivY3g_ryu3FR-iK1eTvm9-H9l8HNFeQfCozBOfABJftjgdXc55JX5u6KPoMY9GapYyUsAkj2Wzjtf7oyNnfCBJR9_11AeqtTPX0-Q Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83cf02fdc1394f2db3f7628a4d28ec47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}] Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e49e5ba10abf48a9954f8b6725bb84a6 Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '7c7d432b-32b3-4823-8fec-eb7afaa92884'} Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:30:00.433530 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Returning 404 to user: Instance 7c7d432b-32b3-4823-8fec-eb7afaa92884 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-321f5f56-300f-40ad-bb27-fa6c3a7c1696 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884" status: 404 len: 111 microversion: 2.1 time: 0.035732 Aug 21 02:30:00.438436 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4100/7546] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:00 2022] GET /compute/v2.1/servers/7c7d432b-32b3-4823-8fec-eb7afaa92884 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:30:03.620074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-478cd2c1-344f-4e50-9358-fcf393de31b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '.version_select at 0x7fc40327e670>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:03.643471 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-478cd2c1-344f-4e50-9358-fcf393de31b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1593078311" status: 202 len: 0 microversion: 2.1 time: 0.027263 Aug 21 02:30:03.644054 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3447/7547] 10.222.0.46 () {58 vars in 1284 bytes} [Sun Aug 21 02:30:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1593078311 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:30:03.673729 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-742e44f7-1ca3-49eb-9653-af54879305ff tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: .version_select at 0x7fc3fa166ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-129842681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOU61ASH9dxK4WfSLJ50fGSOdk8xCG0l/M6kD02mPgWY8fRKj4FVohX9jRVzzw0ZYITWbDneV/+/V75X+jtJY9cie1SZ8m/dlH4AFF0ObO8/uR+UFlYHZJVm4BWa4R7iCg=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:03.692525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-742e44f7-1ca3-49eb-9653-af54879305ff tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:30:03.702933 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-742e44f7-1ca3-49eb-9653-af54879305ff tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:30:03.729046 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-742e44f7-1ca3-49eb-9653-af54879305ff tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059283 Aug 21 02:30:03.729688 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4101/7548] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:30:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:30:09.471385 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:09.475751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-187313868", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "852446ff-2f49-4ccf-be64-b091c1839b93"}], "key_name": "tempest-TestNetworkAdvancedServerOps-129842681", "security_groups": [{"name": "tempest-secgroup-smoke-1972394835"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:09.592105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] validate_networks() for [('852446ff-2f49-4ccf-be64-b091c1839b93', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:30:10.019061 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:30:10.019491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:30:10.020357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:30:10.020795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:30:10.021225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:30:10.033018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:10.033820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:10.034282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:10.035068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:10.035777 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:10.036316 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:10.054516 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:30:10.060039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:30:10.074543 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:30:10.077008 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:30:10.136642 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f807ca79-8441-44fe-ae31-6e7f80776162 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.666903 Aug 21 02:30:10.143686 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3448/7549] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:30:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:30:10.150012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-20fc6295-e51b-45b8-98a9-230af89d4c4e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:10.150869 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-20fc6295-e51b-45b8-98a9-230af89d4c4e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:10.269879 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-20fc6295-e51b-45b8-98a9-230af89d4c4e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:10.277491 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-20fc6295-e51b-45b8-98a9-230af89d4c4e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1265 microversion: 2.1 time: 0.131761 Aug 21 02:30:10.279406 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4102/7550] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:10 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:11.299803 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:11.300416 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:11.309039 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:11.309767 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:11.310482 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:11.311801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:11.312472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:11.313186 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:11.442373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:11.450207 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-edf7bab0-33c2-4caa-abe5-8eb1d8bb9019 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1325 microversion: 2.1 time: 0.155382 Aug 21 02:30:11.450783 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3449/7551] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:11 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:12.471964 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:12.472577 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:12.487496 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=32 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:12.490219 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:12.490678 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:12.491126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:12.491851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:12.492315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:12.492739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:12.698172 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:12.719777 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-72d9120a-148d-4ffc-a52d-afa4a178d6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.251845 Aug 21 02:30:12.721597 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4103/7552] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:12 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:13.316234 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d502f3-08f3-42ca-a6a5-aa1317f8e71a", "tag": "40955eaf-9347-4e72-9f72-afaa99d58404"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:13.325839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:13.326319 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:13.326978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:13.338343 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] Creating event network-changed:40955eaf-9347-4e72-9f72-afaa99d58404 for instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a on n-h2-master-1 Aug 21 02:30:13.343370 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e2810653-4a67-46fc-8424-a379fd42fc82 req-21477eb1-e3ef-436d-ac7b-3f56609135b9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096507 Aug 21 02:30:13.344008 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3450/7553] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:30:13.744184 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:13.744757 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:13.752477 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:13.753003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:13.753464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:13.754265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:13.754776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:13.755262 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:13.906454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:13.914847 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3b0ba210-d32f-4642-9133-353300860fcd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.174726 Aug 21 02:30:13.915424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4104/7554] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:13 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:14.940563 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:14.941433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:14.950717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:14.951375 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:14.951956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:14.952958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:14.953634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:14.954267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:15.090908 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:15.099201 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-22debef6-97b6-443f-af86-65863c730455 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.166163 Aug 21 02:30:15.099771 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3451/7555] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:14 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:16.122156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:16.123064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:16.131342 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:16.131836 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:16.132272 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:16.133172 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:16.133623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:16.134074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:16.277002 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:16.284937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-49b3ffba-d6c5-4fe3-b824-c3eb9b1a1f57 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.168816 Aug 21 02:30:16.285545 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4105/7556] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:16 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:17.306642 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:17.307392 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:17.314923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:17.315419 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:17.315868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:17.317062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:17.317324 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:17.317784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:17.455754 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:17.463776 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4d2ee909-6b64-4747-b52d-a72e7e9c7776 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.161176 Aug 21 02:30:17.464352 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3452/7557] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:17 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:18.487105 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:18.487787 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:18.495505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:18.495998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:18.496434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:18.497169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:18.497622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:18.498047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:18.642032 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:18.650688 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bfca6f44-59af-46c6-ac29-e0da62bd9482 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.168913 Aug 21 02:30:18.651252 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4106/7558] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:18 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:19.460066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d502f3-08f3-42ca-a6a5-aa1317f8e71a", "name": "network-vif-plugged", "status": "completed", "tag": "40955eaf-9347-4e72-9f72-afaa99d58404"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:19.470965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:19.471470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:19.471908 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:19.483934 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] Creating event network-vif-plugged:40955eaf-9347-4e72-9f72-afaa99d58404 for instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a on n-h2-master-1 Aug 21 02:30:19.489618 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a066e497-473e-416a-b569-e151ebe3d1e1 req-d00d660b-a6d5-4083-af27-b2cb76d47194 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Aug 21 02:30:19.490518 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3453/7559] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:30:19.671146 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:19.671761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:19.679293 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:19.679709 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:19.680139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:19.680904 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:19.681354 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:19.681765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:19.824375 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:19.832331 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dacd0674-34c6-41be-a6cc-ac11448a64cc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.165241 Aug 21 02:30:19.833577 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4107/7560] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:19 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:20.854843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:20.855555 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:20.857648 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:20.858400 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:20.859835 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:20.866992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:20.867537 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:20.867986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:20.868793 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:20.869228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:20.869684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:21.024708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:21.032820 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-156c80b1-9d73-4c8d-8aa7-e792694df3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1391 microversion: 2.1 time: 0.182207 Aug 21 02:30:21.033444 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3454/7561] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:20 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:22.057503 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:22.058178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:22.060355 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:22.062051 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:22.069306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:22.069863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:22.070387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:22.071194 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:22.071716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:22.072171 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:22.214331 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:22.222271 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d1f7eebe-92d0-4e32-82e8-3cecc880308b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1562 microversion: 2.1 time: 0.170029 Aug 21 02:30:22.222850 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4108/7562] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:22 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:22.243491 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:22.244092 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:22.253989 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:22.254817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:22.255571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:22.256622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:22.257146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:22.257588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:22.399056 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:22.407044 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff77dd0b-c2b9-474c-a271-1d021e0d91eb tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1562 microversion: 2.1 time: 0.167563 Aug 21 02:30:22.407619 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3455/7563] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:22 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:24.059359 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:30:24.064897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d502f3-08f3-42ca-a6a5-aa1317f8e71a", "tag": "40955eaf-9347-4e72-9f72-afaa99d58404"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:24.072173 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:24.079730 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:24.080202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:24.080321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:24.080629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:24.081139 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:24.081783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:24.082680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:24.083322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:24.084037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:24.092300 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] Creating event network-changed:40955eaf-9347-4e72-9f72-afaa99d58404 for instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a on n-h2-master-1 Aug 21 02:30:24.097996 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8fb302bb-4185-4b5c-9cf2-56e96e79087c req-449fbb18-179a-451e-9873-3668439f6310 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036728 Aug 21 02:30:24.098819 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3456/7564] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:30:24.237892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:30:24.246623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d098edbd-0e65-429d-817b-839516db9e21 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1562 microversion: 2.1 time: 0.191471 Aug 21 02:30:24.247571 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4109/7565] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:30:24 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:30:55.589402 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:30:55.591705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:30:55.594046 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=5 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:55.594819 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=38 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:30:55.600956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:55.601414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:55.601853 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:55.602554 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:30:55.603011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:30:55.603439 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:30:55.672532 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ea60a303-4907-4227-8975-4a81012bc87e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action" status: 200 len: 24570 microversion: 2.1 time: 0.089914 Aug 21 02:30:55.673263 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3457/7566] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:30:55 2022] POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:31:26.095547 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:26.096726 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=42 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:26.103120 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:31:26.105385 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:26.112371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:26.112882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:26.113314 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:26.114002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:26.114443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:26.114858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:26.205216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-00e2b500-9624-4b2e-99aa-72643f0c6041 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action" status: 202 len: 0 microversion: 2.1 time: 0.111725 Aug 21 02:31:26.209283 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4110/7567] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:31:26 2022] POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:31:26.215844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:26.216551 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:26.219446 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:26.220192 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:31:26.228132 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:26.228630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:26.229088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:26.229835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:26.230294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:26.230729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:26.835844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:26.845994 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-013475a9-25dc-43c2-8e6b-a4d751082f43 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1672 microversion: 2.1 time: 0.634484 Aug 21 02:31:26.846576 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3458/7568] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:26 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1672 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:27.874406 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:27.875558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:27.889115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:27.890227 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:27.890949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:27.892092 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:27.892847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:27.893582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:28.095722 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:28.105248 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-71e127a0-6ae2-4b9b-b52a-c364553dd0bc tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.238026 Aug 21 02:31:28.105808 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4111/7569] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:27 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:29.130048 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:29.131005 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:29.139874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:29.140366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:29.140800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:29.141641 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:29.142100 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:29.142540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:29.293509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:29.305524 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-711b1485-895a-4a2f-80fb-c12bacbbfeec tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.181362 Aug 21 02:31:29.306110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3459/7570] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:29 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:30.327187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:30.327805 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:30.335173 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:30.335677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:30.336088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:30.336810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:30.337258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:30.337680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:30.488624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:30.497417 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b7eaab1d-cd10-4207-a8ad-609c62d0447c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.174224 Aug 21 02:31:30.497998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4112/7571] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:30 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:31.524104 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:31.524679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:31.532138 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:31.532632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:31.533117 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:31.533829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:31.534291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:31.534724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:31.683081 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:31.695981 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1be64c35-09b4-4cc5-a679-4c43b178f9ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.177563 Aug 21 02:31:31.696935 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3460/7572] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:31 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:32.726786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:32.727411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:32.734900 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:32.735413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:32.735844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:32.736545 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:32.737042 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:32.737475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:32.893796 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:32.905810 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5305f398-24ca-4878-92a9-46ca1fdda72f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.185504 Aug 21 02:31:32.906584 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4113/7573] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:32 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:33.931319 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:33.931901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:33.939534 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:33.940029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:33.940472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:33.941205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:33.941665 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:33.942097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:34.078618 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:34.089609 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45d34458-cb17-4957-9a12-b0fa177e76de tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.163443 Aug 21 02:31:34.090369 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3461/7574] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:33 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:35.117770 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:35.118552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:35.128071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:35.128713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:35.129290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:35.130251 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:35.130854 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:35.131419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:35.267177 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:35.275498 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b695608a-e481-4479-94a1-92d70d05c3e4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.163117 Aug 21 02:31:35.276102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4114/7575] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:35 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:36.303271 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:36.304149 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:36.314933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:36.315634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:36.316260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:36.317299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:36.317949 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:36.318593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:36.477115 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:36.485640 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a5387030-4f4d-4ebe-ad23-be5e4409f51f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.188250 Aug 21 02:31:36.486226 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3462/7576] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:36 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:37.509380 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:37.510162 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:37.520256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:37.520948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:37.521526 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:37.522442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:37.523119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:37.523767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:37.674164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:37.682626 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-34856318-ec1f-48eb-a829-00b87d2a89ef tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1677 microversion: 2.1 time: 0.178820 Aug 21 02:31:37.683221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4115/7577] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:37 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:38.706039 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:31:38.706833 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:31:38.715646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:38.716280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:38.716856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:38.717771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:31:38.718355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:31:38.718900 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:31:38.860300 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:31:38.872295 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9207f594-4c36-452e-b47b-cc4509c51219 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1680 microversion: 2.1 time: 0.171149 Aug 21 02:31:38.873087 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3463/7578] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:31:38 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:31:41.990800 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:31:41.991629 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:32:11.144914 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:11.147155 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:11.149647 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:11.150309 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:11.156298 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:11.156810 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:11.157254 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:11.157955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:11.158408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:11.158832 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:11.239333 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7e237580-3f68-47b8-a7fd-624670dd52b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action" status: 200 len: 69091 microversion: 2.1 time: 0.097909 Aug 21 02:32:11.240354 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4116/7579] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:32:11 2022] POST /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a/action => generated 69091 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:32:28.342199 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:28.342740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:28.344809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d502f3-08f3-42ca-a6a5-aa1317f8e71a", "tag": "40955eaf-9347-4e72-9f72-afaa99d58404"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:28.348538 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:28.349315 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:28.351715 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:28.352472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:28.352971 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:28.353804 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:28.354264 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:28.355284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:28.355923 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:28.356679 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:28.359768 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:28.360286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:28.360686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:28.374753 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] Creating event network-changed:40955eaf-9347-4e72-9f72-afaa99d58404 for instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a on n-h2-master-1 Aug 21 02:32:28.381150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-0f9a438a-3632-46f8-8da4-18ebed7d9f50 req-f46936ea-9fd0-4246-bbcf-20c1bb0edded service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039921 Aug 21 02:32:28.382425 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4117/7580] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:28.388388 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:32:28.478374 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-56632d94-e9e2-4446-af3e-9adcd6db3369 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 204 len: 0 microversion: 2.1 time: 0.140121 Aug 21 02:32:28.479875 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3464/7581] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:32:28 2022] DELETE /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:32:28.489160 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:28.489922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:28.496371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:28.496889 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:28.497322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:28.498023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:28.498470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:28.498890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:28.642187 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:28.650465 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7c91455b-7368-4331-bf46-ab7c59847c29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1686 microversion: 2.1 time: 0.165747 Aug 21 02:32:28.651267 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4118/7582] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:28 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:29.677765 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:29.678361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:29.685880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:29.686386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:29.686841 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:29.687561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:29.688050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:29.688465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:29.932443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:29.945297 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6ca8daf1-fe90-4000-8e89-90e3d26cb891 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1686 microversion: 2.1 time: 0.274522 Aug 21 02:32:29.946096 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3465/7583] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:29 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1686 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:30.670263 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d502f3-08f3-42ca-a6a5-aa1317f8e71a", "name": "network-vif-deleted", "tag": "40955eaf-9347-4e72-9f72-afaa99d58404"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:30.684442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:30.685142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:30.685830 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:30.698873 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] Creating event network-vif-deleted:40955eaf-9347-4e72-9f72-afaa99d58404 for instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a on n-h2-master-1 Aug 21 02:32:30.704680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-5088e9cd-0778-4fc8-9f1f-56e6aaf3f16f req-139ad7c8-7b79-484b-b675-3a3713acf1d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038470 Aug 21 02:32:30.705476 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4119/7584] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:30.973010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:30.973670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:30.981444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:30.981965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:30.982414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:30.983148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:30.983613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:30.984040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:31.018072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:31.018561 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:31.019049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:31.019506 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lazy-loading 'fault' on Instance uuid e6d502f3-08f3-42ca-a6a5-aa1317f8e71a {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:32:31.066161 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:31.074495 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-91117fc7-4822-4924-8ad8-395fb31a252a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 200 len: 1355 microversion: 2.1 time: 0.105523 Aug 21 02:32:31.075095 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3466/7585] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:30 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:32.103720 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:32.104922 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e6d502f3-08f3-42ca-a6a5-aa1317f8e71a] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:32.115114 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:32.115593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:32.116028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:32.116724 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:32.117211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:32.117638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:32.131392 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] HTTP exception thrown: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Request method failure captured: Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a HTTP/1.1 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZhKiVbJSNOg-wKy9IrhbsDDOKM2yhIHlExziZuE0iDt05gUAqcZKhN25YN90UnA1lJJjfUqj8ivY3g_ryu3FR-iK1eTvm9-H9l8HNFeQfCozBOfABJftjgdXc55JX5u6KPoMY9GapYyUsAkj2Wzjtf7oyNnfCBJR9_11AeqtTPX0-Q Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83cf02fdc1394f2db3f7628a4d28ec47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}] Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: e49e5ba10abf48a9954f8b6725bb84a6 Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: exception: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'e6d502f3-08f3-42ca-a6a5-aa1317f8e71a'} Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:32:32.133097 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Returning 404 to user: Instance e6d502f3-08f3-42ca-a6a5-aa1317f8e71a could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1ea74647-ffdd-4bcb-90ca-aec0816160cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a" status: 404 len: 111 microversion: 2.1 time: 0.039655 Aug 21 02:32:32.137094 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4120/7586] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:32 2022] GET /compute/v2.1/servers/e6d502f3-08f3-42ca-a6a5-aa1317f8e71a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:32:35.572423 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-877e10fe-44c1-4397-8937-9a3cb3d7e0f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '.version_select at 0x7fc3fd982d30>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:35.578529 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-877e10fe-44c1-4397-8937-9a3cb3d7e0f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:32:36.590070 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-877e10fe-44c1-4397-8937-9a3cb3d7e0f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 52100. Aug 21 02:32:36.619388 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-877e10fe-44c1-4397-8937-9a3cb3d7e0f4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129842681" status: 202 len: 0 microversion: 2.1 time: 1.050922 Aug 21 02:32:36.620688 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3467/7587] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 02:32:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-129842681 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 21 02:32:36.654734 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: .version_select at 0x7fc3f9350ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1944612508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJggjBVZQH9G6RLNDJvh8TjUWuk5ydalf2KIBXZQ5oo8BN+Nxlk5FC4XTnPiIckD/GWbLXb49UFrlI7oN2HNw9DOvnq/ciifNEkd9tftO/iQ/tcIRZ/a8dtSxgosYQ9BgQ=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:36.672860 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:32:36.678341 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:32:36.692347 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:32:37.702713 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 52104. Aug 21 02:32:37.725683 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9635d8b3-023c-42c8-83c4-8aca801f4f7b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.074970 Aug 21 02:32:37.726317 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4121/7588] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:32:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:43.413745 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:43.418845 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1093830096", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "baafe5b4-46a4-4747-a12b-8f4170fa94e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1944612508", "security_groups": [{"name": "tempest-secgroup-smoke-1550684533"}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:43.553794 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] validate_networks() for [('baafe5b4-46a4-4747-a12b-8f4170fa94e1', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:32:44.035696 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:32:44.036279 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:32:44.037023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:32:44.037517 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:32:44.038009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:32:44.047914 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:44.048401 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:44.048879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:44.049619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:44.050081 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:44.050511 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:44.067639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:32:44.075574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:32:44.089074 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:32:44.091446 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:32:44.137262 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:32:45.148914 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 52152. Aug 21 02:32:45.154231 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b0d514f4-dd33-469b-badd-b77b30aec755 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.742556 Aug 21 02:32:45.155088 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3468/7589] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:32:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:32:45.165004 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:45.169640 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b9110196-20bb-436f-af5d-2c1d2bf33e25 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:45.170491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b9110196-20bb-436f-af5d-2c1d2bf33e25 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:45.233852 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b9110196-20bb-436f-af5d-2c1d2bf33e25 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:45.248876 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b9110196-20bb-436f-af5d-2c1d2bf33e25 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1267 microversion: 2.1 time: 0.085697 Aug 21 02:32:45.260800 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4122/7590] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:45 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:46.283748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:46.284697 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:46.292280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:46.292956 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:46.293524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:46.295119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:46.295895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:46.297689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:46.386256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:46.395918 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-461c3d01-46aa-4fb9-b8ff-be33eb3bfafd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1327 microversion: 2.1 time: 0.127594 Aug 21 02:32:46.396987 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3469/7591] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:46 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:47.418596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:47.419210 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:47.426343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:47.427326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:47.427767 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:47.428475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:47.428961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:47.429403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:47.661909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:47.670514 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24670f71-d987-45ec-b62b-8c1b313c7b99 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.255861 Aug 21 02:32:47.671192 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4123/7592] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:47 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:47.803629 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:47.814616 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:47.815335 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:47.815584 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:47.827829 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] Creating event network-changed:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h2-master-1 Aug 21 02:32:47.833018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-7a46bc35-99d0-42e1-b39a-146fedfed927 req-92b41b15-c0b7-4726-8770-51dc787da013 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037866 Aug 21 02:32:47.833618 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3470/7593] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:48.697012 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:48.698037 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:48.710459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:48.711153 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:48.711734 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:48.712483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:48.713088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:48.713664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:48.870794 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:48.878855 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-118b8dd8-bb54-4c1b-8962-dd6ddae6210d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.188794 Aug 21 02:32:48.879540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4124/7594] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:48 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:49.902804 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:49.903385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:49.910535 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:49.911355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:49.911811 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:49.912552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:49.913050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:49.913490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:50.061245 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:50.073527 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3f9bf4aa-a33e-477a-bbdf-b8bd690a3353 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.175750 Aug 21 02:32:50.074181 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3471/7595] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:49 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:51.107309 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:51.108117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:51.121551 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:51.122467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:51.123302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:51.124552 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:51.125357 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:51.126163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:51.278255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:51.287237 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-92d3371f-b196-443d-98a9-d428bcb05497 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.185350 Aug 21 02:32:51.287825 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4125/7596] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:51 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:52.311241 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:52.313658 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:52.320460 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:52.320992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:52.321438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:52.322147 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:52.322602 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:52.323020 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:52.478924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:52.489294 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-72532777-a673-4cfd-8ba1-00ce5d770220 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.184338 Aug 21 02:32:52.489970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3472/7597] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:52 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:53.511113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:53.511731 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:53.519451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:53.519934 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:53.520469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:53.521202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:53.521652 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:53.522074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:53.662606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:53.671216 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-415cee29-becc-466e-aa59-0c69758ed92c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.164124 Aug 21 02:32:53.671805 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4126/7598] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:53 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:54.147649 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:54.148152 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:54.206714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "name": "network-vif-plugged", "status": "completed", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:54.217128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:54.217898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:54.218502 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:54.230967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] Creating event network-vif-plugged:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h2-master-1 Aug 21 02:32:54.236050 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-89fe3243-e492-4e5a-9c72-84e45a8935a4 req-1e6ef8fc-d163-40e6-8c20-1eaa652dbeb6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095817 Aug 21 02:32:54.236655 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3473/7599] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:54.698321 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:54.699211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:54.709897 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:54.710345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:54.710769 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:54.711469 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:54.711911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:54.712326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:54.859473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:54.871889 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a6b85231-3e99-4009-ac26-99bde45d9e26 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1393 microversion: 2.1 time: 0.180027 Aug 21 02:32:54.873102 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4127/7600] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:54 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:55.899411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:55.900033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:55.906507 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:55.907003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:55.907447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:55.908155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:55.908614 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:55.909072 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:56.055112 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:56.063168 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-933593db-3928-42a2-971c-513e3faaa4b3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1565 microversion: 2.1 time: 0.169387 Aug 21 02:32:56.063729 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3474/7601] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:55 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:56.083572 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:56.084234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:56.086816 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:32:56.093486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:56.093966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:56.094404 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:56.095103 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:56.095557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:56.095985 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:56.245645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:56.253879 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2120e76-a784-4a7a-82e2-01e262420fa6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1565 microversion: 2.1 time: 0.174307 Aug 21 02:32:56.254475 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4128/7602] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:56 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:32:57.864174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:32:57.864809 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:32:57.866430 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:32:57.872074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:57.872570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:57.873047 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:57.873765 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:57.874234 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:57.874666 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:57.880964 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:32:57.881713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:32:57.882434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:32:57.894834 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] Creating event network-changed:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h2-master-1 Aug 21 02:32:57.901403 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7c87dad4-7367-481b-8328-f97e1ca02876 req-d8206de2-bfea-479d-a9b9-1d15c3b6cac1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 Aug 21 02:32:57.902200 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4129/7603] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:32:58.036734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:32:58.046308 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cc0d9a0b-85df-4775-9872-85fbfffcbf29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1565 microversion: 2.1 time: 0.186134 Aug 21 02:32:58.047163 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3475/7604] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:32:57 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:33:31.366267 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:33:31.367015 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=38 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:33:31.422551 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:33:31.424987 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:33:31.431684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:33:31.432163 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:33:31.432596 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:33:31.433326 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:33:31.433776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:33:31.434197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:33:31.509363 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-31fab061-5eaa-4486-b240-bf929fd7e9cd tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action" status: 200 len: 24571 microversion: 2.1 time: 0.145019 Aug 21 02:33:31.509997 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4130/7605] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:33:31 2022] POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action => generated 24571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:34:01.944210 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:01.944979 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=36 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:01.949445 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:01.951791 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:01.960236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:01.960795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:01.961217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:01.961943 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:01.962399 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:01.962843 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:02.007103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:02.014253 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Old instance type m1.heat2, new instance type m1.heat {{(pid=122483) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 21 02:34:02.021973 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:34:02.022414 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:34:02.022906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:34:02.023333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:34:02.023757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:34:02.095645 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c5efac26-04e9-4748-9fb2-5cab68f8023b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action" status: 202 len: 0 microversion: 2.1 time: 0.153813 Aug 21 02:34:02.099492 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3476/7606] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:34:01 2022] POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:34:02.105534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:02.106235 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:02.109048 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:02.109699 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:02.116935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:02.117426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:02.117866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:02.118705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:02.119167 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:02.119589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:02.264057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:02.272496 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-40ec6292-6fd9-4ebb-9485-93b83d3f0ba4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1693 microversion: 2.1 time: 0.171413 Aug 21 02:34:02.273111 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4131/7607] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:02 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:03.296916 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:03.297558 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:03.304975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:03.306123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:03.306800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:03.307526 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:03.307994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:03.308436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:03.455656 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:03.465746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-873df553-be7b-491a-bd2a-7c507600cff1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1693 microversion: 2.1 time: 0.175234 Aug 21 02:34:03.466328 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3477/7608] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:03 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:04.488197 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:04.488847 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:04.497087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:04.497561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:04.497989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:04.498674 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:04.499123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:04.499567 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:04.714578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:04.724449 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cb08182a-f9b7-4fb8-ac42-7462c9e7f4d4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1693 microversion: 2.1 time: 0.240108 Aug 21 02:34:04.725082 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4132/7609] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:04 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:05.752127 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:05.752691 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:05.760986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:05.761549 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:05.762058 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:05.763237 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:05.763729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:05.764218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:05.898174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:05.906206 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e503409-6f10-4d4b-9df5-64a102328964 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.158856 Aug 21 02:34:05.906778 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3478/7610] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:05 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:06.931774 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:06.932689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:06.941560 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:06.942166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:06.942727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:06.943924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:06.944818 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:06.945392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:07.105437 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:07.117182 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f7d9385a-25f0-4bc5-99f0-6c4712f09fe5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.191734 Aug 21 02:34:07.117761 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4133/7611] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:06 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:08.144331 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:08.145337 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:08.156404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:08.157268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:08.157997 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:08.159150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:08.159912 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:08.160606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:08.328812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:08.337405 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-64ef4a7a-a716-497b-bf35-dbf3a6c6c351 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.200610 Aug 21 02:34:08.337953 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3479/7612] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:08 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:09.363134 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:09.364110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:09.371317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:09.371797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:09.372224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:09.372940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:09.373387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:09.373799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:09.523892 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:09.532107 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9d09ebd8-2b10-480b-a8dc-7e4b47a28ea0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.175735 Aug 21 02:34:09.532684 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4134/7613] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:09 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:10.553719 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:10.554409 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:10.561690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:10.562175 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:10.562598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:10.563317 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:10.563774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:10.564207 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:10.706215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:10.714740 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5b3b8630-4092-4f28-ab3a-710714bbb864 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.165121 Aug 21 02:34:10.715474 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3480/7614] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:10 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:11.740246 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:11.741716 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:11.753634 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:11.754422 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:11.755154 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:11.756452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:11.756969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:11.757392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:11.904431 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:11.913270 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dc641150-e45e-4692-b65a-427a732857d3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.179425 Aug 21 02:34:11.913832 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4135/7615] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:11 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:12.936936 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:12.937748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:12.947339 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:12.947995 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:12.948590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:12.949629 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:12.950244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:12.950822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:13.090534 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:13.098991 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1e6a62f7-c780-4d6b-a899-5d57d5e8c6b6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.167216 Aug 21 02:34:13.099809 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3481/7616] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:12 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:14.122637 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:14.123255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:14.131197 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:14.131771 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:14.132147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:14.132954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:14.133410 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:14.134291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:14.273848 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:14.282122 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d8acda5f-fc88-411e-840b-0bd07499b123 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.163852 Aug 21 02:34:14.282705 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4136/7617] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:14 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:15.305065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:15.305759 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:15.314325 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:15.314894 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:15.315412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:15.316228 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:15.316737 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:15.317334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:15.462017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:15.470159 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1fe127b3-23f3-4d1d-8dcd-1f7061f1ed6c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.169867 Aug 21 02:34:15.470738 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3482/7618] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:15 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:16.493689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:16.494349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:16.502010 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:16.502495 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:16.502928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:16.503624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:16.504072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:16.504503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:16.690323 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:16.698458 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7bfeedc5-f721-4a2a-9a51-e9e6d5a58a94 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1698 microversion: 2.1 time: 0.209789 Aug 21 02:34:16.699047 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4137/7619] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:16 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1698 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:17.312042 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "name": "network-vif-unplugged", "status": "completed", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:17.322895 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:17.323493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:17.323940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:17.336142 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Creating event network-vif-unplugged:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h1-master-1 Aug 21 02:34:17.342060 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] Instance fab89087-8948-4ccb-8c0c-831a671b2231 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122483) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:34:17.353431 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a8c81101-63be-4097-b775-4931f6bac18a req-4928639d-0d1c-4896-8dac-51f3156ab8ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045595 Aug 21 02:34:17.354048 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3483/7620] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:34:17.719767 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:17.720396 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:17.727782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:17.728399 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:17.728951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:17.730035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:17.730533 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:17.730969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:17.869608 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:17.877640 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2b298e5-bb6d-4669-a897-2dd715ae4697 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1697 microversion: 2.1 time: 0.161818 Aug 21 02:34:17.878209 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4138/7621] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:17 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:18.904659 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:18.905386 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:18.912202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:18.912694 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:18.913171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:18.913868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:18.914326 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:18.914753 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:19.060086 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:19.071751 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-014f36ba-6839-4e89-bbaf-3c8118fa955f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1695 microversion: 2.1 time: 0.173812 Aug 21 02:34:19.072554 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3484/7622] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:18 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:19.398064 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:19.409623 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:19.410100 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:19.410529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:19.422653 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Creating event network-changed:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h1-master-1 Aug 21 02:34:19.428644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] Instance fab89087-8948-4ccb-8c0c-831a671b2231 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=122482) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 21 02:34:19.439961 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ebf76c2c-63b5-4ad8-b7bc-eab5b9025e32 req-4866a01d-f8f7-494e-aa19-c4d5d8c78caf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046987 Aug 21 02:34:19.440564 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4139/7623] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:34:20.094748 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:20.095393 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:20.102857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.103356 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.103803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.104690 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.105160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.105619 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.328566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:20.339538 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-500a2ab1-3ae2-471a-b9fc-bfda44b33206 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1692 microversion: 2.1 time: 0.248376 Aug 21 02:34:20.354857 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3485/7624] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:20 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:20.365073 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:20.368660 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:20.386323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.387023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.387980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.388861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.389662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.390303 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.456241 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5d80ed65-05aa-428b-88f3-5cc16a7af2e6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action" status: 204 len: 0 microversion: 2.1 time: 0.099177 Aug 21 02:34:20.456963 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4140/7625] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:34:20 2022] POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 21 02:34:20.466705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:20.467355 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:20.474236 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.474778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.475258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.476080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.476583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.477164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.618067 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:20.628493 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d6072afd-15ac-4850-ab26-0f9098550f4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1692 microversion: 2.1 time: 0.167031 Aug 21 02:34:20.629106 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3486/7626] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:20 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:20.654008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:20.654715 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:20.661345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.661840 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.662285 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.662998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:20.663451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:20.663867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:20.918613 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:20.927426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4b5a6d77-34b4-431b-9b1e-7258c865aa1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1692 microversion: 2.1 time: 0.278477 Aug 21 02:34:20.928016 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4141/7627] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:20 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1692 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:21.950945 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:21.951599 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:21.958594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:21.959087 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:21.959540 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:21.960245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:21.960709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:21.961177 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:22.107320 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:22.120131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95e1f886-19a8-4099-8549-3c49a8d4107a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1692 microversion: 2.1 time: 0.173452 Aug 21 02:34:22.120970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3487/7628] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:21 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:22.874630 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "name": "network-vif-plugged", "status": "completed", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:22.891995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:22.892487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:22.892947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:22.906682 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] Creating event network-vif-plugged:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h1-master-1 Aug 21 02:34:22.913702 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-cfbeeefd-5510-489d-b07f-c9613fb5cae4 req-07bfef1b-bcc4-45d5-bb02-075278ace05a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043412 Aug 21 02:34:22.914918 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4142/7629] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:34:23.143952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:23.144583 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:23.152835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:23.153361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:23.153817 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:23.154539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:23.155007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:23.155443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:23.301323 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:23.309885 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6019c8a4-363d-4c89-89dd-0542d350e660 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1684 microversion: 2.1 time: 0.169962 Aug 21 02:34:23.310474 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3488/7630] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:23 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:45.513901 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:45.516183 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:45.518422 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=24 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:45.519072 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:45.524919 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:45.525432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:45.525868 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:45.526561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:45.527007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:45.527429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:45.595639 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b15035f7-bf4d-4c8b-9a35-b09b25c98b3a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action" status: 200 len: 24573 microversion: 2.1 time: 0.087426 Aug 21 02:34:45.596567 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4143/7631] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:34:45 2022] POST /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231/action => generated 24573 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:34:52.936014 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:52.936541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:52.938872 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=30 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:52.939547 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:34:52.945544 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:52.946040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:52.946623 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:52.947571 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:52.948153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:52.948588 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:52.979324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:34:52.996468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:53.008281 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:53.009208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:53.009730 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:53.022799 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] Creating event network-changed:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h1-master-1 Aug 21 02:34:53.029501 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7fc8901c-0393-47e7-a2ce-d151f4e7d830 req-80525595-7799-424d-8fef-96a0e1b6cb0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095575 Aug 21 02:34:53.030305 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4144/7632] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:34:53.071506 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86a602f3-2967-4f64-927b-966a6bfc7d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 204 len: 0 microversion: 2.1 time: 0.139728 Aug 21 02:34:53.072132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3489/7633] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:34:52 2022] DELETE /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:34:53.083324 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:53.084004 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:53.093436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:53.093942 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:53.094922 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:53.095135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:53.095595 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:53.096023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:53.237491 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:53.245409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5b9ab08c-f364-4eaa-8e02-671da63203f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1690 microversion: 2.1 time: 0.167707 Aug 21 02:34:53.246012 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4145/7634] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:53 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:54.269566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:54.270247 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:54.278030 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:54.278640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:54.279107 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:54.279818 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:54.280278 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:54.280708 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:54.490886 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:34:54.499154 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71a6d433-dcef-41eb-a372-ec78e5e7cb29 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 200 len: 1690 microversion: 2.1 time: 0.234009 Aug 21 02:34:54.499755 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3490/7635] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:54 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:34:55.045941 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab89087-8948-4ccb-8c0c-831a671b2231", "name": "network-vif-deleted", "tag": "b6fd9b21-af5c-4507-8ee9-de4229da0d99"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:55.056415 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:55.056927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:55.057347 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:55.070100 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] Creating event network-vif-deleted:b6fd9b21-af5c-4507-8ee9-de4229da0d99 for instance fab89087-8948-4ccb-8c0c-831a671b2231 on n-h1-master-1 Aug 21 02:34:55.075632 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-bf1dd43a-49b6-4fa3-99c0-0508c045fd7f req-e58fa6e4-b484-433d-8e76-80c4f8bebc85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Aug 21 02:34:55.076227 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4146/7636] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:34:55.521560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:55.522181 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: fab89087-8948-4ccb-8c0c-831a671b2231] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:34:55.529787 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:55.530276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:55.530719 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:55.531414 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:34:55.531868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:34:55.532297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:34:55.546467 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] HTTP exception thrown: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Request method failure captured: Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 HTTP/1.1 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZhKiVbJSNOg-wKy9IrhbsDDOKM2yhIHlExziZuE0iDt05gUAqcZKhN25YN90UnA1lJJjfUqj8ivY3g_ryu3FR-iK1eTvm9-H9l8HNFeQfCozBOfABJftjgdXc55JX5u6KPoMY9GapYyUsAkj2Wzjtf7oyNnfCBJR9_11AeqtTPX0-Q Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83cf02fdc1394f2db3f7628a4d28ec47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}] Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e49e5ba10abf48a9954f8b6725bb84a6 Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: exception: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'fab89087-8948-4ccb-8c0c-831a671b2231'} Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:34:55.548134 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Returning 404 to user: Instance fab89087-8948-4ccb-8c0c-831a671b2231 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-76dcef30-da72-457e-9e85-d8d9750d478a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231" status: 404 len: 111 microversion: 2.1 time: 0.032017 Aug 21 02:34:55.552248 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3491/7637] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:34:55 2022] GET /compute/v2.1/servers/fab89087-8948-4ccb-8c0c-831a671b2231 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:34:58.970707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-09ae4892-3424-47a3-b586-2a4e5d0f2e77 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '.version_select at 0x7fc3f95635e0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:34:58.997327 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-09ae4892-3424-47a3-b586-2a4e5d0f2e77 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1944612508" status: 202 len: 0 microversion: 2.1 time: 0.029790 Aug 21 02:34:58.997845 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4147/7638] 10.222.0.46 () {58 vars in 1284 bytes} [Sun Aug 21 02:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1944612508 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:34:59.026200 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1ac5d621-5334-493a-a30a-08e330e7d614 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: .version_select at 0x7fc3fd18c9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-916430752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiReRU7/jS7bgnsrL+BEuGIu0fJMGvATzYZfnyq0BnT8w3wztqF+Dzaz2/nakkaJ1YhxTBaKXKmrvpWR9cwEnMFnyrb+9rwML3/YawnLEov8M1WA9NNjGcdAAZ9+nPpgQ=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:34:59.046469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1ac5d621-5334-493a-a30a-08e330e7d614 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:34:59.052382 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-1ac5d621-5334-493a-a30a-08e330e7d614 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:34:59.086724 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1ac5d621-5334-493a-a30a-08e330e7d614 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065562 Aug 21 02:34:59.087433 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3492/7639] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:34:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:35:02.006202 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:35:02.006674 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:35:04.795009 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-974813960", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "38562431-0b92-4596-9e83-9f8890b97894"}], "key_name": "tempest-TestNetworkAdvancedServerOps-916430752", "security_groups": [{"name": "tempest-secgroup-smoke-1360818554"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:35:04.952740 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] validate_networks() for [('38562431-0b92-4596-9e83-9f8890b97894', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:35:05.063501 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=14 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:05.553842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:35:05.554758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:35:05.555730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:35:05.556338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:35:05.557116 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:35:05.570181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:05.571015 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:05.571662 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:05.572607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:05.573444 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:05.574072 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:05.596753 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:35:05.604512 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:35:05.621544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:35:05.624619 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:35:05.687119 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d737e1c8-070d-4418-928e-bc3b4b107528 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.896263 Aug 21 02:35:05.687934 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4148/7640] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:35:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:35:05.697252 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:05.702782 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-be9c67aa-bc63-413f-9c51-04dcb3fa9bc0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:05.703413 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-be9c67aa-bc63-413f-9c51-04dcb3fa9bc0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:05.764356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-be9c67aa-bc63-413f-9c51-04dcb3fa9bc0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:05.772277 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-be9c67aa-bc63-413f-9c51-04dcb3fa9bc0 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1265 microversion: 2.1 time: 0.076923 Aug 21 02:35:05.775734 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3493/7641] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:05 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:06.795353 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c20d1f93-305a-4bac-acdc-a6cab13a991c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:06.795976 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c20d1f93-305a-4bac-acdc-a6cab13a991c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:06.853256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c20d1f93-305a-4bac-acdc-a6cab13a991c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:06.862008 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c20d1f93-305a-4bac-acdc-a6cab13a991c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1265 microversion: 2.1 time: 0.070929 Aug 21 02:35:06.862712 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4149/7642] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:06 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:35:07.885595 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50bdda6b-e05b-4e00-adec-11a11076b5ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:07.886277 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50bdda6b-e05b-4e00-adec-11a11076b5ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:07.944456 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50bdda6b-e05b-4e00-adec-11a11076b5ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:07.951760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50bdda6b-e05b-4e00-adec-11a11076b5ab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1265 microversion: 2.1 time: 0.071397 Aug 21 02:35:07.952357 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3494/7643] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:07 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:08.971902 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6d1e38e2-0621-446e-bbce-e509c25dade7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:08.972575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6d1e38e2-0621-446e-bbce-e509c25dade7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:09.026623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6d1e38e2-0621-446e-bbce-e509c25dade7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:09.034042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6d1e38e2-0621-446e-bbce-e509c25dade7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1265 microversion: 2.1 time: 0.066010 Aug 21 02:35:09.034757 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4150/7644] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:08 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:10.058128 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:10.058738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:10.067557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:10.068085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:10.068538 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:10.069290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:10.069756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:10.070191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:10.141873 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:10.150043 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff6f43ea-3583-433e-9207-10e749302b4c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1269 microversion: 2.1 time: 0.098095 Aug 21 02:35:10.150865 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3495/7645] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:10 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:11.172079 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:11.172651 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:11.180967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:11.181445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:11.181873 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:11.182550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:11.182992 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:11.183419 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:11.265891 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:11.276008 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3f23c0bc-0127-4950-8774-7d1bf9ae18d2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1323 microversion: 2.1 time: 0.107729 Aug 21 02:35:11.277123 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4151/7646] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:11 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1323 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:12.303152 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:12.304252 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:12.310156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e037cdce-7210-4368-8a17-2f6a6d395836", "tag": "1c3e0795-f1b6-4eca-9e35-2139737b08cf"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:35:12.314625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:12.315768 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:12.316505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:12.317645 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:12.318609 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:12.319103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:12.322176 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:12.322718 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:12.323350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:12.338012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] Creating event network-changed:1c3e0795-f1b6-4eca-9e35-2139737b08cf for instance e037cdce-7210-4368-8a17-2f6a6d395836 on n-h2-master-1 Aug 21 02:35:12.344076 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e8fcfdb0-2664-4e67-aee6-1d7b8ff0c72c req-d6a7835a-ec9e-481d-80e3-7ac3605a7de1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038480 Aug 21 02:35:12.344839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4152/7647] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:35:12.457787 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:12.465704 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df87fe43-8db6-4b11-b23e-25caa923d262 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.167608 Aug 21 02:35:12.466254 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3496/7648] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:12 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:13.488411 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:13.489115 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:13.498589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:13.499479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:13.500289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:13.501587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:13.502403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:13.503039 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:13.648840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:13.656890 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2c205bb6-c45a-43ba-913c-3c332e99d97c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.173818 Aug 21 02:35:13.657858 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4153/7649] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:13 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:14.681901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:14.682907 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:14.692678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:14.693190 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:14.693660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:14.694361 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:14.694821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:14.695247 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:14.848686 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:14.857035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ee43ecf7-c1ba-4b69-8688-1a37d28fed55 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.181985 Aug 21 02:35:14.857622 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3497/7650] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:14 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:15.878163 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:15.882224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:15.882829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:15.884615 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:15.891124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:15.891578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:15.892321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:15.892704 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:15.893187 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:15.893606 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:16.036703 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:16.045426 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a204348a-00b1-4e15-a241-13a225206813 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.169296 Aug 21 02:35:16.046008 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4154/7651] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:15 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:17.067024 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:17.067669 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:17.075135 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:17.075622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:17.076064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:17.076798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:17.077279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:17.077728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:17.214721 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:17.223237 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f4a74c7a-ca42-42a0-b917-d50e990d1e17 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.160272 Aug 21 02:35:17.223837 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3498/7652] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:17 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:18.249212 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:18.250505 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:18.258403 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:18.258882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:18.259439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:18.260147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:18.260590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:18.261035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:18.405067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:18.413211 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fcb8019-1543-40ac-b576-b0127422cfdf tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.170755 Aug 21 02:35:18.413784 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4155/7653] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:18 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:18.797670 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e037cdce-7210-4368-8a17-2f6a6d395836", "name": "network-vif-plugged", "status": "completed", "tag": "1c3e0795-f1b6-4eca-9e35-2139737b08cf"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:35:18.803827 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:18.811966 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:18.812465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:18.812941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:18.825074 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] Creating event network-vif-plugged:1c3e0795-f1b6-4eca-9e35-2139737b08cf for instance e037cdce-7210-4368-8a17-2f6a6d395836 on n-h2-master-1 Aug 21 02:35:18.831474 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4a99cffd-c1ed-4865-a140-51174b6052e0 req-aa3ca593-7de4-4003-a6d1-55221050ce47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Aug 21 02:35:18.832475 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3499/7654] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:35:19.435695 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:19.436439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:19.438557 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:19.446664 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:19.447205 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:19.447693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:19.448461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:19.449004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:19.449481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:19.608307 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:19.616588 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3dfa2246-6b94-4131-b680-17262b606aab tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1391 microversion: 2.1 time: 0.185359 Aug 21 02:35:19.617190 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4156/7655] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:19 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:20.643775 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:20.645378 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:20.660106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:20.661011 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:20.661751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:20.662889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:20.663560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:20.664160 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:20.811603 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:20.819893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d221b405-4393-40c3-a5da-3b2775c7282c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1563 microversion: 2.1 time: 0.184160 Aug 21 02:35:20.820445 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3500/7656] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:20 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:20.840468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:20.841117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:20.848486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:20.849018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:20.849458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:20.850200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:20.850646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:20.851075 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:20.992837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:21.005284 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ceec7e76-ba28-4ba4-b229-87963fe73889 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1563 microversion: 2.1 time: 0.168261 Aug 21 02:35:21.006039 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4157/7657] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:20 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:22.959918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:35:22.960560 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:22.963458 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:22.969056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:22.969555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:22.969981 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:22.970922 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:22.971845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:22.971958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:23.024253 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e037cdce-7210-4368-8a17-2f6a6d395836", "tag": "1c3e0795-f1b6-4eca-9e35-2139737b08cf"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:35:23.035863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:23.036676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:23.037164 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:23.049599 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] Creating event network-changed:1c3e0795-f1b6-4eca-9e35-2139737b08cf for instance e037cdce-7210-4368-8a17-2f6a6d395836 on n-h2-master-1 Aug 21 02:35:23.055039 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-1558bd30-1ba2-46cc-a945-fff269d56e08 req-01814798-8b28-4749-9da9-82e1a32bb91e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090112 Aug 21 02:35:23.055903 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4158/7658] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:35:23.124262 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:35:23.143064 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c3c831b1-6a14-42c1-bc51-a7b60296ae4a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1563 microversion: 2.1 time: 0.186949 Aug 21 02:35:23.143661 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3501/7659] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:35:22 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:35:56.490396 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:56.491102 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=42 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:35:56.496600 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:35:56.498915 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:35:56.506057 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:56.506549 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:56.506976 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:56.507659 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:35:56.508084 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:35:56.508502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:35:56.581658 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-729e9141-5333-459a-b8d0-1810c82e1885 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action" status: 200 len: 24569 microversion: 2.1 time: 0.094082 Aug 21 02:35:56.582656 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4159/7660] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:35:56 2022] POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action => generated 24569 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:36:26.997949 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:26.999296 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=38 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:27.005500 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:36:27.017611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:27.018475 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:27.018938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:27.042310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Going to try to stop instance {{(pid=122483) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 21 02:36:27.091772 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8895cb7b-b9e2-44c0-8731-f492358e8cc2 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action" status: 202 len: 0 microversion: 2.1 time: 0.097040 Aug 21 02:36:27.092609 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3502/7661] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:36:26 2022] POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:36:27.101996 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:27.102691 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:27.105245 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:27.105911 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:36:27.111515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:27.112123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:27.112715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:27.113443 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:27.113935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:27.114360 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:27.253364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:27.261909 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a7849f91-ffd6-4300-9a69-d9f57dde56e7 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.164362 Aug 21 02:36:27.262484 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4160/7662] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:27 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:28.289256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:28.290544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:28.301642 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:28.302142 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:28.302599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:28.303350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:28.303810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:28.304248 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:28.534589 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:28.542913 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b8a04abe-044f-48f7-af8c-0a26d56910f6 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.261466 Aug 21 02:36:28.543487 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3503/7663] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:28 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:29.567785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:29.568449 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:29.576666 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:29.577235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:29.577716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:29.578486 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:29.578990 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:29.579463 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:29.766730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:29.775414 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1c98e150-36dc-44b1-a945-137fe98af62e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.213617 Aug 21 02:36:29.775993 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4161/7664] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:29 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:30.800310 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:30.800998 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:30.808411 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:30.808940 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:30.809393 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:30.810106 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:30.810596 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:30.811035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:30.951054 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:30.963553 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c40f3b49-ca00-4b4c-a43e-d8a9a3f59a4d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.169362 Aug 21 02:36:30.964476 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3504/7665] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:30 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:31.990575 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:31.991201 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:31.998524 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:31.999002 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:31.999426 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:32.000135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:32.000579 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:32.001025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:32.137168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:32.146613 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b3147756-9477-4519-8910-c027f763c3b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.160954 Aug 21 02:36:32.147218 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4162/7666] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:31 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:33.168470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:33.169129 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:33.176368 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:33.176915 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:33.177365 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:33.178062 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:33.178527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:33.178958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:33.321650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:33.333658 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3df2ba0c-9aa3-4baa-a930-d0ff0367657c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.168827 Aug 21 02:36:33.334404 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3505/7667] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:33 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:34.355763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:34.356376 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:34.364025 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:34.364478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:34.364961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:34.365651 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:34.366096 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:34.366511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:34.505156 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:34.513984 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9096a4e0-c244-4f16-8786-7beae631de60 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.162340 Aug 21 02:36:34.514560 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4163/7668] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:34 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:35.537924 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:35.538520 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:35.546669 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:35.547210 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:35.547698 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:35.548497 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:35.549028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:35.549756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:35.701566 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:35.710358 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-9bb978f0-eb71-47f3-9d95-781167c2c04a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.177328 Aug 21 02:36:35.710869 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3506/7669] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:35 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:36.734508 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:36.735216 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:36.743345 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:36.743831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:36.744306 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:36.745043 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:36.745492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:36.745912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:36.889364 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:36.897671 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b78fc18-50fb-497a-852c-5ee2c6c5bda9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1692 microversion: 2.1 time: 0.167917 Aug 21 02:36:36.898230 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4164/7670] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:36 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:37.926457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:37.927459 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:37.938630 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:37.939453 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:37.940406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:37.941659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:37.941983 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:37.942455 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:38.097318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:38.109221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-adb3f48e-b237-4662-9e58-34f57622eab8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1669 microversion: 2.1 time: 0.189579 Aug 21 02:36:38.109956 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3507/7671] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:37 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:39.212692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:36:39.216110 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:39.225060 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:39.225546 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:39.225981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:39.226685 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:39.227137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:39.227575 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:39.291842 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e4b1dc5-589e-48b1-aad3-6526d51a75f8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action" status: 200 len: 37021 microversion: 2.1 time: 0.085119 Aug 21 02:36:39.292654 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4165/7672] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:36:39 2022] POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action => generated 37021 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:36:39.305765 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:36:39.313161 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:39.313652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:39.314093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:39.338777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Going to try to start instance {{(pid=122483) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 21 02:36:39.388520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8f2a012e-4c80-4800-b0d9-b5be3d5d9c0b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action" status: 202 len: 0 microversion: 2.1 time: 0.086682 Aug 21 02:36:39.389162 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3508/7673] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:36:39 2022] POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:36:39.398525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:39.399140 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:39.406471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:39.407017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:39.407454 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:39.408165 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:39.408637 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:39.409214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:39.595544 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:39.604238 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-adc4573c-12df-4cea-ab85-7a6a2511acf1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1678 microversion: 2.1 time: 0.210056 Aug 21 02:36:39.604806 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4166/7674] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:39 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:40.630248 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:40.631025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:40.638293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:40.638786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:40.639233 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:40.639941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:40.640407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:40.640866 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:40.794329 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:40.803197 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-455fbdd2-c604-4182-bb05-d83dfe82cbde tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1678 microversion: 2.1 time: 0.179889 Aug 21 02:36:40.803770 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3509/7675] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:40 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:36:41.833358 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:36:41.833950 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:36:41.841597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:41.842086 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:41.842544 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:41.843225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:36:41.843676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:36:41.844099 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:36:41.986010 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:36:41.994708 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-677cfabc-28bb-4305-9173-bb8b13a12d0a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1682 microversion: 2.1 time: 0.167732 Aug 21 02:36:41.995288 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4167/7676] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:36:41 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:14.252652 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:14.254992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:14.257413 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=16 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:14.258070 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:14.265136 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:14.265626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:14.266077 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:14.266784 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:14.267239 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:14.267663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:14.340539 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-04da1bae-48aa-48a8-a1eb-9c0ea010f6ee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action" status: 200 len: 61587 microversion: 2.1 time: 0.091855 Aug 21 02:37:14.341322 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3510/7677] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:37:14 2022] POST /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836/action => generated 61587 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:37:31.464539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:31.465127 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:31.467819 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=16 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:31.467992 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e037cdce-7210-4368-8a17-2f6a6d395836", "tag": "1c3e0795-f1b6-4eca-9e35-2139737b08cf"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:31.469004 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=46 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:31.475338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:31.475837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:31.476258 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:31.477056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:31.477500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:31.477911 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:31.480387 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:31.481170 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:31.483825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:31.484449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:31.485192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:31.501180 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] Creating event network-changed:1c3e0795-f1b6-4eca-9e35-2139737b08cf for instance e037cdce-7210-4368-8a17-2f6a6d395836 on n-h2-master-1 Aug 21 02:37:31.506765 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-4a6684ac-e4c8-485d-a690-144e1cdd7004 req-eb17bccd-d4d8-4bb1-b504-d24a1fa8bfe9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043928 Aug 21 02:37:31.507848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3511/7678] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:31.508178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:37:31.593076 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24ab4959-a9f2-4def-88c1-b33cac61e7c8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 204 len: 0 microversion: 2.1 time: 0.132636 Aug 21 02:37:31.597152 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4168/7679] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:37:31 2022] DELETE /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:37:31.603932 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:31.604819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:31.612007 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:31.612594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:31.613146 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:31.613938 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:31.614512 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:31.615070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:31.760158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:31.768385 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-674502f3-e565-49f5-96ec-40bf10c8f407 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1688 microversion: 2.1 time: 0.169403 Aug 21 02:37:31.769137 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3512/7680] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:31 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:32.791786 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:32.792521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:32.800031 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:32.800515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:32.800995 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:32.801690 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:32.802107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:32.802557 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:33.043178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:33.053007 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-12d6d2fc-bd9a-4855-90de-9d25e76797b1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1688 microversion: 2.1 time: 0.265323 Aug 21 02:37:33.053313 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4169/7681] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:32 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:33.843251 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e037cdce-7210-4368-8a17-2f6a6d395836", "name": "network-vif-deleted", "tag": "1c3e0795-f1b6-4eca-9e35-2139737b08cf"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:33.853686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:33.854166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:33.854595 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:33.866387 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] Creating event network-vif-deleted:1c3e0795-f1b6-4eca-9e35-2139737b08cf for instance e037cdce-7210-4368-8a17-2f6a6d395836 on n-h2-master-1 Aug 21 02:37:33.871639 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-dafd9edd-cea5-40fe-81a2-05be9cf4de6e req-2da507c7-74c3-4ebd-bd67-40a4ea7a0bfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 Aug 21 02:37:33.872314 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3513/7682] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:34.076840 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:34.077419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:34.084924 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:34.085406 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:34.085843 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:34.086528 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:34.086974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:34.087394 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:34.119573 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:34.120071 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:34.120500 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:34.120986 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lazy-loading 'fault' on Instance uuid e037cdce-7210-4368-8a17-2f6a6d395836 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:37:34.169599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:34.178247 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-ac5d6459-b0c4-4948-be7a-6a6145ebb612 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 200 len: 1355 microversion: 2.1 time: 0.106359 Aug 21 02:37:34.178839 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4170/7683] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:34 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:35.206274 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:35.207288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: e037cdce-7210-4368-8a17-2f6a6d395836] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:35.218202 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:35.218835 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:35.219276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:35.219965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:35.220421 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:35.220871 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:35.234617 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] HTTP exception thrown: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Request method failure captured: Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 HTTP/1.1 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZhKiVbJSNOg-wKy9IrhbsDDOKM2yhIHlExziZuE0iDt05gUAqcZKhN25YN90UnA1lJJjfUqj8ivY3g_ryu3FR-iK1eTvm9-H9l8HNFeQfCozBOfABJftjgdXc55JX5u6KPoMY9GapYyUsAkj2Wzjtf7oyNnfCBJR9_11AeqtTPX0-Q Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83cf02fdc1394f2db3f7628a4d28ec47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}] Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e49e5ba10abf48a9954f8b6725bb84a6 Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e037cdce-7210-4368-8a17-2f6a6d395836'} Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:37:35.236287 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Returning 404 to user: Instance e037cdce-7210-4368-8a17-2f6a6d395836 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-70d04e07-ea79-44f6-931f-6ef36824b6f9 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836" status: 404 len: 111 microversion: 2.1 time: 0.040271 Aug 21 02:37:35.241233 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3514/7684] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:35 2022] GET /compute/v2.1/servers/e037cdce-7210-4368-8a17-2f6a6d395836 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:37:38.319060 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-19e45a2f-6008-496a-8676-3e37f5a7fe6a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '.version_select at 0x7fc3f8a348b0>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:38.343684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-19e45a2f-6008-496a-8676-3e37f5a7fe6a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-916430752" status: 202 len: 0 microversion: 2.1 time: 0.028349 Aug 21 02:37:38.344273 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4171/7685] 10.222.0.46 () {58 vars in 1281 bytes} [Sun Aug 21 02:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-916430752 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:37:38.375641 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4949a6b8-f409-4f2f-a17f-6c3b10889855 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: .version_select at 0x7fc3fdefc0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1161829529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKjIKDuP3XjS35bSDq93kQMy4NFQNypYoWN3Qv1smuKZuqaGXfPJ8M8pMRwm2cleZHnVMDNfYDhYdfPwGy+U7ZBJ26czDAjjlhQeMvZaRppBc0qeBTlTvZI/8CVWTekBA=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:38.392962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4949a6b8-f409-4f2f-a17f-6c3b10889855 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:37:38.399431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-4949a6b8-f409-4f2f-a17f-6c3b10889855 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:37:38.426856 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4949a6b8-f409-4f2f-a17f-6c3b10889855 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057572 Aug 21 02:37:38.427656 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3515/7686] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:37:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:44.406395 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:44.417438 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-260823923", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "networks": [{"uuid": "79573740-ff9a-4deb-8706-6f33cc748a17"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1161829529", "security_groups": [{"name": "tempest-secgroup-smoke-167457986"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:44.533644 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] validate_networks() for [('79573740-ff9a-4deb-8706-6f33cc748a17', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:37:44.927231 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:37:44.927775 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:37:44.928289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:37:44.928670 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:37:44.929113 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:37:44.938578 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:44.939055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:44.939481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:44.940323 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:44.940803 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:44.941225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:44.963051 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:37:44.968559 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Getting quotas for user e49e5ba10abf48a9954f8b6725bb84a6 and project 83cf02fdc1394f2db3f7628a4d28ec47. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:37:44.981258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:37:44.983836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:37:45.032464 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-cd3b3d7e-9465-421c-8da0-bb6b64208103 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.628241 Aug 21 02:37:45.033356 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4172/7687] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:37:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:37:45.045020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-33743079-4145-419a-a714-45f946b0c01e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:45.046510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-33743079-4145-419a-a714-45f946b0c01e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:45.113632 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-33743079-4145-419a-a714-45f946b0c01e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:45.122131 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-33743079-4145-419a-a714-45f946b0c01e tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1266 microversion: 2.1 time: 0.081454 Aug 21 02:37:45.123098 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3516/7688] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:45 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:46.147832 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:46.149042 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:46.159044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:46.159738 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:46.161014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:46.163941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:46.164440 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:46.164910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:46.265696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:46.274287 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3523a7e8-4227-4ed5-b7fd-0cd3b79c370a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1326 microversion: 2.1 time: 0.133074 Aug 21 02:37:46.274872 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4173/7689] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:46 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:47.297826 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:47.299051 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:47.302419 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:47.310591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:47.311342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:47.311979 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:47.312757 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:47.313231 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:47.313661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:47.568756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:47.576630 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-52a74a72-65a2-4c34-a96b-8f2a43eb97c3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.283160 Aug 21 02:37:47.577279 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3517/7690] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:47 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:47.725147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef45525-0115-41df-910a-efc3a5843dd1", "tag": "dcd7aa8a-2598-446e-af50-1224e1eb6b0a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:47.742861 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:47.743706 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:47.744371 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:47.756752 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] Creating event network-changed:dcd7aa8a-2598-446e-af50-1224e1eb6b0a for instance 1ef45525-0115-41df-910a-efc3a5843dd1 on n-h2-master-1 Aug 21 02:37:47.763841 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ce7bb1d2-e05f-4c28-b042-3d05a1181e79 req-a3295c42-5123-4767-89e7-abab84a4022f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044467 Aug 21 02:37:47.765582 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4174/7691] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:48.601172 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:48.602069 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:48.611714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:48.612245 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:48.612821 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:48.613716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:48.614321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:48.614864 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:48.764952 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:48.776649 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b197cc05-9550-4a2a-8787-e98fddfb857b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.180413 Aug 21 02:37:48.777496 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3518/7692] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:48 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:49.803170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:49.803998 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:49.813007 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:49.813586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:49.814423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:49.815632 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:49.816175 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:49.816682 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:49.980850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:49.992987 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-be74f610-fbfb-4bee-9620-e40796cbbf4f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.195242 Aug 21 02:37:49.993794 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4175/7693] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:49 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:51.022142 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:51.023217 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:51.034663 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:51.035151 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:51.035592 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:51.036291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:51.036748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:51.037182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:51.173325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:51.182967 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f7bf0464-1994-4715-995d-3705a7425281 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.167888 Aug 21 02:37:51.183524 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3519/7694] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:51 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:52.203727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:52.204370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:52.211822 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:52.212297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:52.212735 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:52.213464 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:52.213966 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:52.214335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:52.350773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:52.362912 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e3172446-784a-4043-96bd-43df8fccde5a tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.162716 Aug 21 02:37:52.364386 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4176/7695] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:52 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:53.393484 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:53.394313 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:53.401752 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:53.402268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:53.402695 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:53.403403 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:53.403857 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:53.404286 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:53.538956 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:53.547446 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-65fc87b9-49bf-45f8-afde-aa8a4b1d7182 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.160051 Aug 21 02:37:53.548308 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3520/7696] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:53 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:53.552443 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef45525-0115-41df-910a-efc3a5843dd1", "name": "network-vif-plugged", "status": "completed", "tag": "dcd7aa8a-2598-446e-af50-1224e1eb6b0a"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:53.567700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:53.568256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:53.568747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:53.580544 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] Creating event network-vif-plugged:dcd7aa8a-2598-446e-af50-1224e1eb6b0a for instance 1ef45525-0115-41df-910a-efc3a5843dd1 on n-h2-master-1 Aug 21 02:37:53.585891 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-ed71ad72-e600-4c4a-b2ff-5f1c8949a5f6 req-9a4d657e-d177-49b5-b0d7-a31aa17a77de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038494 Aug 21 02:37:53.586481 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4177/7697] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:54.570259 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:54.571022 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:54.579111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:54.579605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:54.580050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:54.580785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:54.581310 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:54.581748 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:54.734600 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:54.745754 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a76da691-f1af-44b3-b876-5b684abbcc8b tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1391 microversion: 2.1 time: 0.180062 Aug 21 02:37:54.746506 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3521/7698] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:54 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:55.768561 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:55.769531 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=6 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:55.774318 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:55.775068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:55.783530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:55.784117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:55.784899 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:55.785707 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:55.786221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:55.786785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:55.929085 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:55.941546 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0c98d6b8-912a-47b3-8fed-57a5efc352aa tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1563 microversion: 2.1 time: 0.175231 Aug 21 02:37:55.942123 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4178/7699] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:55 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:55.972796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:55.973434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:55.975467 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=6 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:37:55.982083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:55.982564 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:55.983009 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:55.983717 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:55.984180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:55.984611 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:56.138772 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:56.149561 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c88712ec-2363-4db8-b055-c1487d8daaf4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1563 microversion: 2.1 time: 0.182558 Aug 21 02:37:56.150352 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3522/7700] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:55 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:37:57.772047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:37:57.772681 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:37:57.774397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef45525-0115-41df-910a-efc3a5843dd1", "tag": "dcd7aa8a-2598-446e-af50-1224e1eb6b0a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:37:57.780160 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:57.780725 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:57.781465 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:57.782248 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:57.782775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:57.783291 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:57.785366 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:37:57.785850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:37:57.786478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:37:57.797742 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] Creating event network-changed:dcd7aa8a-2598-446e-af50-1224e1eb6b0a for instance 1ef45525-0115-41df-910a-efc3a5843dd1 on n-h2-master-1 Aug 21 02:37:57.803140 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8a8eb917-6106-4d06-b187-6afd50300f6f req-629981b6-5a3e-4fe7-8046-844adc40e387 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032631 Aug 21 02:37:57.803975 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3523/7701] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:37:57.940191 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:37:57.948519 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e19386a-366f-4f72-8f56-db1e0acc0248 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1563 microversion: 2.1 time: 0.180494 Aug 21 02:37:57.960733 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4179/7702] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:37:57 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:38:29.281235 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:38:29.283581 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:38:29.286830 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:38:29.287494 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=38 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:38:29.294320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:38:29.294815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:38:29.295261 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:38:29.295992 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:38:29.296449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:38:29.296893 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:38:29.366520 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-77cae95e-e713-493b-8a51-f86474148061 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action" status: 200 len: 24571 microversion: 2.1 time: 0.090265 Aug 21 02:38:29.367158 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3524/7703] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:38:29 2022] POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:38:59.761571 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:38:59.762599 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=36 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:00.003973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:00.004538 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:00.011692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:00.012097 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:00.012520 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:00.013237 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:00.013677 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:00.014089 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:00.037357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lazy-loading 'flavor' on Instance uuid 1ef45525-0115-41df-910a-efc3a5843dd1 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:39:00.112123 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7b895ffe-d129-42a1-a079-7f1c7d98a934 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.353666 Aug 21 02:39:00.112756 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4180/7704] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:38:59 2022] POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:39:00.121962 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:00.123156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:00.125633 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:00.126298 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=4 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:00.133217 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:00.134088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:00.134533 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:00.135246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:00.135716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:00.136154 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:00.287637 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:00.300760 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f261e4a5-8ed9-4da7-bee1-69fbf3475da3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1689 microversion: 2.1 time: 0.182800 Aug 21 02:39:00.301721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3525/7705] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:00 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:01.323957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:01.324705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:01.331338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:01.331846 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:01.332401 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:01.333148 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:01.333755 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:01.334184 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:01.476900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:01.484937 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9af637d0-c406-4847-8e0d-4540357199b4 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1689 microversion: 2.1 time: 0.166351 Aug 21 02:39:01.485503 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4181/7706] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:01 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:02.514154 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:02.515125 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:02.523848 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:02.524338 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:02.524809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:02.525503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:02.525954 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:02.526383 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:02.664728 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:02.676140 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-60a8e639-e381-4071-96ff-8974a812e02f tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1672 microversion: 2.1 time: 0.170479 Aug 21 02:39:02.677088 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3526/7707] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:02 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:03.779918 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:03.783001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:03.791275 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.791760 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.792169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:03.792935 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.793391 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.793819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:03.858375 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db61bc00-a78e-4d2a-8ea7-1b2b07ecbbd3 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action" status: 200 len: 35726 microversion: 2.1 time: 0.083157 Aug 21 02:39:03.859151 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4182/7708] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:39:03 2022] POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action => generated 35726 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:39:03.872927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:03.873462 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:03.881242 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.881743 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.882192 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:03.882906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.883372 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.884149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:03.962028 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1afc25c8-7baa-4dd0-a246-ce6f1bcdae73 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action" status: 202 len: 0 microversion: 2.1 time: 0.092990 Aug 21 02:39:03.962690 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3527/7709] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:39:03 2022] POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:39:03.971633 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:03.972581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:03.979723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.980211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.980644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:03.981449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:03.981940 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:03.983090 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:04.122809 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:04.136584 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-aaa9b025-0c34-4f3a-b2c2-324b090391ba tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1678 microversion: 2.1 time: 0.169075 Aug 21 02:39:04.137457 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4183/7710] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:03 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:05.163715 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:05.164411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:05.171213 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:05.171720 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:05.172162 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:05.172904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:05.173350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:05.173773 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:05.326628 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:05.338868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-98058423-5e6b-4823-9751-72ec3b799bb5 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1678 microversion: 2.1 time: 0.182210 Aug 21 02:39:05.339572 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3528/7711] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:05 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:06.365112 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:06.365718 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:06.373739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:06.374221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:06.374658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:06.375350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:06.375804 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:06.376224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:06.518693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:06.530237 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-702131a9-407a-49a1-9599-c9b823f52eb8 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1681 microversion: 2.1 time: 0.171509 Aug 21 02:39:06.531041 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4184/7712] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:06 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:06.645819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:06.648327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:06.658754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:06.659402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:06.660044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:06.661166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:06.662184 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:06.662599 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:06.740151 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-130fbdd9-5160-4fc6-b9f7-8d32e3e8faee tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action" status: 200 len: 35726 microversion: 2.1 time: 0.097995 Aug 21 02:39:06.741266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3529/7713] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:39:06 2022] POST /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1/action => generated 35726 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 21 02:39:07.827808 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:07.828330 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:07.830369 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef45525-0115-41df-910a-efc3a5843dd1", "tag": "dcd7aa8a-2598-446e-af50-1224e1eb6b0a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:07.836593 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:07.837467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:07.837973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:07.839044 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:07.839547 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:07.840288 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:07.841344 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:07.841827 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:07.842469 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:07.854689 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] Creating event network-changed:dcd7aa8a-2598-446e-af50-1224e1eb6b0a for instance 1ef45525-0115-41df-910a-efc3a5843dd1 on n-h2-master-1 Aug 21 02:39:07.859786 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-272fd675-ea36-4d69-aa0c-70568eaf5b5b req-85ba1db7-07c5-4d38-8f43-488f5c92a226 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033573 Aug 21 02:39:07.860389 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3530/7714] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:39:07.871749 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:39:07.959174 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e92bef4f-006b-4877-82f0-326d6fb1d678 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 204 len: 0 microversion: 2.1 time: 0.134878 Aug 21 02:39:07.959831 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4185/7715] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:39:07 2022] DELETE /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:39:07.969316 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:07.970065 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:07.976729 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:07.977253 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:07.977702 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:07.978444 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:07.978907 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:07.979343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:08.119085 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:08.127098 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1a543e7e-e167-45e8-97de-d81fa2fbb09d tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1687 microversion: 2.1 time: 0.162601 Aug 21 02:39:08.127684 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3531/7716] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:07 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:09.152868 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:09.153599 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:09.162903 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:09.163389 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:09.163829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:09.164531 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:09.165029 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:09.165439 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:09.304118 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:09.312419 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-66ece3c1-b52d-411a-9673-2176dc1c3a0c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1687 microversion: 2.1 time: 0.163992 Aug 21 02:39:09.313050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4186/7717] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:09 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:10.217819 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef45525-0115-41df-910a-efc3a5843dd1", "name": "network-vif-deleted", "tag": "dcd7aa8a-2598-446e-af50-1224e1eb6b0a"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:10.229091 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:10.229585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:10.230023 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:10.242289 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] Creating event network-vif-deleted:dcd7aa8a-2598-446e-af50-1224e1eb6b0a for instance 1ef45525-0115-41df-910a-efc3a5843dd1 on n-h2-master-1 Aug 21 02:39:10.248073 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-802d438c-2267-459c-9690-f70abbb17a9b req-c39c78fe-bf59-4fab-84e8-16bc2125871d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Aug 21 02:39:10.249064 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3532/7718] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:39:10.335705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:10.336286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:10.344616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:10.345308 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:10.345801 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:10.346505 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:10.346967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:10.347398 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:10.381959 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:10.382450 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:10.383066 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:10.384087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lazy-loading 'fault' on Instance uuid 1ef45525-0115-41df-910a-efc3a5843dd1 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:39:10.428428 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49e5ba10abf48a9954f8b6725bb84a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83cf02fdc1394f2db3f7628a4d28ec47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:10.439833 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e2bd391-1a1b-439d-8262-19b596193680 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 200 len: 1356 microversion: 2.1 time: 0.108223 Aug 21 02:39:10.440483 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4187/7719] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:10 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:11.463723 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:11.464342 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] [instance: 1ef45525-0115-41df-910a-efc3a5843dd1] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:11.471051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:11.471546 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:11.471988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:11.472693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:11.473244 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:11.473632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:11.488045 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] HTTP exception thrown: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Request method failure captured: Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 HTTP/1.1 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZhKiVbJSNOg-wKy9IrhbsDDOKM2yhIHlExziZuE0iDt05gUAqcZKhN25YN90UnA1lJJjfUqj8ivY3g_ryu3FR-iK1eTvm9-H9l8HNFeQfCozBOfABJftjgdXc55JX5u6KPoMY9GapYyUsAkj2Wzjtf7oyNnfCBJR9_11AeqtTPX0-Q Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_83cf02fdc1394f2db3f7628a4d28ec47", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/83cf02fdc1394f2db3f7628a4d28ec47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/83cf02fdc1394f2db3f7628a4d28ec47"}]}] Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 83cf02fdc1394f2db3f7628a4d28ec47 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-629836878 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: e49e5ba10abf48a9954f8b6725bb84a6 Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestNetworkAdvancedServerOps-629836878-project Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: exception: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': '1ef45525-0115-41df-910a-efc3a5843dd1'} Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:39:11.489737 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Returning 404 to user: Instance 1ef45525-0115-41df-910a-efc3a5843dd1 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b42a678-a86a-4a0a-880e-97d78f338f1c tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1" status: 404 len: 111 microversion: 2.1 time: 0.033340 Aug 21 02:39:11.494110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3533/7720] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:11 2022] GET /compute/v2.1/servers/1ef45525-0115-41df-910a-efc3a5843dd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:39:14.943689 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-160ee4e8-4f21-4840-a7ae-88da7b5564c1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] Calling method '.version_select at 0x7fc3f88cd670>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:14.969451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-160ee4e8-4f21-4840-a7ae-88da7b5564c1 tempest-TestNetworkAdvancedServerOps-629836878 tempest-TestNetworkAdvancedServerOps-629836878-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1161829529" status: 202 len: 0 microversion: 2.1 time: 0.029809 Aug 21 02:39:14.970012 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4188/7721] 10.222.0.46 () {58 vars in 1284 bytes} [Sun Aug 21 02:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1161829529 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:39:26.043212 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=18 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:26.044334 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:26.228707 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d075cf4-bffa-4bab-9ee4-7153e7d48c56 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'create', calling method: .version_select at 0x7fc403102d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1092051141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqtAHjBH5saYCydCWlEUL0P/hmKXQzOrUinD9p8dnpHkcAedqfoBJMFw+qeN1f6/9y3DdFROC/BzQ229TQfxeg3gzF7sga0DSyxCtEVWOa93GHxTwLYjltFjJF24jFXog=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:26.245949 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0d075cf4-bffa-4bab-9ee4-7153e7d48c56 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for project 5e5295ac46034f46b4781ed5d0374912. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:39:26.252330 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-0d075cf4-bffa-4bab-9ee4-7153e7d48c56 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for user 89156176073c4a8b960c14e55528d7a9 and project 5e5295ac46034f46b4781ed5d0374912. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:39:26.282590 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d075cf4-bffa-4bab-9ee4-7153e7d48c56 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.245222 Aug 21 02:39:26.283362 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3534/7722] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:39:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:39:27.437527 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:27.443062 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:27.451417 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1712393250", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1092051141", "security_groups": [{"name": "tempest-secgroup-smoke-1272633309"}], "networks": [{"uuid": "8350431c-bb29-4fad-8b70-bd749f8ec3e5"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:27.573584 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] validate_networks() for [('8350431c-bb29-4fad-8b70-bd749f8ec3e5', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:39:27.960569 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:39:27.961226 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:39:27.961552 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:39:27.961947 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:39:27.962356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:39:27.971998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:27.972481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:27.972969 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:27.973727 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:27.974182 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:27.974626 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:27.992624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for project 5e5295ac46034f46b4781ed5d0374912. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:39:27.998239 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for user 89156176073c4a8b960c14e55528d7a9 and project 5e5295ac46034f46b4781ed5d0374912. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:39:28.011744 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:39:28.014143 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:39:28.064037 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2359c39-6b7c-4e11-a9a0-c352c427ebe8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.629478 Aug 21 02:39:28.064892 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4189/7723] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:39:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:39:28.076679 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-530825f9-3118-456a-96cb-3b6da52ae00a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:28.078147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-530825f9-3118-456a-96cb-3b6da52ae00a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:28.133789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-530825f9-3118-456a-96cb-3b6da52ae00a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:28.141622 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-530825f9-3118-456a-96cb-3b6da52ae00a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1247 microversion: 2.1 time: 0.069759 Aug 21 02:39:28.142218 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3535/7724] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:28 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:29.163886 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-6b24e021-21f8-44ea-b30d-b3b39d6db6af tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:29.165205 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-6b24e021-21f8-44ea-b30d-b3b39d6db6af tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:29.233977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-6b24e021-21f8-44ea-b30d-b3b39d6db6af tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:29.241193 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-6b24e021-21f8-44ea-b30d-b3b39d6db6af tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1247 microversion: 2.1 time: 0.082185 Aug 21 02:39:29.241771 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4190/7725] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:29 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:30.262735 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d42d71b1-7def-43b4-aa54-41b44306068e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:30.263593 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d42d71b1-7def-43b4-aa54-41b44306068e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:30.319953 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-d42d71b1-7def-43b4-aa54-41b44306068e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:30.327254 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d42d71b1-7def-43b4-aa54-41b44306068e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1247 microversion: 2.1 time: 0.068990 Aug 21 02:39:30.328028 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3536/7726] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:30 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1247 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:31.348880 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7d7c2d88-ff79-4f4b-9c1e-ac26a4468b3c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:31.349525 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7d7c2d88-ff79-4f4b-9c1e-ac26a4468b3c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:31.412043 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7d7c2d88-ff79-4f4b-9c1e-ac26a4468b3c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:31.419483 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7d7c2d88-ff79-4f4b-9c1e-ac26a4468b3c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1247 microversion: 2.1 time: 0.074637 Aug 21 02:39:31.420020 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4191/7727] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:31 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:32.443276 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:32.444007 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:32.451962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:32.452514 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:32.453044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:32.453829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:32.454341 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:32.454819 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:32.522862 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:32.531389 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5f3f7801-fa11-40cd-8493-6e0a77e903f6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1251 microversion: 2.1 time: 0.092643 Aug 21 02:39:32.531965 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3537/7728] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:32 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1251 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:33.552969 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:33.553581 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:33.561494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:33.561981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:33.562416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:33.563113 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:33.563565 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:33.563996 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:33.997798 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:34.006025 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-deaeabff-0f88-496a-a45d-e5e929b59fa6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1305 microversion: 2.1 time: 0.457011 Aug 21 02:39:34.006580 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4192/7729] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:33 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1305 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:34.970846 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:34.982591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:34.983224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:34.983771 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:34.996175 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] Creating event network-changed:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:39:35.001369 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8252c502-5c4e-4cdf-a309-cbea504ae637 req-9a707f95-4520-4e81-9df1-2539ac3966fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034386 Aug 21 02:39:35.001986 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3538/7730] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:39:35.028534 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:35.029224 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:35.036858 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:35.037269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:35.037703 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:35.038452 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:35.038955 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:35.039388 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:35.274008 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:35.284442 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f9114da9-6408-44e2-9b4a-93006e03fb96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.260678 Aug 21 02:39:35.285053 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4193/7731] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:35 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:36.311434 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:36.312514 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:36.322386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:36.323285 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:36.324012 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:36.325250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:36.325726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:36.326168 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:36.474827 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:36.483983 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-50b21b6e-4c41-4d15-bc9e-1df6c21bc835 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.180568 Aug 21 02:39:36.484564 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3539/7732] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:36 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:37.505153 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:37.505761 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:37.513729 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:37.514185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:37.514625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:37.515330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:37.515785 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:37.516211 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:37.770386 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:37.778925 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-24380b55-3698-4d4c-9732-68d400f5e491 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.277761 Aug 21 02:39:37.779517 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4194/7733] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:37 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:38.805572 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:38.806605 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:38.813300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:38.813800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:38.814246 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:38.814950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:38.815416 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:38.815838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:38.965662 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:38.973556 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c09978d9-3368-4354-884e-dc5dd0ed075a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.174974 Aug 21 02:39:38.974132 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3540/7734] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:38 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:39.994960 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:39.995667 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:39.997929 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:40.003658 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:40.004143 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:40.004586 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:40.005302 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:40.005742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:40.006189 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:40.149100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:40.157533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1bd1bd24-389e-42d4-8e6f-4184dc23fdae tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.166885 Aug 21 02:39:40.158165 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4195/7735] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:39 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:41.178383 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:41.178988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:41.182688 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:41.188522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:41.189052 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:41.189505 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:41.190249 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:41.190714 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:41.191137 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:41.343646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:41.351866 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a02b8530-97c0-49b5-991d-982a7c36c0ff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.177613 Aug 21 02:39:41.352457 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3541/7736] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:41 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:42.168801 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:39:42.235772 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "name": "network-vif-plugged", "status": "completed", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:42.245571 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:42.246045 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:42.246470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:42.258573 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] Creating event network-vif-plugged:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:39:42.264748 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-b1f51a55-12c5-48fe-af15-f65093d44252 req-f7ec9403-1383-4bdf-95dc-58a2d7369f97 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100929 Aug 21 02:39:42.265575 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4196/7737] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:39:42.374585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:42.375194 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:42.386560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:42.521643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:42.529842 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-14f3302e-2f46-4aaf-abb6-ac2a71a48c59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.159338 Aug 21 02:39:42.530419 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3542/7738] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:42 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:43.555995 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:43.557900 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:43.567301 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:43.568135 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:43.568622 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:43.569645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:43.570335 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:43.570947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:43.723106 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:43.731422 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-713de802-294b-4c91-81b4-1a20c05d56ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1373 microversion: 2.1 time: 0.182741 Aug 21 02:39:43.732006 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4197/7739] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:43 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:44.755435 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:44.756204 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:44.766185 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:44.766839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:44.767435 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:44.768429 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:44.769093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:44.769671 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:44.920410 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:44.932811 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3dfed92a-af99-4aad-bfae-f91017721582 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1557 microversion: 2.1 time: 0.182675 Aug 21 02:39:44.933386 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3543/7740] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:44 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:44.953020 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:39:44.953662 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:39:44.960701 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:44.961208 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:44.961619 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:44.962451 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:44.962909 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:44.963331 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:45.108631 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:39:45.116905 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fde8e723-9803-42e4-b130-dcb8e650a984 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1557 microversion: 2.1 time: 0.167861 Aug 21 02:39:45.117475 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4198/7741] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:39:44 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:39:47.159855 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:39:47.170686 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:39:47.171167 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:39:47.171608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:39:47.185605 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] Creating event network-changed:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:39:47.190895 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-fff81a69-166f-491a-af93-f89987e8856f req-7f82377e-34ca-472e-a5a3-91f91f218e78 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034868 Aug 21 02:39:47.191539 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3544/7742] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:40:02.349880 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:40:02.350368 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:41:42.017989 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:41:42.018820 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:41:42.335349 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:41:42.336291 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:41:57.308181 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:41:57.308996 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:42:11.139145 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:42:11.140073 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:42:11.140635 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:11.141784 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:11.146764 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:42:11.147294 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:11.154370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:11.154871 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:11.155283 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:11.155973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:11.156420 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:11.156864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:11.180598 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lazy-loading 'flavor' on Instance uuid a2bd8895-0b52-4e34-a895-cf28ff6f955e {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:42:11.536380 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5271d440-a0f1-4082-bd1d-1bb0a39aa387 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e/action" status: 202 len: 0 microversion: 2.1 time: 0.399324 Aug 21 02:42:11.537074 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4199/7743] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:42:11 2022] POST /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:42:11.543893 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:42:11.544738 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:42:11.545391 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:11.546155 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=40 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:11.551063 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:11.551778 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:11.560892 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:11.561389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:11.561862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:11.562570 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:11.563033 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:11.563464 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:11.760457 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:11.768637 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6c49dd90-2ba3-481b-bc14-1ffa407346d7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.226723 Aug 21 02:42:11.769213 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3545/7744] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:11 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:12.798139 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:12.799419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:12.811247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:12.811705 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:12.812129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:12.812851 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:12.813315 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:12.813728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:12.817895 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53032. Aug 21 02:42:12.818575 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53034. Aug 21 02:42:12.968642 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:12.980042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4c4af880-3ef8-418c-870f-f8a35decd7e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.192069 Aug 21 02:42:12.980618 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4200/7745] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:12 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:13.920169 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:42:13.920902 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:42:14.005178 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:14.006795 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:14.023778 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:14.024340 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:14.024856 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:14.025557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:14.026015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:14.026437 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:14.030267 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53040. Aug 21 02:42:14.033336 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53042. Aug 21 02:42:14.176935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:14.185458 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b4c723ba-b41f-4106-874f-743ccfde6787 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.186703 Aug 21 02:42:14.186063 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3546/7746] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:13 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:15.211329 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:15.212238 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:15.220295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:15.220797 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:15.221256 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:15.221948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:15.222395 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:15.222819 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:15.377967 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:15.386713 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-195696e1-4ab2-43d3-bd70-fec0a4df2722 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.182127 Aug 21 02:42:15.387292 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4201/7747] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:15 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:16.410738 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:16.411482 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:16.419944 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:16.420436 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:16.420955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:16.421661 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:16.422118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:16.422553 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:16.566923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:16.577295 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b476637-b8b2-4cc4-a856-a800092a3828 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.172185 Aug 21 02:42:16.577848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3547/7748] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:16 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:17.606126 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:17.606724 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:17.614054 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:17.614826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:17.616119 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:17.616905 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:17.617947 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:17.618382 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:17.757589 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:17.765740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fc4064f-cc36-4840-9a29-0cbd97de92f2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.164100 Aug 21 02:42:17.766357 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4202/7749] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:17 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:18.789922 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:18.790541 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:18.798035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:18.798525 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:18.798968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:18.799742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:18.800203 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:18.800634 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:18.943982 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:18.957086 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7ac5cb0a-cf35-4101-8d6a-fec25f4566d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.172358 Aug 21 02:42:18.957910 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3548/7750] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:18 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:19.981074 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:19.981692 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:19.988994 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:19.989482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:19.989916 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:19.990614 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:19.991063 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:19.991488 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:20.137510 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:20.148846 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f6db4d3b-79d3-49eb-a35b-808bea80310e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.171841 Aug 21 02:42:20.149490 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4203/7751] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:19 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:21.178365 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:21.179023 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:21.187028 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:21.187522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:21.187970 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:21.188673 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:21.189174 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:21.189605 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:21.350097 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:21.363125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-24c52f6e-8e67-456a-9672-eec044a233d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.190635 Aug 21 02:42:21.363973 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3549/7752] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:21 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:22.387836 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:22.388485 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:22.396038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:22.396459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:22.396933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:22.397638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:22.398091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:22.398519 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:22.544468 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:22.552938 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1e5fed6e-9914-4e6f-9874-2acb06f1dde0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.169649 Aug 21 02:42:22.553493 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4204/7753] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:22 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:23.578440 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:23.579464 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:23.589555 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:23.590044 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:23.590470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:23.591182 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:23.591635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:23.592064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:23.744781 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:23.753282 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3c741dd-f8ee-4bda-be1c-c0b6012238e0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1702 microversion: 2.1 time: 0.180907 Aug 21 02:42:23.753852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3550/7754] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:23 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1702 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:24.777182 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:24.777812 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:24.785212 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:24.785695 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:24.786107 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:24.786826 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:24.787276 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:24.787698 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:24.933454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:24.941718 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c6f6dd82-23b3-4576-beba-7fce8f3d709e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1702 microversion: 2.1 time: 0.168566 Aug 21 02:42:24.942310 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4205/7755] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:24 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1702 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:25.967892 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:25.968734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:25.979506 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:25.979996 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:25.980433 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:25.981165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:25.981625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:25.982056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:26.131585 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:26.141899 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5d14fe4d-1c16-496e-a2f4-d0f8c279c376 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1702 microversion: 2.1 time: 0.180959 Aug 21 02:42:26.142531 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3551/7756] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:25 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1702 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:27.033094 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "name": "network-vif-plugged", "status": "completed", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:42:27.044408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:27.045051 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:27.045435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:27.058684 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] Creating event network-vif-plugged:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:42:27.063973 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-aad71a49-f819-4b56-ab31-8f0a132df932 req-aaf65412-540e-43d5-b412-1ce0e7f1b966 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034698 Aug 21 02:42:27.064836 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4206/7757] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:42:27.168009 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:27.168661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:27.176050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:27.176547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:27.177037 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:27.177746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:27.178216 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:27.178652 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:27.323933 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:27.335893 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-481111a2-b3a9-4a77-bdbe-35815c6d7e51 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1702 microversion: 2.1 time: 0.171831 Aug 21 02:42:27.336638 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3552/7758] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:27 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1702 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:28.358168 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:28.358861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:28.366416 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:28.366898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:28.367624 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:28.368014 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:28.368673 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:28.369221 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:28.508490 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:28.516904 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-37b3500e-6daa-4cbd-969f-ee390754f044 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.162987 Aug 21 02:42:28.517511 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4207/7759] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:28 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:29.539465 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:29.541118 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:29.551351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:29.552074 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:29.552524 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:29.555591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:29.555591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:29.555591 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:29.717269 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:29.728114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-bcb0b449-5b2b-4927-ba54-5872052d8c95 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.192672 Aug 21 02:42:29.741527 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3553/7760] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:29 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:30.752193 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:30.753693 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:30.762000 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:30.762717 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:30.763146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:30.763847 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:30.764295 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:30.764713 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:30.915677 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:30.927079 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-16364123-e8b4-4878-bf32-4a45840fc5e6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.179320 Aug 21 02:42:30.927673 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4208/7761] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:30 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:31.950824 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:31.951504 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:31.958608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:31.959484 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:31.960170 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:31.961243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:31.962050 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:31.962724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:32.114757 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:32.124357 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-45d9e4bf-7474-4658-b7fd-adc71328ad17 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.177538 Aug 21 02:42:32.142759 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3554/7762] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:31 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:33.146704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:33.147516 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:33.154655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:33.155236 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:33.155925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:33.156941 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:33.157470 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:33.157962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:33.305526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:33.314462 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-10b72e86-4c79-42ea-851d-e476391d5aba tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.171847 Aug 21 02:42:33.328792 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4209/7763] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:33 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:34.338507 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:34.342374 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:34.350415 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:34.351189 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:34.351878 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:34.352586 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:34.353078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:34.353774 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:34.509722 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:34.520657 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ad9a549b-53a7-4adc-885c-2be89abfb7db tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.185902 Aug 21 02:42:34.521733 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3555/7764] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:34 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:35.543219 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:35.543826 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:35.550967 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:35.551638 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:35.552078 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:35.552973 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:35.553297 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:35.553910 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:35.714484 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:35.722869 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8508dc16-a46b-4e3e-913a-a80dc754a9a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.184066 Aug 21 02:42:35.723461 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4210/7765] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:35 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:36.744079 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:36.745174 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:36.753014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:36.754838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:36.754838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:36.754838 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:36.755597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:36.756048 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:36.925653 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:36.933961 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-db87afcc-0ad1-4518-8332-b3519ecb9343 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.194017 Aug 21 02:42:36.934541 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3556/7766] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:36 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:37.956893 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:37.957578 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:37.966210 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:37.966770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:37.967271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:37.968074 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:37.968599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:37.969125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:38.113320 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:38.121618 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4a21df32-e5c2-4349-8cbc-81bedec96e12 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1697 microversion: 2.1 time: 0.169441 Aug 21 02:42:38.122199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4211/7767] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:37 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:39.144519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:39.145305 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:39.154473 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:39.154968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:39.155402 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:39.156109 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:39.156565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:39.157036 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:39.297979 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:39.306221 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-df5a59da-0fe0-49be-867c-7a72f35bdbd5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1679 microversion: 2.1 time: 0.166441 Aug 21 02:42:39.306799 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3557/7768] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:39 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:40.327919 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:40.328539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:40.336079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:40.336559 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:40.337023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:40.337694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:40.338269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:40.338694 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:40.479607 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:40.491740 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-02dcbf27-c6e3-444f-865a-e1f66cc66826 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1679 microversion: 2.1 time: 0.167541 Aug 21 02:42:40.492594 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4212/7769] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:40 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:41.524900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:41.526327 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:41.535674 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.536171 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.536625 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:41.537378 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.537867 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.538291 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:41.686130 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:41.690197 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=83 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:41.700948 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2bfd0498-4365-412b-ad52-65f90161049a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1622 microversion: 2.1 time: 0.182046 Aug 21 02:42:41.701494 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3558/7770] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:41 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1622 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:41.721830 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:42:41.722425 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:41.725284 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=29 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:41.731671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.732147 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.732582 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:41.733300 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.733750 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.734169 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:41.736573 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:41.827447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122482) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 21 02:42:41.911887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-30fc1117-2c81-42e6-ba4c-334a4102ebaa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e/action" status: 202 len: 0 microversion: 2.1 time: 0.193567 Aug 21 02:42:41.918117 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4213/7771] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:42:41 2022] POST /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:42:41.924015 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:41.924634 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:41.926522 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=29 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:42:41.932336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.932847 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.933232 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:41.934141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:41.934786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:41.935380 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:42.082070 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:42.089987 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-88670ee9-7888-434e-9675-6c6ea54ae484 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1630 microversion: 2.1 time: 0.169891 Aug 21 02:42:42.090836 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3559/7772] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:41 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1630 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:43.113350 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:43.113949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:43.120350 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:43.120864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:43.121351 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:43.122122 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:43.122540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:43.122957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:43.198356 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "name": "network-vif-unplugged", "status": "completed", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:42:43.213260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:43.213946 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:43.214406 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:43.230120 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] Creating event network-vif-unplugged:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:42:43.239433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-db85e9e1-f033-4ad7-b1cd-7e353f35e168 req-a98b9e6b-217a-40ce-83f8-7fe0c549fe39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044119 Aug 21 02:42:43.240343 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3560/7773] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:42:43.286200 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:43.294322 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9f2afbfb-45db-4f4a-9cb2-8f9a2c71c1fe tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.185911 Aug 21 02:42:43.294904 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4214/7774] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:43 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:44.317524 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:44.318133 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:44.324756 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:44.325432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:44.325888 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:44.326593 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:44.327061 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:44.327499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:44.472076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:44.480043 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fdb566c6-0f9c-4b7f-83ce-56e630904101 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.168001 Aug 21 02:42:44.480624 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3561/7775] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:44 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:45.501837 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:45.502462 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:45.510157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:45.510708 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:45.511157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:45.511885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:45.512336 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:45.513109 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:45.663459 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:45.678096 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1f418478-222b-4ff8-a0c3-c33cc26816e4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.180567 Aug 21 02:42:45.678789 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4215/7776] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:45 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:46.699594 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:46.701010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:46.708263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:46.708742 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:46.709466 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:46.710407 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:46.711088 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:46.711726 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:46.858591 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:46.866705 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e57afe2-54a5-4478-a658-7ef33b4a9875 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.171014 Aug 21 02:42:46.867379 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3562/7777] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:46 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:47.889758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:47.891308 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:47.898998 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:47.899483 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:47.899912 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:47.900616 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:47.901246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:47.901661 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:48.049800 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:48.058706 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-045cfe1c-f9e3-4a87-aa4e-fb28f6d97019 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.173104 Aug 21 02:42:48.071311 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4216/7778] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:47 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:49.083808 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:49.084485 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:49.092281 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:49.092703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:49.093204 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:49.093926 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:49.094386 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:49.094815 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:49.257110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:49.266062 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-5fa7e704-7997-4784-ac85-54d2e49d6e75 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.187778 Aug 21 02:42:49.267292 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3563/7779] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:49 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:50.289537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:50.290498 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:50.298152 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:50.298639 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:50.299058 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:50.299766 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:50.300225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:50.300648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:50.450190 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:50.460023 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b856ba88-5525-44b3-94ef-6cc071c71713 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.175342 Aug 21 02:42:50.460952 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4217/7780] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:50 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:51.484530 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:51.485230 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:51.493268 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:51.493822 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:51.494336 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:51.495118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:51.495643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:51.496125 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:51.641510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:51.650834 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d64d9c3-dc50-4097-bb21-69b3f9663990 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.171859 Aug 21 02:42:51.651424 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3564/7781] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:51 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:52.677291 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:52.678164 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:52.687968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:52.688461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:52.688933 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:52.689625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:52.690123 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:52.690550 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:52.830336 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:52.838500 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e38dce5-6fa3-41e0-9e0b-af382c2f909e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.168031 Aug 21 02:42:52.839073 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4218/7782] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:52 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:53.870184 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:53.871173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:53.883279 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:53.884089 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:53.884852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:53.886051 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:53.886820 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:53.887545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:54.028238 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:54.036800 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3b61b7a1-7da0-4758-86c1-7344a01d17a8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.173810 Aug 21 02:42:54.037385 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3565/7783] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:53 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:55.061621 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:55.062255 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:55.069894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:55.070378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:55.070811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:55.071502 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:55.071949 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:55.072368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:55.216966 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:55.225224 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-acd19a3d-81ef-495c-a775-a1a1910ec601 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.169317 Aug 21 02:42:55.225821 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4219/7784] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:55 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:56.250207 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:56.250901 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:56.259276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:56.259798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:56.260274 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:56.261079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:56.261573 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:56.262035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:56.415597 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:56.428193 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-66644aa8-122b-47be-b419-ad68d57ab0f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.183431 Aug 21 02:42:56.429089 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3566/7785] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:56 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:57.450419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:57.451220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:57.459307 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:57.459811 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:57.460246 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:57.461006 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:57.461459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:57.461885 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:57.615256 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:57.624720 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b178e9d6-29ff-4b35-b84a-774a3f12d02f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.178178 Aug 21 02:42:57.625611 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4220/7786] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:57 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:58.653756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:58.654578 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:58.661962 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:58.662447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:58.662896 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:58.663606 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:58.664068 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:58.664509 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:58.818288 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:42:58.830433 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a30c971d-4f51-405e-a041-f282c717099a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.182326 Aug 21 02:42:58.831299 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3567/7787] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:58 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:42:59.857419 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:42:59.858142 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:42:59.866881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:59.867480 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:59.868020 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:42:59.868928 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:42:59.869494 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:42:59.870064 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:00.019846 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:00.028433 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5ec899ba-fe44-4a21-acdc-291cd72ce8f9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.175849 Aug 21 02:43:00.029072 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4221/7788] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:42:59 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:01.054134 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:43:01.055256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:43:01.064527 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:01.065069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:01.065516 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:01.066243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:01.066654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:01.067083 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:01.209215 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:01.217853 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-83d6971d-4385-4437-a922-a0d0f0f07966 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.170324 Aug 21 02:43:01.218672 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3568/7789] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:43:01 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:02.239934 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:43:02.240558 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:43:02.248105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:02.248645 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:02.249094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:02.249799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:02.250259 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:02.250686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:02.402148 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:02.411373 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-23302322-952d-4313-83e6-9d73e40e7178 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.175419 Aug 21 02:43:02.411961 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4222/7790] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:43:02 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:03.248562 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "name": "network-vif-plugged", "status": "completed", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:43:03.260521 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:03.261049 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:03.261478 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:03.273465 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] Creating event network-vif-plugged:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:43:03.278800 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-a864ad8b-8d6a-4936-be6d-a413ecb6e4ee req-502e38f5-e93b-4ba8-8e50-278238dfd2a7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035639 Aug 21 02:43:03.279440 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3569/7791] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:43:03.436018 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:43:03.437234 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:43:03.445775 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:03.446255 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:03.446655 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:03.447370 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:03.448432 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:03.448882 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:03.686696 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:03.702450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-024e40f2-fcc7-4d9e-bec4-1c4eb4243de2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.272659 Aug 21 02:43:03.703237 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4223/7792] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:43:03 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:04.734308 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:43:04.735361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:43:04.745879 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:04.746655 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:04.747705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:04.748405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:04.748865 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:04.749315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:04.897586 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:04.905698 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2617aeab-2eb0-4e78-8a69-b3deb61dc3ee tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1688 microversion: 2.1 time: 0.180257 Aug 21 02:43:04.906266 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3570/7793] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:43:04 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:05.931270 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:43:05.932249 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:43:05.944597 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:05.945456 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:05.946188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:05.947338 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:43:05.948093 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:43:05.948860 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:43:06.115225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:43:06.123803 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3efe10b7-a8b9-4bfa-b276-9a04c361f0be tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1675 microversion: 2.1 time: 0.199180 Aug 21 02:43:06.124404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4224/7794] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:43:05 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:43:22.359404 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:43:22.359904 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:43:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:44:42.726734 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=23 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:42.728087 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=65 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:42.731912 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:42.732967 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:42.733233 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:44:42.733858 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:44:42.750568 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:42.752105 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:42.752751 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:42.753845 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:42.754315 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:42.754754 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:42.783694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:44:42.797454 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:44:42.808852 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:42.809317 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:42.809962 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:42.827741 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] Creating event network-changed:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:44:42.834261 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9a5701cd-1903-4fc9-b68b-36c535df5ef7 req-6e1da308-5c83-4e19-ba16-1504227bca9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108202 Aug 21 02:44:42.835513 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4225/7795] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:44:42.877091 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4b4b4b24-328c-4c4d-8282-010084e4ad90 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 204 len: 0 microversion: 2.1 time: 0.152797 Aug 21 02:44:42.884582 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3571/7796] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:44:42 2022] DELETE /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:44:42.890068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:42.890843 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:44:42.899105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:42.899607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:42.900046 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:42.900752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:42.901226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:42.901646 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:43.046990 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:44:43.055217 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-818e4f0b-a8f0-4734-9de1-1dd8e0e63697 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.170604 Aug 21 02:44:43.055853 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4226/7797] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:44:42 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:44:44.077898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:44.078650 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:44:44.085654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:44.086153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:44.086585 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:44.087318 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:44.087780 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:44.088220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:44.233068 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:44:44.241232 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b3bb2df6-5e4a-43be-814b-3d06fadd0576 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1681 microversion: 2.1 time: 0.167939 Aug 21 02:44:44.241810 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3572/7798] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:44:44 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:44:44.928887 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bd8895-0b52-4e34-a895-cf28ff6f955e", "name": "network-vif-deleted", "tag": "edcf341d-379d-4bff-9b07-46525c1048bd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:44:44.940618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:44.941136 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:44.941563 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:44.953334 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] Creating event network-vif-deleted:edcf341d-379d-4bff-9b07-46525c1048bd for instance a2bd8895-0b52-4e34-a895-cf28ff6f955e on n-h2-master-1 Aug 21 02:44:44.959281 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-84f985ee-ef1b-416f-ac67-a36bacf69399 req-6a6bbead-2efa-43e3-a133-2c2166b00031 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 Aug 21 02:44:44.960050 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4227/7799] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:44:45.263951 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:45.265261 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:44:45.273040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:45.273541 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:45.273986 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:45.274706 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:45.275164 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:45.275597 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:45.309276 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:45.309769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:45.310220 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:45.310684 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lazy-loading 'fault' on Instance uuid a2bd8895-0b52-4e34-a895-cf28ff6f955e {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:44:45.370644 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:44:45.379629 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c08d0c1b-bcf9-48d0-b195-3d8c450e7b96 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 200 len: 1337 microversion: 2.1 time: 0.119550 Aug 21 02:44:45.380203 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3573/7800] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:44:45 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 1337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:44:46.407820 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:46.408402 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: a2bd8895-0b52-4e34-a895-cf28ff6f955e] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:44:46.415321 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:46.415805 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:46.416240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:46.416989 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:44:46.417442 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:44:46.417867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:44:46.432199 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] HTTP exception thrown: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Request method failure captured: Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e HTTP/1.1 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZrZooIAMrb_MgBBtFWy1gn6NMD6ycGEoVuLdP6myr5OvG6N7oI0XBsEgFOPqnzGJLCEjGSQuxEkN_7bQ1SqSmctF12BBMrROnEsWTv9pPmBLBYM4_5GdzZGblZe2gWWxmONbY9EavXlulmGlzsviU_tf18J1kNLIx-K5vCp2f_vkmI Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: 5e5295ac46034f46b4781ed5d0374912 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestShelveInstance-836697836 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e5295ac46034f46b4781ed5d0374912"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5e5295ac46034f46b4781ed5d0374912", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5e5295ac46034f46b4781ed5d0374912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e5295ac46034f46b4781ed5d0374912"}]}] Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestShelveInstance-836697836 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: 5e5295ac46034f46b4781ed5d0374912 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestShelveInstance-836697836 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestShelveInstance-836697836-project Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: 89156176073c4a8b960c14e55528d7a9 Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestShelveInstance-836697836-project Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: exception: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'a2bd8895-0b52-4e34-a895-cf28ff6f955e'} Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:44:46.433883 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Returning 404 to user: Instance a2bd8895-0b52-4e34-a895-cf28ff6f955e could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1591ad73-d9da-4abe-83ef-aba77992ef72 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e" status: 404 len: 111 microversion: 2.1 time: 0.036201 Aug 21 02:44:46.438849 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4228/7801] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:44:46 2022] GET /compute/v2.1/servers/a2bd8895-0b52-4e34-a895-cf28ff6f955e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:44:46.614910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4ee4cb69-7e40-4376-8a08-61dd5e57c605 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '.version_select at 0x7fc3fc609310>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:44:46.619558 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ee4cb69-7e40-4376-8a08-61dd5e57c605 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:44:47.632276 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ee4cb69-7e40-4376-8a08-61dd5e57c605 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53330. Aug 21 02:44:47.663125 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4ee4cb69-7e40-4376-8a08-61dd5e57c605 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1092051141" status: 202 len: 0 microversion: 2.1 time: 1.052117 Aug 21 02:44:47.663970 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3574/7802] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 02:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1092051141 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:44:47.690521 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'create', calling method: .version_select at 0x7fc4032a5b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1120941922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkbMO5jaX4eyjqbarpUu54/KDbcAlu64SgvU9ArnN7te0xDtHmWJa8A/7zwsXRjbdd5pP626esIw+cP/X0QLXLkkQPjGfGGMjo37BTRS63+uXroN0arnPrENWt63H4hiw=="}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:44:47.708469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for project 5e5295ac46034f46b4781ed5d0374912. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:44:47.713959 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for user 89156176073c4a8b960c14e55528d7a9 and project 5e5295ac46034f46b4781ed5d0374912. Resources: {'key_pairs'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:44:47.728010 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:44:48.737493 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53334. Aug 21 02:44:48.757654 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-41cb5bfd-1bc9-43e8-b218-cb6cca1bd7d4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.071259 Aug 21 02:44:48.758278 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4229/7803] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:44:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:45:02.033557 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:45:02.034300 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:45:06.181011 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:06.181996 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:06.188997 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-42564768", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1120941922", "security_groups": [{"name": "tempest-secgroup-smoke-1833725196"}], "networks": [{"uuid": "8350431c-bb29-4fad-8b70-bd749f8ec3e5"}], "block_device_mapping_v2": [{"uuid": "e5e79811-b5e3-477b-a7f2-80e88e27491b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:45:06.310325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.network.neutron [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] validate_networks() for [('8350431c-bb29-4fad-8b70-bd749f8ec3e5', None, None, None, None, None)] {{(pid=122483) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:45:06.795035 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Flavor limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:45:06.795469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Image limits 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:45:06.796047 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Flavor pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:45:06.796470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Image pref 0:0:0 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:45:06.796926 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.virt.hardware [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:45:06.806998 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:06.807491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:06.807950 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:06.808688 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:06.809191 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:06.809626 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:06.827900 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for project 5e5295ac46034f46b4781ed5d0374912. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:45:06.833419 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Getting quotas for user 89156176073c4a8b960c14e55528d7a9 and project 5e5295ac46034f46b4781ed5d0374912. Resources: {'cores', 'ram', 'instances'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:45:06.899473 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Going to run 1 instances... {{(pid=122483) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:45:06.901698 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5e79811-b5e3-477b-a7f2-80e88e27491b',volume_size=None,volume_type=None)] {{(pid=122483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:45:07.042997 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-d2c14b9f-3955-4116-8df0-889fba00126a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864781 Aug 21 02:45:07.043561 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3575/7804] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:45:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 21 02:45:07.052663 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:07.053523 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:07.054424 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:07.058735 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de1900e3-0a3b-4d37-afa0-2834b34119a0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:07.059465 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de1900e3-0a3b-4d37-afa0-2834b34119a0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:07.121672 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-de1900e3-0a3b-4d37-afa0-2834b34119a0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:07.130059 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de1900e3-0a3b-4d37-afa0-2834b34119a0 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1087 microversion: 2.1 time: 0.079299 Aug 21 02:45:07.130648 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4230/7805] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:07 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:08.152031 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-95721684-9911-46bd-af64-c6c1f71bebf5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:08.152704 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-95721684-9911-46bd-af64-c6c1f71bebf5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:08.206680 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-95721684-9911-46bd-af64-c6c1f71bebf5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:08.213968 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-95721684-9911-46bd-af64-c6c1f71bebf5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1087 microversion: 2.1 time: 0.066710 Aug 21 02:45:08.214546 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3576/7806] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:08 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:09.235170 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77ed5280-7956-496b-9f88-26c4ba498406 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:09.235785 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-77ed5280-7956-496b-9f88-26c4ba498406 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:09.291583 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-77ed5280-7956-496b-9f88-26c4ba498406 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:09.298868 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77ed5280-7956-496b-9f88-26c4ba498406 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1087 microversion: 2.1 time: 0.067668 Aug 21 02:45:09.299632 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4231/7807] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:09 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:10.323418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-8eaa80eb-a431-46d7-8d96-aedf0c621429 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:10.324076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-8eaa80eb-a431-46d7-8d96-aedf0c621429 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:10.391667 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-8eaa80eb-a431-46d7-8d96-aedf0c621429 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:10.401018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-8eaa80eb-a431-46d7-8d96-aedf0c621429 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1087 microversion: 2.1 time: 0.082928 Aug 21 02:45:10.401133 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3577/7808] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:10 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1087 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:11.424368 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:11.425019 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:11.433240 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:11.433716 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:11.434142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:11.434829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:11.435269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:11.435667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:11.497387 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:11.506421 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-db31fb75-ca9f-4e8d-b5fa-f3a938e5099b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1137 microversion: 2.1 time: 0.088434 Aug 21 02:45:11.506985 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4232/7809] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:11 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:12.527821 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:12.529146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:12.536312 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:12.537235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:12.537680 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:12.538413 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:12.538873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:12.539301 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:12.617027 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:12.625158 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fca82a9e-d914-428a-84f6-c2bdc535b639 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1203 microversion: 2.1 time: 0.101451 Aug 21 02:45:12.626204 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3578/7810] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:12 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1203 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:13.649646 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:13.651324 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:13.653213 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:45:13.659547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:13.660038 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:13.660659 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:13.661583 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:13.662255 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:13.662684 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:13.664225 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:13.664743 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:13.665605 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:13.681069 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] Creating event network-changed:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h1-master-1 Aug 21 02:45:13.687907 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-6441553c-1901-4411-92f3-23b27caa358a req-c7e0c576-27b9-4b1f-bd4c-bc7dd52f0302 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107316 Aug 21 02:45:13.688742 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4233/7811] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 21 02:45:13.807891 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:13.816121 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6d0eb782-a8dd-4903-95d8-564bba7fa0a4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1271 microversion: 2.1 time: 0.173581 Aug 21 02:45:13.816714 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3579/7812] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:13 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:45:14.838220 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:14.838928 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:14.847137 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:14.847530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:14.847961 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:14.848670 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:14.849269 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:14.849697 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:14.988758 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:14.996908 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-619d596e-13ee-431b-b483-0ae733cbd37b tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1271 microversion: 2.1 time: 0.163180 Aug 21 02:45:14.997490 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4234/7813] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:14 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:16.019148 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:16.019779 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:16.026447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:16.026941 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:16.027387 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:16.028095 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:16.028552 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:16.029014 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:16.176433 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:16.185286 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cbfc1f3f-11dc-4c3e-aea4-dbcc0a83c002 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1271 microversion: 2.1 time: 0.169811 Aug 21 02:45:16.186383 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3580/7814] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:16 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:17.207596 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:17.208211 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:17.215091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:17.215643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:17.215981 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:17.216684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:17.217188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:17.217611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:17.356313 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:17.364308 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3d5406f0-f91c-42c0-95ee-4e4b40a22d00 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1271 microversion: 2.1 time: 0.160623 Aug 21 02:45:17.365308 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4235/7815] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:17 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:18.390740 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:18.391687 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:18.394794 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:18.405320 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:18.406120 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:18.406851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:18.408002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:18.408802 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:18.409495 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:18.557897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:18.569453 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c07fb7ba-ed65-4652-9333-418b5e490df4 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.185572 Aug 21 02:45:18.570011 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3581/7816] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:18 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:19.594372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:19.595338 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:19.599921 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=4 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:19.609279 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:19.610091 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:19.610813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:19.611971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:19.612723 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:19.613482 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:19.750881 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:19.759726 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8fe0d675-21a4-485c-be2f-23ce210f04cd tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.171999 Aug 21 02:45:19.760309 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4236/7817] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:19 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:20.780025 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:20.780705 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:20.783553 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=10 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:45:20.789898 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:20.790394 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:20.790839 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:20.791557 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:20.792021 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:20.792459 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:20.932443 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:20.940429 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a3a4efdd-1478-456a-bd9f-90e47dfb5651 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.164471 Aug 21 02:45:20.941035 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3582/7818] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:20 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:21.965247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:21.966312 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:21.976866 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:21.977349 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:21.977783 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:21.978473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:21.978927 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:21.979340 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:22.125132 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:22.133887 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dd397787-3048-47d3-bc90-a38c11fb5b1c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.175336 Aug 21 02:45:22.134555 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4237/7819] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:21 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:23.161486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:23.162106 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:23.169813 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:23.170294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:23.170733 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:23.171539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:23.171994 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:23.172443 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:23.323609 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:23.332204 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-82b061b4-863e-479d-8b60-fb0188944c0f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.174627 Aug 21 02:45:23.332966 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3583/7820] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:23 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:24.358574 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:24.359595 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:24.371625 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:24.372429 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:24.373199 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:24.374368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:24.375120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:24.375831 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:24.520071 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:24.533282 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bd7e5eae-6fca-4292-a6ab-42b5f21977ad tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.181083 Aug 21 02:45:24.534133 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4238/7821] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:24 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:25.560072 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:25.561020 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:25.570141 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:25.570904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:25.571635 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:25.572728 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:25.573503 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:25.574111 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:25.715214 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:25.723512 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6b974c09-8778-4834-b7d3-e7526527e202 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.170018 Aug 21 02:45:25.724096 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3584/7822] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:25 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:26.745623 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:26.746207 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:26.754202 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:26.754689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:26.755131 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:26.755837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:26.757032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:26.757515 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:26.900750 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:26.908940 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-a61d4d43-7c22-4392-9b39-8247e684a1a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.167328 Aug 21 02:45:26.909623 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4239/7823] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:26 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:27.931225 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:27.931927 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:27.940438 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:27.941064 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:27.941590 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:27.942412 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:27.942933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:27.943465 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:28.089935 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:28.098919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-eed7b927-8c31-4dcf-a6dd-74c17cf8dfff tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.172440 Aug 21 02:45:28.099516 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3585/7824] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:27 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:28.494908 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "name": "network-vif-plugged", "status": "completed", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:45:28.505120 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:28.505587 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:28.506142 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:28.517634 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] Creating event network-vif-plugged:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h1-master-1 Aug 21 02:45:28.523012 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-cb9a5870-f688-4c46-9217-0f5304bb1ebe req-9b09122b-fc94-44c6-948a-bfa980d720a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088482 Aug 21 02:45:28.523581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4240/7825] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:45:29.122756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:29.123552 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:29.133250 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:29.133862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:29.134397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:29.135282 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:29.135829 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:29.136389 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:29.285287 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:29.296746 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd504399-c35e-4e82-9156-136c3345e568 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1259 microversion: 2.1 time: 0.178723 Aug 21 02:45:29.297596 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3586/7826] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:29 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:30.322130 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:30.322816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:30.329598 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:30.330013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:30.330458 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:30.331146 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:30.331599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:30.332027 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:30.473509 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:30.481843 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-fb1e34f3-f1f9-4055-af19-b36c863005c8 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1443 microversion: 2.1 time: 0.165211 Aug 21 02:45:30.482424 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4241/7827] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:30 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:30.504411 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:45:30.505156 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:45:30.513873 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:30.514371 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:30.514826 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:30.515569 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:30.516034 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:30.516458 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:30.661173 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:45:30.669397 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fff04a4c-a694-4932-9b22-123599252929 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1443 microversion: 2.1 time: 0.170812 Aug 21 02:45:30.669995 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3587/7828] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:45:30 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:45:32.678850 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:45:32.689710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:45:32.690185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:45:32.690629 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:45:32.705715 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] Creating event network-changed:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h1-master-1 Aug 21 02:45:32.710993 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-95dfea79-db94-4c67-90d3-ccf9b7137cf8 req-c08b98b8-7834-464e-82c1-991ab7c39903 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035728 Aug 21 02:45:32.712923 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4242/7829] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:47:13.932582 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:47:13.933876 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:47:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:47:30.139773 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:47:30.140738 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:47:30.141407 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:30.142121 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=62 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:30.146906 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:47:30.147547 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:30.155128 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:30.155727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:30.156176 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:30.156899 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:30.157358 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:30.157788 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:30.183043 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lazy-loading 'flavor' on Instance uuid e3948baa-6a00-4858-bc44-f6cc2d2beda7 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:47:30.262868 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-886adb7a-4cfe-4ef8-b640-cfbd90c6f314 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7/action" status: 202 len: 0 microversion: 2.1 time: 0.124977 Aug 21 02:47:30.263542 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3588/7830] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:47:30 2022] POST /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:47:30.270276 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:47:30.271073 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:47:30.271686 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=30 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:30.272452 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=54 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:30.277861 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:30.278568 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:30.285980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:30.286449 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:30.286884 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:30.287739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:30.288188 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:30.288601 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:30.530300 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:30.538534 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3e6d4ff5-37ed-436b-a9ec-77ad86435e4d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.270261 Aug 21 02:47:30.539146 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4243/7831] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:30 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:31.570766 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:31.571487 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:31.586018 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:31.586522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:31.586963 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:31.587662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:31.588119 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:31.588547 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:31.593521 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53626. Aug 21 02:47:31.596602 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53624. Aug 21 02:47:31.803923 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:31.816369 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7f7fd78c-4432-4df0-a0e4-dae980a83af2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.253010 Aug 21 02:47:31.817187 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3589/7832] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:31 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:32.845741 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:32.846844 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:32.867644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:32.868475 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:32.869206 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:32.870341 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:32.871087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:32.871829 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:32.876254 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53634. Aug 21 02:47:32.878390 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53636. Aug 21 02:47:33.021288 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:33.031746 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9e765fed-231c-40be-b184-d673377a55b7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.193271 Aug 21 02:47:33.032320 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4244/7833] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:32 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:34.056830 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:34.058066 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:34.070099 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:34.070923 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:34.071678 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:34.072836 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:34.073675 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:34.074405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:34.217639 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:34.226194 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff489c13-2885-4930-b026-f66118ff5f20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.175952 Aug 21 02:47:34.226769 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3590/7834] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:34 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:35.251807 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:35.252615 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:35.262503 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:35.263385 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:35.263977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:35.265278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:35.266478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:35.266957 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:35.415372 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:35.424469 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e1669a99-d4b7-44df-842d-dd786ba2f344 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.179308 Aug 21 02:47:35.425083 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4245/7835] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:35 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:36.451714 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:36.452661 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:36.464682 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:36.465565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:36.466267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:36.466978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:36.467447 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:36.467904 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:36.617155 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:36.625965 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ff316e49-7faa-4f57-9f82-cf4adc3711c5 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.181023 Aug 21 02:47:36.626540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3591/7836] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:36 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:37.651683 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:37.652727 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:37.665757 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:37.666599 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:37.667311 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:37.668857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:37.669591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:37.669814 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:37.817092 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:37.828461 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-5714719a-f59f-453b-9a8b-4622190a3d2f tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.183349 Aug 21 02:47:37.829292 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4246/7837] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:37 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:38.855180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:38.856307 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:38.864288 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:38.864795 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:38.865283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:38.865988 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:38.866449 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:38.866882 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:39.013317 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:39.022160 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-542c93c9-34a0-4b0a-8e02-a438ab2b7d62 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.173788 Aug 21 02:47:39.022711 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3592/7838] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:38 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:40.047813 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:40.048856 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:40.060527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:40.061368 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:40.062068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:40.062752 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:40.063195 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:40.063607 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:40.202782 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:40.210812 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-433c6999-6562-4f74-9a18-2e007734bbb9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.169745 Aug 21 02:47:40.211404 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4247/7839] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:40 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:41.235469 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:41.236033 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:41.243785 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:41.244299 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:41.244758 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:41.245523 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:41.246003 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:41.246467 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:41.398267 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:41.406651 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-6a8cb989-f791-4df0-9d30-6bc1b7d9215a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.176719 Aug 21 02:47:41.407232 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3593/7840] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:41 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:42.431068 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:42.431707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:42.439631 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:42.440116 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:42.440553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:42.441369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:42.441821 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:42.442242 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:42.594894 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:42.603200 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2bd98f9-2609-4150-9d2c-5b49a30200a7 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.175990 Aug 21 02:47:42.603750 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4248/7841] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:42 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:43.624905 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:43.626017 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:43.633428 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:43.633958 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:43.634405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:43.635121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:43.635582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:43.636015 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:43.776677 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:43.785216 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-cae602f9-7ddb-4c50-bac6-846e2ce306f3 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.164434 Aug 21 02:47:43.786000 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3594/7842] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:43 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:44.810204 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:44.810973 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:44.820618 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:44.821207 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:44.821700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:44.822511 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:44.823018 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:44.823490 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:44.973289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:44.981557 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-67332326-8104-4c57-a46d-07199a4e879a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1509 microversion: 2.1 time: 0.177990 Aug 21 02:47:44.982131 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4249/7843] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:44 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:47:45.003708 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:47:45.004350 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:45.011786 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:45.012397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:45.012809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:45.013562 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:45.014057 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:45.014615 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:45.064029 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122483) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 21 02:47:45.138093 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:47:46.147508 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [2ccc9a07-1ec1-4eed-9e34-ff7fefa66374] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53664. Aug 21 02:47:46.151383 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-4f5537bf-6ab6-49f4-ad87-d264553274b2 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "POST /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7/action" status: 202 len: 0 microversion: 2.1 time: 1.152082 Aug 21 02:47:46.152011 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3595/7844] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:47:44 2022] POST /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7/action => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:47:46.160347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:46.160983 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:46.168056 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:46.168530 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:46.169013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:46.169710 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:46.170168 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:46.170684 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:46.307028 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:46.315535 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-398a05ed-e67e-4f44-88e2-ef08be2b06a1 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1517 microversion: 2.1 time: 0.158942 Aug 21 02:47:46.316194 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4250/7845] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:46 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:46.965895 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "name": "network-vif-unplugged", "status": "completed", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:47:46.977862 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:46.978364 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:46.978809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:46.991076 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.compute.server_external_events [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] Unable to find a host for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7. Dropping event network-vif-unplugged {{(pid=122483) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 21 02:47:46.992004 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-0eaa6569-04b9-4742-8a05-4992bfc83c43 req-e36d3cfc-2973-44d7-b302-3d8c6bbf53e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030282 Aug 21 02:47:46.992592 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3596/7846] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 21 02:47:47.336434 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:47.337099 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:47.344509 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:47.345024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:47.345459 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:47.346157 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:47.346683 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:47.347117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:47.491097 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:47.500347 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d137bf35-310f-49ce-9e09-e98acb0791eb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1517 microversion: 2.1 time: 0.167564 Aug 21 02:47:47.501037 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4251/7847] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:47 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:48.522205 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:48.522832 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:48.530258 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:48.530750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:48.531198 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:48.531913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:48.532374 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:48.532800 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:48.676450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:48.684688 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-f264ec0d-aed2-4f93-91a7-5b3b9ae6c838 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1519 microversion: 2.1 time: 0.166641 Aug 21 02:47:48.685297 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3597/7848] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:48 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:49.706863 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:49.707424 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:49.714770 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:49.715392 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:49.715837 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:49.716529 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:49.717016 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:49.717434 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:49.854408 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:49.863451 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-c168be7e-c390-432a-a1b3-149d953ad1aa tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1519 microversion: 2.1 time: 0.160830 Aug 21 02:47:49.863992 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4252/7849] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:49 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:50.885431 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:50.886090 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:50.894329 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:50.894794 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:50.895266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:50.895978 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:50.896461 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:50.896917 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:51.042734 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:51.051033 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3e52f4ea-894d-4944-a158-47a2226ef6c9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1519 microversion: 2.1 time: 0.169547 Aug 21 02:47:51.051612 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3598/7850] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:50 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:52.071842 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:52.072415 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:52.079828 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:52.080387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:52.080824 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:52.081556 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:52.082003 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:52.082433 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:52.236088 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:52.244604 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-af817a87-f5d2-4171-ae9d-a23f02202536 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1519 microversion: 2.1 time: 0.176703 Aug 21 02:47:52.245233 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4253/7851] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:52 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:47:53.272483 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:53.273519 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:53.285309 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:53.285814 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:53.286262 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:53.287006 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:53.287470 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:53.287906 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:53.512176 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:53.520554 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-603b8b77-f8dc-492f-9e2d-36ff67fb8ceb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.256274 Aug 21 02:47:53.521172 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3599/7852] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:53 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:54.184225 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:47:54.195367 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:54.195857 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:54.196271 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:54.208030 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] Creating event network-changed:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h2-master-1 Aug 21 02:47:54.214115 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-7daf5fb8-c4ce-4ea2-a172-03b6b9f81032 req-09cbb466-4c07-4dc2-bb97-6a3fb367db5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Aug 21 02:47:54.214713 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4254/7853] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:47:54.542361 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:54.542969 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:54.551693 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:54.552224 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:54.552670 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:54.553417 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:54.553880 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:54.554313 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:54.785622 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:54.794035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0b4686c6-193f-41e9-9f76-3050d391785e tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.255773 Aug 21 02:47:54.794603 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3600/7854] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:54 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:55.819458 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:55.820188 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:55.827105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:55.827591 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:55.828032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:55.828742 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:55.829222 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:55.829648 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:55.982457 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:55.990765 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9c2e1aa1-76bf-4922-adc5-ab996e342dac tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.177618 Aug 21 02:47:55.991384 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4255/7855] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:55 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:57.016373 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:57.017333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:57.029321 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:57.030123 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:57.030850 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:57.031993 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:57.032746 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:57.033501 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:57.173983 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:57.183009 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2842ec30-8c48-4d16-929a-35ee4bd79dbb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.173580 Aug 21 02:47:57.183587 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3601/7856] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:57 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:58.207500 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:58.208180 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:58.216322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:58.216913 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:58.217387 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:58.218161 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:58.218665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:58.219140 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:58.364242 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:58.372562 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d0d3eb61-8008-4c09-a9e7-a505de2e79fb tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.171312 Aug 21 02:47:58.373154 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4256/7857] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:58 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:47:59.396928 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:47:59.397636 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:47:59.408205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:59.409040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:59.409968 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:59.410662 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:47:59.411118 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:47:59.411545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:47:59.415661 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:47:59.554427 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:47:59.563048 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-e683642f-7cc3-49f2-ba3d-3c0119d084df tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.172032 Aug 21 02:47:59.563628 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3602/7858] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:47:59 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:00.587911 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:00.588675 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:00.592154 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=29 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:48:00.599055 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:00.599665 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:00.600181 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:00.601081 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:00.601644 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:00.602166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:00.605892 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=81 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:48:00.745266 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:00.753624 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b17fa7f1-ede3-4128-9b88-7574fce45650 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.170740 Aug 21 02:48:00.754287 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4257/7859] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:00 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:01.775753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:01.776344 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:01.778467 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:48:01.784215 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:01.784707 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:01.785351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:01.786243 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:01.786705 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:01.787140 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:01.924153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:01.932631 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0aa2bcad-cac4-461f-938f-d52bcc3e1320 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.161211 Aug 21 02:48:01.933238 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3603/7860] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:01 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:02.959447 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:02.960469 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:02.971121 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:02.971923 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:02.973001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:02.974082 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:02.974540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:02.974950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:03.123347 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:03.132466 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-1beab763-db73-4cb1-866d-7ba40d082a20 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.180837 Aug 21 02:48:03.133086 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4258/7861] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:02 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:04.154546 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:04.155202 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:04.162648 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:04.163157 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:04.163594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:04.164293 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:04.164750 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:04.165218 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:04.313812 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:04.322378 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-17d81e06-5000-4aa0-973e-807999e72eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.171811 Aug 21 02:48:04.322958 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3604/7862] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:04 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:05.346711 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:05.347418 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:05.355129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:05.355604 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:05.356032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:05.356715 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:05.357229 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:05.357643 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:05.491087 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:05.499150 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-89c01be0-e7d3-49cc-b096-d11bd906fb59 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.158766 Aug 21 02:48:05.500096 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4259/7863] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:05 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:06.524175 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:06.524964 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:06.533297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:06.533791 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:06.534227 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:06.534965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:06.535422 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:06.535849 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:06.597356 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "name": "network-vif-plugged", "status": "completed", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:48:06.608005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:06.608478 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:06.609183 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:06.621506 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] Creating event network-vif-plugged:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h2-master-1 Aug 21 02:48:06.627131 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-02465256-67d8-436d-b85e-c5d73606e709 req-8e0c8f77-3dab-4dbf-99c3-d11e94200b9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Aug 21 02:48:06.627744 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4260/7864] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:48:06.675132 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:06.683393 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-87fcfb30-8db7-4269-af9b-eca823b9f71a tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.163571 Aug 21 02:48:06.683977 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3605/7865] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:06 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:07.712745 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:07.714161 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:07.724948 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:07.725430 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:07.725864 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:07.726561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:07.727005 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:07.727423 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:07.866912 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:07.875563 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f2a44598-1f90-4eb1-8ba9-d0ee64b2024c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1575 microversion: 2.1 time: 0.171994 Aug 21 02:48:07.876122 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4261/7866] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:07 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:08.901325 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:48:08.901947 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:48:08.910798 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:08.911272 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:08.911931 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:08.913029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:48:08.913493 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:48:08.914350 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:48:09.105976 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:48:09.115813 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-0d41c74f-2041-46a2-934c-819ae58e0861 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1562 microversion: 2.1 time: 0.220201 Aug 21 02:48:09.116481 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3606/7867] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:48:08 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:48:22.044715 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:48:22.045717 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:49:25.554947 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=9 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:25.556048 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=25 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:25.556629 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=7 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:25.557777 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=28 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:25.560806 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:25.561433 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:25.562210 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:49:25.569445 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:25.570004 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:25.570504 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:25.571270 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:25.571790 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:25.572277 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:25.573297 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:25.574116 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:25.574556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:25.585606 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] Creating event network-changed:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h2-master-1 Aug 21 02:49:25.591200 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-8abd51f2-f133-4cba-9cfb-7f3af622e3b0 req-f036759d-e9f0-41c0-ba73-c5b49efd1355 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036374 Aug 21 02:49:25.591806 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3607/7868] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:49:25.604526 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:49:25.695778 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-de9bfcd8-4eba-4685-a3de-1e3dfa8cdf42 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 204 len: 0 microversion: 2.1 time: 0.142933 Aug 21 02:49:25.699763 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4262/7869] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:49:25 2022] DELETE /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:49:25.705963 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:25.706673 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:25.714121 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:25.714676 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:25.715205 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:25.715919 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:25.716582 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:25.717042 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:25.889268 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:25.897217 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-30c11ed8-9c4e-49ed-98aa-c9df11607b05 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.195686 Aug 21 02:49:25.897780 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3608/7870] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:25 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:49:26.920286 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:26.921027 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:26.928479 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:26.929026 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:26.929455 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:26.930151 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:26.930602 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:26.931030 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:27.074669 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:27.083773 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-d2d34590-1ce8-412a-8124-e9b4f0a40b91 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1568 microversion: 2.1 time: 0.168389 Aug 21 02:49:27.084373 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4263/7871] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:26 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:27.914510 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3948baa-6a00-4858-bc44-f6cc2d2beda7", "name": "network-vif-deleted", "tag": "1a8ee12e-b018-4b03-b47a-6d89f85065dd"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:49:27.928351 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:27.928929 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:27.929598 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:27.942087 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] Creating event network-vif-deleted:1a8ee12e-b018-4b03-b47a-6d89f85065dd for instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 on n-h2-master-1 Aug 21 02:49:27.947588 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-da86bd45-75ee-410f-9821-b65e38019cc7 req-1af0f637-f43c-4dac-83c4-143473bdbd8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036890 Aug 21 02:49:27.948365 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3609/7872] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:49:28.108058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:28.108730 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:28.116126 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:28.116590 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:28.117079 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:28.117787 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:28.118266 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:28.118689 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:28.186909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:28.195739 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-f8ef094b-ab19-40a9-9a5b-2a647b502f26 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1218 microversion: 2.1 time: 0.091818 Aug 21 02:49:28.196579 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4264/7873] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:28 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:29.219147 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:29.220018 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:29.227022 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:29.227517 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:29.227955 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:29.228664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:29.229155 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:29.229613 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:29.297694 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:29.306290 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-baaf728c-e94f-4222-b76f-3475eec46eb6 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1218 microversion: 2.1 time: 0.092367 Aug 21 02:49:29.306848 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3610/7874] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:29 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:30.327550 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:30.328271 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:30.335764 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:30.336247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:30.336680 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:30.337413 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:30.337865 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:30.338290 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:30.411784 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:30.421010 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0d2e009a-5229-44e7-89c0-6bdf9945bc06 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1218 microversion: 2.1 time: 0.097308 Aug 21 02:49:30.421618 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4265/7875] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:30 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:31.442796 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:31.443405 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:31.451256 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:31.451828 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:31.452266 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:31.453031 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:31.453487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:31.453911 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:31.518040 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:31.526002 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-425d7931-21cd-4d92-8698-d2b317e18477 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1218 microversion: 2.1 time: 0.087182 Aug 21 02:49:31.526571 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3611/7876] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:31 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:32.547982 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:32.548748 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:32.556542 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:32.557436 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:32.558492 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:32.559068 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:32.559583 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:32.560050 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:32.598621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:32.599115 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:32.599585 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:32.600025 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.objects.instance [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lazy-loading 'fault' on Instance uuid e3948baa-6a00-4858-bc44-f6cc2d2beda7 {{(pid=122482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:49:32.643109 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89156176073c4a8b960c14e55528d7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5295ac46034f46b4781ed5d0374912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:32.651569 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eaea32f4-eace-4b00-8f05-5bcc183b94d9 tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 200 len: 1223 microversion: 2.1 time: 0.107491 Aug 21 02:49:32.653238 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4266/7877] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:32 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:33.674509 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:33.675110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [instance: e3948baa-6a00-4858-bc44-f6cc2d2beda7] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:33.681667 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:33.682284 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:33.682897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:33.683608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:33.684071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:33.684499 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:33.698529 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.wsgi [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] HTTP exception thrown: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Request method failure captured: Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: request: GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 HTTP/1.1 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Accept: application/json Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Accept-Encoding: identity Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Connection: close Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Content-Length: 0 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Content-Type: application/json Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Host: 10.222.0.46 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: Openstack-System-Scope: None Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: User-Agent: python-urllib3/1.26.11 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Auth-Token: gAAAAABjAZrZooIAMrb_MgBBtFWy1gn6NMD6ycGEoVuLdP6myr5OvG6N7oI0XBsEgFOPqnzGJLCEjGSQuxEkN_7bQ1SqSmctF12BBMrROnEsWTv9pPmBLBYM4_5GdzZGblZe2gWWxmONbY9EavXlulmGlzsviU_tf18J1kNLIx-K5vCp2f_vkmI Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Id: None Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Domain-Name: None Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Identity-Status: Confirmed Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Is-Admin-Project: True Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Id: default Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Domain-Name: Default Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Id: 5e5295ac46034f46b4781ed5d0374912 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Project-Name: tempest-TestShelveInstance-836697836 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Role: member,reader Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Roles: member,reader Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e5295ac46034f46b4781ed5d0374912"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5e5295ac46034f46b4781ed5d0374912", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5e5295ac46034f46b4781ed5d0374912"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5e5295ac46034f46b4781ed5d0374912"}]}] Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant: tempest-TestShelveInstance-836697836 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Id: 5e5295ac46034f46b4781ed5d0374912 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-Tenant-Name: tempest-TestShelveInstance-836697836 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-User: tempest-TestShelveInstance-836697836-project Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Id: default Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-User-Domain-Name: Default Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-User-Id: 89156176073c4a8b960c14e55528d7a9 Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: X-User-Name: tempest-TestShelveInstance-836697836-project Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: method: > Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: exception: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: action_args: {'id': 'e3948baa-6a00-4858-bc44-f6cc2d2beda7'} Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:49:33.700278 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: ERROR nova.api.openstack.wsgi Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Returning 404 to user: Instance e3948baa-6a00-4858-bc44-f6cc2d2beda7 could not be found. {{(pid=122483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-194e93ae-4618-47a2-a077-a06922a3e51c tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7" status: 404 len: 111 microversion: 2.1 time: 0.031467 Aug 21 02:49:33.704852 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3612/7878] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:33 2022] GET /compute/v2.1/servers/e3948baa-6a00-4858-bc44-f6cc2d2beda7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:49:33.869816 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-77fd8d92-3e8d-4a98-9947-3e2f9a26dd6d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] Calling method '.version_select at 0x7fc3f8688700>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:33.874807 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77fd8d92-3e8d-4a98-9947-3e2f9a26dd6d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:49:34.883958 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [None req-77fd8d92-3e8d-4a98-9947-3e2f9a26dd6d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] [4cb71e0a-7cd1-495d-a482-1ab13b4a66eb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53790. Aug 21 02:49:34.911623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-77fd8d92-3e8d-4a98-9947-3e2f9a26dd6d tempest-TestShelveInstance-836697836 tempest-TestShelveInstance-836697836-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1120941922" status: 202 len: 0 microversion: 2.1 time: 1.045563 Aug 21 02:49:34.912221 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4267/7879] 10.222.0.46 () {58 vars in 1254 bytes} [Sun Aug 21 02:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1120941922 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:49:52.529178 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=12 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:52.529900 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=24 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:52.740843 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Action: 'create', calling method: .version_select at 0x7fc3fe944d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2006660377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXBn/Ly7ZDhm3U2LOM1bAD/2dB6fMPh92Kr4xLP4lJP5vQI5l/f1ennLX417tALEKl5ev+xnyMZplBAHPzv/+h0nLtWgyv0zcCFNvezT1ZoAgSnL8ZOuXIRbS4tjxnE4w=="}} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:49:52.758160 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for project ada6671b46a84260bf51e80a6043e882. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:49:52.766574 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.quota [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for user b7733529dcc341e293d8af606a664c6f and project ada6671b46a84260bf51e80a6043e882. Resources: {'key_pairs'} {{(pid=122483) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:49:52.785440 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:49:53.796717 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [d8f567d2-6447-4ebc-beb1-5902ef9826c7] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53896. Aug 21 02:49:53.817662 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-99a621ba-20f0-4733-a3b9-ff2d82438942 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.294226 Aug 21 02:49:53.818384 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3613/7880] 10.222.0.46 () {60 vars in 1159 bytes} [Sun Aug 21 02:49:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:49:54.860317 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:54.861305 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:49:54.865605 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-128173944", "imageRef": "64873b6f-4787-4a40-b75c-af37e7532ab1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2006660377", "security_groups": [{"name": "tempest-secgroup-smoke-361103400"}], "networks": [{"uuid": "3548c699-f5c2-47ed-8a26-2321579bff10"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:49:54.984624 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] validate_networks() for [('3548c699-f5c2-47ed-8a26-2321579bff10', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:49:55.505065 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:49:55.505773 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:49:55.506349 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:49:55.507078 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:49:55.507763 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:49:55.517448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:55.518284 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:55.518777 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:55.519744 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:49:55.520393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:49:55.520970 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:49:55.538654 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for project ada6671b46a84260bf51e80a6043e882. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:49:55.544100 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for user b7733529dcc341e293d8af606a664c6f and project ada6671b46a84260bf51e80a6043e882. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:49:55.557439 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:49:55.560058 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64873b6f-4787-4a40-b75c-af37e7532ab1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:49:55.612479 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-8e770a32-5fc0-4319-9cc9-c33013d9283a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753737 Aug 21 02:49:55.613190 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4268/7881] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:49:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 02:49:55.625398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c0ba3ee0-6d57-4f33-afab-e979bc56e6a7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:55.626898 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c0ba3ee0-6d57-4f33-afab-e979bc56e6a7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:55.694385 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c0ba3ee0-6d57-4f33-afab-e979bc56e6a7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:55.704344 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c0ba3ee0-6d57-4f33-afab-e979bc56e6a7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1248 microversion: 2.1 time: 0.083771 Aug 21 02:49:55.705678 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3614/7882] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:55 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:56.728363 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-0ef02ab0-beec-4378-92e0-6a76ce93268f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:56.729247 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-0ef02ab0-beec-4378-92e0-6a76ce93268f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:56.793196 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-0ef02ab0-beec-4378-92e0-6a76ce93268f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:56.800231 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-0ef02ab0-beec-4378-92e0-6a76ce93268f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1248 microversion: 2.1 time: 0.078760 Aug 21 02:49:56.800820 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4269/7883] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:56 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:57.821045 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-205635de-9cc1-45f2-b764-c9ed05584e98 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:57.821850 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-205635de-9cc1-45f2-b764-c9ed05584e98 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:57.878240 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-205635de-9cc1-45f2-b764-c9ed05584e98 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:57.885407 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-205635de-9cc1-45f2-b764-c9ed05584e98 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1248 microversion: 2.1 time: 0.068396 Aug 21 02:49:57.885985 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3615/7884] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:57 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:49:58.910057 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-83f6bb36-2468-47e5-9bd4-6da3f956bed3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:49:58.910645 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-83f6bb36-2468-47e5-9bd4-6da3f956bed3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:49:58.969705 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-83f6bb36-2468-47e5-9bd4-6da3f956bed3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:49:58.980622 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-83f6bb36-2468-47e5-9bd4-6da3f956bed3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1248 microversion: 2.1 time: 0.076286 Aug 21 02:49:58.981445 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4270/7885] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:58 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:00.005999 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:00.006764 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:00.017113 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:00.017631 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:00.018069 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:00.018766 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:00.019222 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:00.019646 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:00.085739 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:00.096065 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b9908b03-d4ca-4708-b24d-6567d98bcaa3 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1252 microversion: 2.1 time: 0.096730 Aug 21 02:50:00.096672 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3616/7886] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:49:59 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:01.118496 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:01.119041 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:01.130481 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:01.131337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:01.131987 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:01.132954 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:01.133611 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:01.134224 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:01.217765 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:01.226056 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-563e0223-f31b-4d53-9b9c-8d70415ecf17 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1306 microversion: 2.1 time: 0.112065 Aug 21 02:50:01.226634 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4271/7887] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:01 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:02.193978 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:50:02.205846 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:02.206545 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:02.207180 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:02.218659 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] Creating event network-changed:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:50:02.223938 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-ece158df-88ac-4eed-9a6e-1d2b21dda821 req-03927e13-bd5f-47f5-8ceb-aa505621b3af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034837 Aug 21 02:50:02.224540 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3617/7888] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:50:02.247388 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:02.248392 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:02.255844 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:02.256527 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:02.257001 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:02.257693 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:02.258144 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:02.258561 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:02.497289 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:02.507341 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2e6dd03a-cf41-404d-b163-9486a6ea812d tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.263933 Aug 21 02:50:02.508074 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4272/7889] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:02 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:03.529470 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:03.530265 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:03.537053 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:03.537551 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:03.538004 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:03.538703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:03.539165 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:03.539600 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:03.681223 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:03.689838 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2fbd2652-274f-45d1-98c0-3a864479c78e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.165787 Aug 21 02:50:03.690451 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3618/7890] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:03 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:04.716898 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:04.717587 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:04.724330 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:04.724874 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:04.725334 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:04.726023 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:04.726471 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:04.726894 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:04.947957 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:04.957095 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-abffe01b-6e88-4451-9ac6-3976145d9967 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.246583 Aug 21 02:50:04.957679 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4273/7891] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:04 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:05.981153 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:05.982418 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:05.990472 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:05.990959 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:05.991404 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:05.992103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:05.992560 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:05.993026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:06.137105 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:06.145940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b6876b69-a584-497f-a91c-3632bac765ca tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.171029 Aug 21 02:50:06.146556 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3619/7892] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:05 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:07.167839 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:07.168532 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:07.170740 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:07.177278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:07.177759 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:07.178193 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:07.179094 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:07.179548 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:07.179971 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:07.326117 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:07.334623 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-e4ed2a8a-8bfe-4bbc-b875-e6c2cdc3087e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.170957 Aug 21 02:50:07.335208 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4274/7893] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:07 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:08.363180 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:08.364283 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:08.368755 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=8 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:08.377166 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:08.377660 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:08.378103 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:08.378801 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:08.379260 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:08.379692 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:08.531643 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:08.540035 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fc9c6e5e-ba30-466f-bb04-00f30618ca6e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.183422 Aug 21 02:50:08.540612 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3620/7894] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:08 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:09.163017 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "name": "network-vif-plugged", "status": "completed", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:50:09.168741 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=10 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:50:09.174615 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:09.175032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:09.175462 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:09.187533 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] Creating event network-vif-plugged:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:50:09.192661 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-425b6ddf-5ba3-4788-8986-8f18a011a8fb req-17c374e3-276f-4314-8535-af4b8b72f102 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Aug 21 02:50:09.193307 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4275/7895] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:50:09.563753 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:09.564786 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:09.576040 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:09.576510 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:09.577957 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:09.578709 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:09.579145 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:09.579601 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:09.759140 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:09.769114 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-c17656d6-40e5-4427-9e74-f26080dd31d8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.211617 Aug 21 02:50:09.769790 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3621/7896] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:09 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:10.805258 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:10.805949 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:10.812278 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:10.812749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:10.813214 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:10.814226 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:10.814676 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:10.815117 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:10.952036 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:10.960163 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a5b69d7-6a62-45ce-b420-1ec3a72ddc2a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1373 microversion: 2.1 time: 0.160106 Aug 21 02:50:10.960731 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4276/7897] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:10 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:11.985988 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:11.986612 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:11.993975 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:11.994462 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:11.994902 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:11.995594 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:11.996071 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:11.996498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:12.134944 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:12.143562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-71f76b03-ab6a-4dd9-8331-89883722e447 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1558 microversion: 2.1 time: 0.164147 Aug 21 02:50:12.144110 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3622/7898] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:11 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:12.164241 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:50:12.164897 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:50:12.171977 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:12.172467 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:12.173077 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:12.173925 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:12.174379 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:12.174799 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:12.323147 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:50:12.331445 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-df3c92f4-4039-493d-b574-0731a2e23994 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1558 microversion: 2.1 time: 0.171155 Aug 21 02:50:12.332032 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4277/7899] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:50:12 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:50:14.457751 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:50:14.467391 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:50:14.467889 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:50:14.468306 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:50:14.482573 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] Creating event network-changed:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:50:14.487842 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-bd6e926e-caed-466d-bae1-5bf53219bd36 req-088c5acf-ecca-4c7d-9d35-4081b23a787e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099471 Aug 21 02:50:14.488512 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3623/7900] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:52:40.332871 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:52:40.333491 n-d-master-1 devstack@n-api.service[122482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 21 02:52:40.334334 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:40.335076 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=40 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:40.339284 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1259677592"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:52:40.341833 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:52:40.349185 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:52:40.349692 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:52:40.350124 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:52:40.350813 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:52:40.351263 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:52:40.351679 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:52:40.715791 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-65f80ca6-3f6c-42c8-aca4-b46c377ac04f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "POST /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13/action" status: 202 len: 0 microversion: 2.1 time: 0.386198 Aug 21 02:52:40.716439 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4278/7901] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:52:40 2022] POST /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 02:52:47.859107 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:52:47.859923 n-d-master-1 devstack@n-api.service[122483]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 21 02:52:47.860536 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:47.861398 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=40 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:47.941021 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "name": "network-vif-plugged", "status": "completed", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:52:47.950852 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:52:47.951334 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:52:47.951769 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:52:47.962620 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] Creating event network-vif-plugged:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:52:47.968085 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-f1d115b6-eea7-4913-be27-b33f9450f24a req-6af80173-88f2-481f-8f7e-d6381449d233 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110733 Aug 21 02:52:47.968680 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3624/7902] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:52:59.435808 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:59.436585 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:52:59.441456 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-930487883", "imageRef": "e837ac75-b89c-471b-997e-85fae044bdbd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2006660377", "security_groups": [{"name": "tempest-secgroup-smoke-361103400"}], "networks": [{"uuid": "3548c699-f5c2-47ed-8a26-2321579bff10"}]}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:52:59.474007 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [7389cea5-8347-4456-a2e2-5d4d697ab0f4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 54198. Aug 21 02:52:59.475941 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e9b6dec-81ce-4930-afd2-2045515a0d90] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 54196. Aug 21 02:52:59.568045 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.network.neutron [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] validate_networks() for [('3548c699-f5c2-47ed-8a26-2321579bff10', None, None, None, None, None)] {{(pid=122482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 21 02:52:59.970755 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Flavor limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 21 02:52:59.971427 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Image limits 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 21 02:52:59.972016 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Flavor pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 21 02:52:59.972539 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Image pref 0:0:0 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 21 02:52:59.972909 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.virt.hardware [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 21 02:52:59.982863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:52:59.983343 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:52:59.983776 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:52:59.984496 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:52:59.984974 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:52:59.985393 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:00.002591 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for project ada6671b46a84260bf51e80a6043e882. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 21 02:53:00.008152 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.quota [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Getting quotas for user b7733529dcc341e293d8af606a664c6f and project ada6671b46a84260bf51e80a6043e882. Resources: {'cores', 'ram', 'instances'} {{(pid=122482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 21 02:53:00.021166 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Going to run 1 instances... {{(pid=122482) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 21 02:53:00.023768 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e837ac75-b89c-471b-997e-85fae044bdbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 21 02:53:00.073829 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-58495089-1fc1-47dc-916f-f7472063d2a5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.641587 Aug 21 02:53:00.074469 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4279/7903] 10.222.0.46 () {60 vars in 1147 bytes} [Sun Aug 21 02:52:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 21 02:53:00.085493 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:00.086387 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:00.093918 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-29fdfac6-ae99-49bf-a4e3-df6fc6957499 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:00.094713 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-29fdfac6-ae99-49bf-a4e3-df6fc6957499 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:00.109573 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [09f44526-a08f-443d-be0c-bf347592f031] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 54210. Aug 21 02:53:00.113575 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f53d726-0ead-48d8-a8c6-55212f5a9fa1] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 54212. Aug 21 02:53:00.219681 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-29fdfac6-ae99-49bf-a4e3-df6fc6957499 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:00.226919 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-29fdfac6-ae99-49bf-a4e3-df6fc6957499 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1248 microversion: 2.1 time: 0.144910 Aug 21 02:53:00.227514 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3625/7904] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:00 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1248 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:01.248066 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2ea8dc3c-d206-46d7-8c10-bd02f2d5e4da tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:01.248795 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2ea8dc3c-d206-46d7-8c10-bd02f2d5e4da tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:01.311082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-2ea8dc3c-d206-46d7-8c10-bd02f2d5e4da tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:01.318318 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2ea8dc3c-d206-46d7-8c10-bd02f2d5e4da tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1248 microversion: 2.1 time: 0.074649 Aug 21 02:53:01.318917 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4280/7905] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:01 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:01.845756 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "name": "network-vif-unplugged", "status": "completed", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:53:01.862612 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:01.863825 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:01.864280 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:01.877669 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] Creating event network-vif-unplugged:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:53:01.884323 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-71c26163-d2d8-4a29-908b-952148f5a27e req-4f7ce91f-f20c-4149-841b-f24af1af1961 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042824 Aug 21 02:53:01.885658 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3626/7906] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:53:02.341124 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:02.343357 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:02.352408 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:02.354032 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:02.356581 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:02.358286 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:02.358782 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:02.359867 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:02.450555 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:02.459084 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b7473018-8497-4dc7-b111-5bc038d52e3e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1306 microversion: 2.1 time: 0.123645 Aug 21 02:53:02.460407 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4281/7907] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:02 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1306 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:03.482096 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:03.482816 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:03.489300 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:03.489779 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:03.490432 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:03.491294 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:03.491762 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:03.492235 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:03.641146 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:03.649853 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-b06e2011-08e1-4507-b968-55d86810d637 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.173370 Aug 21 02:53:03.650405 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3627/7908] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:03 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:04.673001 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:04.674295 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:04.682087 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:04.683028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:04.683749 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:04.684728 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:04.685424 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:04.686061 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:04.832793 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:04.841117 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-9b7e9d37-88f4-47e3-99a7-d378e35446c7 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.173121 Aug 21 02:53:04.841687 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4282/7909] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:04 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:05.862303 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:05.863103 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:05.871761 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:05.872323 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:05.872851 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:05.873622 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:05.874163 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:05.874654 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:06.017326 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:06.025804 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-ffabb340-6c04-4f08-8509-65b416753c6c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.167386 Aug 21 02:53:06.026721 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3628/7910] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:05 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:07.048047 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:07.048710 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:07.057489 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:07.057975 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:07.058473 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:07.059180 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:07.059621 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:07.060035 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:07.222942 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:07.231391 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-eb5539bc-0cd3-4ab1-8352-b86a3d13bb8a tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.188339 Aug 21 02:53:07.232199 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4283/7911] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:07 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:08.254657 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:08.255397 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:08.263085 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:08.263578 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:08.264019 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:08.264724 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:08.265206 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:08.265636 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:08.405544 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:08.413613 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-1f631750-61c2-44ab-99b8-f266f694ea25 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.162987 Aug 21 02:53:08.414190 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3629/7912] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:08 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:09.435141 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:09.436565 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:09.444105 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:09.444686 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:09.445216 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:09.446037 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:09.446553 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:09.447017 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:09.606593 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:09.615147 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-7834ffe0-1d06-4685-b672-8653a7853918 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.184023 Aug 21 02:53:09.615704 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4284/7913] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:09 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:10.638158 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:10.638821 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:10.641712 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell0:SELECT=2 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:10.648556 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:10.649078 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:10.649520 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:10.650263 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:10.650716 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:10.651143 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:10.837894 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:10.848359 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-492eaaea-63a3-4085-9488-5534d5761a43 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.214689 Aug 21 02:53:10.849252 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3630/7914] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:10 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:11.202838 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:53:11.211855 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:11.219712 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:11.220191 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:11.220628 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:11.233680 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] Creating event network-changed:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:53:11.239589 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-20d27db1-4bb6-430a-972f-e1e418e4d113 req-363b178e-da00-4f39-9dce-9da0a84c6d64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041802 Aug 21 02:53:11.240274 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4285/7915] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:53:11.877256 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:11.878110 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:11.890490 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:11.891056 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:11.891640 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:11.892697 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:11.893355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:11.893842 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:12.055576 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:12.063708 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-aab7bdfb-4043-42b9-a939-e43428540a3f tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.193300 Aug 21 02:53:12.064288 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3631/7916] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:11 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:13.082448 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell0:SELECT=8 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:53:13.087905 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:13.088606 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:13.095446 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:13.095950 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:13.096378 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:13.097088 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:13.097532 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:13.097944 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:13.357067 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:13.366000 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-dcf7861b-8a80-4d49-b42f-7f533c88b4b8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.284439 Aug 21 02:53:13.366581 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4286/7917] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:13 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:14.389912 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:14.390545 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:14.398070 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:14.398492 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:14.398933 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:14.399632 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:14.400093 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:14.400522 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:14.541357 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:14.549150 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-11e2811c-70c1-4ebb-9c04-47f9e6a8bedd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.163233 Aug 21 02:53:14.549730 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3632/7918] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:14 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 21 02:53:15.571370 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:15.571977 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:15.579166 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:15.579671 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:15.580108 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:15.580806 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:15.581247 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:15.581667 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:15.726781 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:15.735011 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-4fa3177d-eb61-4099-848d-2b2af17a2365 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.167800 Aug 21 02:53:15.735540 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4287/7919] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:15 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:16.605910 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "name": "network-vif-plugged", "status": "completed", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:53:16.618539 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:16.619727 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:16.620153 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:16.631937 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] Creating event network-vif-plugged:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:53:16.637335 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-13f1220e-1d8d-4dec-add8-6d9f354e7040 req-153cc836-5ebd-495b-a59c-97830f569e9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035005 Aug 21 02:53:16.638135 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3633/7920] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:53:16.764000 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:16.765280 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:16.772538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:16.773028 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:16.773448 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:16.774149 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:16.774589 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:16.775047 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:16.919778 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:16.927768 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-11f40016-cdcf-445b-8b58-3c0dd814f4af tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1373 microversion: 2.1 time: 0.167800 Aug 21 02:53:16.928450 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4288/7921] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:16 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:17.949909 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:17.950627 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:17.958498 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:17.958965 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:17.959405 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:17.960110 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:17.960565 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:17.961080 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:18.117990 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:18.128488 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-86733062-0ede-4d24-89fd-df878f7246b5 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1558 microversion: 2.1 time: 0.183034 Aug 21 02:53:18.129205 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3634/7922] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:17 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:18.149648 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:53:18.150264 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:53:18.157461 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:18.157939 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:18.158366 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:18.159013 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:18.159487 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:18.159898 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:18.305473 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:53:18.313450 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-52f09333-a24d-471f-9f5f-f9815158f068 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1558 microversion: 2.1 time: 0.167939 Aug 21 02:53:18.314036 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4289/7923] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:53:18 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:53:20.055333 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:53:20.065810 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:53:20.066292 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:53:20.066725 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:53:20.078562 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] Creating event network-changed:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:53:20.083735 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-5c3cd3c1-93f2-4893-8eed-c79cd3273a2e req-7a1c53f2-cbf6-43d1-8a53-7838dda2cbaa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Aug 21 02:53:20.084361 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3635/7924] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:53:22.378429 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:53:22.379285 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:53:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:54:41.275106 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:41.276033 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=52 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:41.281082 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-563035129"}} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:54:41.283410 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:54:41.290881 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:41.291265 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:41.291696 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:41.292386 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:41.292863 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:41.293355 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:41.508485 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3750f1ce-fd0f-46ed-962b-2df598030849 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "POST /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656/action" status: 202 len: 0 microversion: 2.1 time: 0.236704 Aug 21 02:54:41.509179 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4290/7925] 10.222.0.46 () {60 vars in 1278 bytes} [Sun Aug 21 02:54:41 2022] POST /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 21 02:54:47.247722 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_api:SELECT=24 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:47.249905 n-d-master-1 devstack@n-api.service[122483]: DEBUG dbcounter [-] [122483] Writing DB stats nova_cell1:SELECT=48 {{(pid=122483) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:47.257078 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "name": "network-vif-plugged", "status": "completed", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:54:47.286150 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:47.286664 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:47.287342 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:47.305516 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] Creating event network-vif-plugged:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:54:47.311276 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-e2cf96d3-c41a-4a01-a952-8ac1988d76d0 req-f007bac5-28b0-4c15-884c-787c6f5ad527 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065634 Aug 21 02:54:47.312522 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3636/7926] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:54:56.328281 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:54:56.329069 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:54:56.333121 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_api:SELECT=2 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:56.334781 n-d-master-1 devstack@n-api.service[122482]: DEBUG dbcounter [-] [122482] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 02:54:56.341289 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:56.341765 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:56.342201 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:56.343095 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:56.343538 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:56.343951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:56.373217 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Going to try to terminate instance {{(pid=122482) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:54:56.401496 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:54:56.412035 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:56.412874 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:56.413290 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:56.425672 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.compute.server_external_events [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] Creating event network-changed:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:54:56.430865 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [req-510b43f4-2196-4661-a8a3-9467d30d7a4d req-30b09faf-1def-4e04-9974-2754930936bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104853 Aug 21 02:54:56.431742 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3637/7927] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:54:56.469292 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-2a1a6c4e-06a3-46ff-b79c-d085d6b29cc2 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 204 len: 0 microversion: 2.1 time: 0.145389 Aug 21 02:54:56.472998 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4291/7928] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:54:56 2022] DELETE /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:54:56.480533 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:54:56.481398 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:54:56.489397 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:56.489897 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:56.490355 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:56.491097 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:56.491567 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:56.492002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:56.631030 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:54:56.638956 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-3828ae18-d3cf-468f-b071-5cced4664342 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1683 microversion: 2.1 time: 0.162784 Aug 21 02:54:56.639533 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3638/7929] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:54:56 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:54:57.353334 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "name": "network-vif-unplugged", "status": "completed", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:54:57.367241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:57.368361 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:57.369112 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:57.383928 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] Creating event network-vif-unplugged:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:54:57.390389 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-82e5e3bc-375d-4702-b87e-adc47e4a384a req-6d9630ef-a0d1-4fe1-950c-b2f8def66c95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042735 Aug 21 02:54:57.391122 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4292/7930] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:54:57.662903 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:54:57.663486 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:54:57.671333 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:57.671809 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:57.672283 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:57.673026 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:57.673487 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:57.673985 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:57.823712 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:54:57.832173 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-35e4e361-13e0-4d38-8f5d-23313309eb51 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1683 microversion: 2.1 time: 0.174664 Aug 21 02:54:57.833053 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3639/7931] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:54:57 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:54:58.464560 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5468c330-15b8-4ebf-80fe-11dc8f2c5656", "name": "network-vif-deleted", "tag": "6549bc20-7061-4bd8-954e-0953c350e560"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:54:58.474435 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:58.474901 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:58.475322 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:58.486977 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] Creating event network-vif-deleted:6549bc20-7061-4bd8-954e-0953c350e560 for instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 on n-h1-master-1 Aug 21 02:54:58.492042 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-a176ec83-bf56-4aeb-8fe1-abdf1aaed72e req-155132bc-33c0-4db3-b4c3-9d9eb198bb8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032299 Aug 21 02:54:58.495798 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4293/7932] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:54:58.853777 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:54:58.854396 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:54:58.870148 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:58.870643 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:58.871079 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:58.871803 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:58.872271 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:58.873426 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:58.909887 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:54:58.910388 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:54:58.911149 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:54:58.911741 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lazy-loading 'fault' on Instance uuid 5468c330-15b8-4ebf-80fe-11dc8f2c5656 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:54:58.958178 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:54:58.966591 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-7e24c1d6-2531-41ec-9025-6c14267f535c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 200 len: 1338 microversion: 2.1 time: 0.116897 Aug 21 02:54:58.967658 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3640/7933] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:54:58 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:54:59.993736 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:54:59.994537 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: 5468c330-15b8-4ebf-80fe-11dc8f2c5656] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:00.003348 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:00.004235 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:00.004808 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:00.005747 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:00.006337 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:00.006888 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:00.023551 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] HTTP exception thrown: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Request method failure captured: Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 HTTP/1.1 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZ1Le4IAsHT5nW_bltVh5bVJbHnh-YXEjRh3JdoSZ08E9SjamwV0PJgXEDcbhplaw313fXXEewWguXQUlBDlYrVjBV59r03oRCrEN1Fcdmc-AS0vFOyP4T-EM2i1eia2z-ApmwImbaKLtBxzQKAtCLUDllT-sDqOAEX86ZHXiKEQixU Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ada6671b46a84260bf51e80a6043e882 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ada6671b46a84260bf51e80a6043e882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ada6671b46a84260bf51e80a6043e882", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ada6671b46a84260bf51e80a6043e882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ada6671b46a84260bf51e80a6043e882"}]}] Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ada6671b46a84260bf51e80a6043e882 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestSnapshotPattern-588896248-project Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b7733529dcc341e293d8af606a664c6f Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestSnapshotPattern-588896248-project Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: exception: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': '5468c330-15b8-4ebf-80fe-11dc8f2c5656'} Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:55:00.025167 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Returning 404 to user: Instance 5468c330-15b8-4ebf-80fe-11dc8f2c5656 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-b7bf321c-54fe-4346-b4e2-542a76a163f8 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656" status: 404 len: 111 microversion: 2.1 time: 0.040432 Aug 21 02:55:00.030636 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4294/7934] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:54:59 2022] GET /compute/v2.1/servers/5468c330-15b8-4ebf-80fe-11dc8f2c5656 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:55:01.501010 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:01.501570 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:01.503335 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:55:01.515190 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:01.515700 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:01.516129 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:01.521945 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:01.522440 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:01.522868 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:01.523608 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:01.524066 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:01.524468 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:01.529814 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] Creating event network-changed:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:55:01.535495 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-e63f9779-1027-4e47-b66b-0317c44fca7d req-3cb139ab-e34c-47e2-8609-0611f751fc71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035572 Aug 21 02:55:01.540090 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4295/7935] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:55:01.554854 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Going to try to terminate instance {{(pid=122483) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 21 02:55:01.653018 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-fd98bf15-9033-429c-86a2-958163f80884 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 204 len: 0 microversion: 2.1 time: 0.155972 Aug 21 02:55:01.657061 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3641/7936] 10.222.0.46 () {58 vars in 1239 bytes} [Sun Aug 21 02:55:01 2022] DELETE /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 21 02:55:01.664829 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:01.665704 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:01.675024 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:01.676241 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:01.676951 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:01.677963 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:01.678516 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:01.679038 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:02.045170 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:55:02.045600 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 (ip 10.222.0.46) !!! Aug 21 02:55:02.232899 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.policy [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:55:02.241481 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-3aa32b52-73e6-4b70-ba05-8032f3c6ee1c tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1683 microversion: 2.1 time: 0.582737 Aug 21 02:55:02.242061 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4296/7937] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:55:01 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1683 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:55:02.360211 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:55:02.360392 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:55:03.264468 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:03.265318 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:03.273806 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:03.274396 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:03.274913 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:03.275703 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:03.276267 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:03.276689 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:03.412444 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:55:03.421309 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-dd127386-846b-463c-9a5a-763170c61e41 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1683 microversion: 2.1 time: 0.161363 Aug 21 02:55:03.421968 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3642/7938] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:55:03 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:55:04.162365 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79e6e7f-e05c-4f71-80d5-4ab4a8002e13", "name": "network-vif-deleted", "tag": "efa9dcbf-b807-49c5-85e4-72d0035fca7c"}]} {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 21 02:55:04.174890 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:04.176200 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:04.176663 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:04.189083 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.compute.server_external_events [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] Creating event network-vif-deleted:efa9dcbf-b807-49c5-85e4-72d0035fca7c for instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 on n-h2-master-1 Aug 21 02:55:04.195300 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [req-9ec10042-824a-443e-af04-36e1a8f5fc7b req-32786ce1-3b1a-41eb-94d5-f27fb81b737a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036710 Aug 21 02:55:04.195876 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4297/7939] 10.222.0.46 () {64 vars in 1317 bytes} [Sun Aug 21 02:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 21 02:55:04.447844 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:04.448450 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.compute.api [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122483) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:04.455844 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:04.456696 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:04.457343 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:04.458029 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:04.458491 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:04.458932 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:04.492124 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:04.493002 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:04.493441 n-d-master-1 devstack@n-api.service[122483]: DEBUG oslo_concurrency.lockutils [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:04.493897 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.objects.instance [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lazy-loading 'fault' on Instance uuid b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 {{(pid=122483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 21 02:55:04.542789 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.policy [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7733529dcc341e293d8af606a664c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada6671b46a84260bf51e80a6043e882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122483) authorize /opt/stack/nova/nova/policy.py:199}} Aug 21 02:55:04.551479 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-2e0f9793-f823-4c41-99fa-161f97b3569e tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 200 len: 1338 microversion: 2.1 time: 0.107486 Aug 21 02:55:04.556106 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3643/7940] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:55:04 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 21 02:55:05.578178 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '>' {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:05.578961 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.compute.api [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] [instance: b79e6e7f-e05c-4f71-80d5-4ab4a8002e13] Fetching instance by UUID {{(pid=122482) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 21 02:55:05.587739 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:05.588369 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:05.588980 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:05.589968 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Acquiring lock "3803a468-2abb-4e12-bf4a-d931a62c2742" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 21 02:55:05.590540 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 21 02:55:05.591125 n-d-master-1 devstack@n-api.service[122482]: DEBUG oslo_concurrency.lockutils [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Lock "3803a468-2abb-4e12-bf4a-d931a62c2742" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 21 02:55:05.609083 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.wsgi [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] HTTP exception thrown: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Request method failure captured: Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: request: GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 HTTP/1.1 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Accept: application/json Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Accept-Encoding: identity Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Connection: close Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Content-Length: 0 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Content-Type: application/json Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Host: 10.222.0.46 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: Openstack-System-Scope: None Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: User-Agent: python-urllib3/1.26.11 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Auth-Token: gAAAAABjAZ1Le4IAsHT5nW_bltVh5bVJbHnh-YXEjRh3JdoSZ08E9SjamwV0PJgXEDcbhplaw313fXXEewWguXQUlBDlYrVjBV59r03oRCrEN1Fcdmc-AS0vFOyP4T-EM2i1eia2z-ApmwImbaKLtBxzQKAtCLUDllT-sDqOAEX86ZHXiKEQixU Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Id: None Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Domain-Name: None Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Identity-Status: Confirmed Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Is-Admin-Project: True Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Id: default Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Domain-Name: Default Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Id: ada6671b46a84260bf51e80a6043e882 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Project-Name: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Role: member,reader Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Roles: member,reader Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ada6671b46a84260bf51e80a6043e882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ada6671b46a84260bf51e80a6043e882", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ada6671b46a84260bf51e80a6043e882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ada6671b46a84260bf51e80a6043e882"}]}] Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Id: ada6671b46a84260bf51e80a6043e882 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-Tenant-Name: tempest-TestSnapshotPattern-588896248 Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-User: tempest-TestSnapshotPattern-588896248-project Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Id: default Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-User-Domain-Name: Default Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-User-Id: b7733529dcc341e293d8af606a664c6f Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: X-User-Name: tempest-TestSnapshotPattern-588896248-project Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: method: > Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: exception: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: action_args: {'id': 'b79e6e7f-e05c-4f71-80d5-4ab4a8002e13'} Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: {{(pid=122482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 21 02:55:05.610707 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: ERROR nova.api.openstack.wsgi Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: DEBUG nova.api.openstack.wsgi [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Returning 404 to user: Instance b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 could not be found. {{(pid=122482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: INFO nova.api.openstack.requestlog [None req-bcb3c0af-1e3c-4b8a-b0d6-d3500028b661 tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13" status: 404 len: 111 microversion: 2.1 time: 0.042238 Aug 21 02:55:05.616409 n-d-master-1 devstack@n-api.service[122482]: [pid: 122482|app: 0|req: 4298/7941] 10.222.0.46 () {58 vars in 1236 bytes} [Sun Aug 21 02:55:05 2022] GET /compute/v2.1/servers/b79e6e7f-e05c-4f71-80d5-4ab4a8002e13 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 21 02:55:05.795254 n-d-master-1 devstack@n-api.service[122483]: DEBUG nova.api.openstack.wsgi [None req-a6bc0d3e-7b52-49b6-ba19-a0d0a279e2bd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] Calling method '.version_select at 0x7fc3fcf1c430>' {{(pid=122483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 21 02:55:05.833940 n-d-master-1 devstack@n-api.service[122483]: INFO nova.api.openstack.requestlog [None req-a6bc0d3e-7b52-49b6-ba19-a0d0a279e2bd tempest-TestSnapshotPattern-588896248 tempest-TestSnapshotPattern-588896248-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2006660377" status: 202 len: 0 microversion: 2.1 time: 0.043136 Aug 21 02:55:05.834718 n-d-master-1 devstack@n-api.service[122483]: [pid: 122483|app: 0|req: 3644/7942] 10.222.0.46 () {58 vars in 1257 bytes} [Sun Aug 21 02:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2006660377 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 21 02:56:42.390036 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:56:42.391108 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:56:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:57:13.956502 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:57:13.958187 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:58:22.056884 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:58:22.057842 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:58:22.065905 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:58:22.066575 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 02:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 02:58:22.370092 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 02:58:22.370791 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 02:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:00:02.403179 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:00:02.404010 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 03:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:00:17.339466 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:00:17.340429 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 03:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:00:33.971351 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:00:33.972488 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 03:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:01:42.071571 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:01:42.072519 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 03:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:01:42.075406 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:01:42.075660 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 03:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:01:42.381229 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:01:42.382206 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 03:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:03:22.414587 n-d-master-1 devstack@n-api.service[122483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:03:22.414587 n-d-master-1 devstack@n-api.service[122483]: Sun Aug 21 03:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 21 03:03:37.356357 n-d-master-1 devstack@n-api.service[122482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 21 03:03:37.356957 n-d-master-1 devstack@n-api.service[122482]: Sun Aug 21 03:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!